2025-03-14T03:51:57.9388232Z Current runner version: '2.322.0' 2025-03-14T03:51:57.9395630Z Runner name: 'i-080b96e24229aed16' 2025-03-14T03:51:57.9396664Z Runner group name: 'Default' 2025-03-14T03:51:57.9397701Z Machine name: 'ip-10-0-5-97' 2025-03-14T03:51:57.9401106Z ##[group]GITHUB_TOKEN Permissions 2025-03-14T03:51:57.9403793Z Contents: read 2025-03-14T03:51:57.9404574Z Metadata: read 2025-03-14T03:51:57.9405223Z ##[endgroup] 2025-03-14T03:51:57.9408854Z Secret source: Actions 2025-03-14T03:51:57.9409715Z Prepare workflow directory 2025-03-14T03:51:58.0138977Z Prepare all required actions 2025-03-14T03:51:58.0182081Z Getting action download info 2025-03-14T03:51:58.3697763Z Download action repository 'actions/checkout@v3' (SHA:f43a0e5ff2bd294095638e18286ca9a3d1956744) 2025-03-14T03:51:58.6299950Z Download action repository 'pytorch/test-infra@main' (SHA:de00dac6adc071cb2f9861380a0ed3947b93e5cc) 2025-03-14T03:51:59.9869084Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2025-03-14T03:52:00.1418479Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2025-03-14T03:52:00.4703205Z Getting action download info 2025-03-14T03:52:00.5915616Z Download action repository 'actions/cache@v3' (SHA:2f8e54208210a422b2efd51efaa6bd6d7ca8920f) 2025-03-14T03:52:00.9807389Z Uses: pytorch/pytorch/.github/workflows/llm_td_retrieval.yml@refs/heads/main (aed0b7a742a2d7b7901790622829cbd2135049a4) 2025-03-14T03:52:00.9809539Z Complete job name: before-test / llm-retrieval 2025-03-14T03:52:01.0354413Z A job started hook has been configured by the self-hosted runner administrator 2025-03-14T03:52:01.0459945Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2025-03-14T03:52:01.0469245Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:01.0469952Z ##[endgroup] 2025-03-14T03:52:02.7932409Z Runner Type: linux.4xlarge 2025-03-14T03:52:02.7932910Z Instance Type: c5.4xlarge 2025-03-14T03:52:02.7933228Z AMI Name: unknown 2025-03-14T03:52:02.7962299Z AMI ID: ami-08b5b3a93ed654d19 2025-03-14T03:52:08.4956982Z ##[group]Run actions/checkout@v3 2025-03-14T03:52:08.4957381Z with: 2025-03-14T03:52:08.4957634Z repository: pytorch/pytorch 2025-03-14T03:52:08.4957971Z fetch-depth: 0 2025-03-14T03:52:08.4958236Z path: pytorch 2025-03-14T03:52:08.4958645Z token: *** 2025-03-14T03:52:08.4958894Z ssh-strict: true 2025-03-14T03:52:08.4959159Z persist-credentials: true 2025-03-14T03:52:08.4959461Z clean: true 2025-03-14T03:52:08.4959739Z sparse-checkout-cone-mode: true 2025-03-14T03:52:08.4960069Z fetch-tags: false 2025-03-14T03:52:08.4960328Z lfs: false 2025-03-14T03:52:08.4960569Z submodules: false 2025-03-14T03:52:08.4960864Z set-safe-directory: true 2025-03-14T03:52:08.4961226Z ##[endgroup] 2025-03-14T03:52:08.5893998Z Syncing repository: pytorch/pytorch 2025-03-14T03:52:08.5895539Z ##[group]Getting Git version info 2025-03-14T03:52:08.5896125Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch' 2025-03-14T03:52:08.5897000Z [command]/usr/bin/git version 2025-03-14T03:52:08.5897306Z git version 2.47.1 2025-03-14T03:52:08.5903026Z ##[endgroup] 2025-03-14T03:52:08.5911875Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/4c7bc8cc-6123-44e9-9da4-72aaabefe378/.gitconfig' 2025-03-14T03:52:08.5920657Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/4c7bc8cc-6123-44e9-9da4-72aaabefe378' before making global git config changes 2025-03-14T03:52:08.5921722Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T03:52:08.5924563Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch 2025-03-14T03:52:08.5962135Z [command]/usr/bin/git config --local --get remote.origin.url 2025-03-14T03:52:08.5980298Z https://github.com/pytorch/pytorch 2025-03-14T03:52:08.5994709Z ##[group]Removing previously created refs, to avoid conflicts 2025-03-14T03:52:08.5996985Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2025-03-14T03:52:08.6024752Z HEAD 2025-03-14T03:52:11.8533068Z ##[endgroup] 2025-03-14T03:52:11.8533457Z [command]/usr/bin/git submodule status 2025-03-14T03:52:11.8948455Z 7e1e1fe3858c63c251c637ae41a20de425dde96f android/libs/fbjni (7e1e1fe) 2025-03-14T03:52:11.9066802Z 4dfe081cf6bcd15db339cf2680b9281b8451eeb3 third_party/FP16 (4dfe081) 2025-03-14T03:52:11.9180593Z b408327ac2a15ec3e43352421954f5b1967701d1 third_party/FXdiv (b408327) 2025-03-14T03:52:11.9302714Z c07e3a0400713d546e0dea2d5466dd22ea389c73 third_party/NNPACK (c07e3a0) 2025-03-14T03:52:11.9446840Z e170594ac7cf1dac584da473d4ca9301087090c1 third_party/NVTX (e170594) 2025-03-14T03:52:11.9581650Z a6bfc237255a6bac1513f7c1ebde6d8aed6b5191 third_party/VulkanMemoryAllocator (a6bfc23) 2025-03-14T03:52:11.9740720Z 51a0103656eff6fc9bfd39a4597923c4b542c883 third_party/XNNPACK (51a01036) 2025-03-14T03:52:11.9875116Z 0d98dba29d66e93259db7daa53a9327df767a415 third_party/benchmark (0d98dba) 2025-03-14T03:52:12.0009848Z 8086bbe3a78d931eb96fe12fdc014082e18d18d3 third_party/composable_kernel (8086bbe) 2025-03-14T03:52:12.0129367Z 3b6597bba913d51161383657829b7e644e59c006 third_party/cpp-httplib (3b6597b) 2025-03-14T03:52:12.0250437Z 1e83a2fdd3102f65c6f1fb602c1b320486218a99 third_party/cpuinfo (1e83a2f) 2025-03-14T03:52:12.0372142Z 91b7532f3386768bba4f444ee7672b497f34da8a third_party/cudnn_frontend (91b7532) 2025-03-14T03:52:12.0505770Z afa1772203677c5118fcd82537a9c8fefbcc7008 third_party/cutlass (afa1772) 2025-03-14T03:52:12.0642928Z 3147391d946bb4b6c68edd901f2add6ac1f31f8c third_party/eigen (3147391) 2025-03-14T03:52:12.0779715Z +dbc3157bf256f1339b3fa1fef2be89ac4078be0e third_party/fbgemm (dbc3157) 2025-03-14T03:52:12.0912436Z 979702c87a8713a8e0a5e9fee122b90d2ef13be5 third_party/flash-attention (979702c) 2025-03-14T03:52:12.1062784Z 01834de25e4bf3975a9a00e816292b1ad0fe184b third_party/flatbuffers (01834de) 2025-03-14T03:52:12.1198582Z 123913715afeb8a437e6388b4473fcc4753e1c9a third_party/fmt (1239137) 2025-03-14T03:52:12.1313316Z 3fb5c176c17c765a3492cd2f0321b0dab712f350 third_party/gemmlowp/gemmlowp (3fb5c17) 2025-03-14T03:52:12.1443974Z 5354032ea08eadd7fc4456477f7f7c6308818509 third_party/gloo (5354032) 2025-03-14T03:52:12.1562596Z b514bdc898e2951020cbdca1304b75f5950d1f59 third_party/googletest (b514bdc) 2025-03-14T03:52:12.1679957Z 719d8e6cd7f7a0e01b155657526d693acf97c2b3 third_party/ideep (719d8e6) 2025-03-14T03:52:12.1802147Z 5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42 third_party/ittapi (5b8a7d7) 2025-03-14T03:52:12.1923014Z 2859721fd9e73d3ca1c56f827dbc64e6d68f78a2 third_party/kineto (2859721) 2025-03-14T03:52:12.2055241Z ef685a13cfbe8d418aa2ed34350e21e4938358b6 third_party/kleidiai (ef685a1) 2025-03-14T03:52:12.2188181Z b66e3214d8a104669c2ec05ae91ebc26a8f5ab78 third_party/mimalloc (b66e321) 2025-03-14T03:52:12.2323286Z 87cda1d6646592ac5866dc703c8e1839046a6806 third_party/nlohmann (87cda1d) 2025-03-14T03:52:12.2483145Z b8baa8446686496da4cc8fda09f2b6fe65c2a02c third_party/onnx (b8baa84) 2025-03-14T03:52:12.2623688Z a799f4aed9c94b765dcdaabaeab7d5e7e2310878 third_party/opentelemetry-cpp (a799f4a) 2025-03-14T03:52:12.2742471Z 9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe third_party/pocketfft (9d3ab05) 2025-03-14T03:52:12.2887123Z d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a third_party/protobuf (d1eca4e) 2025-03-14T03:52:12.2997301Z 072586a71b55b7f8c584153d223e95687148a900 third_party/psimd (heads/master) 2025-03-14T03:52:12.3113572Z 4fe0e1e183925bf8cfa6aae24237e724a96479b8 third_party/pthreadpool (4fe0e1e) 2025-03-14T03:52:12.3244318Z a2e59f0e7065404b44dfe92a28aca47ba1378dc4 third_party/pybind11 (a2e59f0) 2025-03-14T03:52:12.3362023Z f45429b087dd7d5bc78bb40dc7cf06425c252d67 third_party/python-peachpy (f45429b) 2025-03-14T03:52:12.3494871Z 56e1f79cb140fb9326d612d0be06b5250565cade third_party/sleef (56e1f79) 2025-03-14T03:52:12.3611438Z 52791a2fd214b2a9dc5759d36725909c1daa7f2e third_party/tensorpipe (52791a2) 2025-03-14T03:52:12.3623443Z ##[group]Cleaning the repository 2025-03-14T03:52:12.3626936Z [command]/usr/bin/git clean -ffdx 2025-03-14T03:52:12.3820179Z [command]/usr/bin/git reset --hard HEAD 2025-03-14T03:52:13.4322607Z Updating files: 77% (12899/16541) 2025-03-14T03:52:13.4541083Z Updating files: 78% (12902/16541) 2025-03-14T03:52:13.4737435Z Updating files: 79% (13068/16541) 2025-03-14T03:52:13.4953381Z Updating files: 80% (13233/16541) 2025-03-14T03:52:13.5065284Z Updating files: 81% (13399/16541) 2025-03-14T03:52:13.5186812Z Updating files: 82% (13564/16541) 2025-03-14T03:52:13.5315834Z Updating files: 83% (13730/16541) 2025-03-14T03:52:13.5447930Z Updating files: 84% (13895/16541) 2025-03-14T03:52:13.5559599Z Updating files: 85% (14060/16541) 2025-03-14T03:52:13.5687975Z Updating files: 86% (14226/16541) 2025-03-14T03:52:13.5795782Z Updating files: 87% (14391/16541) 2025-03-14T03:52:13.5930711Z Updating files: 88% (14557/16541) 2025-03-14T03:52:13.6095807Z Updating files: 89% (14722/16541) 2025-03-14T03:52:13.6200804Z Updating files: 90% (14887/16541) 2025-03-14T03:52:13.6317544Z Updating files: 91% (15053/16541) 2025-03-14T03:52:13.6456762Z Updating files: 92% (15218/16541) 2025-03-14T03:52:13.6619921Z Updating files: 93% (15384/16541) 2025-03-14T03:52:13.6796212Z Updating files: 94% (15549/16541) 2025-03-14T03:52:13.6942623Z Updating files: 95% (15714/16541) 2025-03-14T03:52:13.7070352Z Updating files: 96% (15880/16541) 2025-03-14T03:52:13.7331841Z Updating files: 97% (16045/16541) 2025-03-14T03:52:13.7481318Z Updating files: 98% (16211/16541) 2025-03-14T03:52:13.7664473Z Updating files: 99% (16376/16541) 2025-03-14T03:52:13.7664811Z Updating files: 100% (16541/16541) 2025-03-14T03:52:13.7665150Z Updating files: 100% (16541/16541), done. 2025-03-14T03:52:13.8330654Z HEAD is now at 62b5e613433 Merge c4b8be3d09f2f1e1db7dd861338cb234beb8d6ea into b4745db90482ff139ea62d06ec0a18468e1131b7 2025-03-14T03:52:13.8367037Z ##[endgroup] 2025-03-14T03:52:13.8368977Z ##[group]Disabling automatic garbage collection 2025-03-14T03:52:13.8372654Z [command]/usr/bin/git config --local gc.auto 0 2025-03-14T03:52:13.8399335Z ##[endgroup] 2025-03-14T03:52:13.8399790Z ##[group]Setting up auth 2025-03-14T03:52:13.8404565Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T03:52:13.8429858Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T03:52:13.8726840Z Entering 'android/libs/fbjni' 2025-03-14T03:52:13.8783615Z Entering 'third_party/FP16' 2025-03-14T03:52:13.8837189Z Entering 'third_party/FXdiv' 2025-03-14T03:52:13.8893424Z Entering 'third_party/NNPACK' 2025-03-14T03:52:13.8946507Z Entering 'third_party/NVTX' 2025-03-14T03:52:13.8999557Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T03:52:13.9055911Z Entering 'third_party/XNNPACK' 2025-03-14T03:52:13.9125156Z Entering 'third_party/benchmark' 2025-03-14T03:52:13.9178192Z Entering 'third_party/composable_kernel' 2025-03-14T03:52:13.9237834Z Entering 'third_party/cpp-httplib' 2025-03-14T03:52:13.9290050Z Entering 'third_party/cpuinfo' 2025-03-14T03:52:13.9343006Z Entering 'third_party/cudnn_frontend' 2025-03-14T03:52:13.9395623Z Entering 'third_party/cutlass' 2025-03-14T03:52:13.9456978Z Entering 'third_party/eigen' 2025-03-14T03:52:13.9511609Z Entering 'third_party/fbgemm' 2025-03-14T03:52:13.9564116Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T03:52:13.9615347Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T03:52:13.9667571Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T03:52:13.9726573Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T03:52:13.9777801Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T03:52:13.9830647Z Entering 'third_party/flash-attention' 2025-03-14T03:52:13.9883574Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T03:52:13.9940501Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T03:52:14.0000162Z Entering 'third_party/flatbuffers' 2025-03-14T03:52:14.0054459Z Entering 'third_party/fmt' 2025-03-14T03:52:14.0108553Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T03:52:14.0160653Z Entering 'third_party/gloo' 2025-03-14T03:52:14.0212734Z Entering 'third_party/googletest' 2025-03-14T03:52:14.0266347Z Entering 'third_party/ideep' 2025-03-14T03:52:14.0318317Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T03:52:14.0378145Z Entering 'third_party/ittapi' 2025-03-14T03:52:14.0430049Z Entering 'third_party/kineto' 2025-03-14T03:52:14.0482642Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T03:52:14.0533412Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T03:52:14.0589080Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T03:52:14.0640643Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T03:52:14.0693638Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T03:52:14.0745410Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T03:52:14.0800157Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T03:52:14.0852656Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T03:52:14.0904770Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T03:52:14.0958800Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T03:52:14.1013002Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T03:52:14.1064695Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T03:52:14.1118214Z Entering 'third_party/kleidiai' 2025-03-14T03:52:14.1171255Z Entering 'third_party/mimalloc' 2025-03-14T03:52:14.1224438Z Entering 'third_party/nlohmann' 2025-03-14T03:52:14.1278332Z Entering 'third_party/onnx' 2025-03-14T03:52:14.1346362Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T03:52:14.1401258Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T03:52:14.1455238Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T03:52:14.1507658Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T03:52:14.1559421Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T03:52:14.1611198Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T03:52:14.1664459Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T03:52:14.1715927Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T03:52:14.1767430Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T03:52:14.1818421Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T03:52:14.1872459Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T03:52:14.1926719Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T03:52:14.2000036Z Entering 'third_party/pocketfft' 2025-03-14T03:52:14.2052033Z Entering 'third_party/protobuf' 2025-03-14T03:52:14.2108549Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T03:52:14.2159882Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T03:52:14.2213565Z Entering 'third_party/psimd' 2025-03-14T03:52:14.2266592Z Entering 'third_party/pthreadpool' 2025-03-14T03:52:14.2319667Z Entering 'third_party/pybind11' 2025-03-14T03:52:14.2372688Z Entering 'third_party/python-peachpy' 2025-03-14T03:52:14.2424931Z Entering 'third_party/sleef' 2025-03-14T03:52:14.2476973Z Entering 'third_party/tensorpipe' 2025-03-14T03:52:14.2528998Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T03:52:14.2582422Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T03:52:14.2633723Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T03:52:14.2687701Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T03:52:14.2737230Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T03:52:14.2807635Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T03:52:14.2833739Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T03:52:14.3132057Z Entering 'android/libs/fbjni' 2025-03-14T03:52:14.3188160Z Entering 'third_party/FP16' 2025-03-14T03:52:14.3241657Z Entering 'third_party/FXdiv' 2025-03-14T03:52:14.3297972Z Entering 'third_party/NNPACK' 2025-03-14T03:52:14.3352272Z Entering 'third_party/NVTX' 2025-03-14T03:52:14.3408520Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T03:52:14.3463745Z Entering 'third_party/XNNPACK' 2025-03-14T03:52:14.3535864Z Entering 'third_party/benchmark' 2025-03-14T03:52:14.3592065Z Entering 'third_party/composable_kernel' 2025-03-14T03:52:14.3652584Z Entering 'third_party/cpp-httplib' 2025-03-14T03:52:14.3707211Z Entering 'third_party/cpuinfo' 2025-03-14T03:52:14.3760552Z Entering 'third_party/cudnn_frontend' 2025-03-14T03:52:14.3814930Z Entering 'third_party/cutlass' 2025-03-14T03:52:14.3877267Z Entering 'third_party/eigen' 2025-03-14T03:52:14.3932511Z Entering 'third_party/fbgemm' 2025-03-14T03:52:14.3987957Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T03:52:14.4042792Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T03:52:14.4096577Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T03:52:14.4156938Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T03:52:14.4210380Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T03:52:14.4265310Z Entering 'third_party/flash-attention' 2025-03-14T03:52:14.4321194Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T03:52:14.4380082Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T03:52:14.4442394Z Entering 'third_party/flatbuffers' 2025-03-14T03:52:14.4498402Z Entering 'third_party/fmt' 2025-03-14T03:52:14.4552150Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T03:52:14.4606519Z Entering 'third_party/gloo' 2025-03-14T03:52:14.4659591Z Entering 'third_party/googletest' 2025-03-14T03:52:14.4713584Z Entering 'third_party/ideep' 2025-03-14T03:52:14.4766316Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T03:52:14.4828085Z Entering 'third_party/ittapi' 2025-03-14T03:52:14.4882062Z Entering 'third_party/kineto' 2025-03-14T03:52:14.4934585Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T03:52:14.4986993Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T03:52:14.5040817Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T03:52:14.5093885Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T03:52:14.5146058Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T03:52:14.5198606Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T03:52:14.5252171Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T03:52:14.5305442Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T03:52:14.5357557Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T03:52:14.5411599Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T03:52:14.5466978Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T03:52:14.5519050Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T03:52:14.5573718Z Entering 'third_party/kleidiai' 2025-03-14T03:52:14.5627108Z Entering 'third_party/mimalloc' 2025-03-14T03:52:14.5679543Z Entering 'third_party/nlohmann' 2025-03-14T03:52:14.5732827Z Entering 'third_party/onnx' 2025-03-14T03:52:14.5804658Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T03:52:14.5859909Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T03:52:14.5914512Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T03:52:14.5965593Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T03:52:14.6018352Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T03:52:14.6070436Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T03:52:14.6124114Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T03:52:14.6176604Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T03:52:14.6227773Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T03:52:14.6279172Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T03:52:14.6332682Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T03:52:14.6387530Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T03:52:14.6459777Z Entering 'third_party/pocketfft' 2025-03-14T03:52:14.6513104Z Entering 'third_party/protobuf' 2025-03-14T03:52:14.6569512Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T03:52:14.6622623Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T03:52:14.6676421Z Entering 'third_party/psimd' 2025-03-14T03:52:14.6728966Z Entering 'third_party/pthreadpool' 2025-03-14T03:52:14.6782676Z Entering 'third_party/pybind11' 2025-03-14T03:52:14.6835391Z Entering 'third_party/python-peachpy' 2025-03-14T03:52:14.6888582Z Entering 'third_party/sleef' 2025-03-14T03:52:14.6940722Z Entering 'third_party/tensorpipe' 2025-03-14T03:52:14.6994111Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T03:52:14.7045613Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T03:52:14.7097563Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T03:52:14.7149423Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T03:52:14.7199625Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T03:52:14.7270086Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T03:52:14.7313056Z ##[endgroup] 2025-03-14T03:52:14.7313526Z ##[group]Fetching the repository 2025-03-14T03:52:14.7319444Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2025-03-14T03:52:15.0009793Z From https://github.com/pytorch/pytorch 2025-03-14T03:52:15.0010288Z - [deleted] (none) -> ciflow/trunk/149166 2025-03-14T03:52:16.3571936Z remote: Enumerating objects: 41, done. 2025-03-14T03:52:16.3572425Z remote: Counting objects: 2% (1/35) 2025-03-14T03:52:16.3572833Z remote: Counting objects: 5% (2/35) 2025-03-14T03:52:16.3573233Z remote: Counting objects: 8% (3/35) 2025-03-14T03:52:16.3573717Z remote: Counting objects: 11% (4/35) 2025-03-14T03:52:16.3574109Z remote: Counting objects: 14% (5/35) 2025-03-14T03:52:16.3574487Z remote: Counting objects: 17% (6/35) 2025-03-14T03:52:16.3574880Z remote: Counting objects: 20% (7/35) 2025-03-14T03:52:16.3575270Z remote: Counting objects: 22% (8/35) 2025-03-14T03:52:16.3575658Z remote: Counting objects: 25% (9/35) 2025-03-14T03:52:16.3576051Z remote: Counting objects: 28% (10/35) 2025-03-14T03:52:16.3576434Z remote: Counting objects: 31% (11/35) 2025-03-14T03:52:16.3576832Z remote: Counting objects: 34% (12/35) 2025-03-14T03:52:16.3577227Z remote: Counting objects: 37% (13/35) 2025-03-14T03:52:16.3577622Z remote: Counting objects: 40% (14/35) 2025-03-14T03:52:16.3578019Z remote: Counting objects: 42% (15/35) 2025-03-14T03:52:16.3578397Z remote: Counting objects: 45% (16/35) 2025-03-14T03:52:16.3579344Z remote: Counting objects: 48% (17/35) 2025-03-14T03:52:16.3579742Z remote: Counting objects: 51% (18/35) 2025-03-14T03:52:16.3580141Z remote: Counting objects: 54% (19/35) 2025-03-14T03:52:16.3580540Z remote: Counting objects: 57% (20/35) 2025-03-14T03:52:16.3580924Z remote: Counting objects: 60% (21/35) 2025-03-14T03:52:16.3581318Z remote: Counting objects: 62% (22/35) 2025-03-14T03:52:16.3581715Z remote: Counting objects: 65% (23/35) 2025-03-14T03:52:16.3582112Z remote: Counting objects: 68% (24/35) 2025-03-14T03:52:16.3582505Z remote: Counting objects: 71% (25/35) 2025-03-14T03:52:16.3583008Z remote: Counting objects: 74% (26/35) 2025-03-14T03:52:16.3583388Z remote: Counting objects: 77% (27/35) 2025-03-14T03:52:16.3583809Z remote: Counting objects: 80% (28/35) 2025-03-14T03:52:16.3584205Z remote: Counting objects: 82% (29/35) 2025-03-14T03:52:16.3584600Z remote: Counting objects: 85% (30/35) 2025-03-14T03:52:16.3585014Z remote: Counting objects: 88% (31/35) 2025-03-14T03:52:16.3585413Z remote: Counting objects: 91% (32/35) 2025-03-14T03:52:16.3585792Z remote: Counting objects: 94% (33/35) 2025-03-14T03:52:16.3586185Z remote: Counting objects: 97% (34/35) 2025-03-14T03:52:16.3586581Z remote: Counting objects: 100% (35/35) 2025-03-14T03:52:16.3587004Z remote: Counting objects: 100% (35/35), done. 2025-03-14T03:52:16.3587444Z remote: Compressing objects: 9% (1/11) 2025-03-14T03:52:16.3587852Z remote: Compressing objects: 18% (2/11) 2025-03-14T03:52:16.3588272Z remote: Compressing objects: 27% (3/11) 2025-03-14T03:52:16.3588685Z remote: Compressing objects: 36% (4/11) 2025-03-14T03:52:16.3589101Z remote: Compressing objects: 45% (5/11) 2025-03-14T03:52:16.3589510Z remote: Compressing objects: 54% (6/11) 2025-03-14T03:52:16.3589906Z remote: Compressing objects: 63% (7/11) 2025-03-14T03:52:16.3590478Z remote: Compressing objects: 72% (8/11) 2025-03-14T03:52:16.3590899Z remote: Compressing objects: 81% (9/11) 2025-03-14T03:52:16.3591319Z remote: Compressing objects: 90% (10/11) 2025-03-14T03:52:16.3591740Z remote: Compressing objects: 100% (11/11) 2025-03-14T03:52:16.3592176Z remote: Compressing objects: 100% (11/11), done. 2025-03-14T03:52:16.3650728Z remote: Total 41 (delta 25), reused 27 (delta 24), pack-reused 6 (from 1) 2025-03-14T03:52:16.7024818Z b4745db9048..aed0b7a742a main -> origin/main 2025-03-14T03:52:16.7049597Z 1579a02c823..3ffd7552df1 wdvr/iss145259_alt -> origin/wdvr/iss145259_alt 2025-03-14T03:52:16.7610349Z [command]/usr/bin/git branch --list --remote origin/main 2025-03-14T03:52:16.7999491Z origin/main 2025-03-14T03:52:16.8006323Z [command]/usr/bin/git rev-parse refs/remotes/origin/main 2025-03-14T03:52:16.8024660Z aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T03:52:16.8027942Z ##[endgroup] 2025-03-14T03:52:16.8028414Z ##[group]Determining the checkout info 2025-03-14T03:52:16.8029149Z ##[endgroup] 2025-03-14T03:52:16.8029594Z ##[group]Checking out the ref 2025-03-14T03:52:16.8031804Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main 2025-03-14T03:52:17.6734062Z Previous HEAD position was 62b5e613433 Merge c4b8be3d09f2f1e1db7dd861338cb234beb8d6ea into b4745db90482ff139ea62d06ec0a18468e1131b7 2025-03-14T03:52:17.6754814Z Switched to a new branch 'main' 2025-03-14T03:52:17.6757702Z branch 'main' set up to track 'origin/main'. 2025-03-14T03:52:17.6782969Z ##[endgroup] 2025-03-14T03:52:17.6824226Z [command]/usr/bin/git log -1 --format='%H' 2025-03-14T03:52:17.6846085Z 'aed0b7a742a2d7b7901790622829cbd2135049a4' 2025-03-14T03:52:17.6997360Z Prepare all required actions 2025-03-14T03:52:17.6997936Z Getting action download info 2025-03-14T03:52:17.8493557Z ##[group]Run ./pytorch/.github/actions/setup-linux 2025-03-14T03:52:17.8493965Z ##[endgroup] 2025-03-14T03:52:17.8603512Z ##[group]Run set -euo pipefail 2025-03-14T03:52:17.8603891Z set -euo pipefail 2025-03-14T03:52:17.8604220Z function get_ec2_metadata() { 2025-03-14T03:52:17.8604638Z  # Pulled from instance metadata endpoint for EC2 2025-03-14T03:52:17.8605324Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2025-03-14T03:52:17.8605927Z  category=$1 2025-03-14T03:52:17.8606323Z  # If it is GCP runner (runner name contains gcp), do not run this 2025-03-14T03:52:17.8606781Z  runner_name_str=i-080b96e24229aed16 2025-03-14T03:52:17.8607145Z  if [[ -f /.inarc ]]; then 2025-03-14T03:52:17.8607590Z  echo "ARC Runner, no info on ec2 metadata" 2025-03-14T03:52:17.8608022Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2025-03-14T03:52:17.8608520Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2025-03-14T03:52:17.8609000Z  else 2025-03-14T03:52:17.8609924Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2025-03-14T03:52:17.8610905Z  fi 2025-03-14T03:52:17.8611145Z } 2025-03-14T03:52:17.8611435Z echo "ami-id: $(get_ec2_metadata ami-id)" 2025-03-14T03:52:17.8611881Z echo "instance-id: $(get_ec2_metadata instance-id)" 2025-03-14T03:52:17.8612395Z echo "instance-type: $(get_ec2_metadata instance-type)" 2025-03-14T03:52:17.8612848Z echo "system info $(uname -a)" 2025-03-14T03:52:17.8622358Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:17.8622918Z ##[endgroup] 2025-03-14T03:52:17.8760973Z ami-id: ami-08b5b3a93ed654d19 2025-03-14T03:52:17.8859880Z instance-id: i-080b96e24229aed16 2025-03-14T03:52:17.8956878Z instance-type: c5.4xlarge 2025-03-14T03:52:17.8967333Z system info Linux ip-10-0-5-97.ec2.internal 6.1.129-138.220.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 25 22:18:43 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 2025-03-14T03:52:17.9003414Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T03:52:17.9022481Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T03:52:17.9029385Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:17.9029801Z ##[endgroup] 2025-03-14T03:52:17.9119708Z ##[group]Run if systemctl is-active --quiet docker; then 2025-03-14T03:52:17.9120205Z if systemctl is-active --quiet docker; then 2025-03-14T03:52:17.9120630Z  echo "Docker daemon is running..."; 2025-03-14T03:52:17.9120974Z else 2025-03-14T03:52:17.9121362Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2025-03-14T03:52:17.9121828Z fi 2025-03-14T03:52:17.9127140Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:17.9127565Z ##[endgroup] 2025-03-14T03:52:17.9199269Z Docker daemon is running... 2025-03-14T03:52:17.9253461Z ##[group]Run nick-fields/retry@v3.0.0 2025-03-14T03:52:17.9253810Z with: 2025-03-14T03:52:17.9254041Z shell: bash 2025-03-14T03:52:17.9254292Z timeout_minutes: 5 2025-03-14T03:52:17.9254558Z max_attempts: 3 2025-03-14T03:52:17.9254807Z retry_wait_seconds: 30 2025-03-14T03:52:17.9257938Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2025-03-14T03:52:17.9260534Z polling_interval_seconds: 1 2025-03-14T03:52:17.9260849Z warning_on_retry: true 2025-03-14T03:52:17.9261132Z continue_on_error: false 2025-03-14T03:52:17.9261416Z env: 2025-03-14T03:52:17.9261648Z AWS_RETRY_MODE: standard 2025-03-14T03:52:17.9261936Z AWS_MAX_ATTEMPTS: 5 2025-03-14T03:52:17.9262221Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T03:52:17.9262507Z ##[endgroup] 2025-03-14T03:52:19.1105477Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T03:52:19.1106198Z Configure a credential helper to remove this warning. See 2025-03-14T03:52:19.1106843Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T03:52:19.1107259Z 2025-03-14T03:52:19.1107374Z Login Succeeded 2025-03-14T03:52:20.0176961Z Command completed after 1 attempt(s). 2025-03-14T03:52:20.0244647Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T03:52:20.0245243Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T03:52:20.0245731Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T03:52:20.0252229Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:20.0252656Z ##[endgroup] 2025-03-14T03:52:20.0348251Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T03:52:20.0348882Z # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T03:52:20.0349340Z # shellcheck disable=SC2046 2025-03-14T03:52:20.0349730Z docker stop $(docker ps -q) || true 2025-03-14T03:52:20.0350111Z # Prune all of the docker images 2025-03-14T03:52:20.0350471Z docker system prune -af 2025-03-14T03:52:20.0356022Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:20.0356462Z ##[endgroup] 2025-03-14T03:52:20.0611191Z "docker stop" requires at least 1 argument. 2025-03-14T03:52:20.0611636Z See 'docker stop --help'. 2025-03-14T03:52:20.0611828Z 2025-03-14T03:52:20.0612018Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2025-03-14T03:52:20.0612309Z 2025-03-14T03:52:20.0612449Z Stop one or more running containers 2025-03-14T03:52:20.0755451Z Total reclaimed space: 0B 2025-03-14T03:52:20.0794844Z ##[group]Run set +e 2025-03-14T03:52:20.0795159Z set +e 2025-03-14T03:52:20.0795416Z set -x 2025-03-14T03:52:20.0795650Z  2025-03-14T03:52:20.0795917Z PT_DOMAIN=download.pytorch.org 2025-03-14T03:52:20.0796565Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2025-03-14T03:52:20.0797379Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2025-03-14T03:52:20.0797955Z # one is returned at random 2025-03-14T03:52:20.0798394Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2025-03-14T03:52:20.0798793Z  2025-03-14T03:52:20.0799048Z if [ -z "${RESOLVED_IP}" ]; then 2025-03-14T03:52:20.0799517Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2025-03-14T03:52:20.0800085Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2025-03-14T03:52:20.0800516Z  2025-03-14T03:52:20.0800775Z  if [ -z "${RESOLVED_IP}" ]; then 2025-03-14T03:52:20.0801183Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2025-03-14T03:52:20.0801579Z  exit 1 2025-03-14T03:52:20.0801839Z  fi 2025-03-14T03:52:20.0802076Z fi 2025-03-14T03:52:20.0802559Z  2025-03-14T03:52:20.0802841Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2025-03-14T03:52:20.0803250Z  # Clean up any old records first 2025-03-14T03:52:20.0803647Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2025-03-14T03:52:20.0804118Z fi 2025-03-14T03:52:20.0804349Z  2025-03-14T03:52:20.0804675Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2025-03-14T03:52:20.0805105Z cat /etc/hosts 2025-03-14T03:52:20.0810971Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:20.0811391Z ##[endgroup] 2025-03-14T03:52:20.0834206Z + PT_DOMAIN=download.pytorch.org 2025-03-14T03:52:20.0839561Z ++ dig -4 +short download.pytorch.org 2025-03-14T03:52:20.0840590Z ++ tail -n1 2025-03-14T03:52:20.1577882Z + RESOLVED_IP=18.160.10.28 2025-03-14T03:52:20.1578218Z + '[' -z 18.160.10.28 ']' 2025-03-14T03:52:20.1578691Z + grep -r download.pytorch.org /etc/hosts 2025-03-14T03:52:20.1589803Z 18.160.10.76 download.pytorch.org 2025-03-14T03:52:20.1591027Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2025-03-14T03:52:20.4559471Z + echo '18.160.10.28 download.pytorch.org' 2025-03-14T03:52:20.4559916Z + sudo tee -a /etc/hosts 2025-03-14T03:52:20.5865467Z 18.160.10.28 download.pytorch.org 2025-03-14T03:52:20.5880131Z + cat /etc/hosts 2025-03-14T03:52:20.5888583Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2025-03-14T03:52:20.5893636Z ::1 localhost6 localhost6.localdomain6 2025-03-14T03:52:20.5894083Z 18.160.10.28 download.pytorch.org 2025-03-14T03:52:20.5978052Z ##[group]Run actions/checkout@v3 2025-03-14T03:52:20.5978391Z with: 2025-03-14T03:52:20.5978911Z repository: osalpekar/codellama 2025-03-14T03:52:20.5979233Z ref: main 2025-03-14T03:52:20.5979478Z path: codellama 2025-03-14T03:52:20.5979878Z token: *** 2025-03-14T03:52:20.5980129Z ssh-strict: true 2025-03-14T03:52:20.5980395Z persist-credentials: true 2025-03-14T03:52:20.5980697Z clean: true 2025-03-14T03:52:20.5980971Z sparse-checkout-cone-mode: true 2025-03-14T03:52:20.5981306Z fetch-depth: 1 2025-03-14T03:52:20.5981567Z fetch-tags: false 2025-03-14T03:52:20.5981807Z lfs: false 2025-03-14T03:52:20.5982055Z submodules: false 2025-03-14T03:52:20.5982471Z set-safe-directory: true 2025-03-14T03:52:20.5982968Z ##[endgroup] 2025-03-14T03:52:20.6802467Z Syncing repository: osalpekar/codellama 2025-03-14T03:52:20.6805426Z ##[group]Getting Git version info 2025-03-14T03:52:20.6806039Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch/codellama' 2025-03-14T03:52:20.6829554Z [command]/usr/bin/git version 2025-03-14T03:52:20.6864887Z git version 2.47.1 2025-03-14T03:52:20.6890235Z ##[endgroup] 2025-03-14T03:52:20.6899277Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/6a03e996-1998-45a2-8f0a-51973f80a8d3/.gitconfig' 2025-03-14T03:52:20.6908178Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/6a03e996-1998-45a2-8f0a-51973f80a8d3' before making global git config changes 2025-03-14T03:52:20.6909200Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T03:52:20.6911947Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/codellama 2025-03-14T03:52:20.6950481Z [command]/usr/bin/git config --local --get remote.origin.url 2025-03-14T03:52:20.6966711Z https://github.com/osalpekar/codellama 2025-03-14T03:52:20.6982173Z ##[group]Removing previously created refs, to avoid conflicts 2025-03-14T03:52:20.6985500Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2025-03-14T03:52:20.7009914Z refs/heads/main 2025-03-14T03:52:20.7018237Z [command]/usr/bin/git checkout --detach 2025-03-14T03:52:20.7181665Z HEAD is now at 1ec50e0 Add support for padding attention mask 2025-03-14T03:52:20.7216184Z [command]/usr/bin/git branch --delete --force main 2025-03-14T03:52:20.7237154Z Deleted branch main (was 1ec50e0). 2025-03-14T03:52:20.7271502Z ##[endgroup] 2025-03-14T03:52:20.7273600Z [command]/usr/bin/git submodule status 2025-03-14T03:52:20.7534774Z ##[group]Cleaning the repository 2025-03-14T03:52:20.7537990Z [command]/usr/bin/git clean -ffdx 2025-03-14T03:52:21.1271922Z Removing CodeLlama-7b-Python/ 2025-03-14T03:52:21.1272320Z Removing codellama.egg-info/ 2025-03-14T03:52:21.1272655Z Removing llama/__pycache__/ 2025-03-14T03:52:21.1280591Z [command]/usr/bin/git reset --hard HEAD 2025-03-14T03:52:21.1328539Z HEAD is now at 1ec50e0 Add support for padding attention mask 2025-03-14T03:52:21.1332434Z ##[endgroup] 2025-03-14T03:52:21.1334329Z ##[group]Disabling automatic garbage collection 2025-03-14T03:52:21.1336782Z [command]/usr/bin/git config --local gc.auto 0 2025-03-14T03:52:21.1358661Z ##[endgroup] 2025-03-14T03:52:21.1359096Z ##[group]Setting up auth 2025-03-14T03:52:21.1364362Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T03:52:21.1388837Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T03:52:21.1661293Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T03:52:21.1683831Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T03:52:21.1948119Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T03:52:21.1989510Z ##[endgroup] 2025-03-14T03:52:21.1989974Z ##[group]Fetching the repository 2025-03-14T03:52:21.1995869Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +refs/heads/main*:refs/remotes/origin/main* +refs/tags/main*:refs/tags/main* 2025-03-14T03:52:21.3700921Z remote: Total 0 (delta 0), reused 0 (delta 0), pack-reused 0 (from 0) 2025-03-14T03:52:21.3759851Z ##[endgroup] 2025-03-14T03:52:21.3760318Z ##[group]Determining the checkout info 2025-03-14T03:52:21.3764193Z [command]/usr/bin/git branch --list --remote origin/main 2025-03-14T03:52:21.3782969Z origin/main 2025-03-14T03:52:21.3786596Z ##[endgroup] 2025-03-14T03:52:21.3787128Z ##[group]Checking out the ref 2025-03-14T03:52:21.3790511Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main 2025-03-14T03:52:21.3818558Z Switched to a new branch 'main' 2025-03-14T03:52:21.3820501Z branch 'main' set up to track 'origin/main'. 2025-03-14T03:52:21.3824382Z ##[endgroup] 2025-03-14T03:52:21.3850714Z [command]/usr/bin/git log -1 --format='%H' 2025-03-14T03:52:21.3869778Z '1ec50e0cfc0fadc3b6ceb146617e2119ab26eb34' 2025-03-14T03:52:21.3993946Z ##[group]Run actions/checkout@v3 2025-03-14T03:52:21.3994281Z with: 2025-03-14T03:52:21.3994571Z repository: osalpekar/llm-target-determinator 2025-03-14T03:52:21.3994942Z ref: v0.0.2 2025-03-14T03:52:21.3995194Z path: llm-target-determinator 2025-03-14T03:52:21.3995636Z token: *** 2025-03-14T03:52:21.3995882Z ssh-strict: true 2025-03-14T03:52:21.3996157Z persist-credentials: true 2025-03-14T03:52:21.3996471Z clean: true 2025-03-14T03:52:21.3996726Z sparse-checkout-cone-mode: true 2025-03-14T03:52:21.3997047Z fetch-depth: 1 2025-03-14T03:52:21.3997306Z fetch-tags: false 2025-03-14T03:52:21.3997558Z lfs: false 2025-03-14T03:52:21.3997799Z submodules: false 2025-03-14T03:52:21.3998056Z set-safe-directory: true 2025-03-14T03:52:21.3998347Z ##[endgroup] 2025-03-14T03:52:21.4750929Z Syncing repository: osalpekar/llm-target-determinator 2025-03-14T03:52:21.4753845Z ##[group]Getting Git version info 2025-03-14T03:52:21.4754608Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch/llm-target-determinator' 2025-03-14T03:52:21.4777451Z [command]/usr/bin/git version 2025-03-14T03:52:21.4810440Z git version 2.47.1 2025-03-14T03:52:21.4834921Z ##[endgroup] 2025-03-14T03:52:21.4843524Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/ba33bab6-2abd-47d9-8cf5-c99cf1dd4726/.gitconfig' 2025-03-14T03:52:21.4851756Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/ba33bab6-2abd-47d9-8cf5-c99cf1dd4726' before making global git config changes 2025-03-14T03:52:21.4852969Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T03:52:21.4855562Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/llm-target-determinator 2025-03-14T03:52:21.4899778Z [command]/usr/bin/git config --local --get remote.origin.url 2025-03-14T03:52:21.4916437Z https://github.com/osalpekar/llm-target-determinator 2025-03-14T03:52:21.4929773Z ##[group]Removing previously created refs, to avoid conflicts 2025-03-14T03:52:21.4932162Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2025-03-14T03:52:21.4950634Z HEAD 2025-03-14T03:52:21.5013699Z ##[endgroup] 2025-03-14T03:52:21.5015879Z [command]/usr/bin/git submodule status 2025-03-14T03:52:21.5285070Z ##[group]Cleaning the repository 2025-03-14T03:52:21.5287706Z [command]/usr/bin/git clean -ffdx 2025-03-14T03:52:21.5410503Z Removing __pycache__/ 2025-03-14T03:52:21.5411053Z Removing assets/indexer-files/ 2025-03-14T03:52:21.5411488Z Removing assets/mappings.zip 2025-03-14T03:52:21.5411805Z Removing assets/mappings/ 2025-03-14T03:52:21.5417122Z [command]/usr/bin/git reset --hard HEAD 2025-03-14T03:52:22.2272967Z HEAD is now at 56c1694 update (#8) 2025-03-14T03:52:22.2292913Z ##[endgroup] 2025-03-14T03:52:22.2295191Z ##[group]Disabling automatic garbage collection 2025-03-14T03:52:22.2299612Z [command]/usr/bin/git config --local gc.auto 0 2025-03-14T03:52:22.2324106Z ##[endgroup] 2025-03-14T03:52:22.2324522Z ##[group]Setting up auth 2025-03-14T03:52:22.2329646Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T03:52:22.2354078Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T03:52:22.2629773Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T03:52:22.2652718Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T03:52:22.2925969Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T03:52:22.2963372Z ##[endgroup] 2025-03-14T03:52:22.2963971Z ##[group]Fetching the repository 2025-03-14T03:52:22.2970161Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +refs/heads/v0.0.2*:refs/remotes/origin/v0.0.2* +refs/tags/v0.0.2*:refs/tags/v0.0.2* 2025-03-14T03:52:22.4767954Z remote: Total 0 (delta 0), reused 0 (delta 0), pack-reused 0 (from 0) 2025-03-14T03:52:22.4842364Z ##[endgroup] 2025-03-14T03:52:22.4842992Z ##[group]Determining the checkout info 2025-03-14T03:52:22.4846518Z [command]/usr/bin/git branch --list --remote origin/v0.0.2 2025-03-14T03:52:22.4873951Z [command]/usr/bin/git tag --list v0.0.2 2025-03-14T03:52:22.4891171Z v0.0.2 2025-03-14T03:52:22.4894677Z ##[endgroup] 2025-03-14T03:52:22.4895319Z ##[group]Checking out the ref 2025-03-14T03:52:22.4896961Z [command]/usr/bin/git checkout --progress --force refs/tags/v0.0.2 2025-03-14T03:52:22.8959198Z HEAD is now at 56c1694 update (#8) 2025-03-14T03:52:22.8965541Z ##[endgroup] 2025-03-14T03:52:22.8998275Z [command]/usr/bin/git log -1 --format='%H' 2025-03-14T03:52:22.9017475Z '56c1694a62ad113305fac250397980cb7427db8f' 2025-03-14T03:52:22.9223313Z ##[group]Run pytorch/test-infra/.github/actions/setup-miniconda@main 2025-03-14T03:52:22.9223944Z with: 2025-03-14T03:52:22.9224273Z python-version: 3.9 2025-03-14T03:52:22.9224664Z miniconda-version: 24.7.1-0 2025-03-14T03:52:22.9225207Z default-packages: cmake=3.22 ninja=1.10 pkg-config=0.29 wheel=0.37 2025-03-14T03:52:22.9226003Z ##[endgroup] 2025-03-14T03:52:22.9260121Z ##[group]Run echo "today=$(/bin/date -u '+%Y%m%d')d" >> "${GITHUB_OUTPUT}" 2025-03-14T03:52:22.9277877Z echo "today=$(/bin/date -u '+%Y%m%d')d" >> "${GITHUB_OUTPUT}" 2025-03-14T03:52:22.9278978Z echo "default_packages_checksum=$(echo -n cmake=3.22 ninja=1.10 pkg-config=0.29 wheel=0.37 | md5sum | awk '{print $1}' )" >> "${GITHUB_OUTPUT}" 2025-03-14T03:52:22.9287050Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:22.9287487Z ##[endgroup] 2025-03-14T03:52:22.9411065Z ##[group]Run actions/cache@v3 2025-03-14T03:52:22.9411358Z with: 2025-03-14T03:52:22.9411712Z path: /home/ec2-user/actions-runner/_work/_temp/miniconda 2025-03-14T03:52:22.9412295Z key: miniconda-24.7.1-0-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d 2025-03-14T03:52:22.9412855Z enableCrossOsArchive: false 2025-03-14T03:52:22.9413166Z fail-on-cache-miss: false 2025-03-14T03:52:22.9413461Z lookup-only: false 2025-03-14T03:52:22.9413732Z ##[endgroup] 2025-03-14T03:52:23.1790428Z Cache hit for: miniconda-24.7.1-0-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d 2025-03-14T03:52:24.3344940Z Received 134217728 of 407419837 (32.9%), 128.0 MBs/sec 2025-03-14T03:52:25.3399780Z Received 364904448 of 407419837 (89.6%), 173.6 MBs/sec 2025-03-14T03:52:25.6660985Z Received 407419837 of 407419837 (100.0%), 166.7 MBs/sec 2025-03-14T03:52:25.6664625Z Cache Size: ~389 MB (407419837 B) 2025-03-14T03:52:25.6704729Z [command]/usr/bin/tar -xf /home/ec2-user/actions-runner/_work/_temp/e382757a-4156-4334-a329-07fc4836a3ba/cache.tzst -P -C /home/ec2-user/actions-runner/_work/pytorch/pytorch --use-compress-program unzstd 2025-03-14T03:52:27.3122719Z Cache restored successfully 2025-03-14T03:52:27.3526548Z Cache restored from key: miniconda-24.7.1-0-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d 2025-03-14T03:52:27.3641405Z ##[group]Run set -x 2025-03-14T03:52:27.3641732Z set -x 2025-03-14T03:52:27.3641967Z  2025-03-14T03:52:27.3642317Z MINICONDA_INSTALL_PATH="${RUNNER_TEMP}/miniconda" 2025-03-14T03:52:27.3642813Z echo "${MINICONDA_INSTALL_PATH}/bin" >> $GITHUB_PATH 2025-03-14T03:52:27.3643365Z # NB: GITHUB_PATH has a lower priority than PATH, so also set the path 2025-03-14T03:52:27.3643912Z # here to make sure that the correct conda is used 2025-03-14T03:52:27.3644300Z { 2025-03-14T03:52:27.3644602Z  echo "PATH=${MINICONDA_INSTALL_PATH}/bin:${PATH}" 2025-03-14T03:52:27.3645084Z  echo "CONDA_EXE=${MINICONDA_INSTALL_PATH}/bin/conda"; 2025-03-14T03:52:27.3645508Z } >> "${GITHUB_ENV}" 2025-03-14T03:52:27.3651814Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:27.3652233Z ##[endgroup] 2025-03-14T03:52:27.3676174Z + MINICONDA_INSTALL_PATH=/home/ec2-user/actions-runner/_work/_temp/miniconda 2025-03-14T03:52:27.3676773Z + echo /home/ec2-user/actions-runner/_work/_temp/miniconda/bin 2025-03-14T03:52:27.3677554Z + echo PATH=/home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:52:27.3678676Z + echo CONDA_EXE=/home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:52:27.4619259Z ##[group]Run actions/cache@v3 2025-03-14T03:52:27.4619566Z with: 2025-03-14T03:52:27.4619910Z path: /home/ec2-user/actions-runner/_work/_temp/conda-python-3.9 2025-03-14T03:52:27.4620543Z key: miniconda-env-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d-- 2025-03-14T03:52:27.4621076Z enableCrossOsArchive: false 2025-03-14T03:52:27.4621400Z fail-on-cache-miss: false 2025-03-14T03:52:27.4621888Z lookup-only: false 2025-03-14T03:52:27.4622139Z env: 2025-03-14T03:52:27.4622778Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:52:27.4623565Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:52:27.4624027Z ##[endgroup] 2025-03-14T03:52:27.6609295Z Cache hit for: miniconda-env-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d-- 2025-03-14T03:52:28.5751174Z Received 88563469 of 88563469 (100.0%), 106.8 MBs/sec 2025-03-14T03:52:28.5752584Z Cache Size: ~84 MB (88563469 B) 2025-03-14T03:52:28.5772231Z [command]/usr/bin/tar -xf /home/ec2-user/actions-runner/_work/_temp/4a921c55-0750-45eb-8f2a-9bfbde2c82a0/cache.tzst -P -C /home/ec2-user/actions-runner/_work/pytorch/pytorch --use-compress-program unzstd 2025-03-14T03:52:29.1752519Z Cache restored successfully 2025-03-14T03:52:29.1921803Z Cache restored from key: miniconda-env-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d-- 2025-03-14T03:52:29.2074118Z ##[group]Run set -x 2025-03-14T03:52:29.2074497Z set -x 2025-03-14T03:52:29.2074742Z  2025-03-14T03:52:29.2075137Z # Print the conda we are using here in case we need debugging information 2025-03-14T03:52:29.2075698Z CONDA_RUNTIME=$(which conda) 2025-03-14T03:52:29.2076051Z "${CONDA_RUNTIME}" --version 2025-03-14T03:52:29.2076411Z  2025-03-14T03:52:29.2076942Z # https://docs.conda.io/projects/conda-build/en/stable/user-guide/environment-variables.html 2025-03-14T03:52:29.2077676Z CONDA_PREFIX="${RUNNER_TEMP}/conda_environment_${GITHUB_RUN_ID}" 2025-03-14T03:52:29.2078153Z "${CONDA_RUNTIME}" create \ 2025-03-14T03:52:29.2078755Z  --yes --quiet \ 2025-03-14T03:52:29.2079080Z  --prefix "${CONDA_PREFIX}" \ 2025-03-14T03:52:29.2079442Z  --clone "${CONDA_BASE_ENV}" 2025-03-14T03:52:29.2079752Z  2025-03-14T03:52:29.2079996Z set +e 2025-03-14T03:52:29.2080469Z # NB: Cloning sometimes doesn't copied pip dependencies (untracked files) over. If this 2025-03-14T03:52:29.2081213Z # happens, let's attempt to install the pip requirements directly on top of the cloned 2025-03-14T03:52:29.2081898Z # environment. This is to make sure that no dependency is missing. 2025-03-14T03:52:29.2082650Z UNTRACKED_FILES_COUNT=$("${CONDA_RUNTIME}" package -p "${CONDA_PREFIX}" -u | grep -v "^#" | wc -l | xargs) 2025-03-14T03:52:29.2083237Z set -e 2025-03-14T03:52:29.2083483Z  2025-03-14T03:52:29.2083880Z if [[ -z "${UNTRACKED_FILES_COUNT}" ]] || [[ "${UNTRACKED_FILES_COUNT}" == "0" ]]; then 2025-03-14T03:52:29.2084418Z  if [[ -f "${PIP_REQUIREMENTS_FILE}" ]]; then 2025-03-14T03:52:29.2084971Z  # NB: Force reinstall and don't use the cache, as the installation would still fail 2025-03-14T03:52:29.2085597Z  # when reporting that all requirements have been satisfied 2025-03-14T03:52:29.2086487Z  "${CONDA_RUNTIME}" run -p "${CONDA_PREFIX}" --no-capture-output python3 -mpip install --ignore-installed --no-cache-dir -r "${PIP_REQUIREMENTS_FILE}" 2025-03-14T03:52:29.2087339Z  elif [[ -n "${PIP_REQUIREMENTS_FILE}" ]]; then 2025-03-14T03:52:29.2088034Z  echo "::warning::Specified pip requirements file (${PIP_REQUIREMENTS_FILE}) not found, not going to include it" 2025-03-14T03:52:29.2088694Z  fi 2025-03-14T03:52:29.2088934Z fi 2025-03-14T03:52:29.2089172Z  2025-03-14T03:52:29.2089620Z # Keep exporting CONDA_PREFIX under CONDA_ENV because the latter could be used elsewhere 2025-03-14T03:52:29.2090256Z echo "CONDA_ENV=${CONDA_PREFIX}" >> "${GITHUB_ENV}" 2025-03-14T03:52:29.2090654Z  2025-03-14T03:52:29.2090986Z echo "CONDA_PREFIX=${CONDA_PREFIX}" >> "${GITHUB_ENV}" 2025-03-14T03:52:29.2091825Z echo "CONDA_RUN=${CONDA_RUNTIME} run -p ${CONDA_PREFIX} --no-capture-output" >> "${GITHUB_ENV}" 2025-03-14T03:52:29.2092436Z if [[ "${PYTHON_VERSION}" == "3.11" ]]; then 2025-03-14T03:52:29.2092944Z  # TODO: Remove me, when more packages will be available on default channel 2025-03-14T03:52:29.2093750Z  echo "CONDA_INSTALL=${CONDA_RUNTIME} install --yes --quiet -p ${CONDA_PREFIX} -c pytorch-nightly" >> "${GITHUB_ENV}" 2025-03-14T03:52:29.2094913Z else 2025-03-14T03:52:29.2095411Z  echo "CONDA_INSTALL=${CONDA_RUNTIME} install --yes --quiet -p ${CONDA_PREFIX}" >> "${GITHUB_ENV}" 2025-03-14T03:52:29.2095980Z fi 2025-03-14T03:52:29.2104048Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:29.2104458Z env: 2025-03-14T03:52:29.2105016Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:52:29.2105788Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:52:29.2106276Z PYTHON_VERSION: 3.9 2025-03-14T03:52:29.2106709Z CONDA_BASE_ENV: /home/ec2-user/actions-runner/_work/_temp/conda-python-3.9 2025-03-14T03:52:29.2107196Z PIP_REQUIREMENTS_FILE: 2025-03-14T03:52:29.2107487Z ##[endgroup] 2025-03-14T03:52:29.2136747Z ++ which conda 2025-03-14T03:52:29.2157270Z + CONDA_RUNTIME=/home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:52:29.2157943Z + /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda --version 2025-03-14T03:52:29.3482081Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:52:29.3483327Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:52:29.4682930Z conda 24.7.1 2025-03-14T03:52:29.5015192Z + CONDA_PREFIX=/home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:29.5016613Z + /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda create --yes --quiet --prefix /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --clone /home/ec2-user/actions-runner/_work/_temp/conda-python-3.9 2025-03-14T03:52:29.6217863Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:52:29.6219111Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:52:30.0899510Z Source: /home/ec2-user/actions-runner/_work/_temp/conda-python-3.9 2025-03-14T03:52:30.0900218Z Destination: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:30.0900764Z Packages: 37 2025-03-14T03:52:30.0901009Z Files: 1 2025-03-14T03:52:30.3548047Z Preparing transaction: ...working... done 2025-03-14T03:52:31.9241477Z Verifying transaction: ...working... done 2025-03-14T03:52:32.8192545Z Executing transaction: ...working... done 2025-03-14T03:52:32.9726818Z + set +e 2025-03-14T03:52:32.9733128Z ++ /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda package -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 -u 2025-03-14T03:52:32.9733957Z ++ grep -v '^#' 2025-03-14T03:52:32.9734427Z ++ wc -l 2025-03-14T03:52:32.9735729Z ++ xargs 2025-03-14T03:52:33.0930909Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:52:33.0932134Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:52:33.5420539Z + UNTRACKED_FILES_COUNT=1 2025-03-14T03:52:33.5421056Z + set -e 2025-03-14T03:52:33.5421424Z + [[ -z 1 ]] 2025-03-14T03:52:33.5421844Z + [[ 1 == \0 ]] 2025-03-14T03:52:33.5423267Z + echo CONDA_ENV=/home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.5424571Z + echo CONDA_PREFIX=/home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.5426412Z + echo 'CONDA_RUN=/home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output' 2025-03-14T03:52:33.5427538Z + [[ 3.9 == \3\.\1\1 ]] 2025-03-14T03:52:33.5428405Z + echo 'CONDA_INSTALL=/home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289' 2025-03-14T03:52:33.5448924Z ##[group]Run CONDA_RUNTIME=$(which conda) 2025-03-14T03:52:33.5449329Z CONDA_RUNTIME=$(which conda) 2025-03-14T03:52:33.5460383Z  2025-03-14T03:52:33.5460722Z set -euxo pipefail 2025-03-14T03:52:33.5461145Z "${CONDA_RUNTIME}" config --set channel_priority false 2025-03-14T03:52:33.5471476Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:33.5471897Z env: 2025-03-14T03:52:33.5472445Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:52:33.5473238Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:52:33.5473903Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.5474615Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.5475722Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:52:33.5477191Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.5478100Z ##[endgroup] 2025-03-14T03:52:33.5514781Z + /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda config --set channel_priority false 2025-03-14T03:52:33.6705004Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:52:33.6706247Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:52:33.8245489Z ##[group]Run set -euxo pipefail 2025-03-14T03:52:33.8245866Z set -euxo pipefail 2025-03-14T03:52:33.8246335Z ${CONDA_RUN} pip install -r llm-target-determinator/requirements.txt 2025-03-14T03:52:33.8246851Z cd "${GITHUB_WORKSPACE}/codellama" 2025-03-14T03:52:33.8247227Z ${CONDA_RUN} pip install -e . 2025-03-14T03:52:33.8255137Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:52:33.8255551Z env: 2025-03-14T03:52:33.8256112Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:52:33.8256884Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:52:33.8257535Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.8258240Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.8259401Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:52:33.8260873Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:52:33.8261779Z ##[endgroup] 2025-03-14T03:52:33.8291248Z + /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output pip install -r llm-target-determinator/requirements.txt 2025-03-14T03:52:33.9484829Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:52:33.9486280Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:52:34.7339627Z Collecting torch==2.0.1 (from -r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:34.7363559Z Using cached torch-2.0.1-cp39-cp39-manylinux1_x86_64.whl.metadata (24 kB) 2025-03-14T03:52:34.7904901Z Collecting transformers (from -r llm-target-determinator/requirements.txt (line 2)) 2025-03-14T03:52:34.7927208Z Using cached transformers-4.49.0-py3-none-any.whl.metadata (44 kB) 2025-03-14T03:52:35.0144562Z Collecting huggingface_hub (from -r llm-target-determinator/requirements.txt (line 3)) 2025-03-14T03:52:35.0165177Z Using cached huggingface_hub-0.29.3-py3-none-any.whl.metadata (13 kB) 2025-03-14T03:52:35.0821929Z Collecting black==22.6.0 (from -r llm-target-determinator/requirements.txt (line 4)) 2025-03-14T03:52:35.0842941Z Using cached black-22.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (46 kB) 2025-03-14T03:52:35.1049733Z Collecting ufmt==2.0.0 (from -r llm-target-determinator/requirements.txt (line 5)) 2025-03-14T03:52:35.1069019Z Using cached ufmt-2.0.0-py3-none-any.whl.metadata (5.4 kB) 2025-03-14T03:52:35.1226158Z Collecting usort==1.0.4 (from -r llm-target-determinator/requirements.txt (line 6)) 2025-03-14T03:52:35.1245025Z Using cached usort-1.0.4-py3-none-any.whl.metadata (3.3 kB) 2025-03-14T03:52:35.1478983Z Collecting filelock (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.1505068Z Using cached filelock-3.17.0-py3-none-any.whl.metadata (2.9 kB) 2025-03-14T03:52:35.1546549Z Requirement already satisfied: typing-extensions in /home/ec2-user/.local/lib/python3.9/site-packages (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) (4.12.2) 2025-03-14T03:52:35.1716097Z Collecting sympy (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.1735792Z Using cached sympy-1.13.3-py3-none-any.whl.metadata (12 kB) 2025-03-14T03:52:35.1976472Z Collecting networkx (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.1997158Z Using cached networkx-3.2.1-py3-none-any.whl.metadata (5.2 kB) 2025-03-14T03:52:35.2214626Z Collecting jinja2 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.2234860Z Using cached jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) 2025-03-14T03:52:35.2361519Z Collecting nvidia-cuda-nvrtc-cu11==11.7.99 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.2381321Z Using cached nvidia_cuda_nvrtc_cu11-11.7.99-2-py3-none-manylinux1_x86_64.whl.metadata (1.5 kB) 2025-03-14T03:52:35.2495142Z Collecting nvidia-cuda-runtime-cu11==11.7.99 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.2514223Z Using cached nvidia_cuda_runtime_cu11-11.7.99-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) 2025-03-14T03:52:35.2645543Z Collecting nvidia-cuda-cupti-cu11==11.7.101 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.2665231Z Using cached nvidia_cuda_cupti_cu11-11.7.101-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) 2025-03-14T03:52:35.2804597Z Collecting nvidia-cudnn-cu11==8.5.0.96 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.2824803Z Using cached nvidia_cudnn_cu11-8.5.0.96-2-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) 2025-03-14T03:52:35.2942219Z Collecting nvidia-cublas-cu11==11.10.3.66 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.2961451Z Using cached nvidia_cublas_cu11-11.10.3.66-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) 2025-03-14T03:52:35.3088129Z Collecting nvidia-cufft-cu11==10.9.0.58 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.3109499Z Using cached nvidia_cufft_cu11-10.9.0.58-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB) 2025-03-14T03:52:35.3234360Z Collecting nvidia-curand-cu11==10.2.10.91 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.3254670Z Using cached nvidia_curand_cu11-10.2.10.91-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) 2025-03-14T03:52:35.3389659Z Collecting nvidia-cusolver-cu11==11.4.0.1 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.3409098Z Using cached nvidia_cusolver_cu11-11.4.0.1-2-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) 2025-03-14T03:52:35.3533783Z Collecting nvidia-cusparse-cu11==11.7.4.91 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.3559892Z Using cached nvidia_cusparse_cu11-11.7.4.91-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) 2025-03-14T03:52:35.3704221Z Collecting nvidia-nccl-cu11==2.14.3 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.3724783Z Using cached nvidia_nccl_cu11-2.14.3-py3-none-manylinux1_x86_64.whl.metadata (1.8 kB) 2025-03-14T03:52:35.3855676Z Collecting nvidia-nvtx-cu11==11.7.91 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.3874895Z Using cached nvidia_nvtx_cu11-11.7.91-py3-none-manylinux1_x86_64.whl.metadata (1.7 kB) 2025-03-14T03:52:35.4030612Z Collecting triton==2.0.0 (from torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.4053184Z Using cached triton-2.0.0-1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.0 kB) 2025-03-14T03:52:35.4270685Z Collecting click>=8.0.0 (from black==22.6.0->-r llm-target-determinator/requirements.txt (line 4)) 2025-03-14T03:52:35.4290313Z Using cached click-8.1.8-py3-none-any.whl.metadata (2.3 kB) 2025-03-14T03:52:35.4478302Z Collecting platformdirs>=2 (from black==22.6.0->-r llm-target-determinator/requirements.txt (line 4)) 2025-03-14T03:52:35.4501148Z Using cached platformdirs-4.3.6-py3-none-any.whl.metadata (11 kB) 2025-03-14T03:52:35.4659229Z Collecting pathspec>=0.9.0 (from black==22.6.0->-r llm-target-determinator/requirements.txt (line 4)) 2025-03-14T03:52:35.4678168Z Using cached pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) 2025-03-14T03:52:35.4705277Z Requirement already satisfied: mypy-extensions>=0.4.3 in /home/ec2-user/.local/lib/python3.9/site-packages (from black==22.6.0->-r llm-target-determinator/requirements.txt (line 4)) (1.0.0) 2025-03-14T03:52:35.4854826Z Collecting tomli>=1.1.0 (from black==22.6.0->-r llm-target-determinator/requirements.txt (line 4)) 2025-03-14T03:52:35.4876085Z Using cached tomli-2.2.1-py3-none-any.whl.metadata (10 kB) 2025-03-14T03:52:35.5424778Z Collecting libcst>=0.4.0 (from ufmt==2.0.0->-r llm-target-determinator/requirements.txt (line 5)) 2025-03-14T03:52:35.5443594Z Using cached libcst-1.7.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (17 kB) 2025-03-14T03:52:35.5603022Z Collecting moreorless>=0.4.0 (from ufmt==2.0.0->-r llm-target-determinator/requirements.txt (line 5)) 2025-03-14T03:52:35.5622030Z Using cached moreorless-0.4.0-py2.py3-none-any.whl.metadata (1.5 kB) 2025-03-14T03:52:35.5817959Z Collecting tomlkit>=0.7.2 (from ufmt==2.0.0->-r llm-target-determinator/requirements.txt (line 5)) 2025-03-14T03:52:35.5836655Z Using cached tomlkit-0.13.2-py3-none-any.whl.metadata (2.7 kB) 2025-03-14T03:52:35.5986585Z Collecting trailrunner>=1.2.1 (from ufmt==2.0.0->-r llm-target-determinator/requirements.txt (line 5)) 2025-03-14T03:52:35.6005438Z Using cached trailrunner-1.4.0-py3-none-any.whl.metadata (4.2 kB) 2025-03-14T03:52:35.6217824Z Collecting attrs>=21.2.0 (from usort==1.0.4->-r llm-target-determinator/requirements.txt (line 6)) 2025-03-14T03:52:35.6241708Z Using cached attrs-25.3.0-py3-none-any.whl.metadata (10 kB) 2025-03-14T03:52:35.6571830Z Collecting stdlibs>=2021.4.1 (from usort==1.0.4->-r llm-target-determinator/requirements.txt (line 6)) 2025-03-14T03:52:35.6591434Z Using cached stdlibs-2024.12.3-py3-none-any.whl.metadata (5.0 kB) 2025-03-14T03:52:35.6734952Z Collecting toml>=0.10.0 (from usort==1.0.4->-r llm-target-determinator/requirements.txt (line 6)) 2025-03-14T03:52:35.6754435Z Using cached toml-0.10.2-py2.py3-none-any.whl.metadata (7.1 kB) 2025-03-14T03:52:35.6790486Z Requirement already satisfied: setuptools in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) (75.8.0) 2025-03-14T03:52:35.6794079Z Requirement already satisfied: wheel in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) (0.37.1) 2025-03-14T03:52:35.8051124Z Collecting cmake (from triton==2.0.0->torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.8073392Z Using cached cmake-3.31.6-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.3 kB) 2025-03-14T03:52:35.8272966Z Collecting lit (from triton==2.0.0->torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:35.8293836Z Using cached lit-18.1.8-py3-none-any.whl.metadata (2.5 kB) 2025-03-14T03:52:35.8419014Z Requirement already satisfied: numpy>=1.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from transformers->-r llm-target-determinator/requirements.txt (line 2)) (1.26.4) 2025-03-14T03:52:35.8423548Z Requirement already satisfied: packaging>=20.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from transformers->-r llm-target-determinator/requirements.txt (line 2)) (24.2) 2025-03-14T03:52:35.8428159Z Requirement already satisfied: pyyaml>=5.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from transformers->-r llm-target-determinator/requirements.txt (line 2)) (6.0.1) 2025-03-14T03:52:36.1276813Z Collecting regex!=2019.12.17 (from transformers->-r llm-target-determinator/requirements.txt (line 2)) 2025-03-14T03:52:36.1366220Z Using cached regex-2024.11.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (40 kB) 2025-03-14T03:52:36.1488678Z Requirement already satisfied: requests in /home/ec2-user/.local/lib/python3.9/site-packages (from transformers->-r llm-target-determinator/requirements.txt (line 2)) (2.27.1) 2025-03-14T03:52:36.3667286Z Collecting tokenizers<0.22,>=0.21 (from transformers->-r llm-target-determinator/requirements.txt (line 2)) 2025-03-14T03:52:36.3771001Z Using cached tokenizers-0.21.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB) 2025-03-14T03:52:36.5401678Z Collecting safetensors>=0.4.1 (from transformers->-r llm-target-determinator/requirements.txt (line 2)) 2025-03-14T03:52:36.5459291Z Using cached safetensors-0.5.3-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB) 2025-03-14T03:52:36.6016341Z Collecting tqdm>=4.27 (from transformers->-r llm-target-determinator/requirements.txt (line 2)) 2025-03-14T03:52:36.6055421Z Using cached tqdm-4.67.1-py3-none-any.whl.metadata (57 kB) 2025-03-14T03:52:36.6405560Z Collecting fsspec>=2023.5.0 (from huggingface_hub->-r llm-target-determinator/requirements.txt (line 3)) 2025-03-14T03:52:36.6446962Z Using cached fsspec-2025.3.0-py3-none-any.whl.metadata (11 kB) 2025-03-14T03:52:36.8192795Z Collecting MarkupSafe>=2.0 (from jinja2->torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:36.8214286Z Using cached MarkupSafe-3.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) 2025-03-14T03:52:36.8882983Z Collecting urllib3<1.27,>=1.21.1 (from requests->transformers->-r llm-target-determinator/requirements.txt (line 2)) 2025-03-14T03:52:36.8934623Z Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2025-03-14T03:52:36.9068873Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests->transformers->-r llm-target-determinator/requirements.txt (line 2)) (2025.1.31) 2025-03-14T03:52:36.9076062Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests->transformers->-r llm-target-determinator/requirements.txt (line 2)) (2.0.12) 2025-03-14T03:52:36.9404938Z Collecting idna<4,>=2.5 (from requests->transformers->-r llm-target-determinator/requirements.txt (line 2)) 2025-03-14T03:52:36.9435997Z Using cached idna-3.10-py3-none-any.whl.metadata (10 kB) 2025-03-14T03:52:36.9918117Z Collecting mpmath<1.4,>=1.1.0 (from sympy->torch==2.0.1->-r llm-target-determinator/requirements.txt (line 1)) 2025-03-14T03:52:36.9959299Z Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB) 2025-03-14T03:52:37.0485511Z Using cached torch-2.0.1-cp39-cp39-manylinux1_x86_64.whl (619.9 MB) 2025-03-14T03:52:48.5288297Z Using cached black-22.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB) 2025-03-14T03:52:48.5569582Z Using cached ufmt-2.0.0-py3-none-any.whl (21 kB) 2025-03-14T03:52:48.5633200Z Using cached usort-1.0.4-py3-none-any.whl (23 kB) 2025-03-14T03:52:48.5711715Z Using cached nvidia_cublas_cu11-11.10.3.66-py3-none-manylinux1_x86_64.whl (317.1 MB) 2025-03-14T03:52:53.5970827Z Using cached nvidia_cuda_cupti_cu11-11.7.101-py3-none-manylinux1_x86_64.whl (11.8 MB) 2025-03-14T03:52:53.6875977Z Using cached nvidia_cuda_nvrtc_cu11-11.7.99-2-py3-none-manylinux1_x86_64.whl (21.0 MB) 2025-03-14T03:52:53.8484406Z Using cached nvidia_cuda_runtime_cu11-11.7.99-py3-none-manylinux1_x86_64.whl (849 kB) 2025-03-14T03:52:53.8537295Z Using cached nvidia_cudnn_cu11-8.5.0.96-2-py3-none-manylinux1_x86_64.whl (557.1 MB) 2025-03-14T03:52:58.0978940Z Using cached nvidia_cufft_cu11-10.9.0.58-py3-none-manylinux2014_x86_64.whl (168.4 MB) 2025-03-14T03:52:59.3808040Z Using cached nvidia_curand_cu11-10.2.10.91-py3-none-manylinux1_x86_64.whl (54.6 MB) 2025-03-14T03:52:59.7969516Z Using cached nvidia_cusolver_cu11-11.4.0.1-2-py3-none-manylinux1_x86_64.whl (102.6 MB) 2025-03-14T03:53:00.5952669Z Using cached nvidia_cusparse_cu11-11.7.4.91-py3-none-manylinux1_x86_64.whl (173.2 MB) 2025-03-14T03:53:01.9150387Z Using cached nvidia_nccl_cu11-2.14.3-py3-none-manylinux1_x86_64.whl (177.1 MB) 2025-03-14T03:53:03.7303341Z Using cached nvidia_nvtx_cu11-11.7.91-py3-none-manylinux1_x86_64.whl (98 kB) 2025-03-14T03:53:03.7331104Z Using cached triton-2.0.0-1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB) 2025-03-14T03:53:04.2134708Z Using cached transformers-4.49.0-py3-none-any.whl (10.0 MB) 2025-03-14T03:53:04.2906499Z Using cached huggingface_hub-0.29.3-py3-none-any.whl (468 kB) 2025-03-14T03:53:04.2947487Z Using cached attrs-25.3.0-py3-none-any.whl (63 kB) 2025-03-14T03:53:04.2972623Z Using cached click-8.1.8-py3-none-any.whl (98 kB) 2025-03-14T03:53:04.2999242Z Using cached fsspec-2025.3.0-py3-none-any.whl (193 kB) 2025-03-14T03:53:04.3028174Z Using cached libcst-1.7.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB) 2025-03-14T03:53:04.3134494Z Using cached moreorless-0.4.0-py2.py3-none-any.whl (9.3 kB) 2025-03-14T03:53:04.3156920Z Using cached pathspec-0.12.1-py3-none-any.whl (31 kB) 2025-03-14T03:53:04.3180987Z Using cached platformdirs-4.3.6-py3-none-any.whl (18 kB) 2025-03-14T03:53:04.3205000Z Using cached regex-2024.11.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (780 kB) 2025-03-14T03:53:04.3246735Z Using cached safetensors-0.5.3-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (471 kB) 2025-03-14T03:53:04.3285506Z Using cached stdlibs-2024.12.3-py3-none-any.whl (57 kB) 2025-03-14T03:53:04.3311422Z Using cached tokenizers-0.21.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB) 2025-03-14T03:53:04.3472181Z Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) 2025-03-14T03:53:04.3496051Z Using cached tomli-2.2.1-py3-none-any.whl (14 kB) 2025-03-14T03:53:04.3519155Z Using cached tomlkit-0.13.2-py3-none-any.whl (37 kB) 2025-03-14T03:53:04.3542895Z Using cached tqdm-4.67.1-py3-none-any.whl (78 kB) 2025-03-14T03:53:04.3569332Z Using cached trailrunner-1.4.0-py3-none-any.whl (11 kB) 2025-03-14T03:53:04.3591968Z Using cached filelock-3.17.0-py3-none-any.whl (16 kB) 2025-03-14T03:53:04.3628200Z Using cached jinja2-3.1.6-py3-none-any.whl (134 kB) 2025-03-14T03:53:04.3655296Z Using cached networkx-3.2.1-py3-none-any.whl (1.6 MB) 2025-03-14T03:53:04.3733231Z Using cached sympy-1.13.3-py3-none-any.whl (6.2 MB) 2025-03-14T03:53:04.4097574Z Using cached idna-3.10-py3-none-any.whl (70 kB) 2025-03-14T03:53:04.4123083Z Using cached MarkupSafe-3.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20 kB) 2025-03-14T03:53:04.4146945Z Using cached mpmath-1.3.0-py3-none-any.whl (536 kB) 2025-03-14T03:53:04.4196384Z Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2025-03-14T03:53:04.4225735Z Using cached cmake-3.31.6-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (27.8 MB) 2025-03-14T03:53:04.6289232Z Using cached lit-18.1.8-py3-none-any.whl (96 kB) 2025-03-14T03:53:10.9405416Z Installing collected packages: mpmath, lit, urllib3, tqdm, tomlkit, tomli, toml, sympy, stdlibs, safetensors, regex, platformdirs, pathspec, nvidia-nvtx-cu11, nvidia-nccl-cu11, nvidia-cusparse-cu11, nvidia-curand-cu11, nvidia-cufft-cu11, nvidia-cuda-runtime-cu11, nvidia-cuda-nvrtc-cu11, nvidia-cuda-cupti-cu11, nvidia-cublas-cu11, networkx, MarkupSafe, libcst, idna, fsspec, filelock, cmake, click, attrs, trailrunner, nvidia-cusolver-cu11, nvidia-cudnn-cu11, moreorless, jinja2, black, usort, huggingface_hub, ufmt, tokenizers, transformers, triton, torch 2025-03-14T03:53:50.2214348Z Successfully installed MarkupSafe-3.0.2 attrs-25.3.0 black-22.6.0 click-8.1.8 cmake-3.31.6 filelock-3.17.0 fsspec-2025.3.0 huggingface_hub-0.29.3 idna-3.10 jinja2-3.1.6 libcst-1.7.0 lit-18.1.8 moreorless-0.4.0 mpmath-1.3.0 networkx-3.2.1 nvidia-cublas-cu11-11.10.3.66 nvidia-cuda-cupti-cu11-11.7.101 nvidia-cuda-nvrtc-cu11-11.7.99 nvidia-cuda-runtime-cu11-11.7.99 nvidia-cudnn-cu11-8.5.0.96 nvidia-cufft-cu11-10.9.0.58 nvidia-curand-cu11-10.2.10.91 nvidia-cusolver-cu11-11.4.0.1 nvidia-cusparse-cu11-11.7.4.91 nvidia-nccl-cu11-2.14.3 nvidia-nvtx-cu11-11.7.91 pathspec-0.12.1 platformdirs-4.3.6 regex-2024.11.6 safetensors-0.5.3 stdlibs-2024.12.3 sympy-1.13.3 tokenizers-0.21.1 toml-0.10.2 tomli-2.2.1 tomlkit-0.13.2 torch-2.0.1 tqdm-4.67.1 trailrunner-1.4.0 transformers-4.49.0 triton-2.0.0 ufmt-2.0.0 urllib3-1.26.20 usort-1.0.4 2025-03-14T03:53:50.5668291Z + cd /home/ec2-user/actions-runner/_work/pytorch/pytorch/codellama 2025-03-14T03:53:50.5669794Z + /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output pip install -e . 2025-03-14T03:53:50.6847766Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:53:50.6848989Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:53:51.3346249Z Obtaining file:///home/ec2-user/actions-runner/_work/pytorch/pytorch/codellama 2025-03-14T03:53:51.3353076Z Preparing metadata (setup.py): started 2025-03-14T03:53:51.5034950Z Preparing metadata (setup.py): finished with status 'done' 2025-03-14T03:53:51.5130401Z Requirement already satisfied: torch in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from codellama==0.0.1) (2.0.1) 2025-03-14T03:53:51.5385776Z Collecting fairscale (from codellama==0.0.1) 2025-03-14T03:53:51.5387347Z Using cached fairscale-0.4.13-py3-none-any.whl 2025-03-14T03:53:51.5530704Z Collecting fire (from codellama==0.0.1) 2025-03-14T03:53:51.5532215Z Using cached fire-0.7.0-py3-none-any.whl 2025-03-14T03:53:51.6076733Z Collecting sentencepiece (from codellama==0.0.1) 2025-03-14T03:53:51.6097053Z Using cached sentencepiece-0.2.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.7 kB) 2025-03-14T03:53:51.6120159Z Requirement already satisfied: numpy>=1.22.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from fairscale->codellama==0.0.1) (1.26.4) 2025-03-14T03:53:51.6183204Z Requirement already satisfied: filelock in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (3.17.0) 2025-03-14T03:53:51.6186601Z Requirement already satisfied: typing-extensions in /home/ec2-user/.local/lib/python3.9/site-packages (from torch->codellama==0.0.1) (4.12.2) 2025-03-14T03:53:51.6190231Z Requirement already satisfied: sympy in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (1.13.3) 2025-03-14T03:53:51.6193746Z Requirement already satisfied: networkx in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (3.2.1) 2025-03-14T03:53:51.6197233Z Requirement already satisfied: jinja2 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (3.1.6) 2025-03-14T03:53:51.6203641Z Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (11.7.99) 2025-03-14T03:53:51.6210552Z Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (11.7.99) 2025-03-14T03:53:51.6216730Z Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (11.7.101) 2025-03-14T03:53:51.6222968Z Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (8.5.0.96) 2025-03-14T03:53:51.6229369Z Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (11.10.3.66) 2025-03-14T03:53:51.6235348Z Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (10.9.0.58) 2025-03-14T03:53:51.6241496Z Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (10.2.10.91) 2025-03-14T03:53:51.6247677Z Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (11.4.0.1) 2025-03-14T03:53:51.6253898Z Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (11.7.4.91) 2025-03-14T03:53:51.6260634Z Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (2.14.3) 2025-03-14T03:53:51.6267185Z Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (11.7.91) 2025-03-14T03:53:51.6273353Z Requirement already satisfied: triton==2.0.0 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from torch->codellama==0.0.1) (2.0.0) 2025-03-14T03:53:51.6285022Z Requirement already satisfied: setuptools in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch->codellama==0.0.1) (75.8.0) 2025-03-14T03:53:51.6288635Z Requirement already satisfied: wheel in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch->codellama==0.0.1) (0.37.1) 2025-03-14T03:53:51.6385060Z Requirement already satisfied: cmake in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from triton==2.0.0->torch->codellama==0.0.1) (3.31.6) 2025-03-14T03:53:51.6389883Z Requirement already satisfied: lit in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from triton==2.0.0->torch->codellama==0.0.1) (18.1.8) 2025-03-14T03:53:51.6494690Z Collecting termcolor (from fire->codellama==0.0.1) 2025-03-14T03:53:51.6513285Z Using cached termcolor-2.5.0-py3-none-any.whl.metadata (6.1 kB) 2025-03-14T03:53:51.6591412Z Requirement already satisfied: MarkupSafe>=2.0 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from jinja2->torch->codellama==0.0.1) (3.0.2) 2025-03-14T03:53:51.6656458Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from sympy->torch->codellama==0.0.1) (1.3.0) 2025-03-14T03:53:51.6795069Z Using cached sentencepiece-0.2.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) 2025-03-14T03:53:51.6850345Z Using cached termcolor-2.5.0-py3-none-any.whl (7.8 kB) 2025-03-14T03:53:52.0125076Z Installing collected packages: sentencepiece, termcolor, fire, fairscale, codellama 2025-03-14T03:53:52.2798048Z DEPRECATION: Legacy editable install of codellama==0.0.1 from file:///home/ec2-user/actions-runner/_work/pytorch/pytorch/codellama (setup.py develop) is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to add a pyproject.toml or enable --use-pep517, and use setuptools >= 64. If the resulting installation is not behaving as expected, try using --config-settings editable_mode=compat. Please consult the setuptools documentation for more information. Discussion can be found at https://github.com/pypa/pip/issues/11457 2025-03-14T03:53:52.2800592Z Running setup.py develop for codellama 2025-03-14T03:53:52.5263388Z Successfully installed codellama fairscale-0.4.13 fire-0.7.0 sentencepiece-0.2.0 termcolor-2.5.0 2025-03-14T03:53:52.6446833Z ##[group]Run set -euxo pipefail 2025-03-14T03:53:52.6447221Z set -euxo pipefail 2025-03-14T03:53:52.6447566Z cd "${GITHUB_WORKSPACE}/codellama" 2025-03-14T03:53:52.6447946Z mkdir "CodeLlama-7b-Python" 2025-03-14T03:53:52.6448662Z aws s3 cp "s3://target-determinator-assets/CodeLlama-7b-Python" "CodeLlama-7b-Python" --recursive --no-progress 2025-03-14T03:53:52.6458581Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:53:52.6459004Z env: 2025-03-14T03:53:52.6459562Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:53:52.6460353Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:53:52.6461002Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:53:52.6461706Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:53:52.6462978Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:53:52.6464452Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:53:52.6465366Z ##[endgroup] 2025-03-14T03:53:52.6495604Z + cd /home/ec2-user/actions-runner/_work/pytorch/pytorch/codellama 2025-03-14T03:53:52.6496076Z + mkdir CodeLlama-7b-Python 2025-03-14T03:53:52.6507508Z + aws s3 cp s3://target-determinator-assets/CodeLlama-7b-Python CodeLlama-7b-Python --recursive --no-progress 2025-03-14T03:53:53.2604052Z download: s3://target-determinator-assets/CodeLlama-7b-Python/params.json to CodeLlama-7b-Python/params.json 2025-03-14T03:53:53.2695793Z download: s3://target-determinator-assets/CodeLlama-7b-Python/checklist.chk to CodeLlama-7b-Python/checklist.chk 2025-03-14T03:53:53.3536825Z download: s3://target-determinator-assets/CodeLlama-7b-Python/tokenizer.model to CodeLlama-7b-Python/tokenizer.model 2025-03-14T03:55:14.8089815Z download: s3://target-determinator-assets/CodeLlama-7b-Python/consolidated.00.pth to CodeLlama-7b-Python/consolidated.00.pth 2025-03-14T03:55:14.9402490Z ##[group]Run nick-fields/retry@v3.0.0 2025-03-14T03:55:14.9402846Z with: 2025-03-14T03:55:14.9403069Z max_attempts: 3 2025-03-14T03:55:14.9403332Z retry_wait_seconds: 10 2025-03-14T03:55:14.9403618Z timeout_minutes: 5 2025-03-14T03:55:14.9403882Z shell: bash 2025-03-14T03:55:14.9405052Z command: set -euxo pipefail ${CONDA_RUN} python -m pip install awscli==1.29.40 cd "${GITHUB_WORKSPACE}"/llm-target-determinator/assets aws s3 cp "s3://target-determinator-assets/indexes/latest" . --recursive unzip -o indexer-files\*.zip rm indexer-files*.zip 2025-03-14T03:55:14.9406313Z polling_interval_seconds: 1 2025-03-14T03:55:14.9406629Z warning_on_retry: true 2025-03-14T03:55:14.9406908Z continue_on_error: false 2025-03-14T03:55:14.9407190Z env: 2025-03-14T03:55:14.9407733Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:55:14.9408558Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:55:14.9409194Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:14.9409901Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:14.9410998Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:55:14.9412471Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:14.9413368Z ##[endgroup] 2025-03-14T03:55:15.0377754Z + /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output python -m pip install awscli==1.29.40 2025-03-14T03:55:15.1579198Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:55:15.1580457Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:55:16.2341630Z Collecting awscli==1.29.40 2025-03-14T03:55:16.2420499Z Using cached awscli-1.29.40-py3-none-any.whl.metadata (11 kB) 2025-03-14T03:55:16.6207580Z Collecting botocore==1.31.40 (from awscli==1.29.40) 2025-03-14T03:55:16.6299844Z Using cached botocore-1.31.40-py3-none-any.whl.metadata (6.0 kB) 2025-03-14T03:55:16.6930654Z Collecting docutils<0.17,>=0.10 (from awscli==1.29.40) 2025-03-14T03:55:16.6951752Z Using cached docutils-0.16-py2.py3-none-any.whl.metadata (2.7 kB) 2025-03-14T03:55:16.7589893Z Collecting s3transfer<0.7.0,>=0.6.0 (from awscli==1.29.40) 2025-03-14T03:55:16.7672069Z Using cached s3transfer-0.6.2-py3-none-any.whl.metadata (1.8 kB) 2025-03-14T03:55:16.7764040Z Requirement already satisfied: PyYAML<6.1,>=3.10 in /home/ec2-user/.local/lib/python3.9/site-packages (from awscli==1.29.40) (6.0.1) 2025-03-14T03:55:16.8314743Z Collecting colorama<0.4.5,>=0.2.5 (from awscli==1.29.40) 2025-03-14T03:55:16.8396575Z Using cached colorama-0.4.4-py2.py3-none-any.whl.metadata (14 kB) 2025-03-14T03:55:16.8861641Z Collecting rsa<4.8,>=3.1.2 (from awscli==1.29.40) 2025-03-14T03:55:16.8963322Z Using cached rsa-4.7.2-py3-none-any.whl.metadata (3.6 kB) 2025-03-14T03:55:16.9394533Z Collecting jmespath<2.0.0,>=0.7.1 (from botocore==1.31.40->awscli==1.29.40) 2025-03-14T03:55:16.9440921Z Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2025-03-14T03:55:16.9529349Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from botocore==1.31.40->awscli==1.29.40) (2.8.2) 2025-03-14T03:55:16.9534886Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289/lib/python3.9/site-packages (from botocore==1.31.40->awscli==1.29.40) (1.26.20) 2025-03-14T03:55:17.0219553Z Collecting pyasn1>=0.1.3 (from rsa<4.8,>=3.1.2->awscli==1.29.40) 2025-03-14T03:55:17.0245231Z Using cached pyasn1-0.6.1-py3-none-any.whl.metadata (8.4 kB) 2025-03-14T03:55:17.2938030Z Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore==1.31.40->awscli==1.29.40) 2025-03-14T03:55:17.3129522Z Using cached six-1.17.0-py2.py3-none-any.whl.metadata (1.7 kB) 2025-03-14T03:55:17.3287930Z Using cached awscli-1.29.40-py3-none-any.whl (4.2 MB) 2025-03-14T03:55:17.4718095Z Using cached botocore-1.31.40-py3-none-any.whl (11.2 MB) 2025-03-14T03:55:17.7726348Z Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB) 2025-03-14T03:55:17.7898278Z Using cached docutils-0.16-py2.py3-none-any.whl (548 kB) 2025-03-14T03:55:17.8169530Z Using cached rsa-4.7.2-py3-none-any.whl (34 kB) 2025-03-14T03:55:17.8340566Z Using cached s3transfer-0.6.2-py3-none-any.whl (79 kB) 2025-03-14T03:55:17.8501707Z Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2025-03-14T03:55:17.8590639Z Using cached pyasn1-0.6.1-py3-none-any.whl (83 kB) 2025-03-14T03:55:17.8749516Z Using cached six-1.17.0-py2.py3-none-any.whl (11 kB) 2025-03-14T03:55:18.3835869Z Installing collected packages: six, pyasn1, jmespath, docutils, colorama, rsa, botocore, s3transfer, awscli 2025-03-14T03:55:21.2260836Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2025-03-14T03:55:21.2262313Z boto3 1.35.42 requires botocore<1.36.0,>=1.35.42, but you have botocore 1.31.40 which is incompatible. 2025-03-14T03:55:21.2263124Z boto3 1.35.42 requires s3transfer<0.11.0,>=0.10.0, but you have s3transfer 0.6.2 which is incompatible. 2025-03-14T03:55:21.2264098Z Successfully installed awscli-1.29.40 botocore-1.31.40 colorama-0.4.4 docutils-0.16 jmespath-1.0.1 pyasn1-0.6.1 rsa-4.7.2 s3transfer-0.6.2 six-1.17.0 2025-03-14T03:55:21.3831304Z + cd /home/ec2-user/actions-runner/_work/pytorch/pytorch/llm-target-determinator/assets 2025-03-14T03:55:21.3832237Z + aws s3 cp s3://target-determinator-assets/indexes/latest . --recursive 2025-03-14T03:55:22.0916580Z Completed 256.0 KiB/5.8 MiB (1.3 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.0931432Z Completed 512.0 KiB/5.8 MiB (2.6 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.0948405Z Completed 768.0 KiB/5.8 MiB (3.9 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.0966642Z Completed 1.0 MiB/5.8 MiB (5.1 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.0980272Z Completed 1.2 MiB/5.8 MiB (6.4 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.0994393Z Completed 1.5 MiB/5.8 MiB (7.6 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1006454Z Completed 1.8 MiB/5.8 MiB (8.8 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1338555Z Completed 2.0 MiB/5.8 MiB (10.0 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1348016Z Completed 2.2 MiB/5.8 MiB (9.6 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1358169Z Completed 2.5 MiB/5.8 MiB (10.7 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1367708Z Completed 2.8 MiB/5.8 MiB (11.7 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1377825Z Completed 3.0 MiB/5.8 MiB (12.7 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1387345Z Completed 3.2 MiB/5.8 MiB (13.7 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1397684Z Completed 3.5 MiB/5.8 MiB (14.7 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1406902Z Completed 3.8 MiB/5.8 MiB (15.7 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1755459Z Completed 4.0 MiB/5.8 MiB (16.6 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1761725Z Completed 4.2 MiB/5.8 MiB (15.4 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1770164Z Completed 4.5 MiB/5.8 MiB (16.3 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1779314Z Completed 4.8 MiB/5.8 MiB (17.2 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1785563Z Completed 5.0 MiB/5.8 MiB (18.0 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1793382Z Completed 5.2 MiB/5.8 MiB (18.9 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1800511Z Completed 5.5 MiB/5.8 MiB (19.7 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1814152Z Completed 5.8 MiB/5.8 MiB (20.6 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1818642Z Completed 5.8 MiB/5.8 MiB (20.5 MiB/s) with 1 file(s) remaining 2025-03-14T03:55:22.1819953Z download: s3://target-determinator-assets/indexes/latest/indexer-files-2025-03-06T00:39:20+00:00.zip to ./indexer-files-2025-03-06T00:39:20+00:00.zip 2025-03-14T03:55:22.3055665Z + unzip -o 'indexer-files*.zip' 2025-03-14T03:55:22.3317090Z Archive: indexer-files-2025-03-06T00:39:20+00:00.zip 2025-03-14T03:55:22.3317542Z creating: indexer-files/ 2025-03-14T03:55:22.4027068Z inflating: indexer-files/unittest_index_0.pt 2025-03-14T03:55:22.4029094Z inflating: indexer-files/unittest_index_mapping_0.json 2025-03-14T03:55:22.4033051Z + rm indexer-files-2025-03-06T00:39:20+00:00.zip 2025-03-14T03:55:23.0261467Z Command completed after 1 attempt(s). 2025-03-14T03:55:23.0330769Z ##[group]Run set -euxo pipefail 2025-03-14T03:55:23.0331171Z set -euxo pipefail 2025-03-14T03:55:23.0331563Z cd "${GITHUB_WORKSPACE}"/llm-target-determinator 2025-03-14T03:55:23.0331995Z ${CONDA_RUN} torchrun \ 2025-03-14T03:55:23.0332322Z  --standalone \ 2025-03-14T03:55:23.0332645Z  --nnodes=1 \ 2025-03-14T03:55:23.0332933Z  --nproc-per-node=1 \ 2025-03-14T03:55:23.0333260Z  retriever.py \ 2025-03-14T03:55:23.0333594Z  --experiment-name indexer-files \ 2025-03-14T03:55:23.0333977Z  --pr-parse-format GITDIFF 2025-03-14T03:55:23.0334307Z cd assets 2025-03-14T03:55:23.0334586Z zip -r mappings.zip mappings 2025-03-14T03:55:23.0342861Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:55:23.0343340Z env: 2025-03-14T03:55:23.0343962Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:55:23.0344749Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:55:23.0345385Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:23.0346091Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:23.0347263Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:55:23.0348738Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:23.0349650Z ##[endgroup] 2025-03-14T03:55:23.0376938Z + cd /home/ec2-user/actions-runner/_work/pytorch/pytorch/llm-target-determinator 2025-03-14T03:55:23.0378711Z + /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output torchrun --standalone --nnodes=1 --nproc-per-node=1 retriever.py --experiment-name indexer-files --pr-parse-format GITDIFF 2025-03-14T03:55:23.1577288Z /home/ec2-user/.local/lib/python3.9/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (2.2.2) or chardet (None)/charset_normalizer (2.0.12) doesn't match a supported version! 2025-03-14T03:55:23.1578949Z warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported " 2025-03-14T03:55:25.9849994Z master_addr is only used for static rdzv_backend and when rdzv_endpoint is not specified. 2025-03-14T03:55:28.0349939Z torch.Size([932, 4096]) 2025-03-14T03:55:28.0401850Z > initializing model parallel with size 1 2025-03-14T03:55:28.0402321Z > initializing ddp with size 1 2025-03-14T03:55:28.0402717Z > initializing pipeline with size 1 2025-03-14T03:55:37.2425627Z Loaded in 9.17 seconds 2025-03-14T03:55:50.6486793Z Made output file assets/mappings/indexer-files-gitdiff-output.json 2025-03-14T03:55:50.6487383Z Total time to retreieve: 22.643460273742676 seconds 2025-03-14T03:55:56.7881264Z + cd assets 2025-03-14T03:55:56.7881626Z + zip -r mappings.zip mappings 2025-03-14T03:55:56.8283746Z adding: mappings/ (stored 0%) 2025-03-14T03:55:56.8303491Z adding: mappings/indexer-files-gitdiff-output.json (deflated 67%) 2025-03-14T03:55:57.1629368Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-03-14T03:55:57.1630001Z with: 2025-03-14T03:55:57.1630247Z name: llm_results 2025-03-14T03:55:57.1630533Z retention-days: 14 2025-03-14T03:55:57.1630836Z if-no-files-found: warn 2025-03-14T03:55:57.1631206Z path: llm-target-determinator/assets/mappings.zip 2025-03-14T03:55:57.1631625Z s3-bucket: gha-artifacts 2025-03-14T03:55:57.1631921Z region: us-east-1 2025-03-14T03:55:57.1632189Z env: 2025-03-14T03:55:57.1632756Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:55:57.1633575Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:55:57.1634243Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:57.1634966Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:57.1636180Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:55:57.1637697Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:57.1638618Z AWS_ACCESS_KEY_ID: 2025-03-14T03:55:57.1638902Z AWS_SECRET_ACCESS_KEY: 2025-03-14T03:55:57.1639208Z AWS_SESSION_TOKEN: 2025-03-14T03:55:57.1639498Z AWS_DEFAULT_REGION: 2025-03-14T03:55:57.1639783Z AWS_REGION: 2025-03-14T03:55:57.1640054Z ##[endgroup] 2025-03-14T03:55:58.5710244Z With the provided path, there will be 1 file uploaded 2025-03-14T03:55:58.5710803Z Uploading to s3 prefix: pytorch/pytorch/13849515289/llm_results 2025-03-14T03:55:58.6821821Z Starting upload of mappings.zip 2025-03-14T03:55:58.8124966Z Finished upload of mappings.zip 2025-03-14T03:55:58.8403497Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2025-03-14T03:55:58.8403991Z with: 2025-03-14T03:55:58.8404252Z env: 2025-03-14T03:55:58.8404812Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:55:58.8405625Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:55:58.8406302Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8407027Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8408149Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:55:58.8409701Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8416442Z ##[endgroup] 2025-03-14T03:55:58.8491191Z ##[group]Run set -eou pipefail 2025-03-14T03:55:58.8491588Z set -eou pipefail 2025-03-14T03:55:58.8491898Z  2025-03-14T03:55:58.8492301Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2025-03-14T03:55:58.8492827Z for _ in $(seq 1440); do 2025-03-14T03:55:58.8493213Z  # Break if no ssh session exists anymore 2025-03-14T03:55:58.8493615Z  if [ "$(who)" = "" ]; then 2025-03-14T03:55:58.8493961Z  break 2025-03-14T03:55:58.8494234Z  fi 2025-03-14T03:55:58.8494482Z  echo "." 2025-03-14T03:55:58.8494765Z  sleep 5 2025-03-14T03:55:58.8495041Z done 2025-03-14T03:55:58.8681735Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:55:58.8682168Z env: 2025-03-14T03:55:58.8682767Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:55:58.8683590Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:55:58.8684260Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8684983Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8686094Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:55:58.8687583Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8688478Z ##[endgroup] 2025-03-14T03:55:58.8733826Z Holding runner for 2 hours until all ssh sessions have logged out 2025-03-14T03:55:58.8812010Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T03:55:58.8812637Z # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T03:55:58.8813121Z # shellcheck disable=SC2046 2025-03-14T03:55:58.8813482Z docker stop $(docker ps -q) || true 2025-03-14T03:55:58.8813862Z # Prune all of the docker images 2025-03-14T03:55:58.8814221Z docker system prune -af 2025-03-14T03:55:58.8821858Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:55:58.8822272Z env: 2025-03-14T03:55:58.8822982Z PATH: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2025-03-14T03:55:58.8823785Z CONDA_EXE: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda 2025-03-14T03:55:58.8824450Z CONDA_ENV: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8825170Z CONDA_PREFIX: /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8826467Z CONDA_RUN: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda run -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 --no-capture-output 2025-03-14T03:55:58.8827968Z CONDA_INSTALL: /home/ec2-user/actions-runner/_work/_temp/miniconda/bin/conda install --yes --quiet -p /home/ec2-user/actions-runner/_work/_temp/conda_environment_13849515289 2025-03-14T03:55:58.8828875Z ##[endgroup] 2025-03-14T03:55:59.0463125Z "docker stop" requires at least 1 argument. 2025-03-14T03:55:59.0463739Z See 'docker stop --help'. 2025-03-14T03:55:59.0463962Z 2025-03-14T03:55:59.0696622Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2025-03-14T03:55:59.0696990Z 2025-03-14T03:55:59.0697125Z Stop one or more running containers 2025-03-14T03:55:59.0697495Z Total reclaimed space: 0B 2025-03-14T03:55:59.0858803Z Post job cleanup. 2025-03-14T03:55:59.1871974Z Post job cleanup. 2025-03-14T03:55:59.3519614Z Cache hit occurred on the primary key miniconda-env-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d--, not saving cache. 2025-03-14T03:55:59.3610043Z Post job cleanup. 2025-03-14T03:55:59.5027237Z Cache hit occurred on the primary key miniconda-24.7.1-0-Linux-X64-3.9-feeb26725601c37f5c6ba7685f24d0da-20250314d, not saving cache. 2025-03-14T03:55:59.5157790Z Post job cleanup. 2025-03-14T03:55:59.5990316Z [command]/usr/bin/git version 2025-03-14T03:55:59.6181386Z git version 2.47.1 2025-03-14T03:55:59.6232735Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/fec6763f-2546-4cc9-908c-59e323bdd393/.gitconfig' 2025-03-14T03:55:59.6245378Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/fec6763f-2546-4cc9-908c-59e323bdd393' before making global git config changes 2025-03-14T03:55:59.6246655Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T03:55:59.6260727Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/llm-target-determinator 2025-03-14T03:55:59.6310293Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T03:55:59.6337371Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T03:55:59.6749997Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T03:55:59.6767951Z http.https://github.com/.extraheader 2025-03-14T03:55:59.6777230Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-03-14T03:55:59.6817292Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T03:55:59.7206884Z Post job cleanup. 2025-03-14T03:55:59.7973279Z [command]/usr/bin/git version 2025-03-14T03:55:59.8006002Z git version 2.47.1 2025-03-14T03:55:59.8058565Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/67249b40-4ea3-42ba-81ad-44b30366ee00/.gitconfig' 2025-03-14T03:55:59.8066986Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/67249b40-4ea3-42ba-81ad-44b30366ee00' before making global git config changes 2025-03-14T03:55:59.8067997Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T03:55:59.8070461Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/codellama 2025-03-14T03:55:59.8113794Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T03:55:59.8138504Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T03:55:59.8418089Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T03:55:59.8435432Z http.https://github.com/.extraheader 2025-03-14T03:55:59.8444381Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-03-14T03:55:59.8468994Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T03:55:59.8847434Z Post job cleanup. 2025-03-14T03:55:59.9613223Z [command]/usr/bin/git version 2025-03-14T03:55:59.9646946Z git version 2.47.1 2025-03-14T03:55:59.9693827Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/6841859a-7601-4ac7-9216-157f366fba68/.gitconfig' 2025-03-14T03:55:59.9702191Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/6841859a-7601-4ac7-9216-157f366fba68' before making global git config changes 2025-03-14T03:55:59.9703436Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T03:55:59.9706071Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch/pytorch 2025-03-14T03:55:59.9755764Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T03:55:59.9782636Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T03:56:00.0221189Z Entering 'android/libs/fbjni' 2025-03-14T03:56:00.0345581Z Entering 'third_party/FP16' 2025-03-14T03:56:00.0452666Z Entering 'third_party/FXdiv' 2025-03-14T03:56:00.0549291Z Entering 'third_party/NNPACK' 2025-03-14T03:56:00.0646432Z Entering 'third_party/NVTX' 2025-03-14T03:56:00.0746492Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T03:56:00.0854318Z Entering 'third_party/XNNPACK' 2025-03-14T03:56:00.1017027Z Entering 'third_party/benchmark' 2025-03-14T03:56:00.1125360Z Entering 'third_party/composable_kernel' 2025-03-14T03:56:00.1254919Z Entering 'third_party/cpp-httplib' 2025-03-14T03:56:00.1349299Z Entering 'third_party/cpuinfo' 2025-03-14T03:56:00.1451144Z Entering 'third_party/cudnn_frontend' 2025-03-14T03:56:00.1553972Z Entering 'third_party/cutlass' 2025-03-14T03:56:00.1684871Z Entering 'third_party/eigen' 2025-03-14T03:56:00.1796277Z Entering 'third_party/fbgemm' 2025-03-14T03:56:00.1927119Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T03:56:00.2038849Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T03:56:00.2145330Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T03:56:00.2280640Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T03:56:00.2367167Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T03:56:00.2467912Z Entering 'third_party/flash-attention' 2025-03-14T03:56:00.2600348Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T03:56:00.2738481Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T03:56:00.2874149Z Entering 'third_party/flatbuffers' 2025-03-14T03:56:00.2977271Z Entering 'third_party/fmt' 2025-03-14T03:56:00.3071781Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T03:56:00.3166167Z Entering 'third_party/gloo' 2025-03-14T03:56:00.3257940Z Entering 'third_party/googletest' 2025-03-14T03:56:00.3353495Z Entering 'third_party/ideep' 2025-03-14T03:56:00.3463269Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T03:56:00.3588992Z Entering 'third_party/ittapi' 2025-03-14T03:56:00.3674349Z Entering 'third_party/kineto' 2025-03-14T03:56:00.3793543Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T03:56:00.3908207Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T03:56:00.4014575Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T03:56:00.4109869Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T03:56:00.4205948Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T03:56:00.4312105Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T03:56:00.4411357Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T03:56:00.4517484Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T03:56:00.4629427Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T03:56:00.4727788Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T03:56:00.4830465Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T03:56:00.4929483Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T03:56:00.5040203Z Entering 'third_party/kleidiai' 2025-03-14T03:56:00.5144086Z Entering 'third_party/mimalloc' 2025-03-14T03:56:00.5242100Z Entering 'third_party/nlohmann' 2025-03-14T03:56:00.5343807Z Entering 'third_party/onnx' 2025-03-14T03:56:00.5528226Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T03:56:00.5625082Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T03:56:00.5743112Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T03:56:00.5840843Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T03:56:00.5935979Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T03:56:00.6033256Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T03:56:00.6127536Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T03:56:00.6219877Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T03:56:00.6309492Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T03:56:00.6424618Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T03:56:00.6535666Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T03:56:00.6652694Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T03:56:00.6808976Z Entering 'third_party/pocketfft' 2025-03-14T03:56:00.6902611Z Entering 'third_party/protobuf' 2025-03-14T03:56:00.7052033Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T03:56:00.7151886Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T03:56:00.7232305Z Entering 'third_party/psimd' 2025-03-14T03:56:00.7323454Z Entering 'third_party/pthreadpool' 2025-03-14T03:56:00.7413987Z Entering 'third_party/pybind11' 2025-03-14T03:56:00.7505944Z Entering 'third_party/python-peachpy' 2025-03-14T03:56:00.7598261Z Entering 'third_party/sleef' 2025-03-14T03:56:00.7693116Z Entering 'third_party/tensorpipe' 2025-03-14T03:56:00.7801856Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T03:56:00.7896628Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T03:56:00.7992638Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T03:56:00.8085761Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T03:56:00.8175037Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T03:56:00.8254885Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T03:56:00.8273360Z http.https://github.com/.extraheader 2025-03-14T03:56:00.8283012Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-03-14T03:56:00.8324333Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T03:56:00.8615621Z Entering 'android/libs/fbjni' 2025-03-14T03:56:00.8669573Z Entering 'third_party/FP16' 2025-03-14T03:56:00.8725026Z Entering 'third_party/FXdiv' 2025-03-14T03:56:00.8778785Z Entering 'third_party/NNPACK' 2025-03-14T03:56:00.8832565Z Entering 'third_party/NVTX' 2025-03-14T03:56:00.8886261Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T03:56:00.8939621Z Entering 'third_party/XNNPACK' 2025-03-14T03:56:00.9009234Z Entering 'third_party/benchmark' 2025-03-14T03:56:00.9063262Z Entering 'third_party/composable_kernel' 2025-03-14T03:56:00.9123790Z Entering 'third_party/cpp-httplib' 2025-03-14T03:56:00.9178823Z Entering 'third_party/cpuinfo' 2025-03-14T03:56:00.9233620Z Entering 'third_party/cudnn_frontend' 2025-03-14T03:56:00.9287019Z Entering 'third_party/cutlass' 2025-03-14T03:56:00.9349371Z Entering 'third_party/eigen' 2025-03-14T03:56:00.9405699Z Entering 'third_party/fbgemm' 2025-03-14T03:56:00.9459197Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T03:56:00.9513076Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T03:56:00.9567770Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T03:56:00.9626552Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T03:56:00.9679741Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T03:56:00.9734406Z Entering 'third_party/flash-attention' 2025-03-14T03:56:00.9788589Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T03:56:00.9847333Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T03:56:00.9909944Z Entering 'third_party/flatbuffers' 2025-03-14T03:56:00.9966475Z Entering 'third_party/fmt' 2025-03-14T03:56:01.0020077Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T03:56:01.0073900Z Entering 'third_party/gloo' 2025-03-14T03:56:01.0128399Z Entering 'third_party/googletest' 2025-03-14T03:56:01.0181702Z Entering 'third_party/ideep' 2025-03-14T03:56:01.0233968Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T03:56:01.0295663Z Entering 'third_party/ittapi' 2025-03-14T03:56:01.0349432Z Entering 'third_party/kineto' 2025-03-14T03:56:01.0403838Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T03:56:01.0456329Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T03:56:01.0511430Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T03:56:01.0565253Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T03:56:01.0619162Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T03:56:01.0671512Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T03:56:01.0727081Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T03:56:01.0780178Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T03:56:01.0832918Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T03:56:01.0887774Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T03:56:01.0941028Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T03:56:01.0993350Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T03:56:01.1046863Z Entering 'third_party/kleidiai' 2025-03-14T03:56:01.1100588Z Entering 'third_party/mimalloc' 2025-03-14T03:56:01.1156816Z Entering 'third_party/nlohmann' 2025-03-14T03:56:01.1212781Z Entering 'third_party/onnx' 2025-03-14T03:56:01.1283092Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T03:56:01.1338483Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T03:56:01.1393827Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T03:56:01.1446050Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T03:56:01.1499171Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T03:56:01.1550555Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T03:56:01.1604312Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T03:56:01.1655927Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T03:56:01.1709004Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T03:56:01.1760115Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T03:56:01.1814608Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T03:56:01.1869610Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T03:56:01.1943945Z Entering 'third_party/pocketfft' 2025-03-14T03:56:01.1997721Z Entering 'third_party/protobuf' 2025-03-14T03:56:01.2054913Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T03:56:01.2108732Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T03:56:01.2162864Z Entering 'third_party/psimd' 2025-03-14T03:56:01.2216329Z Entering 'third_party/pthreadpool' 2025-03-14T03:56:01.2269524Z Entering 'third_party/pybind11' 2025-03-14T03:56:01.2322677Z Entering 'third_party/python-peachpy' 2025-03-14T03:56:01.2376715Z Entering 'third_party/sleef' 2025-03-14T03:56:01.2429837Z Entering 'third_party/tensorpipe' 2025-03-14T03:56:01.2483228Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T03:56:01.2534659Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T03:56:01.2587513Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T03:56:01.2638710Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T03:56:01.2690325Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T03:56:01.2829462Z A job completed hook has been configured by the self-hosted runner administrator 2025-03-14T03:56:01.2861773Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2025-03-14T03:56:01.2869110Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T03:56:01.2869539Z ##[endgroup] 2025-03-14T03:56:17.3397260Z Cleaning up orphan processes