2026-02-21T08:04:42.6195581Z Current runner version: '2.331.0'
2026-02-21T08:04:42.6201260Z Runner name: 'i-094f68f2a7449fe73-1002'
2026-02-21T08:04:42.6202126Z Runner group name: 'default'
2026-02-21T08:04:42.6202898Z Machine name: '596000b1b1a4'
2026-02-21T08:04:42.6205520Z ##[group]GITHUB_TOKEN Permissions
2026-02-21T08:04:42.6207464Z Contents: read
2026-02-21T08:04:42.6208125Z Metadata: read
2026-02-21T08:04:42.6208587Z ##[endgroup]
2026-02-21T08:04:42.6210579Z Secret source: Actions
2026-02-21T08:04:42.6211337Z Prepare workflow directory
2026-02-21T08:04:42.6743449Z Prepare all required actions
2026-02-21T08:04:42.6778488Z Getting action download info
2026-02-21T08:04:43.0306657Z Download action repository 'actions/checkout@v6' (SHA:de0fac2e4500dabe0009e67214ff5f5447ce83dd)
2026-02-21T08:04:43.3194376Z Download action repository 'actions/setup-python@v6' (SHA:a309ff8b426b58ec0e2a45f0f869d46889d02405)
2026-02-21T08:04:43.6951518Z Download action repository 'astral-sh/setup-uv@v7' (SHA:eac588ad8def6316056a12d4907a9d4d84ff7a3b)
2026-02-21T08:04:44.0717178Z Download action repository 'pytorch/test-infra@main' (SHA:bb8f04ff3961233c844fde6533c7c6c5f0857909)
2026-02-21T08:04:46.4543462Z Download action repository 'actions/upload-artifact@v6' (SHA:b7c566a772e6b6bfb58ed0dc250532a479d7789f)
2026-02-21T08:04:47.2335193Z Getting action download info
2026-02-21T08:04:47.4112726Z Uses: pytorch/helion/.github/workflows/benchmark.yml@refs/heads/main (874a7d0cadab18218a84ad3579d329dc95c51820)
2026-02-21T08:04:47.4117158Z ##[group] Inputs
2026-02-21T08:04:47.4117539Z   runner: linux.aws.h100
2026-02-21T08:04:47.4117795Z   python-version: 3.12
2026-02-21T08:04:47.4118246Z   image: nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:04:47.4118556Z   runtime-version: cu128
2026-02-21T08:04:47.4118877Z   container-options: --gpus all
2026-02-21T08:04:47.4119228Z   alias: h100
2026-02-21T08:04:47.4119505Z   kernels: layer_norm
2026-02-21T08:04:47.4119773Z   env-vars: 
2026-02-21T08:04:47.4120079Z   custom-args: 
2026-02-21T08:04:47.4120773Z   run_h100: true
2026-02-21T08:04:47.4121043Z   run_b200: true
2026-02-21T08:04:47.4121410Z   run_mi325x: true
2026-02-21T08:04:47.4121654Z ##[endgroup]
2026-02-21T08:04:47.4122056Z Complete job name: run-h100 (layer_norm) / benchmark-cu128-layer_norm-py3.12-h100
2026-02-21T08:04:47.4502136Z ##[group]Checking docker version
2026-02-21T08:04:47.4514315Z ##[command]/usr/bin/docker version --format '{{.Server.APIVersion}}'
2026-02-21T08:04:47.4720903Z '1.53'
2026-02-21T08:04:47.4738587Z Docker daemon API version: '1.53'
2026-02-21T08:04:47.4739072Z ##[command]/usr/bin/docker version --format '{{.Client.APIVersion}}'
2026-02-21T08:04:47.4925848Z '1.52'
2026-02-21T08:04:47.4941282Z Docker client API version: '1.52'
2026-02-21T08:04:47.4947635Z ##[endgroup]
2026-02-21T08:04:47.4950096Z ##[group]Clean up resources from previous jobs
2026-02-21T08:04:47.4955138Z ##[command]/usr/bin/docker ps --all --quiet --no-trunc --filter "label=deba0e"
2026-02-21T08:04:47.5097831Z ##[command]/usr/bin/docker network prune --force --filter "label=deba0e"
2026-02-21T08:04:47.5222313Z ##[endgroup]
2026-02-21T08:04:47.5222581Z ##[group]Create local container network
2026-02-21T08:04:47.5231938Z ##[command]/usr/bin/docker network create --label deba0e github_network_92f0144b3e914f56b98fc7f95480154a
2026-02-21T08:04:47.5691947Z c6f2d877ae5e652ff293c174cc3463025c9019437e663e330a2fb2c37877f8cd
2026-02-21T08:04:47.5711678Z ##[endgroup]
2026-02-21T08:04:47.5735549Z ##[group]Starting job container
2026-02-21T08:04:47.5756407Z ##[command]/usr/bin/docker pull nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:04:47.8677793Z 12.8.1-devel-ubuntu24.04: Pulling from nvidia/cuda
2026-02-21T08:04:48.0499371Z a102f36d092c: Pulling fs layer
2026-02-21T08:04:48.0499865Z 73389fbd088f: Pulling fs layer
2026-02-21T08:04:48.0500204Z 7209097bfb98: Pulling fs layer
2026-02-21T08:04:48.0500500Z cbb9175a9bc5: Pulling fs layer
2026-02-21T08:04:48.0500775Z 545a3ada5b6b: Pulling fs layer
2026-02-21T08:04:48.0501013Z abf026459f52: Pulling fs layer
2026-02-21T08:04:48.0501237Z 398182656c47: Pulling fs layer
2026-02-21T08:04:48.0502030Z 3d6ab8c799cd: Pulling fs layer
2026-02-21T08:04:48.0502267Z 93e2721b7ddd: Pulling fs layer
2026-02-21T08:04:48.0502507Z 5a7813e071bf: Pulling fs layer
2026-02-21T08:04:48.0502751Z 05ec76e31584: Pulling fs layer
2026-02-21T08:04:48.2921729Z 73389fbd088f: Download complete
2026-02-21T08:04:48.2923860Z 7209097bfb98: Download complete
2026-02-21T08:04:48.2927725Z 3d6ab8c799cd: Download complete
2026-02-21T08:04:48.2930347Z a102f36d092c: Download complete
2026-02-21T08:04:48.2932602Z 398182656c47: Download complete
2026-02-21T08:04:48.2935464Z 93e2721b7ddd: Download complete
2026-02-21T08:04:48.2937788Z 545a3ada5b6b: Download complete
2026-02-21T08:04:48.4904257Z 5a7813e071bf: Download complete
2026-02-21T08:04:49.8924459Z 5a7813e071bf: Pull complete
2026-02-21T08:04:50.4903456Z 05ec76e31584: Download complete
2026-02-21T08:07:07.2901672Z cbb9175a9bc5: Download complete
2026-02-21T08:08:08.1903706Z abf026459f52: Download complete
2026-02-21T08:08:08.9919727Z a102f36d092c: Pull complete
2026-02-21T08:08:16.7920372Z 05ec76e31584: Pull complete
2026-02-21T08:08:16.8907057Z 73389fbd088f: Pull complete
2026-02-21T08:08:16.8916003Z 398182656c47: Pull complete
2026-02-21T08:10:26.2918429Z cbb9175a9bc5: Pull complete
2026-02-21T08:10:26.3902921Z 3d6ab8c799cd: Pull complete
2026-02-21T08:10:26.4907877Z 7209097bfb98: Pull complete
2026-02-21T08:10:26.4910868Z 545a3ada5b6b: Pull complete
2026-02-21T08:14:35.5912710Z abf026459f52: Pull complete
2026-02-21T08:14:35.6907320Z 93e2721b7ddd: Pull complete
2026-02-21T08:14:35.6965725Z Digest: sha256:520292dbb4f755fd360766059e62956e9379485d9e073bbd2f6e3c20c270ed66
2026-02-21T08:14:35.6968427Z Status: Downloaded newer image for nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:14:35.6986656Z docker.io/nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:14:35.7090642Z ##[command]/usr/bin/docker create --name 53d02b317a0649e583e7c3d6a8c97e40_nvidiacuda1281develubuntu2404_da14a8 --label deba0e --workdir /__w/helion/helion --network github_network_92f0144b3e914f56b98fc7f95480154a --gpus all -e "HOME=/github/home" -e GITHUB_ACTIONS=true -e CI=true -v "/var/run/docker.sock":"/var/run/docker.sock" -v "/home/bob/_work":"/__w" -v "/home/bob/externals":"/__e":ro -v "/home/bob/_work/_temp":"/__w/_temp" -v "/home/bob/_work/_actions":"/__w/_actions" -v "/home/bob/_work/_tool":"/__w/_tool" -v "/home/bob/_work/_temp/_github_home":"/github/home" -v "/home/bob/_work/_temp/_github_workflow":"/github/workflow" --entrypoint "tail" nvidia/cuda:12.8.1-devel-ubuntu24.04 "-f" "/dev/null"
2026-02-21T08:14:35.8084704Z e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7
2026-02-21T08:14:35.8113369Z ##[command]/usr/bin/docker start e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7
2026-02-21T08:14:36.1921086Z e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7
2026-02-21T08:14:36.1946939Z ##[command]/usr/bin/docker ps --all --filter id=e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 --filter status=running --no-trunc --format "{{.ID}} {{.Status}}"
2026-02-21T08:14:36.2138270Z e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 Up Less than a second
2026-02-21T08:14:36.2164658Z ##[command]/usr/bin/docker inspect --format "{{range .Config.Env}}{{println .}}{{end}}" e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7
2026-02-21T08:14:36.2298064Z HOME=/github/home
2026-02-21T08:14:36.2298322Z GITHUB_ACTIONS=true
2026-02-21T08:14:36.2298520Z CI=true
2026-02-21T08:14:36.2298868Z PATH=/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T08:14:36.2299300Z NVARCH=x86_64
2026-02-21T08:14:36.2307329Z NVIDIA_REQUIRE_CUDA=cuda>=12.8 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=vapps,driver>=470,driver<471 brand=vpc,driver>=470,driver<471 brand=vcs,driver>=470,driver<471 brand=vws,driver>=470,driver<471 brand=cloudgaming,driver>=470,driver<471 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566
2026-02-21T08:14:36.2315777Z NV_CUDA_CUDART_VERSION=12.8.90-1
2026-02-21T08:14:36.2316122Z CUDA_VERSION=12.8.1
2026-02-21T08:14:36.2316330Z LD_LIBRARY_PATH=/usr/local/cuda/lib64
2026-02-21T08:14:36.2316605Z NVIDIA_VISIBLE_DEVICES=all
2026-02-21T08:14:36.2316848Z NVIDIA_DRIVER_CAPABILITIES=compute,utility
2026-02-21T08:14:36.2317106Z NV_CUDA_LIB_VERSION=12.8.1-1
2026-02-21T08:14:36.2317302Z NV_NVTX_VERSION=12.8.90-1
2026-02-21T08:14:36.2317894Z NV_LIBNPP_VERSION=12.3.3.100-1
2026-02-21T08:14:36.2318163Z NV_LIBNPP_PACKAGE=libnpp-12-8=12.3.3.100-1
2026-02-21T08:14:36.2318417Z NV_LIBCUSPARSE_VERSION=12.5.8.93-1
2026-02-21T08:14:36.2318646Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-8
2026-02-21T08:14:36.2318870Z NV_LIBCUBLAS_VERSION=12.8.4.1-1
2026-02-21T08:14:36.2319096Z NV_LIBCUBLAS_PACKAGE=libcublas-12-8=12.8.4.1-1
2026-02-21T08:14:36.2319335Z NV_LIBNCCL_PACKAGE_NAME=libnccl2
2026-02-21T08:14:36.2319545Z NV_LIBNCCL_PACKAGE_VERSION=2.25.1-1
2026-02-21T08:14:36.2319769Z NCCL_VERSION=2.25.1-1
2026-02-21T08:14:36.2319970Z NV_LIBNCCL_PACKAGE=libnccl2=2.25.1-1+cuda12.8
2026-02-21T08:14:36.2320200Z NVIDIA_PRODUCT_NAME=CUDA
2026-02-21T08:14:36.2320393Z NV_CUDA_CUDART_DEV_VERSION=12.8.90-1
2026-02-21T08:14:36.2320605Z NV_NVML_DEV_VERSION=12.8.90-1
2026-02-21T08:14:36.2320807Z NV_LIBCUSPARSE_DEV_VERSION=12.5.8.93-1
2026-02-21T08:14:36.2321031Z NV_LIBNPP_DEV_VERSION=12.3.3.100-1
2026-02-21T08:14:36.2321275Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-8=12.3.3.100-1
2026-02-21T08:14:36.2321573Z NV_LIBCUBLAS_DEV_VERSION=12.8.4.1-1
2026-02-21T08:14:36.2321832Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-8
2026-02-21T08:14:36.2322118Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-8=12.8.4.1-1
2026-02-21T08:14:36.2322400Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.8.1-1
2026-02-21T08:14:36.2322699Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-8=12.8.1-1
2026-02-21T08:14:36.2323010Z NV_NVPROF_VERSION=12.8.90-1
2026-02-21T08:14:36.2323231Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-8=12.8.90-1
2026-02-21T08:14:36.2323480Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev
2026-02-21T08:14:36.2323725Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.25.1-1
2026-02-21T08:14:36.2324162Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.25.1-1+cuda12.8
2026-02-21T08:14:36.2324452Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs
2026-02-21T08:14:36.2331975Z ##[endgroup]
2026-02-21T08:14:36.2340641Z ##[group]Waiting for all services to be ready
2026-02-21T08:14:36.2342107Z ##[endgroup]
2026-02-21T08:14:36.2524250Z ##[group]Run echo "Detected NVIDIA image"
2026-02-21T08:14:36.2524625Z echo "Detected NVIDIA image"
2026-02-21T08:14:36.2524960Z nvidia-smi || echo "nvidia-smi not found"
2026-02-21T08:14:36.2527743Z shell: bash -l {0}
2026-02-21T08:14:36.2528188Z env:
2026-02-21T08:14:36.2528374Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:36.2528601Z ##[endgroup]
2026-02-21T08:14:36.3242967Z Detected NVIDIA image
2026-02-21T08:14:36.3425026Z Sat Feb 21 08:14:36 2026       
2026-02-21T08:14:36.3425432Z +-----------------------------------------------------------------------------------------+
2026-02-21T08:14:36.3425978Z | NVIDIA-SMI 580.95.05              Driver Version: 580.95.05      CUDA Version: 13.0     |
2026-02-21T08:14:36.3426512Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T08:14:36.3427077Z | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
2026-02-21T08:14:36.3427714Z | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
2026-02-21T08:14:36.3428186Z |                                         |                        |               MIG M. |
2026-02-21T08:14:36.3428569Z |=========================================+========================+======================|
2026-02-21T08:14:36.3671158Z |   0  NVIDIA H100 80GB HBM3          On  |   00000000:64:00.0 Off |                    0 |
2026-02-21T08:14:36.3671772Z | N/A   36C    P0             72W /  500W |       0MiB /  81559MiB |      0%      Default |
2026-02-21T08:14:36.3672214Z |                                         |                        |             Disabled |
2026-02-21T08:14:36.3672650Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T08:14:36.3674321Z 
2026-02-21T08:14:36.3674537Z +-----------------------------------------------------------------------------------------+
2026-02-21T08:14:36.3675041Z | Processes:                                                                              |
2026-02-21T08:14:36.3675502Z |  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
2026-02-21T08:14:36.3676010Z |        ID   ID                                                               Usage      |
2026-02-21T08:14:36.3676382Z |=========================================================================================|
2026-02-21T08:14:36.3708498Z |  No running processes found                                                             |
2026-02-21T08:14:36.3709044Z +-----------------------------------------------------------------------------------------+
2026-02-21T08:14:36.4730020Z ##[group]Run set -x
2026-02-21T08:14:36.4730386Z set -x
2026-02-21T08:14:36.4730615Z apt-get update
2026-02-21T08:14:36.4730910Z apt-get install -y git
2026-02-21T08:14:36.4731239Z shell: bash -l {0}
2026-02-21T08:14:36.4731473Z env:
2026-02-21T08:14:36.4731677Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:36.4731915Z ##[endgroup]
2026-02-21T08:14:36.6582588Z + apt-get update
2026-02-21T08:14:36.7489556Z Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64  InRelease [1581 B]
2026-02-21T08:14:36.7561030Z Get:2 http://security.ubuntu.com/ubuntu noble-security InRelease [126 kB]
2026-02-21T08:14:36.8971169Z Get:3 http://archive.ubuntu.com/ubuntu noble InRelease [256 kB]
2026-02-21T08:14:36.9065208Z Get:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64  Packages [1218 kB]
2026-02-21T08:14:36.9814606Z Get:5 http://security.ubuntu.com/ubuntu noble-security/main amd64 Packages [1857 kB]
2026-02-21T08:14:37.1188107Z Get:6 http://security.ubuntu.com/ubuntu noble-security/multiverse amd64 Packages [34.8 kB]
2026-02-21T08:14:37.1190922Z Get:7 http://security.ubuntu.com/ubuntu noble-security/universe amd64 Packages [1207 kB]
2026-02-21T08:14:37.1302663Z Get:8 http://security.ubuntu.com/ubuntu noble-security/restricted amd64 Packages [3196 kB]
2026-02-21T08:14:37.4502623Z Get:9 http://archive.ubuntu.com/ubuntu noble-updates InRelease [126 kB]
2026-02-21T08:14:37.5925851Z Get:10 http://archive.ubuntu.com/ubuntu noble-backports InRelease [126 kB]
2026-02-21T08:14:37.7345508Z Get:11 http://archive.ubuntu.com/ubuntu noble/universe amd64 Packages [19.3 MB]
2026-02-21T08:14:38.5171806Z Get:12 http://archive.ubuntu.com/ubuntu noble/multiverse amd64 Packages [331 kB]
2026-02-21T08:14:38.5214668Z Get:13 http://archive.ubuntu.com/ubuntu noble/main amd64 Packages [1808 kB]
2026-02-21T08:14:38.5569351Z Get:14 http://archive.ubuntu.com/ubuntu noble/restricted amd64 Packages [117 kB]
2026-02-21T08:14:38.5577032Z Get:15 http://archive.ubuntu.com/ubuntu noble-updates/multiverse amd64 Packages [38.1 kB]
2026-02-21T08:14:38.5594705Z Get:16 http://archive.ubuntu.com/ubuntu noble-updates/universe amd64 Packages [2016 kB]
2026-02-21T08:14:38.6072174Z Get:17 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 Packages [2240 kB]
2026-02-21T08:14:38.6515997Z Get:18 http://archive.ubuntu.com/ubuntu noble-updates/restricted amd64 Packages [3381 kB]
2026-02-21T08:14:38.7286638Z Get:19 http://archive.ubuntu.com/ubuntu noble-backports/universe amd64 Packages [34.6 kB]
2026-02-21T08:14:38.7289201Z Get:20 http://archive.ubuntu.com/ubuntu noble-backports/main amd64 Packages [49.5 kB]
2026-02-21T08:14:39.3701687Z Fetched 37.5 MB in 3s (14.1 MB/s)
2026-02-21T08:14:40.1052885Z Reading package lists...
2026-02-21T08:14:40.1212054Z W: https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
2026-02-21T08:14:40.1223508Z + apt-get install -y git
2026-02-21T08:14:40.8783545Z Reading package lists...
2026-02-21T08:14:41.0520476Z Building dependency tree...
2026-02-21T08:14:41.0521271Z Reading state information...
2026-02-21T08:14:41.1963483Z The following additional packages will be installed:
2026-02-21T08:14:41.1964882Z   git-man krb5-locales less libbrotli1 libbsd0 libcbor0.10 libcurl3t64-gnutls
2026-02-21T08:14:41.1965626Z   libedit2 liberror-perl libexpat1 libfido2-1 libgssapi-krb5-2 libk5crypto3
2026-02-21T08:14:41.1968437Z   libkeyutils1 libkrb5-3 libkrb5support0 libnghttp2-14 libpsl5t64 librtmp1
2026-02-21T08:14:41.1971053Z   libssh-4 libx11-6 libx11-data libxau6 libxcb1 libxdmcp6 libxext6 libxmuu1
2026-02-21T08:14:41.1972896Z   openssh-client publicsuffix xauth
2026-02-21T08:14:41.1982426Z Suggested packages:
2026-02-21T08:14:41.1982830Z   gettext-base git-daemon-run | git-daemon-sysvinit git-doc git-email git-gui
2026-02-21T08:14:41.1983870Z   gitk gitweb git-cvs git-mediawiki git-svn krb5-doc krb5-user keychain
2026-02-21T08:14:41.1984533Z   libpam-ssh monkeysphere ssh-askpass
2026-02-21T08:14:41.2615480Z The following NEW packages will be installed:
2026-02-21T08:14:41.2616596Z   git git-man krb5-locales less libbrotli1 libbsd0 libcbor0.10
2026-02-21T08:14:41.2617892Z   libcurl3t64-gnutls libedit2 liberror-perl libexpat1 libfido2-1
2026-02-21T08:14:41.2619403Z   libgssapi-krb5-2 libk5crypto3 libkeyutils1 libkrb5-3 libkrb5support0
2026-02-21T08:14:41.2623940Z   libnghttp2-14 libpsl5t64 librtmp1 libssh-4 libx11-6 libx11-data libxau6
2026-02-21T08:14:41.2631578Z   libxcb1 libxdmcp6 libxext6 libxmuu1 openssh-client publicsuffix xauth
2026-02-21T08:14:41.4669057Z 0 upgraded, 31 newly installed, 0 to remove and 92 not upgraded.
2026-02-21T08:14:41.4669452Z Need to get 8886 kB of archives.
2026-02-21T08:14:41.4669851Z After this operation, 38.0 MB of additional disk space will be used.
2026-02-21T08:14:41.4670915Z Get:1 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 krb5-locales all 1.20.1-6ubuntu2.6 [14.8 kB]
2026-02-21T08:14:41.6472505Z Get:2 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 less amd64 590-2ubuntu2.1 [142 kB]
2026-02-21T08:14:41.8947988Z Get:3 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libbsd0 amd64 0.12.1-1build1.1 [41.2 kB]
2026-02-21T08:14:41.9443368Z Get:4 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libexpat1 amd64 2.6.1-2ubuntu0.4 [88.2 kB]
2026-02-21T08:14:42.0312653Z Get:5 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libkrb5support0 amd64 1.20.1-6ubuntu2.6 [34.4 kB]
2026-02-21T08:14:42.0448064Z Get:6 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libk5crypto3 amd64 1.20.1-6ubuntu2.6 [82.0 kB]
2026-02-21T08:14:42.0770721Z Get:7 http://archive.ubuntu.com/ubuntu noble/main amd64 libkeyutils1 amd64 1.6.3-3build1 [9490 B]
2026-02-21T08:14:42.0796485Z Get:8 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libkrb5-3 amd64 1.20.1-6ubuntu2.6 [348 kB]
2026-02-21T08:14:42.1792852Z Get:9 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libgssapi-krb5-2 amd64 1.20.1-6ubuntu2.6 [143 kB]
2026-02-21T08:14:42.2020894Z Get:10 http://archive.ubuntu.com/ubuntu noble/main amd64 libcbor0.10 amd64 0.10.2-1.2ubuntu2 [25.8 kB]
2026-02-21T08:14:42.2043082Z Get:11 http://archive.ubuntu.com/ubuntu noble/main amd64 libedit2 amd64 3.1-20230828-1build1 [97.6 kB]
2026-02-21T08:14:42.2200496Z Get:12 http://archive.ubuntu.com/ubuntu noble/main amd64 libfido2-1 amd64 1.14.0-1build3 [83.5 kB]
2026-02-21T08:14:42.2290030Z Get:13 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libnghttp2-14 amd64 1.59.0-1ubuntu0.2 [74.3 kB]
2026-02-21T08:14:42.2379703Z Get:14 http://archive.ubuntu.com/ubuntu noble/main amd64 libpsl5t64 amd64 0.21.2-1.1build1 [57.1 kB]
2026-02-21T08:14:42.2455269Z Get:15 http://archive.ubuntu.com/ubuntu noble/main amd64 libxau6 amd64 1:1.0.9-1build6 [7160 B]
2026-02-21T08:14:42.2457090Z Get:16 http://archive.ubuntu.com/ubuntu noble/main amd64 libxdmcp6 amd64 1:1.1.3-0ubuntu6 [10.3 kB]
2026-02-21T08:14:42.2462183Z Get:17 http://archive.ubuntu.com/ubuntu noble/main amd64 libxcb1 amd64 1.15-1ubuntu2 [47.7 kB]
2026-02-21T08:14:42.2694475Z Get:18 http://archive.ubuntu.com/ubuntu noble/main amd64 libx11-data all 2:1.8.7-1build1 [115 kB]
2026-02-21T08:14:42.2922625Z Get:19 http://archive.ubuntu.com/ubuntu noble/main amd64 libx11-6 amd64 2:1.8.7-1build1 [650 kB]
2026-02-21T08:14:42.3332747Z Get:20 http://archive.ubuntu.com/ubuntu noble/main amd64 libxext6 amd64 2:1.3.4-1build2 [30.4 kB]
2026-02-21T08:14:42.3354985Z Get:21 http://archive.ubuntu.com/ubuntu noble/main amd64 libxmuu1 amd64 2:1.1.3-3build2 [8958 B]
2026-02-21T08:14:42.3357522Z Get:22 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 openssh-client amd64 1:9.6p1-3ubuntu13.14 [906 kB]
2026-02-21T08:14:42.3913728Z Get:23 http://archive.ubuntu.com/ubuntu noble/main amd64 publicsuffix all 20231001.0357-0.1 [129 kB]
2026-02-21T08:14:42.3977621Z Get:24 http://archive.ubuntu.com/ubuntu noble/main amd64 xauth amd64 1:1.1.2-1build1 [25.6 kB]
2026-02-21T08:14:42.3996275Z Get:25 http://archive.ubuntu.com/ubuntu noble/main amd64 libbrotli1 amd64 1.1.0-2build2 [331 kB]
2026-02-21T08:14:42.4152099Z Get:26 http://archive.ubuntu.com/ubuntu noble/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build7 [56.3 kB]
2026-02-21T08:14:42.4177229Z Get:27 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libssh-4 amd64 0.10.6-2ubuntu0.3 [190 kB]
2026-02-21T08:14:42.4249640Z Get:28 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libcurl3t64-gnutls amd64 8.5.0-2ubuntu10.6 [333 kB]
2026-02-21T08:14:42.4369059Z Get:29 http://archive.ubuntu.com/ubuntu noble/main amd64 liberror-perl all 0.17029-2 [25.6 kB]
2026-02-21T08:14:42.4371568Z Get:30 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 git-man all 1:2.43.0-1ubuntu7.3 [1100 kB]
2026-02-21T08:14:42.4662103Z Get:31 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 git amd64 1:2.43.0-1ubuntu7.3 [3680 kB]
2026-02-21T08:14:42.6871219Z debconf: delaying package configuration, since apt-utils is not installed
2026-02-21T08:14:42.7292693Z Fetched 8886 kB in 1s (6985 kB/s)
2026-02-21T08:14:42.7753864Z Selecting previously unselected package krb5-locales.
2026-02-21T08:14:42.7791924Z (Reading database ... 
2026-02-21T08:14:42.7792181Z (Reading database ... 5%
2026-02-21T08:14:42.7792426Z (Reading database ... 10%
2026-02-21T08:14:42.7792654Z (Reading database ... 15%
2026-02-21T08:14:42.7800656Z (Reading database ... 20%
2026-02-21T08:14:42.7800919Z (Reading database ... 25%
2026-02-21T08:14:42.7801189Z (Reading database ... 30%
2026-02-21T08:14:42.7801393Z (Reading database ... 35%
2026-02-21T08:14:42.7801618Z (Reading database ... 40%
2026-02-21T08:14:42.7801825Z (Reading database ... 45%
2026-02-21T08:14:42.7802027Z (Reading database ... 50%
2026-02-21T08:14:42.7802226Z (Reading database ... 55%
2026-02-21T08:14:42.7802419Z (Reading database ... 60%
2026-02-21T08:14:42.7807146Z (Reading database ... 65%
2026-02-21T08:14:42.7815611Z (Reading database ... 70%
2026-02-21T08:14:42.7822868Z (Reading database ... 75%
2026-02-21T08:14:42.7824781Z (Reading database ... 80%
2026-02-21T08:14:42.7830944Z (Reading database ... 85%
2026-02-21T08:14:42.7837167Z (Reading database ... 90%
2026-02-21T08:14:42.7850485Z (Reading database ... 95%
2026-02-21T08:14:42.7850695Z (Reading database ... 100%
2026-02-21T08:14:42.7851018Z (Reading database ... 15165 files and directories currently installed.)
2026-02-21T08:14:42.7864381Z Preparing to unpack .../00-krb5-locales_1.20.1-6ubuntu2.6_all.deb ...
2026-02-21T08:14:42.7965204Z Unpacking krb5-locales (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:42.8762720Z Selecting previously unselected package less.
2026-02-21T08:14:42.8781228Z Preparing to unpack .../01-less_590-2ubuntu2.1_amd64.deb ...
2026-02-21T08:14:42.8887448Z Unpacking less (590-2ubuntu2.1) ...
2026-02-21T08:14:42.9717611Z Selecting previously unselected package libbsd0:amd64.
2026-02-21T08:14:42.9736117Z Preparing to unpack .../02-libbsd0_0.12.1-1build1.1_amd64.deb ...
2026-02-21T08:14:42.9932324Z Unpacking libbsd0:amd64 (0.12.1-1build1.1) ...
2026-02-21T08:14:43.0786501Z Selecting previously unselected package libexpat1:amd64.
2026-02-21T08:14:43.0799012Z Preparing to unpack .../03-libexpat1_2.6.1-2ubuntu0.4_amd64.deb ...
2026-02-21T08:14:43.0871891Z Unpacking libexpat1:amd64 (2.6.1-2ubuntu0.4) ...
2026-02-21T08:14:43.1598011Z Selecting previously unselected package libkrb5support0:amd64.
2026-02-21T08:14:43.1610290Z Preparing to unpack .../04-libkrb5support0_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:43.1724715Z Unpacking libkrb5support0:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:43.2496780Z Selecting previously unselected package libk5crypto3:amd64.
2026-02-21T08:14:43.2506767Z Preparing to unpack .../05-libk5crypto3_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:43.2603217Z Unpacking libk5crypto3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:43.3320428Z Selecting previously unselected package libkeyutils1:amd64.
2026-02-21T08:14:43.3331173Z Preparing to unpack .../06-libkeyutils1_1.6.3-3build1_amd64.deb ...
2026-02-21T08:14:43.3429028Z Unpacking libkeyutils1:amd64 (1.6.3-3build1) ...
2026-02-21T08:14:43.4138190Z Selecting previously unselected package libkrb5-3:amd64.
2026-02-21T08:14:43.4149087Z Preparing to unpack .../07-libkrb5-3_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:43.4236221Z Unpacking libkrb5-3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:43.5251059Z Selecting previously unselected package libgssapi-krb5-2:amd64.
2026-02-21T08:14:43.5262343Z Preparing to unpack .../08-libgssapi-krb5-2_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:43.5371347Z Unpacking libgssapi-krb5-2:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:43.6189278Z Selecting previously unselected package libcbor0.10:amd64.
2026-02-21T08:14:43.6199586Z Preparing to unpack .../09-libcbor0.10_0.10.2-1.2ubuntu2_amd64.deb ...
2026-02-21T08:14:43.6301389Z Unpacking libcbor0.10:amd64 (0.10.2-1.2ubuntu2) ...
2026-02-21T08:14:43.7034819Z Selecting previously unselected package libedit2:amd64.
2026-02-21T08:14:43.7047604Z Preparing to unpack .../10-libedit2_3.1-20230828-1build1_amd64.deb ...
2026-02-21T08:14:43.7171991Z Unpacking libedit2:amd64 (3.1-20230828-1build1) ...
2026-02-21T08:14:43.8031135Z Selecting previously unselected package libfido2-1:amd64.
2026-02-21T08:14:43.8045141Z Preparing to unpack .../11-libfido2-1_1.14.0-1build3_amd64.deb ...
2026-02-21T08:14:43.8146335Z Unpacking libfido2-1:amd64 (1.14.0-1build3) ...
2026-02-21T08:14:43.8978063Z Selecting previously unselected package libnghttp2-14:amd64.
2026-02-21T08:14:43.8988900Z Preparing to unpack .../12-libnghttp2-14_1.59.0-1ubuntu0.2_amd64.deb ...
2026-02-21T08:14:43.9106118Z Unpacking libnghttp2-14:amd64 (1.59.0-1ubuntu0.2) ...
2026-02-21T08:14:43.9984357Z Selecting previously unselected package libpsl5t64:amd64.
2026-02-21T08:14:43.9994444Z Preparing to unpack .../13-libpsl5t64_0.21.2-1.1build1_amd64.deb ...
2026-02-21T08:14:44.0105538Z Unpacking libpsl5t64:amd64 (0.21.2-1.1build1) ...
2026-02-21T08:14:44.0884601Z Selecting previously unselected package libxau6:amd64.
2026-02-21T08:14:44.0894401Z Preparing to unpack .../14-libxau6_1%3a1.0.9-1build6_amd64.deb ...
2026-02-21T08:14:44.0980744Z Unpacking libxau6:amd64 (1:1.0.9-1build6) ...
2026-02-21T08:14:44.1617951Z Selecting previously unselected package libxdmcp6:amd64.
2026-02-21T08:14:44.1628055Z Preparing to unpack .../15-libxdmcp6_1%3a1.1.3-0ubuntu6_amd64.deb ...
2026-02-21T08:14:44.1704295Z Unpacking libxdmcp6:amd64 (1:1.1.3-0ubuntu6) ...
2026-02-21T08:14:44.2518938Z Selecting previously unselected package libxcb1:amd64.
2026-02-21T08:14:44.2528966Z Preparing to unpack .../16-libxcb1_1.15-1ubuntu2_amd64.deb ...
2026-02-21T08:14:44.2637736Z Unpacking libxcb1:amd64 (1.15-1ubuntu2) ...
2026-02-21T08:14:44.3347368Z Selecting previously unselected package libx11-data.
2026-02-21T08:14:44.3364967Z Preparing to unpack .../17-libx11-data_2%3a1.8.7-1build1_all.deb ...
2026-02-21T08:14:44.3471746Z Unpacking libx11-data (2:1.8.7-1build1) ...
2026-02-21T08:14:44.5131950Z Selecting previously unselected package libx11-6:amd64.
2026-02-21T08:14:44.5147331Z Preparing to unpack .../18-libx11-6_2%3a1.8.7-1build1_amd64.deb ...
2026-02-21T08:14:44.5248164Z Unpacking libx11-6:amd64 (2:1.8.7-1build1) ...
2026-02-21T08:14:44.6102481Z Selecting previously unselected package libxext6:amd64.
2026-02-21T08:14:44.6113781Z Preparing to unpack .../19-libxext6_2%3a1.3.4-1build2_amd64.deb ...
2026-02-21T08:14:44.6210621Z Unpacking libxext6:amd64 (2:1.3.4-1build2) ...
2026-02-21T08:14:44.6905267Z Selecting previously unselected package libxmuu1:amd64.
2026-02-21T08:14:44.6915289Z Preparing to unpack .../20-libxmuu1_2%3a1.1.3-3build2_amd64.deb ...
2026-02-21T08:14:44.6998767Z Unpacking libxmuu1:amd64 (2:1.1.3-3build2) ...
2026-02-21T08:14:44.7929998Z Selecting previously unselected package openssh-client.
2026-02-21T08:14:44.7940246Z Preparing to unpack .../21-openssh-client_1%3a9.6p1-3ubuntu13.14_amd64.deb ...
2026-02-21T08:14:44.8102570Z Unpacking openssh-client (1:9.6p1-3ubuntu13.14) ...
2026-02-21T08:14:44.9453305Z Selecting previously unselected package publicsuffix.
2026-02-21T08:14:44.9464867Z Preparing to unpack .../22-publicsuffix_20231001.0357-0.1_all.deb ...
2026-02-21T08:14:44.9575629Z Unpacking publicsuffix (20231001.0357-0.1) ...
2026-02-21T08:14:45.0226730Z Selecting previously unselected package xauth.
2026-02-21T08:14:45.0237179Z Preparing to unpack .../23-xauth_1%3a1.1.2-1build1_amd64.deb ...
2026-02-21T08:14:45.0343442Z Unpacking xauth (1:1.1.2-1build1) ...
2026-02-21T08:14:45.1165976Z Selecting previously unselected package libbrotli1:amd64.
2026-02-21T08:14:45.1176880Z Preparing to unpack .../24-libbrotli1_1.1.0-2build2_amd64.deb ...
2026-02-21T08:14:45.1286062Z Unpacking libbrotli1:amd64 (1.1.0-2build2) ...
2026-02-21T08:14:45.2206876Z Selecting previously unselected package librtmp1:amd64.
2026-02-21T08:14:45.2218497Z Preparing to unpack .../25-librtmp1_2.4+20151223.gitfa8646d.1-2build7_amd64.deb ...
2026-02-21T08:14:45.2311118Z Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build7) ...
2026-02-21T08:14:45.3133229Z Selecting previously unselected package libssh-4:amd64.
2026-02-21T08:14:45.3143257Z Preparing to unpack .../26-libssh-4_0.10.6-2ubuntu0.3_amd64.deb ...
2026-02-21T08:14:45.3265711Z Unpacking libssh-4:amd64 (0.10.6-2ubuntu0.3) ...
2026-02-21T08:14:45.4118848Z Selecting previously unselected package libcurl3t64-gnutls:amd64.
2026-02-21T08:14:45.4130164Z Preparing to unpack .../27-libcurl3t64-gnutls_8.5.0-2ubuntu10.6_amd64.deb ...
2026-02-21T08:14:45.4277729Z Unpacking libcurl3t64-gnutls:amd64 (8.5.0-2ubuntu10.6) ...
2026-02-21T08:14:45.4923287Z Selecting previously unselected package liberror-perl.
2026-02-21T08:14:45.4932869Z Preparing to unpack .../28-liberror-perl_0.17029-2_all.deb ...
2026-02-21T08:14:45.5013377Z Unpacking liberror-perl (0.17029-2) ...
2026-02-21T08:14:45.5732486Z Selecting previously unselected package git-man.
2026-02-21T08:14:45.5743097Z Preparing to unpack .../29-git-man_1%3a2.43.0-1ubuntu7.3_all.deb ...
2026-02-21T08:14:45.5820003Z Unpacking git-man (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:45.6733877Z Selecting previously unselected package git.
2026-02-21T08:14:45.6748962Z Preparing to unpack .../30-git_1%3a2.43.0-1ubuntu7.3_amd64.deb ...
2026-02-21T08:14:45.6908596Z Unpacking git (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:45.9910403Z Setting up libexpat1:amd64 (2.6.1-2ubuntu0.4) ...
2026-02-21T08:14:46.0203764Z Setting up libxau6:amd64 (1:1.0.9-1build6) ...
2026-02-21T08:14:46.0506678Z Setting up libkeyutils1:amd64 (1.6.3-3build1) ...
2026-02-21T08:14:46.0775846Z Setting up libcbor0.10:amd64 (0.10.2-1.2ubuntu2) ...
2026-02-21T08:14:46.1043450Z Setting up libbrotli1:amd64 (1.1.0-2build2) ...
2026-02-21T08:14:46.1333153Z Setting up libpsl5t64:amd64 (0.21.2-1.1build1) ...
2026-02-21T08:14:46.1617045Z Setting up libnghttp2-14:amd64 (1.59.0-1ubuntu0.2) ...
2026-02-21T08:14:46.1882633Z Setting up less (590-2ubuntu2.1) ...
2026-02-21T08:14:46.2433239Z Setting up krb5-locales (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.2714355Z Setting up libkrb5support0:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.2992483Z Setting up liberror-perl (0.17029-2) ...
2026-02-21T08:14:46.3267487Z Setting up libx11-data (2:1.8.7-1build1) ...
2026-02-21T08:14:46.3595280Z Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build7) ...
2026-02-21T08:14:46.3882063Z Setting up libk5crypto3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.4164460Z Setting up git-man (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:46.4481298Z Setting up libkrb5-3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.4828517Z Setting up libfido2-1:amd64 (1.14.0-1build3) ...
2026-02-21T08:14:46.5080215Z Setting up libbsd0:amd64 (0.12.1-1build1.1) ...
2026-02-21T08:14:46.5381360Z Setting up publicsuffix (20231001.0357-0.1) ...
2026-02-21T08:14:46.5621106Z Setting up libxdmcp6:amd64 (1:1.1.3-0ubuntu6) ...
2026-02-21T08:14:46.5864367Z Setting up libxcb1:amd64 (1.15-1ubuntu2) ...
2026-02-21T08:14:46.6195624Z Setting up libedit2:amd64 (3.1-20230828-1build1) ...
2026-02-21T08:14:46.6456533Z Setting up libgssapi-krb5-2:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.6775274Z Setting up libssh-4:amd64 (0.10.6-2ubuntu0.3) ...
2026-02-21T08:14:46.7086879Z Setting up libx11-6:amd64 (2:1.8.7-1build1) ...
2026-02-21T08:14:46.7364468Z Setting up libxmuu1:amd64 (2:1.1.3-3build2) ...
2026-02-21T08:14:46.7608262Z Setting up openssh-client (1:9.6p1-3ubuntu13.14) ...
2026-02-21T08:14:46.8912322Z Setting up libcurl3t64-gnutls:amd64 (8.5.0-2ubuntu10.6) ...
2026-02-21T08:14:46.9157289Z Setting up libxext6:amd64 (2:1.3.4-1build2) ...
2026-02-21T08:14:46.9402141Z Setting up git (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:46.9801580Z Setting up xauth (1:1.1.2-1build1) ...
2026-02-21T08:14:47.0051457Z Processing triggers for libc-bin (2.39-0ubuntu8.4) ...
2026-02-21T08:14:47.1085377Z ##[group]Run actions/checkout@v6
2026-02-21T08:14:47.1085640Z with:
2026-02-21T08:14:47.1085821Z   repository: pytorch/helion
2026-02-21T08:14:47.1086158Z   token: ***
2026-02-21T08:14:47.1086327Z   ssh-strict: true
2026-02-21T08:14:47.1086486Z   ssh-user: git
2026-02-21T08:14:47.1086664Z   persist-credentials: true
2026-02-21T08:14:47.1086871Z   clean: true
2026-02-21T08:14:47.1087038Z   sparse-checkout-cone-mode: true
2026-02-21T08:14:47.1087250Z   fetch-depth: 1
2026-02-21T08:14:47.1087695Z   fetch-tags: false
2026-02-21T08:14:47.1087862Z   show-progress: true
2026-02-21T08:14:47.1088027Z   lfs: false
2026-02-21T08:14:47.1088173Z   submodules: false
2026-02-21T08:14:47.1088332Z   set-safe-directory: true
2026-02-21T08:14:47.1088518Z env:
2026-02-21T08:14:47.1088677Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:47.1088875Z ##[endgroup]
2026-02-21T08:14:47.1127896Z ##[command]/usr/bin/docker exec  e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T08:14:47.3074883Z Syncing repository: pytorch/helion
2026-02-21T08:14:47.3075964Z ##[group]Getting Git version info
2026-02-21T08:14:47.3076229Z Working directory is '/__w/helion/helion'
2026-02-21T08:14:47.3076625Z [command]/usr/bin/git version
2026-02-21T08:14:47.3097113Z git version 2.43.0
2026-02-21T08:14:47.3120895Z ##[endgroup]
2026-02-21T08:14:47.3133432Z Temporarily overriding HOME='/__w/_temp/2369f319-fb03-4d6e-8401-6e2217e81c0c' before making global git config changes
2026-02-21T08:14:47.3134368Z Adding repository directory to the temporary git global config as a safe directory
2026-02-21T08:14:47.3138180Z [command]/usr/bin/git config --global --add safe.directory /__w/helion/helion
2026-02-21T08:14:47.3176001Z Deleting the contents of '/__w/helion/helion'
2026-02-21T08:14:47.3250027Z ##[group]Initializing the repository
2026-02-21T08:14:47.3253471Z [command]/usr/bin/git init /__w/helion/helion
2026-02-21T08:14:47.3289771Z hint: Using 'master' as the name for the initial branch. This default branch name
2026-02-21T08:14:47.3290737Z hint: is subject to change. To configure the initial branch name to use in all
2026-02-21T08:14:47.3291513Z hint: of your new repositories, which will suppress this warning, call:
2026-02-21T08:14:47.3292072Z hint: 
2026-02-21T08:14:47.3292475Z hint: 	git config --global init.defaultBranch <name>
2026-02-21T08:14:47.3292946Z hint: 
2026-02-21T08:14:47.3293390Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2026-02-21T08:14:47.3294452Z hint: 'development'. The just-created branch can be renamed via this command:
2026-02-21T08:14:47.3294965Z hint: 
2026-02-21T08:14:47.3295149Z hint: 	git branch -m <name>
2026-02-21T08:14:47.3320320Z Initialized empty Git repository in /__w/helion/helion/.git/
2026-02-21T08:14:47.3330476Z [command]/usr/bin/git remote add origin https://github.com/pytorch/helion
2026-02-21T08:14:47.3400138Z ##[endgroup]
2026-02-21T08:14:47.3400496Z ##[group]Disabling automatic garbage collection
2026-02-21T08:14:47.3403315Z [command]/usr/bin/git config --local gc.auto 0
2026-02-21T08:14:47.3432009Z ##[endgroup]
2026-02-21T08:14:47.3432307Z ##[group]Setting up auth
2026-02-21T08:14:47.3433411Z Removing SSH command configuration
2026-02-21T08:14:47.3438315Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2026-02-21T08:14:47.3492259Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2026-02-21T08:14:47.3780742Z Removing HTTP extra header
2026-02-21T08:14:47.3784250Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2026-02-21T08:14:47.3813374Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2026-02-21T08:14:47.4090579Z Removing includeIf entries pointing to credentials config files
2026-02-21T08:14:47.4095831Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir:
2026-02-21T08:14:47.4127703Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url
2026-02-21T08:14:47.4408423Z [command]/usr/bin/git config --file /__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config http.https://github.com/.extraheader AUTHORIZATION: basic ***
2026-02-21T08:14:47.4444742Z [command]/usr/bin/git config --local includeIf.gitdir:/__w/helion/helion/.git.path /__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T08:14:47.4475767Z [command]/usr/bin/git config --local includeIf.gitdir:/__w/helion/helion/.git/worktrees/*.path /__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T08:14:47.4506409Z [command]/usr/bin/git config --local includeIf.gitdir:/github/workspace/.git.path /github/runner_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T08:14:47.4536965Z [command]/usr/bin/git config --local includeIf.gitdir:/github/workspace/.git/worktrees/*.path /github/runner_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T08:14:47.4564638Z ##[endgroup]
2026-02-21T08:14:47.4564972Z ##[group]Fetching the repository
2026-02-21T08:14:47.4572089Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --no-recurse-submodules --depth=1 origin +874a7d0cadab18218a84ad3579d329dc95c51820:refs/remotes/origin/main
2026-02-21T08:14:47.9142448Z From https://github.com/pytorch/helion
2026-02-21T08:14:47.9142888Z  * [new ref]         874a7d0cadab18218a84ad3579d329dc95c51820 -> origin/main
2026-02-21T08:14:47.9173514Z [command]/usr/bin/git branch --list --remote origin/main
2026-02-21T08:14:47.9200129Z   origin/main
2026-02-21T08:14:47.9206436Z [command]/usr/bin/git rev-parse refs/remotes/origin/main
2026-02-21T08:14:47.9232762Z 874a7d0cadab18218a84ad3579d329dc95c51820
2026-02-21T08:14:47.9236195Z ##[endgroup]
2026-02-21T08:14:47.9236525Z ##[group]Determining the checkout info
2026-02-21T08:14:47.9238106Z ##[endgroup]
2026-02-21T08:14:47.9242130Z [command]/usr/bin/git sparse-checkout disable
2026-02-21T08:14:47.9290400Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig
2026-02-21T08:14:47.9318735Z ##[group]Checking out the ref
2026-02-21T08:14:47.9322089Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main
2026-02-21T08:14:47.9608055Z Switched to a new branch 'main'
2026-02-21T08:14:47.9608366Z branch 'main' set up to track 'origin/main'.
2026-02-21T08:14:47.9614153Z ##[endgroup]
2026-02-21T08:14:47.9653482Z [command]/usr/bin/git log -1 --format=%H
2026-02-21T08:14:47.9680154Z 874a7d0cadab18218a84ad3579d329dc95c51820
2026-02-21T08:14:47.9872286Z ##[group]Run actions/setup-python@v6
2026-02-21T08:14:47.9872552Z with:
2026-02-21T08:14:47.9872713Z   python-version: 3.12
2026-02-21T08:14:47.9872904Z   check-latest: false
2026-02-21T08:14:47.9873219Z   token: ***
2026-02-21T08:14:47.9873393Z   update-environment: true
2026-02-21T08:14:47.9873593Z   allow-prereleases: false
2026-02-21T08:14:47.9873790Z   freethreaded: false
2026-02-21T08:14:47.9873957Z env:
2026-02-21T08:14:47.9874275Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:47.9874476Z ##[endgroup]
2026-02-21T08:14:47.9893793Z ##[command]/usr/bin/docker exec  e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T08:14:48.2324943Z ##[group]Installed versions
2026-02-21T08:14:48.2336642Z Version 3.12 was not found in the local cache
2026-02-21T08:14:48.6561558Z Version 3.12 is available for downloading
2026-02-21T08:14:48.6562470Z Download from "https://github.com/actions/python-versions/releases/download/3.12.12-18393146713/python-3.12.12-linux-24.04-x64.tar.gz"
2026-02-21T08:14:49.1533203Z Extract downloaded archive
2026-02-21T08:14:49.1666924Z [command]/usr/bin/tar xz --warning=no-unknown-keyword --overwrite -C /__w/_temp/e22c93e4-c1be-4336-a944-90cbc8742079 -f /__w/_temp/dedc9ee5-eac1-448c-ba7f-2c7ae5d2a1ba
2026-02-21T08:14:51.2382038Z Execute installation script
2026-02-21T08:14:51.2498579Z Check if Python hostedtoolcache folder exist...
2026-02-21T08:14:51.2498935Z Creating Python hostedtoolcache folder...
2026-02-21T08:14:51.2511135Z Create Python 3.12.12 folder
2026-02-21T08:14:51.2523627Z Copy Python binaries to hostedtoolcache folder
2026-02-21T08:14:51.9630486Z Create additional symlinks (Required for the UsePythonVersion Azure Pipelines task and the setup-python GitHub Action)
2026-02-21T08:14:51.9668810Z Upgrading pip...
2026-02-21T08:14:53.7217610Z Looking in links: /tmp/tmp1pys1rhh
2026-02-21T08:14:53.7220231Z Requirement already satisfied: pip in /__w/_tool/Python/3.12.12/x64/lib/python3.12/site-packages (25.0.1)
2026-02-21T08:14:53.7274425Z ##[error]WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
2026-02-21T08:14:54.4759759Z ##[error]WARNING: The directory '/github/home/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
2026-02-21T08:14:54.6614697Z Collecting pip
2026-02-21T08:14:54.7164441Z Downloading pip-26.0.1-py3-none-any.whl.metadata (4.7 kB)
2026-02-21T08:14:54.7300345Z Downloading pip-26.0.1-py3-none-any.whl (1.8 MB)
2026-02-21T08:14:54.7877142Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 56.1 MB/s eta 0:00:00
2026-02-21T08:14:54.7877499Z 
2026-02-21T08:14:54.7999203Z Installing collected packages: pip
2026-02-21T08:14:54.8000281Z Attempting uninstall: pip
2026-02-21T08:14:54.8019483Z Found existing installation: pip 25.0.1
2026-02-21T08:14:54.8699751Z Uninstalling pip-25.0.1:
2026-02-21T08:14:54.8761730Z Successfully uninstalled pip-25.0.1
2026-02-21T08:14:55.7061463Z Successfully installed pip-26.0.1
2026-02-21T08:14:55.7571774Z Create complete file
2026-02-21T08:14:55.7614675Z Successfully set up CPython (3.12.12)
2026-02-21T08:14:55.7615765Z ##[endgroup]
2026-02-21T08:14:55.7864169Z ##[group]Run astral-sh/setup-uv@v7
2026-02-21T08:14:55.7864450Z with:
2026-02-21T08:14:55.7864624Z   activate-environment: false
2026-02-21T08:14:55.7864907Z   working-directory: /home/bob/_work/helion/helion
2026-02-21T08:14:55.7865317Z   github-token: ***
2026-02-21T08:14:55.7865505Z   enable-cache: auto
2026-02-21T08:14:55.7866015Z   cache-dependency-glob: **/*requirements*.txt
**/*requirements*.in
**/*constraints*.txt
**/*constraints*.in
**/pyproject.toml
**/uv.lock
**/*.py.lock

2026-02-21T08:14:55.7866553Z   restore-cache: true
2026-02-21T08:14:55.7866725Z   save-cache: true
2026-02-21T08:14:55.7866884Z   prune-cache: true
2026-02-21T08:14:55.7867050Z   cache-python: false
2026-02-21T08:14:55.7867238Z   ignore-nothing-to-cache: false
2026-02-21T08:14:55.7867458Z   ignore-empty-workdir: false
2026-02-21T08:14:55.7867663Z   add-problem-matchers: true
2026-02-21T08:14:55.7867867Z   resolution-strategy: highest
2026-02-21T08:14:55.7868057Z env:
2026-02-21T08:14:55.7868249Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:55.7868483Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:55.7868795Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:14:55.7869098Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:55.7869378Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:55.7869641Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:55.7869955Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:14:55.7870262Z ##[endgroup]
2026-02-21T08:14:55.7875912Z ##[command]/usr/bin/docker exec  e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T08:14:56.0524699Z (node:802) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.
2026-02-21T08:14:56.0525470Z (Use `node --trace-deprecation ...` to show where the warning was created)
2026-02-21T08:14:56.0612144Z Trying to find version for uv in: /__w/helion/helion/uv.toml
2026-02-21T08:14:56.0612557Z Could not find file: /__w/helion/helion/uv.toml
2026-02-21T08:14:56.0613567Z Trying to find version for uv in: /__w/helion/helion/pyproject.toml
2026-02-21T08:14:56.0623515Z Could not determine uv version from uv.toml or pyproject.toml. Falling back to latest.
2026-02-21T08:14:56.0625656Z Getting latest version from GitHub API...
2026-02-21T08:14:56.2807943Z manifest-file not provided, reading from local file.
2026-02-21T08:14:56.2848437Z manifest-file does not contain version 0.10.4, arch x86_64, platform unknown-linux-gnu. Falling back to GitHub releases.
2026-02-21T08:14:56.2849416Z Downloading uv from "https://github.com/astral-sh/uv/releases/download/0.10.4/uv-x86_64-unknown-linux-gnu.tar.gz" ...
2026-02-21T08:14:56.4971902Z [command]/usr/bin/tar xz --warning=no-unknown-keyword --overwrite -C /__w/_temp/dcd6af4f-1c43-4e47-af3f-2b44cd1f6d7d -f /__w/_temp/5f4b4880-7832-4444-baa4-2980b3c6287b
2026-02-21T08:14:57.0900359Z Added /github/home/.local/bin to the path
2026-02-21T08:14:57.0903359Z Added /__w/_tool/uv/0.10.4/x86_64 to the path
2026-02-21T08:14:57.0905111Z Set UV_PYTHON_INSTALL_DIR to /github/home/.local/share/uv/python
2026-02-21T08:14:57.0905557Z Added /github/home/.local/share/uv/python to the path
2026-02-21T08:14:57.0914339Z Successfully installed uv version 0.10.4
2026-02-21T08:14:57.2589257Z ##[group]Run uv venv --python 3.12
2026-02-21T08:14:57.2589579Z uv venv --python 3.12
2026-02-21T08:14:57.2589927Z shell: bash -l {0}
2026-02-21T08:14:57.2590095Z env:
2026-02-21T08:14:57.2590247Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:57.2590498Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.2590817Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:14:57.2591130Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.2591398Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.2591664Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.2591984Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:14:57.2592357Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:14:57.2592623Z ##[endgroup]
2026-02-21T08:14:57.4055798Z Using CPython 3.12.12 interpreter at: /__w/_tool/Python/3.12.12/x64/bin/python3.12
2026-02-21T08:14:57.4056344Z Creating virtual environment at: .venv
2026-02-21T08:14:57.4061526Z Activate with: source .venv/bin/activate
2026-02-21T08:14:57.4145254Z ##[group]Run source .venv/bin/activate
2026-02-21T08:14:57.4145586Z source .venv/bin/activate
2026-02-21T08:14:57.4146009Z uv pip install -U "torch==2.9.*" --index-url https://download.pytorch.org/whl/cu128
2026-02-21T08:14:57.4146709Z shell: bash -l {0}
2026-02-21T08:14:57.4146885Z env:
2026-02-21T08:14:57.4147033Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:57.4147284Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.4147607Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:14:57.4147914Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.4148198Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.4148452Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.4148764Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:14:57.4149120Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:14:57.4149418Z ##[endgroup]
2026-02-21T08:14:57.8325011Z Resolved 26 packages in 245ms
2026-02-21T08:14:57.8405964Z Downloading torch (859.1MiB)
2026-02-21T08:14:57.8415795Z Downloading triton (162.6MiB)
2026-02-21T08:14:57.8459683Z Downloading nvidia-nccl-cu12 (307.4MiB)
2026-02-21T08:14:57.8468966Z Downloading networkx (2.0MiB)
2026-02-21T08:14:57.8500872Z Downloading sympy (6.0MiB)
2026-02-21T08:14:57.8542346Z Downloading nvidia-cuda-nvrtc-cu12 (84.0MiB)
2026-02-21T08:14:57.8782573Z Downloading nvidia-cufft-cu12 (184.2MiB)
2026-02-21T08:14:57.8843326Z Downloading nvidia-nvshmem-cu12 (118.9MiB)
2026-02-21T08:14:57.8914851Z Downloading nvidia-cusparse-cu12 (274.9MiB)
2026-02-21T08:14:57.8953006Z Downloading nvidia-cuda-cupti-cu12 (9.8MiB)
2026-02-21T08:14:57.9057532Z Downloading nvidia-cublas-cu12 (566.8MiB)
2026-02-21T08:14:57.9120454Z Downloading nvidia-cufile-cu12 (1.1MiB)
2026-02-21T08:14:57.9213356Z Downloading nvidia-cusolver-cu12 (255.1MiB)
2026-02-21T08:14:57.9253516Z Downloading nvidia-cusparselt-cu12 (273.9MiB)
2026-02-21T08:14:57.9290309Z Downloading nvidia-nvjitlink-cu12 (37.4MiB)
2026-02-21T08:14:57.9392071Z Downloading nvidia-curand-cu12 (60.7MiB)
2026-02-21T08:14:57.9477025Z Downloading nvidia-cudnn-cu12 (674.0MiB)
2026-02-21T08:14:58.2068288Z  Downloaded nvidia-cufile-cu12
2026-02-21T08:14:58.3607045Z  Downloaded networkx
2026-02-21T08:14:59.2920276Z  Downloaded sympy
2026-02-21T08:14:59.9650320Z  Downloaded nvidia-cuda-cupti-cu12
2026-02-21T08:15:00.7833740Z  Downloaded triton
2026-02-21T08:15:02.8211647Z  Downloaded nvidia-nvjitlink-cu12
2026-02-21T08:15:02.9711065Z  Downloaded nvidia-cuda-nvrtc-cu12
2026-02-21T08:15:04.2390456Z  Downloaded nvidia-curand-cu12
2026-02-21T08:15:08.6980639Z  Downloaded nvidia-nvshmem-cu12
2026-02-21T08:15:10.8042845Z  Downloaded nvidia-cufft-cu12
2026-02-21T08:15:16.7116225Z  Downloaded torch
2026-02-21T08:15:16.8232048Z  Downloaded nvidia-cusparse-cu12
2026-02-21T08:15:18.8484239Z  Downloaded nvidia-cusolver-cu12
2026-02-21T08:15:18.9206273Z  Downloaded nvidia-cusparselt-cu12
2026-02-21T08:15:19.9291256Z  Downloaded nvidia-nccl-cu12
2026-02-21T08:15:21.4433369Z  Downloaded nvidia-cublas-cu12
2026-02-21T08:15:23.5557852Z  Downloaded nvidia-cudnn-cu12
2026-02-21T08:15:23.5652891Z Prepared 26 packages in 25.73s
2026-02-21T08:15:23.5706663Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:23.5707841Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:23.5711829Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:27.8161770Z Installed 26 packages in 4.25s
2026-02-21T08:15:27.8162104Z  + filelock==3.20.0
2026-02-21T08:15:27.8162800Z  + fsspec==2025.12.0
2026-02-21T08:15:27.8163040Z  + jinja2==3.1.6
2026-02-21T08:15:27.8163689Z  + markupsafe==3.0.2
2026-02-21T08:15:27.8164281Z  + mpmath==1.3.0
2026-02-21T08:15:27.8164528Z  + networkx==3.6.1
2026-02-21T08:15:27.8165469Z  + nvidia-cublas-cu12==12.8.4.1
2026-02-21T08:15:27.8165794Z  + nvidia-cuda-cupti-cu12==12.8.90
2026-02-21T08:15:27.8166094Z  + nvidia-cuda-nvrtc-cu12==12.8.93
2026-02-21T08:15:27.8166371Z  + nvidia-cuda-runtime-cu12==12.8.90
2026-02-21T08:15:27.8166648Z  + nvidia-cudnn-cu12==9.10.2.21
2026-02-21T08:15:27.8166900Z  + nvidia-cufft-cu12==11.3.3.83
2026-02-21T08:15:27.8167141Z  + nvidia-cufile-cu12==1.13.1.3
2026-02-21T08:15:27.8167384Z  + nvidia-curand-cu12==10.3.9.90
2026-02-21T08:15:27.8167650Z  + nvidia-cusolver-cu12==11.7.3.90
2026-02-21T08:15:27.8167911Z  + nvidia-cusparse-cu12==12.5.8.93
2026-02-21T08:15:27.8168181Z  + nvidia-cusparselt-cu12==0.7.1
2026-02-21T08:15:27.8170900Z  + nvidia-nccl-cu12==2.27.5
2026-02-21T08:15:27.8171168Z  + nvidia-nvjitlink-cu12==12.8.93
2026-02-21T08:15:27.8171442Z  + nvidia-nvshmem-cu12==3.3.20
2026-02-21T08:15:27.8171689Z  + nvidia-nvtx-cu12==12.8.90
2026-02-21T08:15:27.8171945Z  + setuptools==70.2.0
2026-02-21T08:15:27.8172165Z  + sympy==1.14.0
2026-02-21T08:15:27.8172699Z  + torch==2.9.1+cu128
2026-02-21T08:15:27.8172901Z  + triton==3.5.1
2026-02-21T08:15:27.8173105Z  + typing-extensions==4.15.0
2026-02-21T08:15:27.8323469Z ##[group]Run source .venv/bin/activate
2026-02-21T08:15:27.8323778Z source .venv/bin/activate
2026-02-21T08:15:27.8324269Z SETUPTOOLS_SCM_PRETEND_VERSION="0.0.0" uv pip install -e .'[dev]'
2026-02-21T08:15:27.8324663Z python -c "import helion; print(helion.__name__)"
2026-02-21T08:15:27.8325146Z shell: bash -l {0}
2026-02-21T08:15:27.8325303Z env:
2026-02-21T08:15:27.8325456Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:15:27.8325695Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.8326246Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:15:27.8326556Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.8326814Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.8327076Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.8327387Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:15:27.8327781Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:15:27.8328049Z ##[endgroup]
2026-02-21T08:15:29.8190473Z Resolved 30 packages in 1.85s
2026-02-21T08:15:29.8202009Z    Building helion @ file:///__w/helion/helion
2026-02-21T08:15:29.8435559Z Downloading scipy (33.4MiB)
2026-02-21T08:15:29.8437041Z Downloading numpy (15.8MiB)
2026-02-21T08:15:29.8438769Z Downloading scikit-learn (8.5MiB)
2026-02-21T08:15:29.8440416Z Downloading virtualenv (5.6MiB)
2026-02-21T08:15:29.8443824Z Downloading pygments (1.2MiB)
2026-02-21T08:15:30.2307185Z  Downloaded pygments
2026-02-21T08:15:30.2445990Z       Built helion @ file:///__w/helion/helion
2026-02-21T08:15:30.2587355Z  Downloaded virtualenv
2026-02-21T08:15:30.4767036Z  Downloaded scikit-learn
2026-02-21T08:15:30.5256009Z  Downloaded numpy
2026-02-21T08:15:30.8930617Z  Downloaded scipy
2026-02-21T08:15:30.9049595Z Prepared 27 packages in 1.08s
2026-02-21T08:15:30.9058407Z Uninstalled 1 package in 0.79ms
2026-02-21T08:15:30.9065206Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:30.9066469Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:30.9067453Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:31.3041414Z Installed 29 packages in 398ms
2026-02-21T08:15:31.3041964Z  + cfgv==3.5.0
2026-02-21T08:15:31.3042476Z  + distlib==0.4.0
2026-02-21T08:15:31.3043032Z  + expecttest==0.3.0
2026-02-21T08:15:31.3043566Z  + filecheck==1.0.3
2026-02-21T08:15:31.3044277Z  - filelock==3.20.0
2026-02-21T08:15:31.3044847Z  + filelock==3.24.3
2026-02-21T08:15:31.3045386Z  + helion==0.0.0 (from file:///__w/helion/helion)
2026-02-21T08:15:31.3045967Z  + hypothesis==6.151.9
2026-02-21T08:15:31.3046275Z  + identify==2.6.16
2026-02-21T08:15:31.3046525Z  + iniconfig==2.3.0
2026-02-21T08:15:31.3046817Z  + joblib==1.5.3
2026-02-21T08:15:31.3047047Z  + markdown-it-py==4.0.0
2026-02-21T08:15:31.3047402Z  + mdurl==0.1.2
2026-02-21T08:15:31.3059977Z  + nodeenv==1.10.0
2026-02-21T08:15:31.3060183Z  + numpy==2.4.2
2026-02-21T08:15:31.3060365Z  + packaging==26.0
2026-02-21T08:15:31.3060569Z  + platformdirs==4.9.2
2026-02-21T08:15:31.3060779Z  + pluggy==1.6.0
2026-02-21T08:15:31.3060985Z  + pre-commit==4.5.1
2026-02-21T08:15:31.3061176Z  + psutil==7.2.2
2026-02-21T08:15:31.3061346Z  + pygments==2.19.2
2026-02-21T08:15:31.3061529Z  + pytest==9.0.2
2026-02-21T08:15:31.3061722Z  + pytest-timeout==2.4.0
2026-02-21T08:15:31.3061937Z  + pyyaml==6.0.3
2026-02-21T08:15:31.3062110Z  + rich==14.3.3
2026-02-21T08:15:31.3062295Z  + scikit-learn==1.8.0
2026-02-21T08:15:31.3062501Z  + scipy==1.17.0
2026-02-21T08:15:31.3062689Z  + sortedcontainers==2.4.0
2026-02-21T08:15:31.3062900Z  + threadpoolctl==3.6.0
2026-02-21T08:15:31.3063097Z  + virtualenv==20.38.0
2026-02-21T08:15:46.1262420Z helion
2026-02-21T08:15:47.1979558Z ##[group]Run set -x
2026-02-21T08:15:47.1979824Z set -x
2026-02-21T08:15:47.1980008Z source .venv/bin/activate
2026-02-21T08:15:47.1980232Z uv pip install pip
2026-02-21T08:15:47.1980479Z uv pip install quack-kernels --no-deps
2026-02-21T08:15:47.1980778Z mkdir -p benchmarks/ && pushd benchmarks/
2026-02-21T08:15:47.1981126Z git clone https://github.com/pytorch-labs/tritonbench/
2026-02-21T08:15:47.1981450Z pushd tritonbench/
2026-02-21T08:15:47.1981686Z git submodule update --init --recursive
2026-02-21T08:15:47.1982218Z uv pip install -r requirements.txt
2026-02-21T08:15:47.1982463Z python install.py --liger
2026-02-21T08:15:47.1982693Z uv pip install -e . --no-deps
2026-02-21T08:15:47.1982905Z popd
2026-02-21T08:15:47.1983062Z popd
2026-02-21T08:15:47.1983341Z shell: bash -l {0}
2026-02-21T08:15:47.1983499Z env:
2026-02-21T08:15:47.1983693Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:15:47.1983943Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.1984441Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:15:47.1984748Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.1985028Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.1985300Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.1985624Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:15:47.1986001Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:15:47.1986458Z ##[endgroup]
2026-02-21T08:15:47.4638547Z + source .venv/bin/activate
2026-02-21T08:15:47.4639189Z ++ '[' -z '' ']'
2026-02-21T08:15:47.4639727Z ++ '[' -n x ']'
2026-02-21T08:15:47.4640242Z ++ SCRIPT_PATH=.venv/bin/activate
2026-02-21T08:15:47.4641129Z ++ '[' .venv/bin/activate = /__w/_temp/46443c9e-5166-49f4-b615-d19c0cb53d8a.sh ']'
2026-02-21T08:15:47.4641814Z ++ deactivate nondestructive
2026-02-21T08:15:47.4642189Z ++ unset -f pydoc
2026-02-21T08:15:47.4642497Z ++ '[' -z '' ']'
2026-02-21T08:15:47.4642772Z ++ '[' -z '' ']'
2026-02-21T08:15:47.4643039Z ++ hash -r
2026-02-21T08:15:47.4643297Z ++ '[' -z '' ']'
2026-02-21T08:15:47.4643579Z ++ unset VIRTUAL_ENV
2026-02-21T08:15:47.4643900Z ++ unset VIRTUAL_ENV_PROMPT
2026-02-21T08:15:47.4644792Z ++ '[' '!' nondestructive = nondestructive ']'
2026-02-21T08:15:47.4645289Z ++ VIRTUAL_ENV=/__w/helion/helion/.venv
2026-02-21T08:15:47.4646322Z ++ '[' linux-gnu = cygwin ']'
2026-02-21T08:15:47.4646912Z ++ '[' linux-gnu = msys ']'
2026-02-21T08:15:47.4650031Z ++ export VIRTUAL_ENV
2026-02-21T08:15:47.4650358Z ++ '[' -z '' ']'
2026-02-21T08:15:47.4650870Z ++ unset SCRIPT_PATH
2026-02-21T08:15:47.4651862Z ++ _OLD_VIRTUAL_PATH=/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T08:15:47.4653535Z ++ PATH=/__w/helion/helion/.venv/bin:/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T08:15:47.4654689Z ++ export PATH
2026-02-21T08:15:47.4654871Z ++ '[' xhelion '!=' x ']'
2026-02-21T08:15:47.4655085Z ++ VIRTUAL_ENV_PROMPT=helion
2026-02-21T08:15:47.4655317Z ++ export VIRTUAL_ENV_PROMPT
2026-02-21T08:15:47.4655519Z ++ '[' -z '' ']'
2026-02-21T08:15:47.4655700Z ++ '[' -z '' ']'
2026-02-21T08:15:47.4655867Z ++ _OLD_VIRTUAL_PS1=
2026-02-21T08:15:47.4656081Z ++ PS1='(helion) '
2026-02-21T08:15:47.4656272Z ++ export PS1
2026-02-21T08:15:47.4656459Z ++ alias pydoc
2026-02-21T08:15:47.4656648Z ++ true
2026-02-21T08:15:47.4656809Z ++ hash -r
2026-02-21T08:15:47.4656992Z + uv pip install pip
2026-02-21T08:15:47.5659156Z Resolved 1 package in 90ms
2026-02-21T08:15:47.5753489Z Downloading pip (1.7MiB)
2026-02-21T08:15:47.6401565Z  Downloaded pip
2026-02-21T08:15:47.6429742Z Prepared 1 package in 77ms
2026-02-21T08:15:47.6461666Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:47.6462405Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:47.6463125Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:47.9350966Z Installed 1 package in 291ms
2026-02-21T08:15:47.9352108Z  + pip==26.0.1
2026-02-21T08:15:47.9409064Z + uv pip install quack-kernels --no-deps
2026-02-21T08:15:48.0824762Z Resolved 1 package in 132ms
2026-02-21T08:15:48.3263276Z Prepared 1 package in 243ms
2026-02-21T08:15:48.3292724Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:48.3293423Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:48.3294234Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:48.3953255Z Installed 1 package in 68ms
2026-02-21T08:15:48.3953683Z  + quack-kernels==0.2.10
2026-02-21T08:15:48.3995869Z + mkdir -p benchmarks/
2026-02-21T08:15:48.4010574Z + pushd benchmarks/
2026-02-21T08:15:48.4010879Z + git clone https://github.com/pytorch-labs/tritonbench/
2026-02-21T08:15:48.4011261Z /__w/helion/helion/benchmarks /__w/helion/helion
2026-02-21T08:15:48.5198827Z Cloning into 'tritonbench'...
2026-02-21T08:15:50.0396516Z + pushd tritonbench/
2026-02-21T08:15:50.0396871Z + git submodule update --init --recursive
2026-02-21T08:15:50.0397425Z /__w/helion/helion/benchmarks/tritonbench /__w/helion/helion/benchmarks /__w/helion/helion
2026-02-21T08:15:50.1576585Z Submodule 'submodules/ThunderKittens' (https://github.com/HazyResearch/ThunderKittens.git) registered for path 'submodules/ThunderKittens'
2026-02-21T08:15:50.2522672Z Submodule 'submodules/aiter' (https://github.com/ROCm/aiter.git) registered for path 'submodules/aiter'
2026-02-21T08:15:50.3200543Z Submodule 'submodules/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/cutlass'
2026-02-21T08:15:50.3537699Z Submodule 'submodules/flash-attention' (https://github.com/Dao-AILab/flash-attention.git) registered for path 'submodules/flash-attention'
2026-02-21T08:15:50.4447052Z Submodule 'submodules/generative-recommenders' (https://github.com/facebookresearch/generative-recommenders.git) registered for path 'submodules/generative-recommenders'
2026-02-21T08:15:50.5206298Z Submodule 'submodules/xformers' (https://github.com/facebookresearch/xformers.git) registered for path 'submodules/xformers'
2026-02-21T08:15:50.5239960Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/ThunderKittens'...
2026-02-21T08:15:55.9207540Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/aiter'...
2026-02-21T08:16:28.1247858Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/cutlass'...
2026-02-21T08:16:35.0226290Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/flash-attention'...
2026-02-21T08:16:37.0976734Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/generative-recommenders'...
2026-02-21T08:16:37.8111217Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers'...
2026-02-21T08:16:43.1857785Z Submodule path 'submodules/ThunderKittens': checked out '25f7568450b412a1984a4f619fb28373df06fa1b'
2026-02-21T08:16:44.1794767Z Submodule path 'submodules/aiter': checked out '1f5b378dcc9d9b0bcd9456c8c767b7424a5e8190'
2026-02-21T08:16:44.3026449Z Submodule '3rdparty/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/aiter/3rdparty/composable_kernel'
2026-02-21T08:16:44.3066665Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/aiter/3rdparty/composable_kernel'...
2026-02-21T08:16:54.7023896Z Submodule path 'submodules/aiter/3rdparty/composable_kernel': checked out 'e31a7a4f29b371c32ea9daf9211b6ae1fed2fa40'
2026-02-21T08:16:56.0790397Z Submodule path 'submodules/cutlass': checked out 'ad7b2f5e84fcfa124cb02b91d5bd26d238c0459e'
2026-02-21T08:16:56.2246740Z Submodule path 'submodules/flash-attention': checked out '43375aab2893018dfb7950db1cfa623c14946ad6'
2026-02-21T08:16:56.3809029Z Submodule 'csrc/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/flash-attention/csrc/composable_kernel'
2026-02-21T08:16:56.4756502Z Submodule 'csrc/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/flash-attention/csrc/cutlass'
2026-02-21T08:16:56.4790886Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/flash-attention/csrc/composable_kernel'...
2026-02-21T08:17:07.4897665Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/flash-attention/csrc/cutlass'...
2026-02-21T08:17:17.4274527Z Submodule path 'submodules/flash-attention/csrc/composable_kernel': checked out 'e8709c24f403173ad21a2da907d1347957e324fb'
2026-02-21T08:17:18.8807559Z Submodule path 'submodules/flash-attention/csrc/cutlass': checked out 'b1d6e2c9b334dfa811e4183dfbd02419249e4b52'
2026-02-21T08:17:19.1825567Z Submodule path 'submodules/generative-recommenders': checked out '88512dbd71b053226bc4ef8ec1630e3db53e55e5'
2026-02-21T08:17:19.2625345Z Submodule 'generative_recommenders/ops/cpp/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/generative-recommenders/generative_recommenders/ops/cpp/cutlass'
2026-02-21T08:17:19.2658960Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/generative-recommenders/generative_recommenders/ops/cpp/cutlass'...
2026-02-21T08:17:27.8049671Z Submodule path 'submodules/generative-recommenders/generative_recommenders/ops/cpp/cutlass': checked out 'dc4817921edda44a549197ff3a9dcf5df0636e7b'
2026-02-21T08:17:27.9321802Z Submodule path 'submodules/xformers': checked out '8fc8ec5a4d6498ff81c0c418b89bbaf133ae3a44'
2026-02-21T08:17:28.0581967Z Submodule 'third_party/composable_kernel_tiled' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/xformers/third_party/composable_kernel_tiled'
2026-02-21T08:17:28.3770431Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/xformers/third_party/cutlass'
2026-02-21T08:17:28.3788723Z Submodule 'third_party/flash-attention' (https://github.com/Dao-AILab/flash-attention.git) registered for path 'submodules/xformers/third_party/flash-attention'
2026-02-21T08:17:28.3828094Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/composable_kernel_tiled'...
2026-02-21T08:17:36.6748004Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/cutlass'...
2026-02-21T08:17:42.8353560Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/flash-attention'...
2026-02-21T08:17:45.9408649Z Submodule path 'submodules/xformers/third_party/composable_kernel_tiled': checked out '4f54fa30583704f34da2ac50372d524cae6bad7d'
2026-02-21T08:17:46.9704149Z Submodule path 'submodules/xformers/third_party/cutlass': checked out 'e9627ce55b42fd2599f58cd4396da9380954def0'
2026-02-21T08:17:47.0490596Z Submodule path 'submodules/xformers/third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5'
2026-02-21T08:17:47.1501760Z Submodule 'csrc/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/xformers/third_party/flash-attention/csrc/composable_kernel'
2026-02-21T08:17:47.2516398Z Submodule 'csrc/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/xformers/third_party/flash-attention/csrc/cutlass'
2026-02-21T08:17:47.4636560Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/flash-attention/csrc/composable_kernel'...
2026-02-21T08:17:54.6591442Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/flash-attention/csrc/cutlass'...
2026-02-21T08:18:01.6293432Z Submodule path 'submodules/xformers/third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33'
2026-02-21T08:18:02.7398803Z Submodule path 'submodules/xformers/third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420'
2026-02-21T08:18:02.7447990Z + uv pip install -r requirements.txt
2026-02-21T08:18:02.7532358Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:03.2666014Z Resolved 30 packages in 511ms
2026-02-21T08:18:03.2915028Z Downloading fonttools (4.7MiB)
2026-02-21T08:18:03.2915854Z Downloading hf-xet (3.2MiB)
2026-02-21T08:18:03.2917409Z Downloading kiwisolver (1.4MiB)
2026-02-21T08:18:03.2920092Z Downloading tokenizers (3.0MiB)
2026-02-21T08:18:03.2921477Z Downloading pillow (6.7MiB)
2026-02-21T08:18:03.2923017Z Downloading matplotlib (8.3MiB)
2026-02-21T08:18:03.2924837Z Downloading transformers (10.3MiB)
2026-02-21T08:18:03.6941984Z  Downloaded kiwisolver
2026-02-21T08:18:03.7823830Z  Downloaded tokenizers
2026-02-21T08:18:03.7918007Z  Downloaded hf-xet
2026-02-21T08:18:03.8714867Z  Downloaded pillow
2026-02-21T08:18:03.8857093Z  Downloaded fonttools
2026-02-21T08:18:03.9155326Z  Downloaded matplotlib
2026-02-21T08:18:04.4268411Z  Downloaded transformers
2026-02-21T08:18:04.4511040Z Prepared 23 packages in 1.18s
2026-02-21T08:18:04.4571364Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:18:04.4572119Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:18:04.4572824Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:18:04.9412126Z Installed 23 packages in 489ms
2026-02-21T08:18:04.9412752Z  + certifi==2026.1.4
2026-02-21T08:18:04.9413070Z  + charset-normalizer==3.4.4
2026-02-21T08:18:04.9413330Z  + contourpy==1.3.3
2026-02-21T08:18:04.9413531Z  + cycler==0.12.1
2026-02-21T08:18:04.9413735Z  + fonttools==4.61.1
2026-02-21T08:18:04.9413940Z  + hf-xet==1.2.0
2026-02-21T08:18:04.9414325Z  + huggingface-hub==0.36.2
2026-02-21T08:18:04.9414559Z  + idna==3.11
2026-02-21T08:18:04.9414753Z  + kiwisolver==1.4.9
2026-02-21T08:18:04.9414965Z  + matplotlib==3.10.8
2026-02-21T08:18:04.9415187Z  + nvidia-ml-py==13.590.48
2026-02-21T08:18:04.9415408Z  + pillow==12.1.1
2026-02-21T08:18:04.9415610Z  + pyparsing==3.3.2
2026-02-21T08:18:04.9415852Z  + python-dateutil==2.9.0.post0
2026-02-21T08:18:04.9416096Z  + regex==2026.2.19
2026-02-21T08:18:04.9416289Z  + requests==2.32.5
2026-02-21T08:18:04.9416498Z  + safetensors==0.7.0
2026-02-21T08:18:04.9416727Z  + six==1.17.0
2026-02-21T08:18:04.9416917Z  + tabulate==0.9.0
2026-02-21T08:18:04.9417128Z  + tokenizers==0.21.4
2026-02-21T08:18:04.9417335Z  + tqdm==4.67.3
2026-02-21T08:18:04.9417536Z  + transformers==4.53.0
2026-02-21T08:18:04.9417746Z  + urllib3==2.6.3
2026-02-21T08:18:04.9538368Z + python install.py --liger
2026-02-21T08:18:10.3062425Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:10.3104581Z Audited 6 packages in 4ms
2026-02-21T08:18:10.6728772Z INFO:__main__:[tritonbench] installing liger-kernels...
2026-02-21T08:18:10.6808412Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:10.7116636Z Resolved 1 package in 29ms
2026-02-21T08:18:10.7826019Z Prepared 1 package in 70ms
2026-02-21T08:18:10.7859716Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:18:10.7860511Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:18:10.7861273Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:18:10.7924418Z Installed 1 package in 9ms
2026-02-21T08:18:10.7924743Z  + liger-kernel-nightly==0.7.0.dev20260219183429
2026-02-21T08:18:10.7971749Z INFO:__main__:[tritonbench] installation complete!
2026-02-21T08:18:11.1383210Z + uv pip install -e . --no-deps
2026-02-21T08:18:11.2286883Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:11.2321525Z Resolved 1 package in 1ms
2026-02-21T08:18:11.2369575Z    Building tritonbench @ file:///__w/helion/helion/benchmarks/tritonbench
2026-02-21T08:18:12.5579539Z       Built tritonbench @ file:///__w/helion/helion/benchmarks/tritonbench
2026-02-21T08:18:12.5591340Z Prepared 1 package in 1.32s
2026-02-21T08:18:12.5595289Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:18:12.5596030Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:18:12.5596818Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:18:12.5766129Z Installed 1 package in 17ms
2026-02-21T08:18:12.5766753Z  + tritonbench==0.0.1 (from file:///__w/helion/helion/benchmarks/tritonbench)
2026-02-21T08:18:12.5908669Z + popd
2026-02-21T08:18:12.5909598Z + popd
2026-02-21T08:18:12.5909925Z /__w/helion/helion/benchmarks /__w/helion/helion
2026-02-21T08:18:12.5910244Z /__w/helion/helion
2026-02-21T08:18:12.5975818Z ##[group]Run rm -rf /tmp/torchinductor_*/ || true
2026-02-21T08:18:12.5976226Z rm -rf /tmp/torchinductor_*/ || true
2026-02-21T08:18:12.5976471Z 
2026-02-21T08:18:12.5976649Z source .venv/bin/activate
2026-02-21T08:18:12.5976858Z 
2026-02-21T08:18:12.5977055Z TEST_REPORTS_DIR=$(pwd)/test/test-reports
2026-02-21T08:18:12.5977328Z mkdir -p "$TEST_REPORTS_DIR"
2026-02-21T08:18:12.5977556Z echo "$TEST_REPORTS_DIR"
2026-02-21T08:18:12.5977746Z 
2026-02-21T08:18:12.5977897Z KERNEL_LIST="layer_norm"
2026-02-21T08:18:12.5978114Z for kernel in ${KERNEL_LIST//,/ }; do
2026-02-21T08:18:12.5978383Z   echo "=========================================="
2026-02-21T08:18:12.5978727Z   echo "Running benchmark for kernel: $kernel"
2026-02-21T08:18:12.5979007Z   echo "=========================================="
2026-02-21T08:18:12.5979236Z 
2026-02-21T08:18:12.5979507Z   # Get available implementations and baseline for this kernel
2026-02-21T08:18:12.5980025Z   KERNEL_INFO=$(python benchmarks/run.py --list-impls-for-benchmark-ci --op $kernel | grep "^$kernel:")
2026-02-21T08:18:12.5980562Z   IMPLS=$(echo "$KERNEL_INFO" | sed -n 's/.*impls=\([^ ]*\).*/\1/p')
2026-02-21T08:18:12.5981016Z   BASELINE=$(echo "$KERNEL_INFO" | sed -n 's/.*baseline=\([^ ]*\).*/\1/p')
2026-02-21T08:18:12.5981332Z 
2026-02-21T08:18:12.5981491Z   if [[ -z "$IMPLS" ]]; then
2026-02-21T08:18:12.5981822Z     echo "Warning: No implementations found for kernel $kernel, skipping..."
2026-02-21T08:18:12.5982165Z     continue
2026-02-21T08:18:12.5982342Z   fi
2026-02-21T08:18:12.5982515Z   if [[ -z "$BASELINE" ]]; then
2026-02-21T08:18:12.5982829Z     echo "Warning: No baseline found for kernel $kernel, skipping..."
2026-02-21T08:18:12.5983135Z     continue
2026-02-21T08:18:12.5983300Z   fi
2026-02-21T08:18:12.5983469Z   echo "Using baseline: $BASELINE"
2026-02-21T08:18:12.5983759Z   echo "Available implementations for $kernel: $IMPLS"
2026-02-21T08:18:12.5984192Z 
2026-02-21T08:18:12.5984383Z   # Do autotuning but do not record the results
2026-02-21T08:18:12.5984642Z    python benchmarks/run.py \
2026-02-21T08:18:12.5984865Z       --op $kernel \
2026-02-21T08:18:12.5985075Z       --metrics speedup,accuracy \
2026-02-21T08:18:12.5985337Z       --latency-measure-mode triton_do_bench \
2026-02-21T08:18:12.5985592Z       --cudagraph \
2026-02-21T08:18:12.5985784Z       --only $IMPLS \
2026-02-21T08:18:12.5986018Z       --only-match-mode prefix-with-baseline \
2026-02-21T08:18:12.5986273Z       --baseline $BASELINE \
2026-02-21T08:18:12.5986487Z       --atol 1e-2 \
2026-02-21T08:18:12.5986676Z       --rtol 1e-2 \
2026-02-21T08:18:12.5986893Z       --input-sample-mode equally-spaced-k \
2026-02-21T08:18:12.5987147Z       --keep-going \
2026-02-21T08:18:12.5987331Z       
2026-02-21T08:18:12.5987707Z 
2026-02-21T08:18:12.5987849Z   # Relax the GPU
2026-02-21T08:18:12.5988033Z   sleep 2m
2026-02-21T08:18:12.5988192Z 
2026-02-21T08:18:12.5988370Z   # Run again with cache and record results
2026-02-21T08:18:12.5988753Z    HELION_PRINT_OUTPUT_CODE=1 HELION_ASSERT_CACHE_HIT=1 python benchmarks/run.py \
2026-02-21T08:18:12.5989116Z       --op $kernel \
2026-02-21T08:18:12.5989329Z       --metrics speedup,accuracy \
2026-02-21T08:18:12.5989609Z       --latency-measure-mode triton_do_bench \
2026-02-21T08:18:12.5989865Z       --cudagraph \
2026-02-21T08:18:12.5990051Z       --only $IMPLS \
2026-02-21T08:18:12.5990471Z       --only-match-mode prefix-with-baseline \
2026-02-21T08:18:12.5990732Z       --baseline $BASELINE \
2026-02-21T08:18:12.5990942Z       --atol 1e-2 \
2026-02-21T08:18:12.5991165Z       --rtol 1e-2 \
2026-02-21T08:18:12.5991424Z       --input-sample-mode equally-spaced-k \
2026-02-21T08:18:12.5991728Z       --output "$TEST_REPORTS_DIR/helionbench.json" \
2026-02-21T08:18:12.5992001Z       --append-to-output \
2026-02-21T08:18:12.5992215Z       --keep-going \
2026-02-21T08:18:12.5992393Z       
2026-02-21T08:18:12.5992543Z 
2026-02-21T08:18:12.5992752Z   echo "✅ Completed benchmark for kernel: $kernel"
2026-02-21T08:18:12.5993014Z done
2026-02-21T08:18:12.5993165Z 
2026-02-21T08:18:12.5993370Z if [[ ! -s "$TEST_REPORTS_DIR/helionbench.json" ]]; then
2026-02-21T08:18:12.5993695Z   echo "❌ helionbench.json is missing or empty"
2026-02-21T08:18:12.5993942Z   exit 1
2026-02-21T08:18:12.5994245Z fi
2026-02-21T08:18:12.5994424Z cat "$TEST_REPORTS_DIR/helionbench.json"
2026-02-21T08:18:12.5994777Z shell: bash -l {0}
2026-02-21T08:18:12.5994941Z env:
2026-02-21T08:18:12.5995095Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:18:12.5995378Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:12.5995677Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:18:12.5995977Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:12.5996234Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:12.5996494Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:12.5996809Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:18:12.5997159Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:18:12.5997426Z ##[endgroup]
2026-02-21T08:18:12.6915071Z /__w/helion/helion/test/test-reports
2026-02-21T08:18:12.6915385Z ==========================================
2026-02-21T08:18:12.6915670Z Running benchmark for kernel: layer_norm
2026-02-21T08:18:12.6915923Z ==========================================
2026-02-21T08:18:19.6668297Z Using baseline: torch_layer_norm
2026-02-21T08:18:19.6668961Z Available implementations for layer_norm: helion_layer_norm_tritonbench,liger_layer_norm,torch_compile_layer_norm
2026-02-21T08:18:26.4790954Z Using num_inputs=20 for layer_norm
2026-02-21T08:18:27.3056615Z Running layer_norm benchmark with Helion implementation...
2026-02-21T08:18:27.3057120Z 
2026-02-21T08:18:27.5745199Z Equally-spaced-k mode: Selected 20 equally spaced inputs (total available: 30)
2026-02-21T08:18:27.5745919Z WARNING:tritonbench.utils.triton_op:Input IDs to run: [0, 2, 3, 5, 6, 8, 9, 11, 12, 14, 15, 17, 18, 20, 21, 23, 24, 26, 27, 29]
2026-02-21T08:18:27.5754565Z 
2026-02-21T08:18:27.5766294Z   0%|          | 0/20 [00:00<?, ?it/s]WARNING:tritonbench.utils.triton_op:Running input ID 0:
2026-02-21T08:18:27.5766701Z (M, N)
2026-02-21T08:18:27.5766894Z ------------
2026-02-21T08:18:27.5767070Z (4096, 1024)
2026-02-21T08:18:27.5769729Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:18:29.5408759Z INFO:tritonbench.utils.triton_op:Took 192.59ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:18:33.5686324Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:18:35.2844628Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:18:35.2847935Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:18:35.2848485Z               'dtype': 'torch.float32',
2026-02-21T08:18:35.2848955Z               'shape': (4096, 1024),
2026-02-21T08:18:35.2849371Z               'stride': (1024, 1)},
2026-02-21T08:18:35.2849756Z             (1024,),
2026-02-21T08:18:35.2850249Z             { 'device': 'cuda:0',
2026-02-21T08:18:35.2850671Z               'dtype': 'torch.float32',
2026-02-21T08:18:35.2851101Z               'shape': (1024,),
2026-02-21T08:18:35.2852179Z               'stride': (1,)},
2026-02-21T08:18:35.2852580Z             { 'device': 'cuda:0',
2026-02-21T08:18:35.2852982Z               'dtype': 'torch.float32',
2026-02-21T08:18:35.2853447Z               'shape': (1024,),
2026-02-21T08:18:35.2853693Z               'stride': (1,)},
2026-02-21T08:18:35.2853885Z             1e-05),
2026-02-21T08:18:35.2854202Z   'kwargs': {}}
2026-02-21T08:18:35.2854595Z INFO:tritonbench.utils.triton_op:Took 1.37ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:18:35.3440418Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:18:35.3441772Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:18:35.3442706Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:18:35.3443305Z While processing:
2026-02-21T08:18:35.3451721Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:18:35.3452150Z     if bias is not None:
2026-02-21T08:18:35.3452354Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:18:35.3452481Z 
2026-02-21T08:18:35.5433095Z [0s] Autotune random seed: 2135381352
2026-02-21T08:18:36.0942859Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:19:40.6518619Z [64s] Timeout after 60s compiling Config(block_sizes=[128], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last', 'first', '', 'last', 'last', 'first', 'first'], maxnreg=64, num_sm_multiplier=64, num_stages=2, num_warps=2, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[1], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T08:19:41.2560226Z [65s] Timeout after 60s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', '', '', 'first', 'first', 'last', '', 'first'], maxnreg=256, num_sm_multiplier=16, num_stages=6, num_warps=2, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[1], range_warp_specializes=[], reduction_loops=[128])
2026-02-21T08:19:42.2054400Z [66s] Timeout after 60s compiling Config(block_sizes=[64], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first', 'last', '', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=8, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:19:42.2079076Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.1 configs/s
2026-02-21T08:19:48.5696599Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.8 configs/s
2026-02-21T08:19:48.5710002Z [72s] Adaptive compile timeout: 30s (90% percentile=5.2s, bounds=[30.0s, 60s])
2026-02-21T08:19:49.7689474Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 852.4 configs/s
2026-02-21T08:19:49.8657100Z [73s] Initial random population of 100, 5 starting points: 
2026-02-21T08:19:49.8657472Z error=7
2026-02-21T08:19:49.8657672Z timeout=3
2026-02-21T08:19:49.8657850Z ok=90
2026-02-21T08:19:49.8658027Z min=0.0151
2026-02-21T08:19:49.8658205Z mid=0.0831
2026-02-21T08:19:49.8658389Z max=7.9995
2026-02-21T08:19:49.8658583Z best={'block_sizes': [1],
2026-02-21T08:19:49.8659490Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:19:49.8660071Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:19:49.8660527Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:19:49.8660872Z  'num_stages': 1,
2026-02-21T08:19:49.8661073Z  'num_warps': 4,
2026-02-21T08:19:49.8661281Z  'pid_type': 'flat',
2026-02-21T08:19:49.8661500Z  'range_flattens': [None],
2026-02-21T08:19:49.8661751Z  'range_multi_buffers': [None],
2026-02-21T08:19:49.8662008Z  'range_num_stages': [0],
2026-02-21T08:19:49.8662251Z  'range_unroll_factors': [0],
2026-02-21T08:19:49.8662513Z  'range_warp_specializes': [],
2026-02-21T08:19:49.8662767Z  'reduction_loops': [None]}
2026-02-21T08:19:49.8680241Z [73s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:19:51.3224428Z [75s] Generation 1 starting: 86 neighbors, 5 active search path(s)
2026-02-21T08:19:58.3867904Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 43.1 configs/s
2026-02-21T08:20:04.2286957Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 15.3 configs/s
2026-02-21T08:20:11.9204855Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 136.9         
2026-02-21T08:20:11.9205509Z                                                                   configs/s     
2026-02-21T08:20:12.5100194Z [96s] Generation 1 complete: 
2026-02-21T08:20:12.5100913Z ok=91
2026-02-21T08:20:12.5101170Z min=0.0156
2026-02-21T08:20:12.5101403Z mid=0.0193
2026-02-21T08:20:12.5101617Z max=0.1951
2026-02-21T08:20:12.5101859Z best={'block_sizes': [1],
2026-02-21T08:20:12.5102451Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:20:12.5103204Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:20:12.5103745Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:20:12.5104330Z  'num_stages': 2,
2026-02-21T08:20:12.5104618Z  'num_warps': 4,
2026-02-21T08:20:12.5104877Z  'pid_type': 'flat',
2026-02-21T08:20:12.5105157Z  'range_flattens': [None],
2026-02-21T08:20:12.5105456Z  'range_multi_buffers': [None],
2026-02-21T08:20:12.5105791Z  'range_num_stages': [0],
2026-02-21T08:20:12.5106085Z  'range_unroll_factors': [0],
2026-02-21T08:20:12.5106414Z  'range_warp_specializes': [],
2026-02-21T08:20:12.5106736Z  'reduction_loops': [None]}
2026-02-21T08:20:12.5126393Z [96s] Fitting surrogate: 191 points, 191 targets
2026-02-21T08:20:13.7908131Z [97s] Generation 2 starting: 76 neighbors, 5 active search path(s)
2026-02-21T08:20:19.6427865Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 20.0 configs/s
2026-02-21T08:20:25.1761729Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 14.2 configs/s
2026-02-21T08:20:32.9487494Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 136.5         
2026-02-21T08:20:32.9489745Z                                                                   configs/s     
2026-02-21T08:20:33.5720533Z [117s] Generation 2 complete: 
2026-02-21T08:20:33.5720831Z ok=82
2026-02-21T08:20:33.5721011Z min=0.0154
2026-02-21T08:20:33.5721187Z mid=0.0170
2026-02-21T08:20:33.5722076Z max=0.0998
2026-02-21T08:20:33.5722281Z best={'block_sizes': [1],
2026-02-21T08:20:33.5722752Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:20:33.5723423Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:20:33.5723891Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:20:33.5724841Z  'load_eviction_policies': ['first', 'last', 'last', 'last', 'first', 'first', '', 'first'],
2026-02-21T08:20:33.5725339Z  'num_stages': 2,
2026-02-21T08:20:33.5725560Z  'num_warps': 4,
2026-02-21T08:20:33.5725758Z  'pid_type': 'flat',
2026-02-21T08:20:33.5725955Z  'range_flattens': [None],
2026-02-21T08:20:33.5726171Z  'range_multi_buffers': [None],
2026-02-21T08:20:33.5726727Z  'range_num_stages': [0],
2026-02-21T08:20:33.5726949Z  'range_unroll_factors': [0],
2026-02-21T08:20:33.5727171Z  'range_warp_specializes': [],
2026-02-21T08:20:33.5727395Z  'reduction_loops': [None]}
2026-02-21T08:20:33.5746640Z [117s] Fitting surrogate: 273 points, 273 targets
2026-02-21T08:20:34.3752577Z [118s] Generation 3 starting: 47 neighbors, 5 active search path(s)
2026-02-21T08:20:38.0273512Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 48.4 configs/s
2026-02-21T08:20:41.6129949Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 13.2 configs/s
2026-02-21T08:20:47.0381190Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 188.1         
2026-02-21T08:20:47.0381723Z                                                                   configs/s     
2026-02-21T08:20:47.5245199Z [131s] Generation 3 complete: 
2026-02-21T08:20:47.5245525Z ok=52
2026-02-21T08:20:47.5245715Z min=0.0150
2026-02-21T08:20:47.5245915Z mid=0.0159
2026-02-21T08:20:47.5246096Z max=0.0217
2026-02-21T08:20:47.5246324Z best={'block_sizes': [1],
2026-02-21T08:20:47.5246793Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:20:47.5247406Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:20:47.5247865Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:20:47.5248185Z  'num_stages': 1,
2026-02-21T08:20:47.5248382Z  'num_warps': 4,
2026-02-21T08:20:47.5248575Z  'pid_type': 'flat',
2026-02-21T08:20:47.5248791Z  'range_flattens': [None],
2026-02-21T08:20:47.5249027Z  'range_multi_buffers': [None],
2026-02-21T08:20:47.5249266Z  'range_num_stages': [0],
2026-02-21T08:20:47.5249494Z  'range_unroll_factors': [0],
2026-02-21T08:20:47.5249735Z  'range_warp_specializes': [],
2026-02-21T08:20:47.5250091Z  'reduction_loops': [None]}
2026-02-21T08:20:47.5273119Z [131s] Fitting surrogate: 325 points, 325 targets
2026-02-21T08:20:48.6351127Z [132s] Generation 4 starting: 45 neighbors, 5 active search path(s)
2026-02-21T08:20:52.3202864Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 26.4 configs/s
2026-02-21T08:20:55.1033605Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 16.4 configs/s
2026-02-21T08:21:00.1040796Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 203.9         
2026-02-21T08:21:00.1041406Z                                                                   configs/s     
2026-02-21T08:21:00.5221755Z [144s] Generation 4 complete: 
2026-02-21T08:21:00.5222050Z ok=50
2026-02-21T08:21:00.5222559Z min=0.0154
2026-02-21T08:21:00.5222819Z mid=0.0158
2026-02-21T08:21:00.5223327Z max=0.0300
2026-02-21T08:21:00.5223766Z best={'block_sizes': [1],
2026-02-21T08:21:00.5224943Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:00.5225862Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:21:00.5226665Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:21:00.5227137Z  'num_stages': 1,
2026-02-21T08:21:00.5241998Z  'num_warps': 4,
2026-02-21T08:21:00.5242296Z  'pid_type': 'flat',
2026-02-21T08:21:00.6509528Z  'range_flattens': [None],
2026-02-21T08:21:00.6509974Z  'range_multi_buffers': [None],
2026-02-21T08:21:00.6510389Z  'range_num_stages': [0],
2026-02-21T08:21:00.6510768Z  'range_unroll_factors': [0],
2026-02-21T08:21:00.6511172Z  'range_warp_specializes': [],
2026-02-21T08:21:00.6511557Z  'reduction_loops': [None]}
2026-02-21T08:21:00.6512024Z [144s] Fitting surrogate: 375 points, 375 targets
2026-02-21T08:21:01.2086573Z [145s] Generation 5 starting: 35 neighbors, 4 active search path(s)
2026-02-21T08:21:05.2055507Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 15.6 configs/s
2026-02-21T08:21:07.4115239Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 16.6 configs/s
2026-02-21T08:21:11.7312348Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 251.4         
2026-02-21T08:21:11.7312888Z                                                                   configs/s     
2026-02-21T08:21:12.1003144Z [156s] Generation 5 complete: 
2026-02-21T08:21:12.1003505Z ok=39
2026-02-21T08:21:12.1003714Z min=0.0152
2026-02-21T08:21:12.1003890Z mid=0.0156
2026-02-21T08:21:12.1004523Z max=0.0206
2026-02-21T08:21:12.1004716Z best={'block_sizes': [1],
2026-02-21T08:21:12.1005192Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:12.1005849Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:12.1006286Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:21:12.1006724Z  'load_eviction_policies': ['first', 'last', 'last', '', 'first', 'first', '', 'first'],
2026-02-21T08:21:12.1007143Z  'num_stages': 2,
2026-02-21T08:21:12.1007348Z  'num_warps': 4,
2026-02-21T08:21:12.1007558Z  'pid_type': 'flat',
2026-02-21T08:21:12.1007800Z  'range_flattens': [None],
2026-02-21T08:21:12.1008052Z  'range_multi_buffers': [None],
2026-02-21T08:21:12.1008296Z  'range_num_stages': [0],
2026-02-21T08:21:12.1008533Z  'range_unroll_factors': [0],
2026-02-21T08:21:12.1008789Z  'range_warp_specializes': [],
2026-02-21T08:21:12.1009043Z  'reduction_loops': [None]}
2026-02-21T08:21:12.1027151Z [156s] Fitting surrogate: 414 points, 414 targets
2026-02-21T08:21:12.8072357Z [156s] Generation 6 starting: 36 neighbors, 4 active search path(s)
2026-02-21T08:21:15.5356128Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 36.7 configs/s
2026-02-21T08:21:18.2595104Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 13.4 configs/s
2026-02-21T08:21:22.4027326Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 246.4         
2026-02-21T08:21:22.4027900Z                                                                   configs/s     
2026-02-21T08:21:22.7837626Z [166s] Generation 6 complete: 
2026-02-21T08:21:22.7838021Z ok=40
2026-02-21T08:21:22.7838301Z min=0.0151
2026-02-21T08:21:22.7838527Z mid=0.0154
2026-02-21T08:21:22.7838754Z max=0.0200
2026-02-21T08:21:22.7838995Z best={'block_sizes': [1],
2026-02-21T08:21:22.7839602Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:22.7840404Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:22.7840908Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:21:22.7841388Z  'load_eviction_policies': ['first', 'last', 'last', '', 'first', '', '', 'first'],
2026-02-21T08:21:22.7841862Z  'num_stages': 3,
2026-02-21T08:21:22.7842083Z  'num_warps': 4,
2026-02-21T08:21:22.7842299Z  'pid_type': 'flat',
2026-02-21T08:21:22.7842545Z  'range_flattens': [None],
2026-02-21T08:21:22.7842805Z  'range_multi_buffers': [None],
2026-02-21T08:21:22.7843084Z  'range_num_stages': [0],
2026-02-21T08:21:22.7843342Z  'range_unroll_factors': [0],
2026-02-21T08:21:22.7843626Z  'range_warp_specializes': [],
2026-02-21T08:21:22.7843898Z  'reduction_loops': [None]}
2026-02-21T08:21:22.7865972Z [166s] Fitting surrogate: 454 points, 454 targets
2026-02-21T08:21:23.5768759Z [167s] Generation 7 starting: 41 neighbors, 4 active search path(s)
2026-02-21T08:21:28.2098751Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 17.6 configs/s
2026-02-21T08:21:30.9401559Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 41/41 15.2 configs/s
2026-02-21T08:21:35.9176807Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 216.8         
2026-02-21T08:21:35.9177354Z                                                                   configs/s     
2026-02-21T08:21:36.3179359Z [180s] Generation 7 complete: 
2026-02-21T08:21:36.3179649Z ok=45
2026-02-21T08:21:36.3179821Z min=0.0151
2026-02-21T08:21:36.3179998Z mid=0.0154
2026-02-21T08:21:36.3180163Z max=0.0226
2026-02-21T08:21:36.3180343Z best={'block_sizes': [1],
2026-02-21T08:21:36.3181617Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:36.3182264Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:36.3182719Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:21:36.3183140Z  'load_eviction_policies': ['first', 'last', 'last', '', 'first', '', 'last', 'first'],
2026-02-21T08:21:36.3183555Z  'num_stages': 3,
2026-02-21T08:21:36.3183755Z  'num_warps': 4,
2026-02-21T08:21:36.3183947Z  'pid_type': 'flat',
2026-02-21T08:21:36.3184594Z  'range_flattens': [None],
2026-02-21T08:21:36.3184837Z  'range_multi_buffers': [None],
2026-02-21T08:21:36.3185081Z  'range_num_stages': [0],
2026-02-21T08:21:36.3185316Z  'range_unroll_factors': [0],
2026-02-21T08:21:36.3185563Z  'range_warp_specializes': [],
2026-02-21T08:21:36.3185800Z  'reduction_loops': [None]}
2026-02-21T08:21:36.3207423Z [180s] Fitting surrogate: 499 points, 499 targets
2026-02-21T08:21:36.9141771Z [180s] Generation 8 starting: 30 neighbors, 3 active search path(s)
2026-02-21T08:21:39.7161606Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 16.0 configs/s
2026-02-21T08:21:41.7403495Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 30/30 15.1 configs/s
2026-02-21T08:21:45.1517669Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 298.3         
2026-02-21T08:21:45.1518215Z                                                                   configs/s     
2026-02-21T08:21:45.4644317Z [189s] Generation 8 complete: 
2026-02-21T08:21:45.4644638Z ok=33
2026-02-21T08:21:45.4644817Z min=0.0151
2026-02-21T08:21:45.4645015Z mid=0.0152
2026-02-21T08:21:45.4645187Z max=0.0205
2026-02-21T08:21:45.4645390Z best={'block_sizes': [1],
2026-02-21T08:21:45.4645852Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:45.4646481Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:45.4646967Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:21:45.4647405Z  'load_eviction_policies': ['first', 'last', 'last', '', 'first', '', 'last', 'last'],
2026-02-21T08:21:45.4647821Z  'num_stages': 3,
2026-02-21T08:21:45.4648758Z  'num_warps': 4,
2026-02-21T08:21:45.4648965Z  'pid_type': 'flat',
2026-02-21T08:21:45.4649177Z  'range_flattens': [None],
2026-02-21T08:21:45.4649418Z  'range_multi_buffers': [None],
2026-02-21T08:21:45.4649677Z  'range_num_stages': [0],
2026-02-21T08:21:45.4650000Z  'range_unroll_factors': [0],
2026-02-21T08:21:45.4650268Z  'range_warp_specializes': [],
2026-02-21T08:21:45.4650513Z  'reduction_loops': [None]}
2026-02-21T08:21:45.4674413Z [189s] Fitting surrogate: 532 points, 532 targets
2026-02-21T08:21:46.0314135Z [189s] Generation 9 starting: 30 neighbors, 3 active search path(s)
2026-02-21T08:21:49.7129193Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 12.7 configs/s
2026-02-21T08:21:51.5003552Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 30/30 17.2 configs/s
2026-02-21T08:21:55.1876472Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 298.2         
2026-02-21T08:21:55.1877077Z                                                                   configs/s     
2026-02-21T08:21:55.5024406Z [199s] Generation 9 complete: 
2026-02-21T08:21:55.5024698Z ok=33
2026-02-21T08:21:55.5024870Z min=0.0151
2026-02-21T08:21:55.5025050Z mid=0.0156
2026-02-21T08:21:55.5025212Z max=0.0200
2026-02-21T08:21:55.5025397Z best={'block_sizes': [1],
2026-02-21T08:21:55.5025841Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:55.5026471Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:21:55.5026896Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:21:55.5027323Z  'load_eviction_policies': ['first', 'last', 'last', 'last', 'first', '', 'last', 'last'],
2026-02-21T08:21:55.5027742Z  'num_stages': 3,
2026-02-21T08:21:55.5027930Z  'num_warps': 4,
2026-02-21T08:21:55.5028146Z  'pid_type': 'flat',
2026-02-21T08:21:55.5028362Z  'range_flattens': [None],
2026-02-21T08:21:55.5028588Z  'range_multi_buffers': [None],
2026-02-21T08:21:55.5028819Z  'range_num_stages': [0],
2026-02-21T08:21:55.5029052Z  'range_unroll_factors': [0],
2026-02-21T08:21:55.5029285Z  'range_warp_specializes': [],
2026-02-21T08:21:55.5029521Z  'reduction_loops': [None]}
2026-02-21T08:21:55.5052934Z [199s] Fitting surrogate: 565 points, 565 targets
2026-02-21T08:21:56.0773295Z [199s] Generation 10 starting: 30 neighbors, 3 active search path(s)
2026-02-21T08:21:58.4763749Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 30.9 configs/s
2026-02-21T08:22:00.4093554Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 15.8 configs/s
2026-02-21T08:22:03.8154637Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 298.7         
2026-02-21T08:22:03.8155376Z                                                                   configs/s     
2026-02-21T08:22:04.1378851Z [208s] Generation 10 complete: 
2026-02-21T08:22:04.1381376Z ok=33
2026-02-21T08:22:04.1381566Z min=0.0152
2026-02-21T08:22:04.1381763Z mid=0.0153
2026-02-21T08:22:04.1381938Z max=0.0199
2026-02-21T08:22:04.1382156Z best={'block_sizes': [1],
2026-02-21T08:22:04.1382649Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:22:04.1383385Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:04.1383878Z               'pointer'],
2026-02-21T08:22:04.1384699Z  'load_eviction_policies': ['first', 'last', 'last', 'last', 'first', '', 'last', 'last'],
2026-02-21T08:22:04.1385163Z  'num_stages': 3,
2026-02-21T08:22:04.1385366Z  'num_warps': 4,
2026-02-21T08:22:04.1385580Z  'pid_type': 'flat',
2026-02-21T08:22:04.1385800Z  'range_flattens': [None],
2026-02-21T08:22:04.1386052Z  'range_multi_buffers': [None],
2026-02-21T08:22:04.1386313Z  'range_num_stages': [0],
2026-02-21T08:22:04.1386569Z  'range_unroll_factors': [0],
2026-02-21T08:22:04.1386834Z  'range_warp_specializes': [],
2026-02-21T08:22:04.1387088Z  'reduction_loops': [None]}
2026-02-21T08:22:04.1415188Z [208s] Fitting surrogate: 598 points, 598 targets
2026-02-21T08:22:04.7498811Z [208s] Generation 11 starting: 31 neighbors, 3 active search path(s)
2026-02-21T08:22:08.9328729Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 11.9 configs/s
2026-02-21T08:22:11.3804634Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 13.6 configs/s
2026-02-21T08:22:15.1276289Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 297.7         
2026-02-21T08:22:15.1277934Z                                                                   configs/s     
2026-02-21T08:22:15.4290410Z [219s] Generation 11 complete: 
2026-02-21T08:22:15.4290867Z ok=34
2026-02-21T08:22:15.4291157Z min=0.0150
2026-02-21T08:22:15.4291452Z mid=0.0158
2026-02-21T08:22:15.4291714Z max=0.1572
2026-02-21T08:22:15.4292595Z best={'block_sizes': [1],
2026-02-21T08:22:15.4293365Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:15.4294726Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:15.4295423Z               'pointer'],
2026-02-21T08:22:15.4296157Z  'load_eviction_policies': ['first', 'last', 'last', 'last', 'first', '', 'last', 'last'],
2026-02-21T08:22:15.4296851Z  'num_stages': 3,
2026-02-21T08:22:15.4297045Z  'num_warps': 4,
2026-02-21T08:22:15.4297240Z  'pid_type': 'flat',
2026-02-21T08:22:15.4297453Z  'range_flattens': [None],
2026-02-21T08:22:15.4297686Z  'range_multi_buffers': [None],
2026-02-21T08:22:15.4297923Z  'range_num_stages': [0],
2026-02-21T08:22:15.4298161Z  'range_unroll_factors': [0],
2026-02-21T08:22:15.4298398Z  'range_warp_specializes': [],
2026-02-21T08:22:15.4298639Z  'reduction_loops': [None]}
2026-02-21T08:22:15.4321144Z [219s] Fitting surrogate: 632 points, 632 targets
2026-02-21T08:22:16.0291149Z [219s] Generation 12 starting: 31 neighbors, 3 active search path(s)
2026-02-21T08:22:19.2826117Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 27.1 configs/s
2026-02-21T08:22:21.1433232Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 17.1 configs/s
2026-02-21T08:22:24.6586141Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 289.6         
2026-02-21T08:22:24.6586731Z                                                                   configs/s     
2026-02-21T08:22:24.9797942Z [228s] Generation 12 complete: 
2026-02-21T08:22:24.9798484Z ok=34
2026-02-21T08:22:24.9798793Z min=0.0149
2026-02-21T08:22:24.9799105Z mid=0.0153
2026-02-21T08:22:24.9799401Z max=0.0213
2026-02-21T08:22:24.9799735Z best={'block_sizes': [1],
2026-02-21T08:22:24.9800587Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:24.9801819Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:24.9802687Z               'pointer'],
2026-02-21T08:22:24.9803279Z  'load_eviction_policies': ['first', 'last', 'last', 'last', 'first', '', 'last', 'first'],
2026-02-21T08:22:24.9803794Z  'num_stages': 3,
2026-02-21T08:22:24.9804350Z  'num_warps': 4,
2026-02-21T08:22:24.9804590Z  'pid_type': 'flat',
2026-02-21T08:22:24.9804829Z  'range_flattens': [None],
2026-02-21T08:22:24.9805097Z  'range_multi_buffers': [None],
2026-02-21T08:22:24.9805373Z  'range_num_stages': [0],
2026-02-21T08:22:24.9805639Z  'range_unroll_factors': [0],
2026-02-21T08:22:24.9805937Z  'range_warp_specializes': [],
2026-02-21T08:22:24.9806221Z  'reduction_loops': [None]}
2026-02-21T08:22:24.9833038Z [228s] Fitting surrogate: 666 points, 666 targets
2026-02-21T08:22:25.5526212Z [229s] Generation 13 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:22:29.4136386Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 10.9 configs/s
2026-02-21T08:22:31.5512505Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 13.8 configs/s
2026-02-21T08:22:35.1707093Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 307.2         
2026-02-21T08:22:35.1708053Z                                                                   configs/s     
2026-02-21T08:22:35.4787886Z [239s] Generation 13 complete: 
2026-02-21T08:22:35.4788126Z ok=32
2026-02-21T08:22:35.4788300Z min=0.0149
2026-02-21T08:22:35.4788479Z mid=0.0153
2026-02-21T08:22:35.4788642Z max=0.0201
2026-02-21T08:22:35.4788822Z best={'block_sizes': [1],
2026-02-21T08:22:35.4789258Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:35.4790017Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:35.4790833Z               'pointer'],
2026-02-21T08:22:35.4791461Z  'load_eviction_policies': ['first', 'last', 'last', '', 'first', '', 'last', 'first'],
2026-02-21T08:22:35.4792127Z  'num_stages': 3,
2026-02-21T08:22:35.4793019Z  'num_warps': 4,
2026-02-21T08:22:35.4793386Z  'pid_type': 'flat',
2026-02-21T08:22:35.4793732Z  'range_flattens': [None],
2026-02-21T08:22:35.4794603Z  'range_multi_buffers': [None],
2026-02-21T08:22:35.4795002Z  'range_num_stages': [0],
2026-02-21T08:22:35.4795369Z  'range_unroll_factors': [0],
2026-02-21T08:22:35.4795759Z  'range_warp_specializes': [],
2026-02-21T08:22:35.4796168Z  'reduction_loops': [None]}
2026-02-21T08:22:35.4822969Z [239s] Fitting surrogate: 698 points, 698 targets
2026-02-21T08:22:36.0591903Z [239s] Generation 14 starting: 30 neighbors, 3 active search path(s)
2026-02-21T08:22:38.5786918Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 31.0 configs/s
2026-02-21T08:22:40.6917008Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 14.4 configs/s
2026-02-21T08:22:44.1012332Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 298.4         
2026-02-21T08:22:44.1012913Z                                                                   configs/s     
2026-02-21T08:22:44.4210993Z [248s] Generation 14 complete: 
2026-02-21T08:22:44.4211421Z ok=33
2026-02-21T08:22:44.4211714Z min=0.0151
2026-02-21T08:22:44.4212034Z mid=0.0152
2026-02-21T08:22:44.4212298Z max=0.0224
2026-02-21T08:22:44.4212594Z best={'block_sizes': [1],
2026-02-21T08:22:44.4213240Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:44.4215080Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:22:44.4215891Z               'pointer', 'pointer'],
2026-02-21T08:22:44.4216689Z  'load_eviction_policies': ['first', 'last', 'last', '', 'first', '', 'last', 'first'],
2026-02-21T08:22:44.4217125Z  'num_stages': 4,
2026-02-21T08:22:44.4217312Z  'num_warps': 4,
2026-02-21T08:22:44.4217513Z  'pid_type': 'flat',
2026-02-21T08:22:44.4217729Z  'range_flattens': [None],
2026-02-21T08:22:44.4217979Z  'range_multi_buffers': [None],
2026-02-21T08:22:44.4218231Z  'range_num_stages': [0],
2026-02-21T08:22:44.4218472Z  'range_unroll_factors': [0],
2026-02-21T08:22:44.4218725Z  'range_warp_specializes': [],
2026-02-21T08:22:44.4218963Z  'reduction_loops': [None]}
2026-02-21T08:22:44.4249825Z [248s] Fitting surrogate: 731 points, 731 targets
2026-02-21T08:22:44.8465252Z [248s] Generation 15 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:22:48.6297390Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 7.5 configs/s
2026-02-21T08:22:49.8574776Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.9 configs/s
2026-02-21T08:22:52.0206273Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 470.7         
2026-02-21T08:22:52.0206800Z                                                                   configs/s     
2026-02-21T08:22:52.2260381Z [256s] Generation 15 complete: 
2026-02-21T08:22:52.2260677Z ok=22
2026-02-21T08:22:52.2260868Z min=0.0149
2026-02-21T08:22:52.2261061Z mid=0.0154
2026-02-21T08:22:52.2261291Z max=0.0509
2026-02-21T08:22:52.2261522Z best={'block_sizes': [1],
2026-02-21T08:22:52.2261990Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:52.2263090Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:22:52.2263559Z               'pointer', 'pointer'],
2026-02-21T08:22:52.2264351Z  'load_eviction_policies': ['first', 'last', 'last', 'first', 'first', '', 'last', 'first'],
2026-02-21T08:22:52.2264795Z  'num_stages': 4,
2026-02-21T08:22:52.2264980Z  'num_warps': 4,
2026-02-21T08:22:52.2265174Z  'pid_type': 'flat',
2026-02-21T08:22:52.2265385Z  'range_flattens': [None],
2026-02-21T08:22:52.2265611Z  'range_multi_buffers': [None],
2026-02-21T08:22:52.2265851Z  'range_num_stages': [0],
2026-02-21T08:22:52.2266072Z  'range_unroll_factors': [0],
2026-02-21T08:22:52.2266315Z  'range_warp_specializes': [],
2026-02-21T08:22:52.2266550Z  'reduction_loops': [None]}
2026-02-21T08:22:52.2297956Z [256s] Fitting surrogate: 753 points, 753 targets
2026-02-21T08:22:52.6343500Z [256s] Generation 16 starting: 16 neighbors, 2 active search path(s)
2026-02-21T08:22:54.4284350Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 21.7 configs/s
2026-02-21T08:22:55.3939336Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 16/16 17.4 configs/s
2026-02-21T08:22:57.2432961Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 551.2         
2026-02-21T08:22:57.2433444Z                                                                   configs/s     
2026-02-21T08:22:57.4218172Z [261s] Generation 16 complete: 
2026-02-21T08:22:57.4218484Z ok=18
2026-02-21T08:22:57.4218673Z min=0.0151
2026-02-21T08:22:57.4218845Z mid=0.0153
2026-02-21T08:22:57.4219019Z max=0.0186
2026-02-21T08:22:57.4219207Z best={'block_sizes': [1],
2026-02-21T08:22:57.4219619Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:22:57.4220280Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:22:57.4220736Z               'pointer', 'pointer'],
2026-02-21T08:22:57.4221147Z  'load_eviction_policies': ['first', 'last', 'last', 'first', 'first', '', 'last', 'first'],
2026-02-21T08:22:57.4221577Z  'num_stages': 4,
2026-02-21T08:22:57.4221795Z  'num_warps': 4,
2026-02-21T08:22:57.4221990Z  'pid_type': 'flat',
2026-02-21T08:22:57.4222191Z  'range_flattens': [None],
2026-02-21T08:22:57.4222438Z  'range_multi_buffers': [None],
2026-02-21T08:22:57.4222688Z  'range_num_stages': [0],
2026-02-21T08:22:57.4222919Z  'range_unroll_factors': [0],
2026-02-21T08:22:57.4223158Z  'range_warp_specializes': [],
2026-02-21T08:22:57.4223414Z  'reduction_loops': [None]}
2026-02-21T08:22:57.4264925Z [261s] Fitting surrogate: 771 points, 771 targets
2026-02-21T08:22:57.7107044Z [261s] Generation 17 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:22:58.9141895Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 91.2 configs/s
2026-02-21T08:22:59.4537134Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.3 configs/s
2026-02-21T08:23:00.8762495Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 910.6         
2026-02-21T08:23:00.8763782Z                                                                   configs/s     
2026-02-21T08:23:00.9890358Z [264s] Generation 17 complete: 
2026-02-21T08:23:00.9890645Z ok=11
2026-02-21T08:23:00.9890821Z min=0.0151
2026-02-21T08:23:00.9891005Z mid=0.0156
2026-02-21T08:23:00.9891172Z max=0.0166
2026-02-21T08:23:00.9891366Z best={'block_sizes': [4],
2026-02-21T08:23:00.9891808Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:23:00.9892479Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:23:00.9893078Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', '', 'first', 'last'],
2026-02-21T08:23:00.9893932Z  'num_stages': 8,
2026-02-21T08:23:00.9894504Z  'num_warps': 2,
2026-02-21T08:23:00.9894700Z  'pid_type': 'flat',
2026-02-21T08:23:00.9894920Z  'range_flattens': [None],
2026-02-21T08:23:00.9895157Z  'range_multi_buffers': [None],
2026-02-21T08:23:00.9895406Z  'range_num_stages': [0],
2026-02-21T08:23:00.9895641Z  'range_unroll_factors': [0],
2026-02-21T08:23:00.9895886Z  'range_warp_specializes': [],
2026-02-21T08:23:00.9896136Z  'reduction_loops': [None]}
2026-02-21T08:23:00.9922462Z [264s] Fitting surrogate: 782 points, 782 targets
2026-02-21T08:23:01.2551491Z [265s] Generation 18 starting: 7 neighbors, 1 active search path(s)
2026-02-21T08:23:02.8904545Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7/7 1.5 configs/s
2026-02-21T08:23:03.3152503Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 7/7 18.6 configs/s
2026-02-21T08:23:04.1466389Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 1230.0        
2026-02-21T08:23:04.1466902Z                                                                   configs/s     
2026-02-21T08:23:04.2134483Z [268s] Generation 18 complete: 
2026-02-21T08:23:04.2134772Z ok=8
2026-02-21T08:23:04.2134966Z min=0.0151
2026-02-21T08:23:04.2135160Z mid=0.0158
2026-02-21T08:23:04.2135332Z max=0.0176
2026-02-21T08:23:04.2135509Z best={'block_sizes': [4],
2026-02-21T08:23:04.2135952Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:23:04.2136624Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:23:04.2137219Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', '', 'first', 'last'],
2026-02-21T08:23:04.2137617Z  'num_stages': 8,
2026-02-21T08:23:04.2137810Z  'num_warps': 2,
2026-02-21T08:23:04.2138023Z  'pid_type': 'flat',
2026-02-21T08:23:04.2138236Z  'range_flattens': [None],
2026-02-21T08:23:04.2138472Z  'range_multi_buffers': [None],
2026-02-21T08:23:04.2138711Z  'range_num_stages': [0],
2026-02-21T08:23:04.2138953Z  'range_unroll_factors': [0],
2026-02-21T08:23:04.2139198Z  'range_warp_specializes': [],
2026-02-21T08:23:04.2139444Z  'reduction_loops': [None]}
2026-02-21T08:23:04.2175822Z [268s] Fitting surrogate: 790 points, 790 targets
2026-02-21T08:23:04.3749366Z [268s] Autotuning complete in 268.3s after searching 734 configs.
2026-02-21T08:23:04.3749847Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:23:04.3752089Z     @helion.kernel(config=helion.Config(block_sizes=[4], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', 'first', 'last', '', 'first', 'last'], num_stages=8, num_warps=2, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:23:04.3754457Z 
2026-02-21T08:23:04.3754896Z [268s] Code of selected kernel: /tmp/torchinductor_root/22/c2224j7ry6e27apmnfyxjamn43ilbal7ytebftso4yqbqd2ggwbg.py
2026-02-21T08:23:05.2767333Z WARNING:tritonbench.utils.triton_op:Completed input ID 0:
2026-02-21T08:23:05.2768107Z (M, N)
2026-02-21T08:23:05.2768289Z ------------
2026-02-21T08:23:05.2768480Z (4096, 1024)
2026-02-21T08:23:05.2768615Z 
2026-02-21T08:23:05.2788514Z   5%|▌         | 1/20 [04:37<1:27:56, 277.70s/it]WARNING:tritonbench.utils.triton_op:Running input ID 2:
2026-02-21T08:23:05.2788955Z (M, N)
2026-02-21T08:23:05.2789121Z ------------
2026-02-21T08:23:05.2789296Z (4096, 2048)
2026-02-21T08:23:05.2790865Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:23:06.9542998Z INFO:tritonbench.utils.triton_op:Took 3.15ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:23:12.1405376Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:23:13.9223561Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:23:13.9224292Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:23:13.9224596Z               'dtype': 'torch.float32',
2026-02-21T08:23:13.9224910Z               'shape': (4096, 2048),
2026-02-21T08:23:13.9225177Z               'stride': (2048, 1)},
2026-02-21T08:23:13.9225430Z             (2048,),
2026-02-21T08:23:13.9225644Z             { 'device': 'cuda:0',
2026-02-21T08:23:13.9225924Z               'dtype': 'torch.float32',
2026-02-21T08:23:13.9226200Z               'shape': (2048,),
2026-02-21T08:23:13.9226445Z               'stride': (1,)},
2026-02-21T08:23:13.9226693Z             { 'device': 'cuda:0',
2026-02-21T08:23:13.9226948Z               'dtype': 'torch.float32',
2026-02-21T08:23:13.9227220Z               'shape': (2048,),
2026-02-21T08:23:13.9227454Z               'stride': (1,)},
2026-02-21T08:23:13.9227688Z             1e-05),
2026-02-21T08:23:13.9227883Z   'kwargs': {}}
2026-02-21T08:23:13.9228381Z INFO:tritonbench.utils.triton_op:Took 2.91ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:23:13.9229338Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:23:13.9230273Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:23:13.9230914Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:23:13.9231282Z While processing:
2026-02-21T08:23:13.9234432Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:23:13.9234905Z     if bias is not None:
2026-02-21T08:23:13.9235143Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:23:13.9235300Z 
2026-02-21T08:23:14.0324758Z [0s] Autotune random seed: 2135381352
2026-02-21T08:23:14.1739681Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:23:51.1593818Z [36s] Timeout after 30s compiling Config(block_sizes=[128], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last', 'first', '', 'last', 'last', 'first', 'first'], maxnreg=64, num_sm_multiplier=64, num_stages=2, num_warps=2, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[1], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T08:23:51.5711371Z [37s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:23:52.6370857Z [38s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'last', 'last', '', 'last', 'first', 'last', ''], maxnreg=128, num_sm_multiplier=1, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T08:23:53.0881484Z [38s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first', 'last', '', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=8, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:23:53.4497005Z [39s] Timeout after 30s compiling Config(block_sizes=[2048], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'first', '', 'last', 'last', 'first', 'first', 'last'], num_stages=8, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:23:53.4520774Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 2.3 configs/s
2026-02-21T08:24:00.7531927Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.8 configs/s
2026-02-21T08:24:00.7545523Z [46s] Adaptive compile timeout: 30s (90% percentile=12.9s, bounds=[30.0s, 30s])
2026-02-21T08:24:02.4721513Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 590.5 configs/s
2026-02-21T08:24:02.6225418Z [48s] Initial random population of 100, 5 starting points: 
2026-02-21T08:24:02.6225811Z error=6
2026-02-21T08:24:02.6225991Z timeout=5
2026-02-21T08:24:02.6226172Z ok=89
2026-02-21T08:24:02.6226350Z min=0.0272
2026-02-21T08:24:02.6226533Z mid=0.1631
2026-02-21T08:24:02.6226708Z max=8.8229
2026-02-21T08:24:02.6226912Z best={'block_sizes': [1],
2026-02-21T08:24:02.6227344Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:24:02.6227903Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:24:02.6228360Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:24:02.6228716Z  'num_stages': 1,
2026-02-21T08:24:02.6228922Z  'num_warps': 4,
2026-02-21T08:24:02.6229123Z  'pid_type': 'flat',
2026-02-21T08:24:02.6229364Z  'range_flattens': [None],
2026-02-21T08:24:02.6229619Z  'range_multi_buffers': [None],
2026-02-21T08:24:02.6229881Z  'range_num_stages': [0],
2026-02-21T08:24:02.6230120Z  'range_unroll_factors': [0],
2026-02-21T08:24:02.6230382Z  'range_warp_specializes': [],
2026-02-21T08:24:02.6230636Z  'reduction_loops': [None]}
2026-02-21T08:24:02.6246551Z [48s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:24:04.2649199Z [50s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T08:24:15.1040166Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 34.5 configs/s
2026-02-21T08:24:21.8865010Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 13.9 configs/s
2026-02-21T08:24:30.2937694Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.3         
2026-02-21T08:24:30.2940285Z                                                                   configs/s     
2026-02-21T08:24:30.9623860Z [76s] Generation 1 complete: 
2026-02-21T08:24:31.1875455Z ok=95
2026-02-21T08:24:31.1875642Z min=0.0259
2026-02-21T08:24:31.1875826Z mid=0.0325
2026-02-21T08:24:31.1876001Z max=0.3273
2026-02-21T08:24:31.1876189Z best={'block_sizes': [1],
2026-02-21T08:24:31.1876682Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:24:31.1877262Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:24:31.1877692Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:24:31.1878022Z  'num_stages': 1,
2026-02-21T08:24:31.1878225Z  'num_warps': 4,
2026-02-21T08:24:31.1878428Z  'pid_type': 'flat',
2026-02-21T08:24:31.1878646Z  'range_flattens': [None],
2026-02-21T08:24:31.1878896Z  'range_multi_buffers': [None],
2026-02-21T08:24:31.1879163Z  'range_num_stages': [0],
2026-02-21T08:24:31.1879770Z  'range_unroll_factors': [0],
2026-02-21T08:24:31.1880076Z  'range_warp_specializes': [],
2026-02-21T08:24:31.1880354Z  'reduction_loops': [None]}
2026-02-21T08:24:31.1880620Z [76s] Fitting surrogate: 195 points, 195 targets
2026-02-21T08:24:32.1789492Z [78s] Generation 2 starting: 75 neighbors, 5 active search path(s)
2026-02-21T08:24:45.3283849Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 5.6 configs/s
2026-02-21T08:24:50.1600376Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 16.3 configs/s
2026-02-21T08:24:58.7903261Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 122.1         
2026-02-21T08:24:58.7908417Z                                                                   configs/s     
2026-02-21T08:24:59.4757498Z [105s] Generation 2 complete: 
2026-02-21T08:24:59.4757898Z ok=80
2026-02-21T08:24:59.4758168Z min=0.0261
2026-02-21T08:24:59.4758427Z mid=0.0282
2026-02-21T08:24:59.4758677Z max=0.0924
2026-02-21T08:24:59.4758982Z best={'block_sizes': [1],
2026-02-21T08:24:59.4759658Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:24:59.4760528Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:24:59.4761024Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:24:59.4761359Z  'num_stages': 1,
2026-02-21T08:24:59.4761570Z  'num_warps': 4,
2026-02-21T08:24:59.4761780Z  'pid_type': 'flat',
2026-02-21T08:24:59.4762001Z  'range_flattens': [None],
2026-02-21T08:24:59.4762255Z  'range_multi_buffers': [None],
2026-02-21T08:24:59.4762514Z  'range_num_stages': [0],
2026-02-21T08:24:59.4762780Z  'range_unroll_factors': [0],
2026-02-21T08:24:59.4763040Z  'range_warp_specializes': [],
2026-02-21T08:24:59.4763300Z  'reduction_loops': [None]}
2026-02-21T08:24:59.4782415Z [105s] Fitting surrogate: 275 points, 275 targets
2026-02-21T08:25:00.5185876Z [106s] Generation 3 starting: 64 neighbors, 5 active search path(s)
2026-02-21T08:25:07.4398075Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 19.3 configs/s
2026-02-21T08:25:12.4097389Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 13.6 configs/s
2026-02-21T08:25:19.1756558Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.4         
2026-02-21T08:25:19.1757103Z                                                                   configs/s     
2026-02-21T08:25:19.7240322Z [125s] Generation 3 complete: 
2026-02-21T08:25:19.7240604Z ok=69
2026-02-21T08:25:19.7240790Z min=0.0261
2026-02-21T08:25:19.7240981Z mid=0.0275
2026-02-21T08:25:19.7241158Z max=0.1742
2026-02-21T08:25:19.7241358Z best={'block_sizes': [2],
2026-02-21T08:25:19.7241828Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:25:19.7242563Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:25:19.7243106Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:25:19.7243545Z  'load_eviction_policies': ['', '', 'first', 'first', 'first', '', 'last', 'first'],
2026-02-21T08:25:19.7244364Z  'num_stages': 2,
2026-02-21T08:25:19.7244893Z  'num_warps': 4,
2026-02-21T08:25:19.7245102Z  'pid_type': 'flat',
2026-02-21T08:25:19.7245325Z  'range_flattens': [None],
2026-02-21T08:25:19.7245576Z  'range_multi_buffers': [None],
2026-02-21T08:25:19.7245836Z  'range_num_stages': [0],
2026-02-21T08:25:19.7246074Z  'range_unroll_factors': [0],
2026-02-21T08:25:19.7246335Z  'range_warp_specializes': [],
2026-02-21T08:25:19.7246589Z  'reduction_loops': [None]}
2026-02-21T08:25:19.7268631Z [125s] Fitting surrogate: 344 points, 344 targets
2026-02-21T08:25:20.8688574Z [126s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T08:25:28.3583922Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 13.9 configs/s
2026-02-21T08:25:32.6945370Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 15.4 configs/s
2026-02-21T08:25:40.1809651Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 137.6         
2026-02-21T08:25:40.1810309Z                                                                   configs/s     
2026-02-21T08:25:40.6980012Z [146s] Generation 4 complete: 
2026-02-21T08:25:40.6980310Z ok=70
2026-02-21T08:25:40.6980531Z min=0.0257
2026-02-21T08:25:40.6980745Z mid=0.0267
2026-02-21T08:25:40.6980947Z max=0.1461
2026-02-21T08:25:40.6981160Z best={'block_sizes': [8],
2026-02-21T08:25:40.6981692Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:25:40.6982348Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:25:40.6982826Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:25:40.6983206Z  'num_stages': 1,
2026-02-21T08:25:40.6983431Z  'num_warps': 8,
2026-02-21T08:25:40.6983660Z  'pid_type': 'flat',
2026-02-21T08:25:40.6983909Z  'range_flattens': [None],
2026-02-21T08:25:40.6984408Z  'range_multi_buffers': [None],
2026-02-21T08:25:40.6984688Z  'range_num_stages': [0],
2026-02-21T08:25:40.6984958Z  'range_unroll_factors': [0],
2026-02-21T08:25:40.6985248Z  'range_warp_specializes': [],
2026-02-21T08:25:40.6985533Z  'reduction_loops': [None]}
2026-02-21T08:25:40.7012084Z [146s] Fitting surrogate: 414 points, 414 targets
2026-02-21T08:25:41.6030102Z [147s] Generation 5 starting: 53 neighbors, 5 active search path(s)
2026-02-21T08:25:48.6315374Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 23.7 configs/s
2026-02-21T08:25:52.0194285Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 16.7 configs/s
2026-02-21T08:25:58.5287482Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 156.4         
2026-02-21T08:25:58.5287958Z                                                                   configs/s     
2026-02-21T08:25:59.0546947Z [164s] Generation 5 complete: 
2026-02-21T08:25:59.0547220Z ok=59
2026-02-21T08:25:59.0547409Z min=0.0260
2026-02-21T08:25:59.0547609Z mid=0.0267
2026-02-21T08:25:59.0547774Z max=0.1644
2026-02-21T08:25:59.0547954Z best={'block_sizes': [8],
2026-02-21T08:25:59.0548406Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:25:59.1165989Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:25:59.1166365Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:25:59.1166633Z  'num_stages': 1,
2026-02-21T08:25:59.1166792Z  'num_warps': 8,
2026-02-21T08:25:59.1166960Z  'pid_type': 'flat',
2026-02-21T08:25:59.1167142Z  'range_flattens': [None],
2026-02-21T08:25:59.1167329Z  'range_multi_buffers': [None],
2026-02-21T08:25:59.1167531Z  'range_num_stages': [0],
2026-02-21T08:25:59.1167716Z  'range_unroll_factors': [0],
2026-02-21T08:25:59.1167925Z  'range_warp_specializes': [],
2026-02-21T08:25:59.1168122Z  'reduction_loops': [None]}
2026-02-21T08:25:59.1168375Z [164s] Fitting surrogate: 473 points, 473 targets
2026-02-21T08:26:00.0871792Z [165s] Generation 6 starting: 62 neighbors, 5 active search path(s)
2026-02-21T08:26:07.2295064Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 14.9 configs/s
2026-02-21T08:26:11.5381375Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 15.0 configs/s
2026-02-21T08:26:19.0485340Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.5         
2026-02-21T08:26:19.0485862Z                                                                   configs/s     
2026-02-21T08:26:19.6421203Z [185s] Generation 6 complete: 
2026-02-21T08:26:19.6421455Z ok=67
2026-02-21T08:26:19.6421629Z min=0.0257
2026-02-21T08:26:19.6421806Z mid=0.0267
2026-02-21T08:26:19.6421977Z max=0.3563
2026-02-21T08:26:19.6422158Z best={'block_sizes': [4],
2026-02-21T08:26:19.6422592Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:26:19.6423594Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:26:19.6424217Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:26:19.6424556Z  'num_stages': 1,
2026-02-21T08:26:19.6424766Z  'num_warps': 4,
2026-02-21T08:26:19.6424953Z  'pid_type': 'flat',
2026-02-21T08:26:19.6425165Z  'range_flattens': [None],
2026-02-21T08:26:19.6425389Z  'range_multi_buffers': [None],
2026-02-21T08:26:19.6425626Z  'range_num_stages': [0],
2026-02-21T08:26:19.6425847Z  'range_unroll_factors': [0],
2026-02-21T08:26:19.6426089Z  'range_warp_specializes': [],
2026-02-21T08:26:19.6426309Z  'reduction_loops': [None]}
2026-02-21T08:26:19.6455807Z [185s] Fitting surrogate: 540 points, 540 targets
2026-02-21T08:26:20.5075244Z [186s] Generation 7 starting: 50 neighbors, 5 active search path(s)
2026-02-21T08:26:29.9920223Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 6.3 configs/s
2026-02-21T08:26:33.0271594Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 17.1 configs/s
2026-02-21T08:26:38.8113480Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 175.7         
2026-02-21T08:26:38.8114315Z                                                                   configs/s     
2026-02-21T08:26:39.2863121Z [205s] Generation 7 complete: 
2026-02-21T08:26:39.2863381Z ok=55
2026-02-21T08:26:39.2863568Z min=0.0254
2026-02-21T08:26:39.2863749Z mid=0.0263
2026-02-21T08:26:39.2863930Z max=0.0606
2026-02-21T08:26:39.2864272Z best={'block_sizes': [4],
2026-02-21T08:26:39.2864754Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:26:39.2865418Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:26:39.2865903Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T08:26:39.2866270Z  'num_stages': 1,
2026-02-21T08:26:39.2866469Z  'num_warps': 4,
2026-02-21T08:26:39.2866684Z  'pid_type': 'flat',
2026-02-21T08:26:39.2866905Z  'range_flattens': [None],
2026-02-21T08:26:39.2867167Z  'range_multi_buffers': [None],
2026-02-21T08:26:39.2867427Z  'range_num_stages': [0],
2026-02-21T08:26:39.2867678Z  'range_unroll_factors': [0],
2026-02-21T08:26:39.2867944Z  'range_warp_specializes': [],
2026-02-21T08:26:39.2868738Z  'reduction_loops': [None]}
2026-02-21T08:26:39.2903066Z [205s] Fitting surrogate: 595 points, 595 targets
2026-02-21T08:26:40.5526099Z [206s] Generation 8 starting: 56 neighbors, 5 active search path(s)
2026-02-21T08:26:47.4726568Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 10.7 configs/s
2026-02-21T08:26:50.9752444Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 16.5 configs/s
2026-02-21T08:26:57.8016013Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 148.9         
2026-02-21T08:26:57.8016545Z                                                                   configs/s     
2026-02-21T08:26:58.3597026Z [224s] Generation 8 complete: 
2026-02-21T08:26:58.3597378Z ok=62
2026-02-21T08:26:58.3597567Z min=0.0254
2026-02-21T08:26:58.3598556Z mid=0.0263
2026-02-21T08:26:58.3598736Z max=0.1898
2026-02-21T08:26:58.3598927Z best={'block_sizes': [4],
2026-02-21T08:26:58.3599394Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:26:58.3600029Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:26:58.3600545Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', 'first'],
2026-02-21T08:26:58.3600912Z  'num_stages': 1,
2026-02-21T08:26:58.3601115Z  'num_warps': 4,
2026-02-21T08:26:58.3601316Z  'pid_type': 'flat',
2026-02-21T08:26:58.3601534Z  'range_flattens': [None],
2026-02-21T08:26:58.3601769Z  'range_multi_buffers': [None],
2026-02-21T08:26:58.3602018Z  'range_num_stages': [0],
2026-02-21T08:26:58.3602261Z  'range_unroll_factors': [0],
2026-02-21T08:26:58.3602554Z  'range_warp_specializes': [],
2026-02-21T08:26:58.3602797Z  'reduction_loops': [None]}
2026-02-21T08:26:58.3638030Z [224s] Fitting surrogate: 657 points, 657 targets
2026-02-21T08:26:59.3577345Z [225s] Generation 9 starting: 56 neighbors, 5 active search path(s)
2026-02-21T08:27:04.1847355Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 25.3 configs/s
2026-02-21T08:27:07.9851145Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 15.1 configs/s
2026-02-21T08:27:15.2682814Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 146.9         
2026-02-21T08:27:15.2683356Z                                                                   configs/s     
2026-02-21T08:27:15.8375987Z [241s] Generation 9 complete: 
2026-02-21T08:27:15.8376280Z ok=61
2026-02-21T08:27:15.8376471Z min=0.0256
2026-02-21T08:27:15.8376653Z mid=0.0264
2026-02-21T08:27:15.8376841Z max=0.0722
2026-02-21T08:27:15.8377030Z best={'block_sizes': [4],
2026-02-21T08:27:15.8377507Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:27:15.8378208Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:27:15.8378752Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', 'first'],
2026-02-21T08:27:15.8379143Z  'num_stages': 1,
2026-02-21T08:27:15.8379364Z  'num_warps': 4,
2026-02-21T08:27:15.8379581Z  'pid_type': 'flat',
2026-02-21T08:27:15.8379808Z  'range_flattens': [None],
2026-02-21T08:27:15.8380064Z  'range_multi_buffers': [None],
2026-02-21T08:27:15.8380321Z  'range_num_stages': [0],
2026-02-21T08:27:15.8380573Z  'range_unroll_factors': [0],
2026-02-21T08:27:15.8380839Z  'range_warp_specializes': [],
2026-02-21T08:27:15.8381097Z  'reduction_loops': [None]}
2026-02-21T08:27:15.8414411Z [241s] Fitting surrogate: 718 points, 718 targets
2026-02-21T08:27:16.7939233Z [242s] Generation 10 starting: 57 neighbors, 5 active search path(s)
2026-02-21T08:27:21.9258121Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 17.8 configs/s
2026-02-21T08:27:25.3216158Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 57/57 17.0 configs/s
2026-02-21T08:27:32.3489172Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 152.6         
2026-02-21T08:27:32.3489819Z                                                                   configs/s     
2026-02-21T08:27:32.8969171Z [258s] Generation 10 complete: 
2026-02-21T08:27:32.8969468Z ok=62
2026-02-21T08:27:32.8969657Z min=0.0253
2026-02-21T08:27:32.8969838Z mid=0.0261
2026-02-21T08:27:32.8970011Z max=0.1670
2026-02-21T08:27:32.8970314Z best={'block_sizes': [4],
2026-02-21T08:27:32.8970780Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:27:32.8971419Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:27:32.8971926Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', ''],
2026-02-21T08:27:32.8972283Z  'num_stages': 1,
2026-02-21T08:27:32.8972486Z  'num_warps': 4,
2026-02-21T08:27:32.8972691Z  'pid_type': 'flat',
2026-02-21T08:27:32.8973557Z  'range_flattens': [None],
2026-02-21T08:27:32.8973820Z  'range_multi_buffers': [None],
2026-02-21T08:27:32.8974443Z  'range_num_stages': [0],
2026-02-21T08:27:32.8974686Z  'range_unroll_factors': [0],
2026-02-21T08:27:32.8974956Z  'range_warp_specializes': [],
2026-02-21T08:27:32.8975206Z  'reduction_loops': [None]}
2026-02-21T08:27:32.9012804Z [258s] Fitting surrogate: 780 points, 780 targets
2026-02-21T08:27:33.8357621Z [259s] Generation 11 starting: 57 neighbors, 5 active search path(s)
2026-02-21T08:27:37.3460493Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 33.4 configs/s
2026-02-21T08:27:40.7389603Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 57/57 17.0 configs/s
2026-02-21T08:27:47.4282787Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 152.1         
2026-02-21T08:27:47.4283321Z                                                                   configs/s     
2026-02-21T08:27:47.9776832Z [273s] Generation 11 complete: 
2026-02-21T08:27:47.9777420Z ok=62
2026-02-21T08:27:47.9777739Z min=0.0254
2026-02-21T08:27:47.9777931Z mid=0.0264
2026-02-21T08:27:47.9778110Z max=0.2079
2026-02-21T08:27:47.9778313Z best={'block_sizes': [4],
2026-02-21T08:27:47.9778812Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:27:47.9779496Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:27:47.9780027Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', ''],
2026-02-21T08:27:47.9780394Z  'num_stages': 1,
2026-02-21T08:27:47.9780606Z  'num_warps': 4,
2026-02-21T08:27:47.9780823Z  'pid_type': 'flat',
2026-02-21T08:27:47.9781057Z  'range_flattens': [None],
2026-02-21T08:27:47.9781303Z  'range_multi_buffers': [None],
2026-02-21T08:27:47.9781564Z  'range_num_stages': [0],
2026-02-21T08:27:47.9781805Z  'range_unroll_factors': [0],
2026-02-21T08:27:47.9782071Z  'range_warp_specializes': [],
2026-02-21T08:27:47.9782325Z  'reduction_loops': [None]}
2026-02-21T08:27:47.9826372Z [273s] Fitting surrogate: 842 points, 842 targets
2026-02-21T08:27:48.8722662Z [274s] Generation 12 starting: 49 neighbors, 5 active search path(s)
2026-02-21T08:27:51.9862142Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 - configs/s
2026-02-21T08:27:54.9466056Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 50/50 17.2 configs/s
2026-02-21T08:28:01.4420457Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 166.4         
2026-02-21T08:28:01.4420974Z                                                                   configs/s     
2026-02-21T08:28:01.9217765Z [287s] Generation 12 complete: 
2026-02-21T08:28:01.9218033Z ok=54
2026-02-21T08:28:01.9218211Z min=0.0255
2026-02-21T08:28:01.9218379Z mid=0.0261
2026-02-21T08:28:01.9218553Z max=0.0387
2026-02-21T08:28:01.9218732Z best={'block_sizes': [4],
2026-02-21T08:28:01.9219192Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:28:01.9219889Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:28:01.9220384Z  'load_eviction_policies': ['', '', '', '', '', 'last', '', ''],
2026-02-21T08:28:01.9221116Z  'num_stages': 1,
2026-02-21T08:28:01.9221312Z  'num_warps': 4,
2026-02-21T08:28:01.9221518Z  'pid_type': 'flat',
2026-02-21T08:28:01.9221734Z  'range_flattens': [None],
2026-02-21T08:28:01.9221979Z  'range_multi_buffers': [None],
2026-02-21T08:28:01.9222227Z  'range_num_stages': [0],
2026-02-21T08:28:01.9222461Z  'range_unroll_factors': [0],
2026-02-21T08:28:01.9222699Z  'range_warp_specializes': [],
2026-02-21T08:28:01.9222954Z  'reduction_loops': [None]}
2026-02-21T08:28:01.9261982Z [287s] Fitting surrogate: 896 points, 896 targets
2026-02-21T08:28:02.8612746Z [288s] Generation 13 starting: 54 neighbors, 5 active search path(s)
2026-02-21T08:28:06.3500517Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 21.8 configs/s
2026-02-21T08:28:09.5708554Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 54/54 17.0 configs/s
2026-02-21T08:28:16.3824482Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 157.5         
2026-02-21T08:28:16.3825041Z                                                                   configs/s     
2026-02-21T08:28:16.9150790Z [302s] Generation 13 complete: 
2026-02-21T08:28:16.9151281Z ok=59
2026-02-21T08:28:16.9151573Z min=0.0255
2026-02-21T08:28:16.9151849Z mid=0.0262
2026-02-21T08:28:16.9152114Z max=0.0776
2026-02-21T08:28:16.9152401Z best={'block_sizes': [8],
2026-02-21T08:28:16.9153120Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:28:16.9154600Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:28:16.9155416Z  'load_eviction_policies': ['', '', '', '', '', 'last', '', ''],
2026-02-21T08:28:16.9155999Z  'num_stages': 1,
2026-02-21T08:28:16.9156319Z  'num_warps': 8,
2026-02-21T08:28:16.9156672Z  'pid_type': 'flat',
2026-02-21T08:28:16.9157039Z  'range_flattens': [None],
2026-02-21T08:28:16.9157465Z  'range_multi_buffers': [None],
2026-02-21T08:28:16.9157891Z  'range_num_stages': [0],
2026-02-21T08:28:16.9158128Z  'range_unroll_factors': [0],
2026-02-21T08:28:16.9158353Z  'range_warp_specializes': [],
2026-02-21T08:28:16.9158580Z  'reduction_loops': [None]}
2026-02-21T08:28:16.9200882Z [302s] Fitting surrogate: 955 points, 955 targets
2026-02-21T08:28:17.8099573Z [303s] Generation 14 starting: 51 neighbors, 5 active search path(s)
2026-02-21T08:28:21.0183614Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 11.2 configs/s
2026-02-21T08:28:24.0358051Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 51/51 17.2 configs/s
2026-02-21T08:28:30.1359533Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 166.8         
2026-02-21T08:28:30.1360068Z                                                                   configs/s     
2026-02-21T08:28:30.6389087Z [316s] Generation 14 complete: 
2026-02-21T08:28:30.6389545Z ok=56
2026-02-21T08:28:30.6389842Z min=0.0254
2026-02-21T08:28:30.6390151Z mid=0.0260
2026-02-21T08:28:30.6390427Z max=0.1937
2026-02-21T08:28:30.6391303Z best={'block_sizes': [4],
2026-02-21T08:28:30.6392032Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:28:30.6393034Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:28:30.6393841Z  'load_eviction_policies': ['', '', '', 'last', '', 'last', '', ''],
2026-02-21T08:28:30.6394690Z  'num_stages': 1,
2026-02-21T08:28:30.6395006Z  'num_warps': 4,
2026-02-21T08:28:30.6395350Z  'pid_type': 'flat',
2026-02-21T08:28:30.6395691Z  'range_flattens': [None],
2026-02-21T08:28:30.6396067Z  'range_multi_buffers': [None],
2026-02-21T08:28:30.6396498Z  'range_num_stages': [0],
2026-02-21T08:28:30.6396913Z  'range_unroll_factors': [0],
2026-02-21T08:28:30.6397216Z  'range_warp_specializes': [],
2026-02-21T08:28:30.6397441Z  'reduction_loops': [None]}
2026-02-21T08:28:30.6449555Z [316s] Fitting surrogate: 1011 points, 1011 targets
2026-02-21T08:28:31.6012554Z [317s] Generation 15 starting: 56 neighbors, 5 active search path(s)
2026-02-21T08:28:35.0734784Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 - configs/s
2026-02-21T08:28:38.4199837Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 57/57 17.3 configs/s
2026-02-21T08:28:45.5020823Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 152.4         
2026-02-21T08:28:45.5021345Z                                                                   configs/s     
2026-02-21T08:28:46.0507167Z [331s] Generation 15 complete: 
2026-02-21T08:28:46.0507585Z ok=61
2026-02-21T08:28:46.0507931Z min=0.0254
2026-02-21T08:28:46.0508259Z mid=0.0261
2026-02-21T08:28:46.0508586Z max=0.0529
2026-02-21T08:28:46.0508935Z best={'block_sizes': [4],
2026-02-21T08:28:46.0512174Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:28:46.0513432Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:28:46.0514614Z               'pointer'],
2026-02-21T08:28:46.0515202Z  'load_eviction_policies': ['', '', '', '', 'first', 'first', 'first', 'last'],
2026-02-21T08:28:46.0515851Z  'num_stages': 3,
2026-02-21T08:28:46.0516187Z  'num_warps': 4,
2026-02-21T08:28:46.0516510Z  'pid_type': 'flat',
2026-02-21T08:28:46.0516853Z  'range_flattens': [None],
2026-02-21T08:28:46.0517244Z  'range_multi_buffers': [None],
2026-02-21T08:28:46.0517689Z  'range_num_stages': [0],
2026-02-21T08:28:46.0518056Z  'range_unroll_factors': [0],
2026-02-21T08:28:46.0518287Z  'range_warp_specializes': [],
2026-02-21T08:28:46.0518507Z  'reduction_loops': [None]}
2026-02-21T08:28:46.0559367Z [331s] Fitting surrogate: 1072 points, 1072 targets
2026-02-21T08:28:47.0409537Z [332s] Generation 16 starting: 58 neighbors, 5 active search path(s)
2026-02-21T08:28:50.7505489Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 9.8 configs/s
2026-02-21T08:28:54.1750418Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 58/58 17.2 configs/s
2026-02-21T08:29:01.1137179Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 146.6         
2026-02-21T08:29:01.1137672Z                                                                   configs/s     
2026-02-21T08:29:01.6798930Z [347s] Generation 16 complete: 
2026-02-21T08:29:01.6799388Z ok=63
2026-02-21T08:29:01.6799676Z min=0.0259
2026-02-21T08:29:01.6799960Z mid=0.0266
2026-02-21T08:29:01.6800235Z max=0.1518
2026-02-21T08:29:01.6800522Z best={'block_sizes': [4],
2026-02-21T08:29:01.6801273Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:29:01.6802297Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:29:01.6803164Z  'load_eviction_policies': ['', '', '', 'last', '', 'last', '', ''],
2026-02-21T08:29:01.6803739Z  'num_stages': 2,
2026-02-21T08:29:01.6804529Z  'num_warps': 4,
2026-02-21T08:29:01.6804857Z  'pid_type': 'flat',
2026-02-21T08:29:01.6805206Z  'range_flattens': [None],
2026-02-21T08:29:01.6806182Z  'range_multi_buffers': [None],
2026-02-21T08:29:01.6806571Z  'range_num_stages': [0],
2026-02-21T08:29:01.6806941Z  'range_unroll_factors': [0],
2026-02-21T08:29:01.6807326Z  'range_warp_specializes': [],
2026-02-21T08:29:01.6807719Z  'reduction_loops': [None]}
2026-02-21T08:29:01.6858999Z [347s] Fitting surrogate: 1135 points, 1135 targets
2026-02-21T08:29:02.5555030Z [348s] Generation 17 starting: 47 neighbors, 5 active search path(s)
2026-02-21T08:29:06.1732640Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 13.9 configs/s
2026-02-21T08:29:09.0292368Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 48/48 17.1 configs/s
2026-02-21T08:29:14.3483119Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 191.4         
2026-02-21T08:29:14.3484731Z                                                                   configs/s     
2026-02-21T08:29:14.7821846Z [360s] Generation 17 complete: 
2026-02-21T08:29:14.7822135Z ok=52
2026-02-21T08:29:14.7822338Z min=0.0254
2026-02-21T08:29:14.7822516Z mid=0.0264
2026-02-21T08:29:14.7822678Z max=0.1644
2026-02-21T08:29:14.7822862Z best={'block_sizes': [4],
2026-02-21T08:29:14.7823304Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:29:14.7823916Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:29:14.7824764Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:29:14.7825148Z  'load_eviction_policies': ['', '', '', '', 'first', 'first', 'first', 'last'],
2026-02-21T08:29:14.7825525Z  'num_stages': 3,
2026-02-21T08:29:14.7825711Z  'num_warps': 4,
2026-02-21T08:29:14.7825904Z  'pid_type': 'flat',
2026-02-21T08:29:14.7826108Z  'range_flattens': [None],
2026-02-21T08:29:14.7826361Z  'range_multi_buffers': [None],
2026-02-21T08:29:14.7826604Z  'range_num_stages': [0],
2026-02-21T08:29:14.7826826Z  'range_unroll_factors': [0],
2026-02-21T08:29:14.7827081Z  'range_warp_specializes': [],
2026-02-21T08:29:14.7827330Z  'reduction_loops': [None]}
2026-02-21T08:29:14.7884931Z [360s] Fitting surrogate: 1187 points, 1187 targets
2026-02-21T08:29:15.8051839Z [361s] Generation 18 starting: 55 neighbors, 5 active search path(s)
2026-02-21T08:29:19.6107563Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 18.7 configs/s
2026-02-21T08:29:22.9383376Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 56/56 17.1 configs/s
2026-02-21T08:29:29.5620309Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 162.8         
2026-02-21T08:29:29.5620935Z                                                                   configs/s     
2026-02-21T08:29:30.0683093Z [375s] Generation 18 complete: 
2026-02-21T08:29:30.0683429Z ok=60
2026-02-21T08:29:30.0683625Z min=0.0254
2026-02-21T08:29:30.0683853Z mid=0.0268
2026-02-21T08:29:30.0684541Z max=0.1645
2026-02-21T08:29:30.0684757Z best={'block_sizes': [4],
2026-02-21T08:29:30.0685242Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:29:30.0685924Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:29:30.0686410Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:29:30.0686808Z  'load_eviction_policies': ['', '', '', '', 'first', 'first', 'first', 'last'],
2026-02-21T08:29:30.0687210Z  'num_stages': 3,
2026-02-21T08:29:30.0687409Z  'num_warps': 4,
2026-02-21T08:29:30.0687607Z  'pid_type': 'flat',
2026-02-21T08:29:30.0687847Z  'range_flattens': [None],
2026-02-21T08:29:30.0688105Z  'range_multi_buffers': [None],
2026-02-21T08:29:30.0688372Z  'range_num_stages': [0],
2026-02-21T08:29:30.0688580Z  'range_unroll_factors': [0],
2026-02-21T08:29:30.0688789Z  'range_warp_specializes': [],
2026-02-21T08:29:30.0688996Z  'reduction_loops': [None]}
2026-02-21T08:29:30.0740193Z [375s] Fitting surrogate: 1247 points, 1247 targets
2026-02-21T08:29:30.7127562Z [376s] Generation 19 starting: 34 neighbors, 3 active search path(s)
2026-02-21T08:29:33.4906136Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 8.6 configs/s
2026-02-21T08:29:35.5859436Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 17.1 configs/s
2026-02-21T08:29:39.1697450Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 283.6         
2026-02-21T08:29:39.1698068Z                                                                   configs/s     
2026-02-21T08:29:39.4742028Z [385s] Generation 19 complete: 
2026-02-21T08:29:39.4742396Z ok=38
2026-02-21T08:29:39.4742629Z min=0.0256
2026-02-21T08:29:39.4742855Z mid=0.0270
2026-02-21T08:29:39.4743079Z max=0.1646
2026-02-21T08:29:39.4743320Z best={'block_sizes': [4],
2026-02-21T08:29:39.4745100Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:29:39.4746036Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:29:39.4746740Z  'load_eviction_policies': ['', '', '', 'last', '', 'last', '', ''],
2026-02-21T08:29:39.4747282Z  'num_stages': 2,
2026-02-21T08:29:39.4747558Z  'num_warps': 4,
2026-02-21T08:29:39.4747838Z  'pid_type': 'flat',
2026-02-21T08:29:39.4748149Z  'range_flattens': [None],
2026-02-21T08:29:39.4748499Z  'range_multi_buffers': [None],
2026-02-21T08:29:39.4748881Z  'range_num_stages': [0],
2026-02-21T08:29:39.4749215Z  'range_unroll_factors': [0],
2026-02-21T08:29:39.4749576Z  'range_warp_specializes': [],
2026-02-21T08:29:39.4749924Z  'reduction_loops': [None]}
2026-02-21T08:29:39.4805475Z [385s] Fitting surrogate: 1285 points, 1285 targets
2026-02-21T08:29:40.1360469Z [385s] Generation 20 starting: 34 neighbors, 3 active search path(s)
2026-02-21T08:29:42.6993095Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 12.6 configs/s
2026-02-21T08:29:44.7839307Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 17.2 configs/s
2026-02-21T08:29:48.6964400Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 259.9         
2026-02-21T08:29:48.6965171Z                                                                   configs/s     
2026-02-21T08:29:49.0256410Z [394s] Generation 20 complete: 
2026-02-21T08:29:49.0256813Z ok=37
2026-02-21T08:29:49.0257073Z min=0.0254
2026-02-21T08:29:49.0257329Z mid=0.0264
2026-02-21T08:29:49.0257570Z max=0.1646
2026-02-21T08:29:49.0257841Z best={'block_sizes': [4],
2026-02-21T08:29:49.0258494Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:29:49.0259372Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:29:49.0260070Z  'load_eviction_policies': ['', '', '', 'last', '', 'last', '', 'last'],
2026-02-21T08:29:49.0260609Z  'num_stages': 2,
2026-02-21T08:29:49.0260914Z  'num_warps': 4,
2026-02-21T08:29:49.0261276Z  'pid_type': 'flat',
2026-02-21T08:29:49.0261584Z  'range_flattens': [None],
2026-02-21T08:29:49.0261900Z  'range_multi_buffers': [None],
2026-02-21T08:29:49.0262227Z  'range_num_stages': [0],
2026-02-21T08:29:49.0262533Z  'range_unroll_factors': [0],
2026-02-21T08:29:49.0262864Z  'range_warp_specializes': [],
2026-02-21T08:29:49.0263185Z  'reduction_loops': [None]}
2026-02-21T08:29:49.0320928Z [394s] Fitting surrogate: 1322 points, 1322 targets
2026-02-21T08:29:49.2056549Z [395s] Autotuning complete in 395.0s after searching 1243 configs.
2026-02-21T08:29:49.2057189Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:29:49.2059796Z     @helion.kernel(config=helion.Config(block_sizes=[4], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['', '', '', 'last', '', 'last', '', 'last'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:29:49.2062553Z 
2026-02-21T08:29:49.2063093Z [395s] Code of selected kernel: /tmp/torchinductor_root/rp/crpuid3nffmbrrxz7jocc66r2e3vvj7qvoc7m2jkuizdndgngj6m.py
2026-02-21T08:29:50.1488937Z WARNING:tritonbench.utils.triton_op:Completed input ID 2:
2026-02-21T08:29:50.1489370Z (M, N)
2026-02-21T08:29:50.1489567Z ------------
2026-02-21T08:29:50.1489776Z (4096, 2048)
2026-02-21T08:29:50.1489904Z 
2026-02-21T08:29:50.1503567Z  10%|█         | 2/20 [11:22<1:45:45, 352.51s/it]WARNING:tritonbench.utils.triton_op:Running input ID 3:
2026-02-21T08:29:50.1504464Z (M, N)
2026-02-21T08:29:50.1504664Z ------------
2026-02-21T08:29:50.1504866Z (4096, 2560)
2026-02-21T08:29:50.1506353Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:29:51.7992316Z INFO:tritonbench.utils.triton_op:Took 3.20ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:29:56.2136982Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:29:57.6387133Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:29:57.6387931Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:29:57.6388473Z               'dtype': 'torch.float32',
2026-02-21T08:29:57.6388956Z               'shape': (4096, 2560),
2026-02-21T08:29:57.6389371Z               'stride': (2560, 1)},
2026-02-21T08:29:57.6389761Z             (2560,),
2026-02-21T08:29:57.6390091Z             { 'device': 'cuda:0',
2026-02-21T08:29:57.6390528Z               'dtype': 'torch.float32',
2026-02-21T08:29:57.6390957Z               'shape': (2560,),
2026-02-21T08:29:57.6391348Z               'stride': (1,)},
2026-02-21T08:29:57.6391719Z             { 'device': 'cuda:0',
2026-02-21T08:29:57.6392127Z               'dtype': 'torch.float32',
2026-02-21T08:29:57.6392542Z               'shape': (2560,),
2026-02-21T08:29:57.6392928Z               'stride': (1,)},
2026-02-21T08:29:57.6393293Z             1e-05),
2026-02-21T08:29:57.6393594Z   'kwargs': {}}
2026-02-21T08:29:57.6427354Z INFO:tritonbench.utils.triton_op:Took 4.47ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:29:57.6504458Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:29:57.6505653Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:29:57.6506463Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:29:57.6506947Z While processing:
2026-02-21T08:29:57.6507506Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:29:57.6508062Z     if bias is not None:
2026-02-21T08:29:57.6508343Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:29:57.6508521Z 
2026-02-21T08:29:57.8139607Z [0s] Autotune random seed: 2135381352
2026-02-21T08:29:57.9769066Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:30:32.1387529Z [34s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', '', 'last', 'last', '', '', 'last', 'last'], maxnreg=256, num_sm_multiplier=2, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[None], range_num_stages=[2], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T08:30:32.6956927Z [34s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:30:33.3178393Z [35s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:30:34.8014948Z [36s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'last', 'last', '', 'last', 'first', 'last', ''], maxnreg=128, num_sm_multiplier=1, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T08:30:35.4609426Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first', 'last', '', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=8, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:30:35.9052115Z [37s] Timeout after 30s compiling Config(block_sizes=[2048], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'first', '', 'last', 'last', 'first', 'first', 'last'], num_stages=8, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:30:35.9074134Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 1.1 configs/s
2026-02-21T08:30:41.3247883Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 18.6 configs/s
2026-02-21T08:30:41.3262411Z [43s] Adaptive compile timeout: 30s (90% percentile=13.8s, bounds=[30.0s, 30s])
2026-02-21T08:30:42.8535932Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 659.9 configs/s
2026-02-21T08:30:42.9886918Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T08:30:42.9889720Z error=10
2026-02-21T08:30:42.9890045Z timeout=6
2026-02-21T08:30:42.9890226Z ok=84
2026-02-21T08:30:42.9890400Z min=0.0322
2026-02-21T08:30:42.9890575Z mid=0.1750
2026-02-21T08:30:42.9890747Z max=10.2470
2026-02-21T08:30:42.9890949Z best={'block_sizes': [1],
2026-02-21T08:30:42.9891374Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:30:42.9891950Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:30:42.9892350Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:30:42.9892689Z  'num_stages': 1,
2026-02-21T08:30:42.9892893Z  'num_warps': 4,
2026-02-21T08:30:42.9893096Z  'pid_type': 'flat',
2026-02-21T08:30:42.9893326Z  'range_flattens': [None],
2026-02-21T08:30:42.9893568Z  'range_multi_buffers': [None],
2026-02-21T08:30:42.9893818Z  'range_num_stages': [0],
2026-02-21T08:30:42.9894451Z  'range_unroll_factors': [0],
2026-02-21T08:30:42.9896238Z  'range_warp_specializes': [],
2026-02-21T08:30:42.9896481Z  'reduction_loops': [None]}
2026-02-21T08:30:42.9913961Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:30:44.4748677Z [46s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T08:30:51.7440694Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 19.1 configs/s
2026-02-21T08:30:57.9390532Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 15.3 configs/s
2026-02-21T08:31:07.5400039Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 105.8         
2026-02-21T08:31:07.5400602Z                                                                   configs/s     
2026-02-21T08:31:08.2681984Z [70s] Generation 1 complete: 
2026-02-21T08:31:08.2682254Z ok=95
2026-02-21T08:31:08.2682991Z min=0.0318
2026-02-21T08:31:08.2683188Z mid=0.0392
2026-02-21T08:31:08.2683365Z max=0.1701
2026-02-21T08:31:08.2683550Z best={'block_sizes': [1],
2026-02-21T08:31:08.2684165Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:31:08.2684773Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:31:08.2685180Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:31:08.2685513Z  'num_stages': 1,
2026-02-21T08:31:08.2685718Z  'num_warps': 4,
2026-02-21T08:31:08.2685957Z  'pid_type': 'flat',
2026-02-21T08:31:08.2686198Z  'range_flattens': [None],
2026-02-21T08:31:08.2686443Z  'range_multi_buffers': [None],
2026-02-21T08:31:08.2686681Z  'range_num_stages': [0],
2026-02-21T08:31:08.2686898Z  'range_unroll_factors': [0],
2026-02-21T08:31:08.2687138Z  'range_warp_specializes': [],
2026-02-21T08:31:08.2687374Z  'reduction_loops': [None]}
2026-02-21T08:31:08.2705703Z [70s] Fitting surrogate: 195 points, 195 targets
2026-02-21T08:31:09.5770829Z [71s] Generation 2 starting: 79 neighbors, 5 active search path(s)
2026-02-21T08:31:16.3159330Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 23.8 configs/s
2026-02-21T08:31:21.4226817Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 16.4 configs/s
2026-02-21T08:31:29.8841967Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 120.0         
2026-02-21T08:31:29.8842427Z                                                                   configs/s     
2026-02-21T08:31:30.5246417Z [92s] Generation 2 complete: 
2026-02-21T08:31:30.5246737Z ok=84
2026-02-21T08:31:30.5246944Z min=0.0316
2026-02-21T08:31:30.5247172Z mid=0.0364
2026-02-21T08:31:30.5247379Z max=0.1817
2026-02-21T08:31:30.5247600Z best={'block_sizes': [1],
2026-02-21T08:31:30.5248131Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:31:30.5248843Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:31:30.5249356Z  'load_eviction_policies': ['', '', '', '', '', '', 'first', ''],
2026-02-21T08:31:30.5249764Z  'num_stages': 1,
2026-02-21T08:31:30.5250608Z  'num_warps': 8,
2026-02-21T08:31:30.5250845Z  'pid_type': 'flat',
2026-02-21T08:31:30.5251114Z  'range_flattens': [None],
2026-02-21T08:31:30.5251418Z  'range_multi_buffers': [None],
2026-02-21T08:31:30.5251741Z  'range_num_stages': [0],
2026-02-21T08:31:30.5252052Z  'range_unroll_factors': [0],
2026-02-21T08:31:30.5252331Z  'range_warp_specializes': [],
2026-02-21T08:31:30.5252557Z  'reduction_loops': [None]}
2026-02-21T08:31:30.5277122Z [92s] Fitting surrogate: 279 points, 279 targets
2026-02-21T08:31:31.3372391Z [93s] Generation 3 starting: 49 neighbors, 5 active search path(s)
2026-02-21T08:31:35.7946060Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 15.0 configs/s
2026-02-21T08:31:38.9116770Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 16.9 configs/s
2026-02-21T08:31:44.4626733Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 182.6         
2026-02-21T08:31:44.4627271Z                                                                   configs/s     
2026-02-21T08:31:44.8888390Z [106s] Generation 3 complete: 
2026-02-21T08:31:44.8888664Z error=1
2026-02-21T08:31:44.8888849Z ok=54
2026-02-21T08:31:44.8889019Z min=0.0316
2026-02-21T08:31:44.8889199Z mid=0.0346
2026-02-21T08:31:44.8889364Z max=0.0956
2026-02-21T08:31:44.8889564Z best={'block_sizes': [1],
2026-02-21T08:31:44.8890107Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:31:44.8890697Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:31:44.8891143Z  'load_eviction_policies': ['', '', 'last', '', '', '', 'first', ''],
2026-02-21T08:31:44.8891540Z  'num_stages': 1,
2026-02-21T08:31:44.8891761Z  'num_warps': 4,
2026-02-21T08:31:44.8891964Z  'pid_type': 'flat',
2026-02-21T08:31:44.8892168Z  'range_flattens': [None],
2026-02-21T08:31:44.8892376Z  'range_multi_buffers': [None],
2026-02-21T08:31:44.8892598Z  'range_num_stages': [0],
2026-02-21T08:31:44.8892804Z  'range_unroll_factors': [0],
2026-02-21T08:31:44.8893040Z  'range_warp_specializes': [],
2026-02-21T08:31:44.8893263Z  'reduction_loops': [None]}
2026-02-21T08:31:44.8914649Z [106s] Fitting surrogate: 334 points, 334 targets
2026-02-21T08:31:45.7352790Z [107s] Generation 4 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:31:49.7368285Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 22.8 configs/s
2026-02-21T08:31:53.0044679Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 16.7 configs/s
2026-02-21T08:31:59.5087576Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 165.4         
2026-02-21T08:31:59.5088125Z                                                                   configs/s     
2026-02-21T08:31:59.9921251Z [122s] Generation 4 complete: 
2026-02-21T08:31:59.9921706Z ok=57
2026-02-21T08:31:59.9922037Z min=0.0310
2026-02-21T08:31:59.9922319Z mid=0.0342
2026-02-21T08:31:59.9922565Z max=0.0613
2026-02-21T08:31:59.9922749Z best={'block_sizes': [1],
2026-02-21T08:31:59.9923213Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:31:59.9923792Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:31:59.9924474Z  'load_eviction_policies': ['', '', 'last', '', '', '', 'first', ''],
2026-02-21T08:31:59.9924836Z  'num_stages': 1,
2026-02-21T08:31:59.9925036Z  'num_warps': 4,
2026-02-21T08:31:59.9925251Z  'pid_type': 'flat',
2026-02-21T08:31:59.9925465Z  'range_flattens': [None],
2026-02-21T08:31:59.9925723Z  'range_multi_buffers': [None],
2026-02-21T08:31:59.9925980Z  'range_num_stages': [0],
2026-02-21T08:31:59.9926213Z  'range_unroll_factors': [0],
2026-02-21T08:31:59.9926454Z  'range_warp_specializes': [],
2026-02-21T08:31:59.9926713Z  'reduction_loops': [None]}
2026-02-21T08:31:59.9947274Z [122s] Fitting surrogate: 391 points, 391 targets
2026-02-21T08:32:00.8258308Z [122s] Generation 5 starting: 48 neighbors, 5 active search path(s)
2026-02-21T08:32:04.6681849Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 23.1 configs/s
2026-02-21T08:32:07.7365111Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 16.9 configs/s
2026-02-21T08:32:13.4518223Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 177.5         
2026-02-21T08:32:13.4518731Z                                                                   configs/s     
2026-02-21T08:32:13.8991875Z [135s] Generation 5 complete: 
2026-02-21T08:32:13.8992203Z ok=54
2026-02-21T08:32:13.8992431Z min=0.0312
2026-02-21T08:32:13.8992644Z mid=0.0332
2026-02-21T08:32:13.8992824Z max=0.0595
2026-02-21T08:32:13.8993022Z best={'block_sizes': [1],
2026-02-21T08:32:13.8993496Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:32:13.8994749Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:32:13.8995320Z  'load_eviction_policies': ['', '', 'last', '', '', '', 'first', 'first'],
2026-02-21T08:32:13.8995714Z  'num_stages': 1,
2026-02-21T08:32:13.8995917Z  'num_warps': 4,
2026-02-21T08:32:13.8996113Z  'pid_type': 'flat',
2026-02-21T08:32:13.8996347Z  'range_flattens': [None],
2026-02-21T08:32:13.8996581Z  'range_multi_buffers': [None],
2026-02-21T08:32:13.8996832Z  'range_num_stages': [0],
2026-02-21T08:32:13.8997073Z  'range_unroll_factors': [0],
2026-02-21T08:32:13.8997321Z  'range_warp_specializes': [],
2026-02-21T08:32:13.8997566Z  'reduction_loops': [None]}
2026-02-21T08:32:13.9024968Z [135s] Fitting surrogate: 445 points, 445 targets
2026-02-21T08:32:14.8187525Z [136s] Generation 6 starting: 54 neighbors, 5 active search path(s)
2026-02-21T08:32:19.2123464Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 20.9 configs/s
2026-02-21T08:32:22.6029821Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 17.0 configs/s
2026-02-21T08:32:29.0109432Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 168.8         
2026-02-21T08:32:29.0110008Z                                                                   configs/s     
2026-02-21T08:32:29.4866409Z [151s] Generation 6 complete: 
2026-02-21T08:32:29.4866721Z error=1
2026-02-21T08:32:29.4866905Z ok=59
2026-02-21T08:32:29.4867087Z min=0.0311
2026-02-21T08:32:29.4867276Z mid=0.0332
2026-02-21T08:32:29.4867448Z max=0.2731
2026-02-21T08:32:29.4867641Z best={'block_sizes': [1],
2026-02-21T08:32:29.4868119Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:32:29.4868792Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:32:29.4869328Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'first'],
2026-02-21T08:32:29.4869710Z  'num_stages': 1,
2026-02-21T08:32:29.4869948Z  'num_warps': 4,
2026-02-21T08:32:29.4870154Z  'pid_type': 'flat',
2026-02-21T08:32:29.4870382Z  'range_flattens': [None],
2026-02-21T08:32:29.4870625Z  'range_multi_buffers': [None],
2026-02-21T08:32:29.4870907Z  'range_num_stages': [0],
2026-02-21T08:32:29.4871156Z  'range_unroll_factors': [0],
2026-02-21T08:32:29.4871417Z  'range_warp_specializes': [],
2026-02-21T08:32:29.4871678Z  'reduction_loops': [None]}
2026-02-21T08:32:29.4897949Z [151s] Fitting surrogate: 505 points, 505 targets
2026-02-21T08:32:30.3635165Z [152s] Generation 7 starting: 53 neighbors, 5 active search path(s)
2026-02-21T08:32:35.4213525Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 4.2 configs/s
2026-02-21T08:32:38.6563008Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 16.9 configs/s
2026-02-21T08:32:45.4024754Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 159.7         
2026-02-21T08:32:45.4025334Z                                                                   configs/s     
2026-02-21T08:32:45.8946853Z [167s] Generation 7 complete: 
2026-02-21T08:32:45.8947186Z ok=58
2026-02-21T08:32:45.8947376Z min=0.0312
2026-02-21T08:32:45.8947571Z mid=0.0327
2026-02-21T08:32:45.8948457Z max=0.0812
2026-02-21T08:32:45.8948649Z best={'block_sizes': [1],
2026-02-21T08:32:45.8949133Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:32:45.8949751Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:32:45.8950236Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'first'],
2026-02-21T08:32:45.8950586Z  'num_stages': 1,
2026-02-21T08:32:45.8950788Z  'num_warps': 4,
2026-02-21T08:32:45.8950983Z  'pid_type': 'flat',
2026-02-21T08:32:45.8951204Z  'range_flattens': [None],
2026-02-21T08:32:45.8951440Z  'range_multi_buffers': [None],
2026-02-21T08:32:45.8951680Z  'range_num_stages': [0],
2026-02-21T08:32:45.8951912Z  'range_unroll_factors': [0],
2026-02-21T08:32:45.8952509Z  'range_warp_specializes': [],
2026-02-21T08:32:45.8952786Z  'reduction_loops': [None]}
2026-02-21T08:32:45.8979241Z [167s] Fitting surrogate: 563 points, 563 targets
2026-02-21T08:32:46.7179808Z [168s] Generation 8 starting: 45 neighbors, 5 active search path(s)
2026-02-21T08:32:50.3300092Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 23.6 configs/s
2026-02-21T08:32:53.1678130Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.8 configs/s
2026-02-21T08:32:58.5673665Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 187.9         
2026-02-21T08:32:58.5674546Z                                                                   configs/s     
2026-02-21T08:32:58.9868965Z [181s] Generation 8 complete: 
2026-02-21T08:32:58.9869214Z ok=50
2026-02-21T08:32:58.9869387Z min=0.0307
2026-02-21T08:32:58.9869567Z mid=0.0337
2026-02-21T08:32:58.9869739Z max=0.0761
2026-02-21T08:32:58.9869925Z best={'block_sizes': [1],
2026-02-21T08:32:58.9870394Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:32:58.9870978Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:32:58.9871457Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'first'],
2026-02-21T08:32:58.9871819Z  'num_stages': 1,
2026-02-21T08:32:58.9872002Z  'num_warps': 4,
2026-02-21T08:32:58.9872197Z  'pid_type': 'flat',
2026-02-21T08:32:58.9872397Z  'range_flattens': [None],
2026-02-21T08:32:58.9872628Z  'range_multi_buffers': [None],
2026-02-21T08:32:58.9872863Z  'range_num_stages': [0],
2026-02-21T08:32:58.9873113Z  'range_unroll_factors': [0],
2026-02-21T08:32:58.9873357Z  'range_warp_specializes': [],
2026-02-21T08:32:58.9873592Z  'reduction_loops': [None]}
2026-02-21T08:32:58.9909974Z [181s] Fitting surrogate: 613 points, 613 targets
2026-02-21T08:32:59.6912228Z [181s] Generation 9 starting: 39 neighbors, 4 active search path(s)
2026-02-21T08:33:02.8147593Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 22.5 configs/s
2026-02-21T08:33:05.1382895Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 40/40 17.6 configs/s
2026-02-21T08:33:10.0745901Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 205.3         
2026-02-21T08:33:10.0746422Z                                                                   configs/s     
2026-02-21T08:33:10.4577890Z [192s] Generation 9 complete: 
2026-02-21T08:33:10.4578178Z error=1
2026-02-21T08:33:10.4578354Z ok=42
2026-02-21T08:33:10.4578528Z min=0.0343
2026-02-21T08:33:10.4590690Z mid=0.0353
2026-02-21T08:33:10.4590890Z max=0.0523
2026-02-21T08:33:10.4591091Z best={'block_sizes': [1],
2026-02-21T08:33:10.4591520Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:33:10.4592089Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:33:10.4592543Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'first'],
2026-02-21T08:33:10.4592882Z  'num_stages': 1,
2026-02-21T08:33:10.4593063Z  'num_warps': 4,
2026-02-21T08:33:10.4593230Z  'pid_type': 'flat',
2026-02-21T08:33:10.4593429Z  'range_flattens': [None],
2026-02-21T08:33:10.4594173Z  'range_multi_buffers': [None],
2026-02-21T08:33:10.4594409Z  'range_num_stages': [0],
2026-02-21T08:33:10.4594607Z  'range_unroll_factors': [0],
2026-02-21T08:33:10.4594826Z  'range_warp_specializes': [],
2026-02-21T08:33:10.4595033Z  'reduction_loops': [None]}
2026-02-21T08:33:10.4617985Z [192s] Fitting surrogate: 656 points, 656 targets
2026-02-21T08:33:11.0608463Z [193s] Generation 10 starting: 31 neighbors, 3 active search path(s)
2026-02-21T08:33:14.1782783Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 8.5 configs/s
2026-02-21T08:33:16.1448908Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 17.7 configs/s
2026-02-21T08:33:19.7975586Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 277.2         
2026-02-21T08:33:19.7976614Z                                                                   configs/s     
2026-02-21T08:33:20.0907577Z [202s] Generation 10 complete: 
2026-02-21T08:33:20.0907899Z error=1
2026-02-21T08:33:20.0908124Z ok=34
2026-02-21T08:33:20.0908328Z min=0.0313
2026-02-21T08:33:20.0908539Z mid=0.0334
2026-02-21T08:33:20.0908749Z max=0.0727
2026-02-21T08:33:20.0908943Z best={'block_sizes': [1],
2026-02-21T08:33:20.0909414Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:33:20.0910067Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:33:20.0910607Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'last'],
2026-02-21T08:33:20.0910984Z  'num_stages': 1,
2026-02-21T08:33:20.0911182Z  'num_warps': 4,
2026-02-21T08:33:20.0911386Z  'pid_type': 'flat',
2026-02-21T08:33:20.0911598Z  'range_flattens': [None],
2026-02-21T08:33:20.0911843Z  'range_multi_buffers': [None],
2026-02-21T08:33:20.0912103Z  'range_num_stages': [0],
2026-02-21T08:33:20.0912335Z  'range_unroll_factors': [0],
2026-02-21T08:33:20.0912588Z  'range_warp_specializes': [],
2026-02-21T08:33:20.0912838Z  'reduction_loops': [None]}
2026-02-21T08:33:20.0945830Z [202s] Fitting surrogate: 691 points, 691 targets
2026-02-21T08:33:20.6652138Z [202s] Generation 11 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:33:22.8764688Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 25.8 configs/s
2026-02-21T08:33:24.5684376Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 17.6 configs/s
2026-02-21T08:33:28.2545017Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 274.5         
2026-02-21T08:33:28.2545693Z                                                                   configs/s     
2026-02-21T08:33:28.5477348Z [210s] Generation 11 complete: 
2026-02-21T08:33:28.5477818Z ok=32
2026-02-21T08:33:28.5478109Z min=0.0342
2026-02-21T08:33:28.5478400Z mid=0.0351
2026-02-21T08:33:28.5478704Z max=0.1831
2026-02-21T08:33:28.5479032Z best={'block_sizes': [1],
2026-02-21T08:33:28.5479758Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:33:28.5481539Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:33:28.5482342Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'last'],
2026-02-21T08:33:28.5482903Z  'num_stages': 1,
2026-02-21T08:33:28.5483226Z  'num_warps': 4,
2026-02-21T08:33:28.5483572Z  'pid_type': 'flat',
2026-02-21T08:33:28.5483955Z  'range_flattens': [None],
2026-02-21T08:33:28.5484725Z  'range_multi_buffers': [None],
2026-02-21T08:33:28.5484951Z  'range_num_stages': [0],
2026-02-21T08:33:28.5485156Z  'range_unroll_factors': [0],
2026-02-21T08:33:28.5485386Z  'range_warp_specializes': [],
2026-02-21T08:33:28.5485607Z  'reduction_loops': [None]}
2026-02-21T08:33:28.5517218Z [210s] Fitting surrogate: 723 points, 723 targets
2026-02-21T08:33:29.1659595Z [211s] Generation 12 starting: 31 neighbors, 3 active search path(s)
2026-02-21T08:33:31.8620739Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 23.3 configs/s
2026-02-21T08:33:33.8529228Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 17.5 configs/s
2026-02-21T08:33:37.0197242Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 319.9         
2026-02-21T08:33:37.0197760Z                                                                   configs/s     
2026-02-21T08:33:37.2783219Z [219s] Generation 12 complete: 
2026-02-21T08:33:37.2783518Z error=1
2026-02-21T08:33:37.2783689Z ok=34
2026-02-21T08:33:37.2783858Z min=0.0314
2026-02-21T08:33:37.2784305Z mid=0.0344
2026-02-21T08:33:37.2784482Z max=0.3546
2026-02-21T08:33:37.2784671Z best={'block_sizes': [2],
2026-02-21T08:33:37.2785109Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:33:37.2785739Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:33:37.2786237Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'last'],
2026-02-21T08:33:37.2786579Z  'num_stages': 1,
2026-02-21T08:33:37.2786791Z  'num_warps': 16,
2026-02-21T08:33:37.2787004Z  'pid_type': 'flat',
2026-02-21T08:33:37.2787215Z  'range_flattens': [None],
2026-02-21T08:33:37.2787449Z  'range_multi_buffers': [None],
2026-02-21T08:33:37.2787690Z  'range_num_stages': [0],
2026-02-21T08:33:37.2787923Z  'range_unroll_factors': [0],
2026-02-21T08:33:37.2788170Z  'range_warp_specializes': [],
2026-02-21T08:33:37.2788412Z  'reduction_loops': [None]}
2026-02-21T08:33:37.2825237Z [219s] Fitting surrogate: 758 points, 758 targets
2026-02-21T08:33:38.2265107Z [220s] Generation 13 starting: 27 neighbors, 3 active search path(s)
2026-02-21T08:33:40.4375740Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 39.5 configs/s
2026-02-21T08:33:42.1733372Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 17.1 configs/s
2026-02-21T08:33:45.3220767Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 321.9         
2026-02-21T08:33:45.3221262Z                                                                   configs/s     
2026-02-21T08:33:45.5791083Z [227s] Generation 13 complete: 
2026-02-21T08:33:45.5791490Z ok=30
2026-02-21T08:33:45.5791751Z min=0.0314
2026-02-21T08:33:45.5792030Z mid=0.0330
2026-02-21T08:33:45.5792272Z max=0.0609
2026-02-21T08:33:45.5792550Z best={'block_sizes': [1],
2026-02-21T08:33:45.5793221Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:33:45.5794619Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:33:45.5795479Z  'load_eviction_policies': ['', 'last', 'last', '', '', '', '', 'last'],
2026-02-21T08:33:45.5795875Z  'num_stages': 1,
2026-02-21T08:33:45.5796060Z  'num_warps': 4,
2026-02-21T08:33:45.5796238Z  'pid_type': 'flat',
2026-02-21T08:33:45.5796449Z  'range_flattens': [None],
2026-02-21T08:33:45.5796658Z  'range_multi_buffers': [None],
2026-02-21T08:33:45.5796881Z  'range_num_stages': [0],
2026-02-21T08:33:45.5797087Z  'range_unroll_factors': [0],
2026-02-21T08:33:45.5798121Z  'range_warp_specializes': [],
2026-02-21T08:33:45.5798350Z  'reduction_loops': [None]}
2026-02-21T08:33:45.5834529Z [227s] Fitting surrogate: 788 points, 788 targets
2026-02-21T08:33:46.1547757Z [228s] Generation 14 starting: 28 neighbors, 3 active search path(s)
2026-02-21T08:33:48.3826336Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 31.0 configs/s
2026-02-21T08:33:50.1228001Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 17.1 configs/s
2026-02-21T08:33:53.7508871Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 279.5         
2026-02-21T08:33:53.7509410Z                                                                   configs/s     
2026-02-21T08:33:54.0455477Z [236s] Generation 14 complete: 
2026-02-21T08:33:54.0455907Z ok=31
2026-02-21T08:33:54.0456972Z min=0.0310
2026-02-21T08:33:54.0457338Z mid=0.0319
2026-02-21T08:33:54.0457594Z max=0.0987
2026-02-21T08:33:54.0457878Z best={'block_sizes': [1],
2026-02-21T08:33:54.0458600Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:33:54.0459566Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:33:54.0460363Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', '', 'last'],
2026-02-21T08:33:54.0460959Z  'num_stages': 1,
2026-02-21T08:33:54.0461333Z  'num_warps': 4,
2026-02-21T08:33:54.0461684Z  'pid_type': 'flat',
2026-02-21T08:33:54.0461924Z  'range_flattens': [None],
2026-02-21T08:33:54.0462147Z  'range_multi_buffers': [None],
2026-02-21T08:33:54.0462398Z  'range_num_stages': [0],
2026-02-21T08:33:54.0462624Z  'range_unroll_factors': [0],
2026-02-21T08:33:54.0462864Z  'range_warp_specializes': [],
2026-02-21T08:33:54.0463096Z  'reduction_loops': [None]}
2026-02-21T08:33:54.0499292Z [236s] Fitting surrogate: 819 points, 819 targets
2026-02-21T08:33:54.7717408Z [236s] Generation 15 starting: 40 neighbors, 3 active search path(s)
2026-02-21T08:33:57.8380476Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 21.2 configs/s
2026-02-21T08:34:00.2462716Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 16.9 configs/s
2026-02-21T08:34:04.5718003Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 259.1         
2026-02-21T08:34:04.5718554Z                                                                   configs/s     
2026-02-21T08:34:04.8832364Z [246s] Generation 15 complete: 
2026-02-21T08:34:04.8832801Z ok=43
2026-02-21T08:34:04.8833062Z min=0.0343
2026-02-21T08:34:04.8833341Z mid=0.0349
2026-02-21T08:34:04.8833588Z max=0.3154
2026-02-21T08:34:04.8833866Z best={'block_sizes': [1],
2026-02-21T08:34:04.8835100Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:34:04.8836142Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:34:04.8836797Z               'pointer'],
2026-02-21T08:34:04.8837333Z  'load_eviction_policies': ['', 'last', '', '', '', 'first', '', 'first'],
2026-02-21T08:34:04.8837924Z  'num_stages': 4,
2026-02-21T08:34:04.8838211Z  'num_warps': 4,
2026-02-21T08:34:04.8838523Z  'pid_type': 'flat',
2026-02-21T08:34:04.8838867Z  'range_flattens': [None],
2026-02-21T08:34:04.8839238Z  'range_multi_buffers': [None],
2026-02-21T08:34:04.8839461Z  'range_num_stages': [0],
2026-02-21T08:34:04.8839670Z  'range_unroll_factors': [0],
2026-02-21T08:34:04.8839895Z  'range_warp_specializes': [],
2026-02-21T08:34:04.8840127Z  'reduction_loops': [None]}
2026-02-21T08:34:04.8875437Z [246s] Fitting surrogate: 862 points, 862 targets
2026-02-21T08:34:05.4463194Z [247s] Generation 16 starting: 28 neighbors, 2 active search path(s)
2026-02-21T08:34:08.1556008Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 11.7 configs/s
2026-02-21T08:34:09.9765973Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 16.9 configs/s
2026-02-21T08:34:12.5062175Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 401.2         
2026-02-21T08:34:12.5063170Z                                                                   configs/s     
2026-02-21T08:34:12.7190320Z [254s] Generation 16 complete: 
2026-02-21T08:34:12.7190758Z ok=31
2026-02-21T08:34:12.7191023Z min=0.0313
2026-02-21T08:34:12.7191297Z mid=0.0330
2026-02-21T08:34:12.7191552Z max=0.3159
2026-02-21T08:34:12.7191823Z best={'block_sizes': [1],
2026-02-21T08:34:12.7192511Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:34:12.7193458Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:34:12.7194575Z               'pointer'],
2026-02-21T08:34:12.7195021Z  'load_eviction_policies': ['', '', 'last', '', '', '', 'last', ''],
2026-02-21T08:34:12.7195672Z  'num_stages': 3,
2026-02-21T08:34:12.7195860Z  'num_warps': 4,
2026-02-21T08:34:12.7196043Z  'pid_type': 'flat',
2026-02-21T08:34:12.7196251Z  'range_flattens': [None],
2026-02-21T08:34:12.7196470Z  'range_multi_buffers': [None],
2026-02-21T08:34:12.7196695Z  'range_num_stages': [0],
2026-02-21T08:34:12.7196904Z  'range_unroll_factors': [0],
2026-02-21T08:34:12.7197132Z  'range_warp_specializes': [],
2026-02-21T08:34:12.7197347Z  'reduction_loops': [None]}
2026-02-21T08:34:12.7237693Z [254s] Fitting surrogate: 893 points, 893 targets
2026-02-21T08:34:13.1575999Z [255s] Generation 17 starting: 19 neighbors, 2 active search path(s)
2026-02-21T08:34:14.5599527Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 18.2 configs/s
2026-02-21T08:34:15.6860459Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.6 configs/s
2026-02-21T08:34:18.2503456Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 395.0         
2026-02-21T08:34:18.2504280Z                                                                   configs/s     
2026-02-21T08:34:18.4628724Z [260s] Generation 17 complete: 
2026-02-21T08:34:18.4629210Z ok=21
2026-02-21T08:34:18.4629496Z min=0.0343
2026-02-21T08:34:18.4629770Z mid=0.0349
2026-02-21T08:34:18.4630014Z max=0.0410
2026-02-21T08:34:18.4630286Z best={'block_sizes': [1],
2026-02-21T08:34:18.4630972Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:34:18.4631924Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:34:18.4632543Z               'pointer'],
2026-02-21T08:34:18.4633010Z  'load_eviction_policies': ['', '', 'last', '', '', '', 'last', ''],
2026-02-21T08:34:18.4633549Z  'num_stages': 3,
2026-02-21T08:34:18.4633842Z  'num_warps': 4,
2026-02-21T08:34:18.4634547Z  'pid_type': 'flat',
2026-02-21T08:34:18.4634867Z  'range_flattens': [None],
2026-02-21T08:34:18.4635219Z  'range_multi_buffers': [None],
2026-02-21T08:34:18.4635585Z  'range_num_stages': [0],
2026-02-21T08:34:18.4635926Z  'range_unroll_factors': [0],
2026-02-21T08:34:18.4636287Z  'range_warp_specializes': [],
2026-02-21T08:34:18.4636653Z  'reduction_loops': [None]}
2026-02-21T08:34:18.4675806Z [260s] Fitting surrogate: 914 points, 914 targets
2026-02-21T08:34:18.6257955Z [260s] Autotuning complete in 260.6s after searching 870 configs.
2026-02-21T08:34:18.6258426Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:34:18.6260414Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', '', 'last', '', '', '', 'last', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:34:18.6262281Z 
2026-02-21T08:34:18.6262699Z [260s] Code of selected kernel: /tmp/torchinductor_root/wk/cwkc7kqwgeteiotwix77udrv3dmk5w5yghpadeq5uuactfwnmyed.py
2026-02-21T08:34:19.6169282Z WARNING:tritonbench.utils.triton_op:Completed input ID 3:
2026-02-21T08:34:19.6169638Z (M, N)
2026-02-21T08:34:19.6169816Z ------------
2026-02-21T08:34:19.6170061Z (4096, 2560)
2026-02-21T08:34:19.6170178Z 
2026-02-21T08:34:19.6190667Z  15%|█▌        | 3/20 [15:52<1:29:08, 314.59s/it]WARNING:tritonbench.utils.triton_op:Running input ID 5:
2026-02-21T08:34:19.6191226Z (M, N)
2026-02-21T08:34:19.6191429Z ------------
2026-02-21T08:34:19.6191642Z (4096, 3584)
2026-02-21T08:34:19.6193605Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:34:21.1966004Z INFO:tritonbench.utils.triton_op:Took 3.29ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:34:24.3614456Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:34:25.8745980Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:34:25.8746370Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:34:25.8746700Z               'dtype': 'torch.float32',
2026-02-21T08:34:25.8747052Z               'shape': (4096, 3584),
2026-02-21T08:34:25.8747361Z               'stride': (3584, 1)},
2026-02-21T08:34:25.8747640Z             (3584,),
2026-02-21T08:34:25.8747890Z             { 'device': 'cuda:0',
2026-02-21T08:34:25.8748182Z               'dtype': 'torch.float32',
2026-02-21T08:34:25.8748490Z               'shape': (3584,),
2026-02-21T08:34:25.8748760Z               'stride': (1,)},
2026-02-21T08:34:25.8749033Z             { 'device': 'cuda:0',
2026-02-21T08:34:25.8749326Z               'dtype': 'torch.float32',
2026-02-21T08:34:25.8749622Z               'shape': (3584,),
2026-02-21T08:34:25.8749885Z               'stride': (1,)},
2026-02-21T08:34:25.8750133Z             1e-05),
2026-02-21T08:34:25.8750354Z   'kwargs': {}}
2026-02-21T08:34:25.8785840Z INFO:tritonbench.utils.triton_op:Took 4.36ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:34:25.8868225Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:34:25.8869416Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:34:25.8870206Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:34:25.8870660Z While processing:
2026-02-21T08:34:25.8871221Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:34:25.8871773Z     if bias is not None:
2026-02-21T08:34:25.8872056Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:34:25.8872226Z 
2026-02-21T08:34:26.0527119Z [0s] Autotune random seed: 2135381352
2026-02-21T08:34:26.2198253Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:35:00.1530815Z [33s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', '', 'last', 'last', '', '', 'last', 'last'], maxnreg=256, num_sm_multiplier=2, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[None], range_num_stages=[2], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T08:35:00.8106046Z [34s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:35:01.5676827Z [35s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:35:03.1657031Z [36s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'last', 'last', '', 'last', 'first', 'last', ''], maxnreg=128, num_sm_multiplier=1, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T08:35:03.9468328Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first', 'last', '', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=8, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:35:04.5566126Z [38s] Timeout after 30s compiling Config(block_sizes=[2048], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'first', '', 'last', 'last', 'first', 'first', 'last'], num_stages=8, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:35:04.5589822Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T08:35:10.0261121Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 18.5 configs/s
2026-02-21T08:35:10.0274900Z [43s] Adaptive compile timeout: 30s (90% percentile=13.5s, bounds=[30.0s, 30s])
2026-02-21T08:35:11.7571347Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 576.9 configs/s
2026-02-21T08:35:11.8971217Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T08:35:11.8971618Z error=11
2026-02-21T08:35:11.8971812Z timeout=6
2026-02-21T08:35:11.8972008Z ok=83
2026-02-21T08:35:11.8972213Z min=0.0436
2026-02-21T08:35:11.8972406Z mid=0.2424
2026-02-21T08:35:11.8972591Z max=14.4496
2026-02-21T08:35:11.8972816Z best={'block_sizes': [1],
2026-02-21T08:35:11.8973273Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:35:11.8973859Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:35:11.8974473Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:35:11.8974856Z  'num_stages': 1,
2026-02-21T08:35:11.8975145Z  'num_warps': 4,
2026-02-21T08:35:11.8975428Z  'pid_type': 'flat',
2026-02-21T08:35:11.8975693Z  'range_flattens': [None],
2026-02-21T08:35:11.8975958Z  'range_multi_buffers': [None],
2026-02-21T08:35:11.8976254Z  'range_num_stages': [0],
2026-02-21T08:35:11.8976532Z  'range_unroll_factors': [0],
2026-02-21T08:35:11.8976815Z  'range_warp_specializes': [],
2026-02-21T08:35:11.8977102Z  'reduction_loops': [None]}
2026-02-21T08:35:11.8993232Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:35:13.8048039Z [47s] Generation 1 starting: 87 neighbors, 5 active search path(s)
2026-02-21T08:35:22.3922211Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 9.1 configs/s
2026-02-21T08:35:28.0036451Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 91/91 16.3 configs/s
2026-02-21T08:35:37.7938775Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.1         
2026-02-21T08:35:37.7939440Z                                                                   configs/s     
2026-02-21T08:35:38.4233447Z [72s] Generation 1 complete: 
2026-02-21T08:35:38.4233890Z ok=93
2026-02-21T08:35:38.4234443Z min=0.0437
2026-02-21T08:35:38.4234654Z mid=0.0565
2026-02-21T08:35:38.4234865Z max=0.6190
2026-02-21T08:35:38.4235103Z best={'block_sizes': [1],
2026-02-21T08:35:38.4236239Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:35:38.4236957Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:35:38.4237504Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:35:38.4237906Z  'num_stages': 1,
2026-02-21T08:35:38.4238145Z  'num_warps': 8,
2026-02-21T08:35:38.4238385Z  'pid_type': 'flat',
2026-02-21T08:35:38.4238647Z  'range_flattens': [None],
2026-02-21T08:35:38.4238957Z  'range_multi_buffers': [None],
2026-02-21T08:35:38.4239261Z  'range_num_stages': [0],
2026-02-21T08:35:38.4239541Z  'range_unroll_factors': [0],
2026-02-21T08:35:38.4239832Z  'range_warp_specializes': [],
2026-02-21T08:35:38.4240127Z  'reduction_loops': [None]}
2026-02-21T08:35:38.4256974Z [72s] Fitting surrogate: 193 points, 193 targets
2026-02-21T08:35:39.6674844Z [73s] Generation 2 starting: 75 neighbors, 5 active search path(s)
2026-02-21T08:35:46.6048455Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 18.0 configs/s
2026-02-21T08:35:51.4026489Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 16.4 configs/s
2026-02-21T08:36:01.3537905Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 101.8         
2026-02-21T08:36:01.3538392Z                                                                   configs/s     
2026-02-21T08:36:02.0341058Z [95s] Generation 2 complete: 
2026-02-21T08:36:02.0341335Z ok=81
2026-02-21T08:36:02.0341540Z min=0.0430
2026-02-21T08:36:02.0341737Z mid=0.0498
2026-02-21T08:36:02.0341933Z max=0.6244
2026-02-21T08:36:02.0342125Z best={'block_sizes': [1],
2026-02-21T08:36:02.0342593Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:36:02.0343211Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:36:02.0343687Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:36:02.0344213Z  'num_stages': 1,
2026-02-21T08:36:02.0344431Z  'num_warps': 16,
2026-02-21T08:36:02.0344640Z  'pid_type': 'flat',
2026-02-21T08:36:02.0344861Z  'range_flattens': [None],
2026-02-21T08:36:02.0345504Z  'range_multi_buffers': [None],
2026-02-21T08:36:02.0345774Z  'range_num_stages': [0],
2026-02-21T08:36:02.0346021Z  'range_unroll_factors': [0],
2026-02-21T08:36:02.0346290Z  'range_warp_specializes': [],
2026-02-21T08:36:02.0346559Z  'reduction_loops': [None]}
2026-02-21T08:36:02.0373122Z [95s] Fitting surrogate: 274 points, 274 targets
2026-02-21T08:36:03.0287892Z [96s] Generation 3 starting: 58 neighbors, 5 active search path(s)
2026-02-21T08:36:09.0800934Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 9.5 configs/s
2026-02-21T08:36:12.7622141Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.5 configs/s
2026-02-21T08:36:20.5962155Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 129.1         
2026-02-21T08:36:20.5963250Z                                                                   configs/s     
2026-02-21T08:36:21.1389550Z [114s] Generation 3 complete: 
2026-02-21T08:36:21.1389803Z ok=63
2026-02-21T08:36:21.1389996Z min=0.0436
2026-02-21T08:36:21.1390187Z mid=0.0474
2026-02-21T08:36:21.1390361Z max=0.6143
2026-02-21T08:36:21.1390537Z best={'block_sizes': [1],
2026-02-21T08:36:21.1390964Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:36:21.1391535Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:36:21.1391973Z  'load_eviction_policies': ['', '', '', 'last', '', '', '', ''],
2026-02-21T08:36:21.1392300Z  'num_stages': 1,
2026-02-21T08:36:21.1392482Z  'num_warps': 16,
2026-02-21T08:36:21.1392685Z  'pid_type': 'flat',
2026-02-21T08:36:21.1392895Z  'range_flattens': [None],
2026-02-21T08:36:21.1393129Z  'range_multi_buffers': [None],
2026-02-21T08:36:21.1393371Z  'range_num_stages': [0],
2026-02-21T08:36:21.1393595Z  'range_unroll_factors': [0],
2026-02-21T08:36:21.1393842Z  'range_warp_specializes': [],
2026-02-21T08:36:21.1394405Z  'reduction_loops': [None]}
2026-02-21T08:36:21.1417832Z [114s] Fitting surrogate: 337 points, 337 targets
2026-02-21T08:36:22.1002815Z [115s] Generation 4 starting: 57 neighbors, 5 active search path(s)
2026-02-21T08:36:27.0687229Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 32.2 configs/s
2026-02-21T08:36:30.5817717Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 16.7 configs/s
2026-02-21T08:36:38.9273599Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 127.9         
2026-02-21T08:36:38.9274581Z                                                                   configs/s     
2026-02-21T08:36:39.4536452Z [133s] Generation 4 complete: 
2026-02-21T08:36:39.4536889Z ok=63
2026-02-21T08:36:39.4537056Z min=0.0433
2026-02-21T08:36:39.4537238Z mid=0.0459
2026-02-21T08:36:39.4537410Z max=0.6145
2026-02-21T08:36:39.4537588Z best={'block_sizes': [1],
2026-02-21T08:36:39.4538049Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:36:39.4538632Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:36:39.4539119Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', '', ''],
2026-02-21T08:36:39.4539462Z  'num_stages': 1,
2026-02-21T08:36:39.4539652Z  'num_warps': 4,
2026-02-21T08:36:39.4539848Z  'pid_type': 'flat',
2026-02-21T08:36:39.4540056Z  'range_flattens': [None],
2026-02-21T08:36:39.4540297Z  'range_multi_buffers': [None],
2026-02-21T08:36:39.4540548Z  'range_num_stages': [0],
2026-02-21T08:36:39.4540784Z  'range_unroll_factors': [0],
2026-02-21T08:36:39.4541021Z  'range_warp_specializes': [],
2026-02-21T08:36:39.4541278Z  'reduction_loops': [None]}
2026-02-21T08:36:39.4568912Z [133s] Fitting surrogate: 400 points, 400 targets
2026-02-21T08:36:40.4023642Z [134s] Generation 5 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:36:45.4480575Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 7.9 configs/s
2026-02-21T08:36:48.8084333Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.6 configs/s
2026-02-21T08:36:54.9466865Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 164.8         
2026-02-21T08:36:54.9467447Z                                                                   configs/s     
2026-02-21T08:36:55.3787376Z [149s] Generation 5 complete: 
2026-02-21T08:36:55.3787671Z ok=57
2026-02-21T08:36:55.3787848Z min=0.0427
2026-02-21T08:36:55.3788029Z mid=0.0471
2026-02-21T08:36:55.3788195Z max=0.2143
2026-02-21T08:36:55.3788383Z best={'block_sizes': [1],
2026-02-21T08:36:55.3788820Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:36:55.3789446Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:36:55.3789878Z               'pointer'],
2026-02-21T08:36:55.3790655Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', '', 'first'],
2026-02-21T08:36:55.3791069Z  'num_stages': 1,
2026-02-21T08:36:55.3791269Z  'num_warps': 4,
2026-02-21T08:36:55.3791473Z  'pid_type': 'flat',
2026-02-21T08:36:55.3791699Z  'range_flattens': [None],
2026-02-21T08:36:55.3791943Z  'range_multi_buffers': [None],
2026-02-21T08:36:55.3792187Z  'range_num_stages': [0],
2026-02-21T08:36:55.3792423Z  'range_unroll_factors': [0],
2026-02-21T08:36:55.3792691Z  'range_warp_specializes': [],
2026-02-21T08:36:55.3792940Z  'reduction_loops': [None]}
2026-02-21T08:36:55.3820232Z [149s] Fitting surrogate: 457 points, 457 targets
2026-02-21T08:36:56.3916047Z [150s] Generation 6 starting: 61 neighbors, 5 active search path(s)
2026-02-21T08:37:02.3077960Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 18.1 configs/s
2026-02-21T08:37:06.1789171Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 16.7 configs/s
2026-02-21T08:37:14.7544807Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.1         
2026-02-21T08:37:14.7545322Z                                                                   configs/s     
2026-02-21T08:37:15.3584933Z [169s] Generation 6 complete: 
2026-02-21T08:37:15.3586346Z ok=67
2026-02-21T08:37:15.3586530Z min=0.0427
2026-02-21T08:37:15.3586707Z mid=0.0456
2026-02-21T08:37:15.3586872Z max=0.1103
2026-02-21T08:37:15.3587047Z best={'block_sizes': [1],
2026-02-21T08:37:15.3587447Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:37:15.3588032Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:37:15.3588443Z               'pointer'],
2026-02-21T08:37:15.3588764Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', '', 'first'],
2026-02-21T08:37:15.3589129Z  'num_stages': 2,
2026-02-21T08:37:15.3589320Z  'num_warps': 4,
2026-02-21T08:37:15.3589508Z  'pid_type': 'flat',
2026-02-21T08:37:15.3589713Z  'range_flattens': [None],
2026-02-21T08:37:15.3589943Z  'range_multi_buffers': [None],
2026-02-21T08:37:15.3590182Z  'range_num_stages': [0],
2026-02-21T08:37:15.3590400Z  'range_unroll_factors': [0],
2026-02-21T08:37:15.3590642Z  'range_warp_specializes': [],
2026-02-21T08:37:15.3590883Z  'reduction_loops': [None]}
2026-02-21T08:37:15.3621397Z [169s] Fitting surrogate: 524 points, 524 targets
2026-02-21T08:37:16.1496849Z [169s] Generation 7 starting: 47 neighbors, 5 active search path(s)
2026-02-21T08:37:20.2976726Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 13.8 configs/s
2026-02-21T08:37:23.1716724Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 17.3 configs/s
2026-02-21T08:37:30.3463636Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.2         
2026-02-21T08:37:30.3464303Z                                                                   configs/s     
2026-02-21T08:37:30.8253808Z [184s] Generation 7 complete: 
2026-02-21T08:37:30.8254319Z error=1
2026-02-21T08:37:30.8254500Z ok=52
2026-02-21T08:37:30.8254687Z min=0.0423
2026-02-21T08:37:30.8254859Z mid=0.0441
2026-02-21T08:37:30.8255017Z max=0.0729
2026-02-21T08:37:30.8255193Z best={'block_sizes': [1],
2026-02-21T08:37:30.8255628Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:37:30.8256671Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:37:30.8257149Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', '', 'first'],
2026-02-21T08:37:30.8257512Z  'num_stages': 2,
2026-02-21T08:37:30.8257702Z  'num_warps': 4,
2026-02-21T08:37:30.8257892Z  'pid_type': 'flat',
2026-02-21T08:37:30.8258113Z  'range_flattens': [None],
2026-02-21T08:37:30.8258340Z  'range_multi_buffers': [None],
2026-02-21T08:37:30.8258575Z  'range_num_stages': [0],
2026-02-21T08:37:30.8258795Z  'range_unroll_factors': [0],
2026-02-21T08:37:30.8259038Z  'range_warp_specializes': [],
2026-02-21T08:37:30.8259272Z  'reduction_loops': [None]}
2026-02-21T08:37:30.8290001Z [184s] Fitting surrogate: 577 points, 577 targets
2026-02-21T08:37:31.5279286Z [185s] Generation 8 starting: 37 neighbors, 4 active search path(s)
2026-02-21T08:37:34.7150682Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 23.8 configs/s
2026-02-21T08:37:36.9751050Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.2 configs/s
2026-02-21T08:37:41.8117318Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 208.8         
2026-02-21T08:37:41.8118133Z                                                                   configs/s     
2026-02-21T08:37:42.1695392Z [195s] Generation 8 complete: 
2026-02-21T08:37:42.1695794Z ok=41
2026-02-21T08:37:42.1696074Z min=0.0423
2026-02-21T08:37:42.1696361Z mid=0.0445
2026-02-21T08:37:42.1696623Z max=0.0967
2026-02-21T08:37:42.1696914Z best={'block_sizes': [1],
2026-02-21T08:37:42.1697640Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:37:42.1698634Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:37:42.1699482Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', '', 'first'],
2026-02-21T08:37:42.1700228Z  'num_stages': 2,
2026-02-21T08:37:42.1700467Z  'num_warps': 4,
2026-02-21T08:37:42.1700662Z  'pid_type': 'flat',
2026-02-21T08:37:42.1700871Z  'range_flattens': [None],
2026-02-21T08:37:42.1701104Z  'range_multi_buffers': [None],
2026-02-21T08:37:42.1701343Z  'range_num_stages': [0],
2026-02-21T08:37:42.1701563Z  'range_unroll_factors': [0],
2026-02-21T08:37:42.1701809Z  'range_warp_specializes': [],
2026-02-21T08:37:42.1702045Z  'reduction_loops': [None]}
2026-02-21T08:37:42.1733163Z [195s] Fitting surrogate: 618 points, 618 targets
2026-02-21T08:37:42.7207345Z [196s] Generation 9 starting: 28 neighbors, 3 active search path(s)
2026-02-21T08:37:45.3740271Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 18.5 configs/s
2026-02-21T08:37:47.1187851Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 29/29 17.1 configs/s
2026-02-21T08:37:50.7792288Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 275.6         
2026-02-21T08:37:50.7792884Z                                                                   configs/s     
2026-02-21T08:37:51.0512285Z [204s] Generation 9 complete: 
2026-02-21T08:37:51.0512607Z ok=31
2026-02-21T08:37:51.0512794Z min=0.0430
2026-02-21T08:37:51.0512984Z mid=0.0477
2026-02-21T08:37:51.0513155Z max=0.0867
2026-02-21T08:37:51.0513352Z best={'block_sizes': [1],
2026-02-21T08:37:51.0513852Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:37:51.0514869Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:37:51.0515393Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', '', 'first'],
2026-02-21T08:37:51.0515828Z  'num_stages': 2,
2026-02-21T08:37:51.0516020Z  'num_warps': 8,
2026-02-21T08:37:51.0516211Z  'pid_type': 'flat',
2026-02-21T08:37:51.0516463Z  'range_flattens': [None],
2026-02-21T08:37:51.0516688Z  'range_multi_buffers': [None],
2026-02-21T08:37:51.0516927Z  'range_num_stages': [0],
2026-02-21T08:37:51.0517153Z  'range_unroll_factors': [0],
2026-02-21T08:37:51.0517400Z  'range_warp_specializes': [],
2026-02-21T08:37:51.0517648Z  'reduction_loops': [None]}
2026-02-21T08:37:51.0549720Z [204s] Fitting surrogate: 649 points, 649 targets
2026-02-21T08:37:51.7442197Z [205s] Generation 10 starting: 38 neighbors, 3 active search path(s)
2026-02-21T08:37:55.7581496Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 16.5 configs/s
2026-02-21T08:37:58.1533836Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 17.0 configs/s
2026-02-21T08:38:03.2582192Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 198.1         
2026-02-21T08:38:03.2582710Z                                                                   configs/s     
2026-02-21T08:38:03.6267890Z [217s] Generation 10 complete: 
2026-02-21T08:38:03.6269077Z ok=42
2026-02-21T08:38:03.6269414Z min=0.0429
2026-02-21T08:38:03.6269691Z mid=0.0448
2026-02-21T08:38:03.6269958Z max=0.1118
2026-02-21T08:38:03.6270252Z best={'block_sizes': [2],
2026-02-21T08:38:03.6271016Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:03.6271996Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:03.6272647Z               'tensor_descriptor'],
2026-02-21T08:38:03.6273178Z  'load_eviction_policies': ['', '', '', '', '', 'last', '', ''],
2026-02-21T08:38:03.6273717Z  'num_stages': 1,
2026-02-21T08:38:03.6274539Z  'num_warps': 8,
2026-02-21T08:38:03.6274735Z  'pid_type': 'flat',
2026-02-21T08:38:03.6274924Z  'range_flattens': [None],
2026-02-21T08:38:03.6275136Z  'range_multi_buffers': [None],
2026-02-21T08:38:03.6275355Z  'range_num_stages': [0],
2026-02-21T08:38:03.6275564Z  'range_unroll_factors': [0],
2026-02-21T08:38:03.6275786Z  'range_warp_specializes': [],
2026-02-21T08:38:03.6276010Z  'reduction_loops': [None]}
2026-02-21T08:38:03.6315537Z [217s] Fitting surrogate: 691 points, 691 targets
2026-02-21T08:38:04.2627806Z [218s] Generation 11 starting: 34 neighbors, 3 active search path(s)
2026-02-21T08:38:07.3752239Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 2.4 configs/s
2026-02-21T08:38:09.3758201Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 17.4 configs/s
2026-02-21T08:38:14.1300983Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 212.8         
2026-02-21T08:38:14.1301578Z                                                                   configs/s     
2026-02-21T08:38:14.4787727Z [228s] Generation 11 complete: 
2026-02-21T08:38:14.4787997Z ok=37
2026-02-21T08:38:14.4788165Z min=0.0428
2026-02-21T08:38:14.4788341Z mid=0.0432
2026-02-21T08:38:14.4788501Z max=0.3579
2026-02-21T08:38:14.4788692Z best={'block_sizes': [2],
2026-02-21T08:38:14.4789145Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:14.4789756Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:14.4790616Z               'tensor_descriptor'],
2026-02-21T08:38:14.4790943Z  'load_eviction_policies': ['', '', '', '', '', 'last', '', ''],
2026-02-21T08:38:14.4791289Z  'num_stages': 1,
2026-02-21T08:38:14.4791477Z  'num_warps': 8,
2026-02-21T08:38:14.4791673Z  'pid_type': 'flat',
2026-02-21T08:38:14.4791875Z  'range_flattens': [None],
2026-02-21T08:38:14.4792106Z  'range_multi_buffers': [None],
2026-02-21T08:38:14.4792328Z  'range_num_stages': [0],
2026-02-21T08:38:14.4792542Z  'range_unroll_factors': [0],
2026-02-21T08:38:14.4792774Z  'range_warp_specializes': [],
2026-02-21T08:38:14.4792989Z  'reduction_loops': [None]}
2026-02-21T08:38:14.4829764Z [228s] Fitting surrogate: 728 points, 728 targets
2026-02-21T08:38:14.9152306Z [228s] Generation 12 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:38:17.0626416Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 4.4 configs/s
2026-02-21T08:38:18.2653427Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.3 configs/s
2026-02-21T08:38:21.1948259Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 344.2         
2026-02-21T08:38:21.1948915Z                                                                   configs/s     
2026-02-21T08:38:21.4222565Z [235s] Generation 12 complete: 
2026-02-21T08:38:21.4222825Z ok=23
2026-02-21T08:38:21.4223005Z min=0.0428
2026-02-21T08:38:21.4223176Z mid=0.0433
2026-02-21T08:38:21.4223334Z max=0.0658
2026-02-21T08:38:21.4223523Z best={'block_sizes': [1],
2026-02-21T08:38:21.4223959Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:38:21.4224960Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:21.4225410Z               'pointer'],
2026-02-21T08:38:21.4225779Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'first', 'first'],
2026-02-21T08:38:21.4226182Z  'num_stages': 6,
2026-02-21T08:38:21.4226368Z  'num_warps': 16,
2026-02-21T08:38:21.4226571Z  'pid_type': 'flat',
2026-02-21T08:38:21.4226782Z  'range_flattens': [None],
2026-02-21T08:38:21.4227012Z  'range_multi_buffers': [None],
2026-02-21T08:38:21.4227247Z  'range_num_stages': [0],
2026-02-21T08:38:21.4227449Z  'range_unroll_factors': [0],
2026-02-21T08:38:21.4227672Z  'range_warp_specializes': [],
2026-02-21T08:38:21.4227888Z  'reduction_loops': [None]}
2026-02-21T08:38:21.4264330Z [235s] Fitting surrogate: 751 points, 751 targets
2026-02-21T08:38:21.7006767Z [235s] Generation 13 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:38:22.5718746Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 15.7 configs/s
2026-02-21T08:38:23.1005430Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.8 configs/s
2026-02-21T08:38:24.4225926Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 751.4         
2026-02-21T08:38:24.4226554Z                                                                   configs/s     
2026-02-21T08:38:24.5422587Z [238s] Generation 13 complete: 
2026-02-21T08:38:24.5422865Z ok=10
2026-02-21T08:38:24.5423050Z min=0.0461
2026-02-21T08:38:24.5423225Z mid=0.0463
2026-02-21T08:38:24.5423388Z max=0.0540
2026-02-21T08:38:24.5423565Z best={'block_sizes': [1],
2026-02-21T08:38:24.5424367Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:24.5424981Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:24.5425427Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:38:24.5425861Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'first', 'first'],
2026-02-21T08:38:24.5426276Z  'num_stages': 6,
2026-02-21T08:38:24.5426468Z  'num_warps': 4,
2026-02-21T08:38:24.5426682Z  'pid_type': 'flat',
2026-02-21T08:38:24.5426889Z  'range_flattens': [None],
2026-02-21T08:38:24.5427120Z  'range_multi_buffers': [None],
2026-02-21T08:38:24.5427353Z  'range_num_stages': [0],
2026-02-21T08:38:24.5428112Z  'range_unroll_factors': [0],
2026-02-21T08:38:24.5428348Z  'range_warp_specializes': [],
2026-02-21T08:38:24.5428605Z  'reduction_loops': [None]}
2026-02-21T08:38:24.5461787Z [238s] Fitting surrogate: 761 points, 761 targets
2026-02-21T08:38:24.8333805Z [238s] Generation 14 starting: 11 neighbors, 1 active search path(s)
2026-02-21T08:38:26.6275190Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 26.0 configs/s
2026-02-21T08:38:27.3540265Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.6 configs/s
2026-02-21T08:38:28.9429952Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 630.0         
2026-02-21T08:38:28.9430526Z                                                                   configs/s     
2026-02-21T08:38:29.0781841Z [242s] Generation 14 complete: 
2026-02-21T08:38:29.0782126Z ok=13
2026-02-21T08:38:29.0782294Z min=0.0430
2026-02-21T08:38:29.0782473Z mid=0.0455
2026-02-21T08:38:29.0782639Z max=0.0682
2026-02-21T08:38:29.0782860Z best={'block_sizes': [1],
2026-02-21T08:38:29.0783308Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:29.0783932Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:29.0784685Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:38:29.0785104Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'last', 'first'],
2026-02-21T08:38:29.0785511Z  'num_stages': 6,
2026-02-21T08:38:29.0785699Z  'num_warps': 16,
2026-02-21T08:38:29.0785892Z  'pid_type': 'flat',
2026-02-21T08:38:29.0786095Z  'range_flattens': [None],
2026-02-21T08:38:29.0786350Z  'range_multi_buffers': [None],
2026-02-21T08:38:29.0786602Z  'range_num_stages': [0],
2026-02-21T08:38:29.0786838Z  'range_unroll_factors': [0],
2026-02-21T08:38:29.0787092Z  'range_warp_specializes': [],
2026-02-21T08:38:29.0787337Z  'reduction_loops': [None]}
2026-02-21T08:38:29.0820734Z [242s] Fitting surrogate: 774 points, 774 targets
2026-02-21T08:38:29.3766778Z [243s] Generation 15 starting: 10 neighbors, 1 active search path(s)
2026-02-21T08:38:30.3171675Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 18.4 configs/s
2026-02-21T08:38:30.9123749Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.3 configs/s
2026-02-21T08:38:32.2054340Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 770.7         
2026-02-21T08:38:32.2054837Z                                                                   configs/s     
2026-02-21T08:38:32.3241964Z [246s] Generation 15 complete: 
2026-02-21T08:38:32.3242231Z ok=11
2026-02-21T08:38:32.3242410Z min=0.0431
2026-02-21T08:38:32.3242591Z mid=0.0433
2026-02-21T08:38:32.3242762Z max=0.0683
2026-02-21T08:38:32.3242945Z best={'block_sizes': [1],
2026-02-21T08:38:32.3243403Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:32.3244341Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:32.3244770Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:38:32.3245151Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'last', ''],
2026-02-21T08:38:32.3245520Z  'num_stages': 6,
2026-02-21T08:38:32.3245700Z  'num_warps': 16,
2026-02-21T08:38:32.3245883Z  'pid_type': 'flat',
2026-02-21T08:38:32.3246072Z  'range_flattens': [None],
2026-02-21T08:38:32.3246287Z  'range_multi_buffers': [None],
2026-02-21T08:38:32.3246507Z  'range_num_stages': [0],
2026-02-21T08:38:32.3246723Z  'range_unroll_factors': [0],
2026-02-21T08:38:32.3246946Z  'range_warp_specializes': [],
2026-02-21T08:38:32.3247175Z  'reduction_loops': [None]}
2026-02-21T08:38:32.3282286Z [246s] Fitting surrogate: 785 points, 785 targets
2026-02-21T08:38:32.6162153Z [246s] Generation 16 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:38:33.5590395Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 10.1 configs/s
2026-02-21T08:38:34.0861449Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.8 configs/s
2026-02-21T08:38:35.4148004Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 748.3         
2026-02-21T08:38:35.4148499Z                                                                   configs/s     
2026-02-21T08:38:35.5343707Z [249s] Generation 16 complete: 
2026-02-21T08:38:35.5344297Z ok=10
2026-02-21T08:38:35.5344493Z min=0.0458
2026-02-21T08:38:35.5344676Z mid=0.0463
2026-02-21T08:38:35.5344860Z max=0.0540
2026-02-21T08:38:35.5345057Z best={'block_sizes': [1],
2026-02-21T08:38:35.5345534Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:35.5346215Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:38:35.5347088Z               'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:38:35.5347539Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'last', ''],
2026-02-21T08:38:35.5347945Z  'num_stages': 6,
2026-02-21T08:38:35.5348133Z  'num_warps': 4,
2026-02-21T08:38:35.5348330Z  'pid_type': 'flat',
2026-02-21T08:38:35.5348536Z  'range_flattens': [None],
2026-02-21T08:38:35.5348768Z  'range_multi_buffers': [None],
2026-02-21T08:38:35.5349000Z  'range_num_stages': [0],
2026-02-21T08:38:35.5349238Z  'range_unroll_factors': [0],
2026-02-21T08:38:35.5349480Z  'range_warp_specializes': [],
2026-02-21T08:38:35.5349723Z  'reduction_loops': [None]}
2026-02-21T08:38:35.5384568Z [249s] Fitting surrogate: 795 points, 795 targets
2026-02-21T08:38:35.8398571Z [249s] Generation 17 starting: 10 neighbors, 1 active search path(s)
2026-02-21T08:38:37.1422878Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 5.5 configs/s
2026-02-21T08:38:37.7969520Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 18.1 configs/s
2026-02-21T08:38:39.2571151Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 685.3         
2026-02-21T08:38:39.2571694Z                                                                   configs/s     
2026-02-21T08:38:39.3804289Z [253s] Generation 17 complete: 
2026-02-21T08:38:39.3804589Z ok=12
2026-02-21T08:38:39.3804771Z min=0.0429
2026-02-21T08:38:39.3804956Z mid=0.0432
2026-02-21T08:38:39.3805125Z max=0.0865
2026-02-21T08:38:39.3805318Z best={'block_sizes': [1],
2026-02-21T08:38:39.3805800Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:38:39.3806496Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:39.3806971Z               'tensor_descriptor'],
2026-02-21T08:38:39.3807374Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'last', ''],
2026-02-21T08:38:39.3807803Z  'num_stages': 6,
2026-02-21T08:38:39.3808006Z  'num_warps': 16,
2026-02-21T08:38:39.3808222Z  'pid_type': 'flat',
2026-02-21T08:38:39.3808449Z  'range_flattens': [None],
2026-02-21T08:38:39.3808798Z  'range_multi_buffers': [None],
2026-02-21T08:38:39.3809139Z  'range_num_stages': [0],
2026-02-21T08:38:39.3809409Z  'range_unroll_factors': [0],
2026-02-21T08:38:39.3809687Z  'range_warp_specializes': [],
2026-02-21T08:38:39.3810043Z  'reduction_loops': [None]}
2026-02-21T08:38:39.3846539Z [253s] Fitting surrogate: 807 points, 807 targets
2026-02-21T08:38:39.6739366Z [253s] Generation 18 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:38:40.4917726Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 76.1 configs/s
2026-02-21T08:38:41.0171929Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.9 configs/s
2026-02-21T08:38:42.3562422Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 746.0         
2026-02-21T08:38:42.3563533Z                                                                   configs/s     
2026-02-21T08:38:42.4798901Z [256s] Generation 18 complete: 
2026-02-21T08:38:42.4799215Z ok=10
2026-02-21T08:38:42.4799409Z min=0.0463
2026-02-21T08:38:42.4800176Z mid=0.0469
2026-02-21T08:38:42.4800364Z max=0.0543
2026-02-21T08:38:42.4800574Z best={'block_sizes': [1],
2026-02-21T08:38:42.4801093Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:38:42.4801833Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:42.4802283Z               'pointer'],
2026-02-21T08:38:42.4802639Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'last', ''],
2026-02-21T08:38:42.4803040Z  'num_stages': 6,
2026-02-21T08:38:42.4803238Z  'num_warps': 16,
2026-02-21T08:38:42.4803443Z  'pid_type': 'flat',
2026-02-21T08:38:42.4803662Z  'range_flattens': [None],
2026-02-21T08:38:42.4803903Z  'range_multi_buffers': [None],
2026-02-21T08:38:42.4804527Z  'range_num_stages': [0],
2026-02-21T08:38:42.4804780Z  'range_unroll_factors': [0],
2026-02-21T08:38:42.4805043Z  'range_warp_specializes': [],
2026-02-21T08:38:42.4805291Z  'reduction_loops': [None]}
2026-02-21T08:38:42.4840988Z [256s] Fitting surrogate: 817 points, 817 targets
2026-02-21T08:38:42.7648649Z [256s] Generation 19 starting: 8 neighbors, 1 active search path(s)
2026-02-21T08:38:43.7561338Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 11.2 configs/s
2026-02-21T08:38:44.2986004Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.2 configs/s
2026-02-21T08:38:45.6285587Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 747.1         
2026-02-21T08:38:45.6286125Z                                                                   configs/s     
2026-02-21T08:38:45.7479239Z [259s] Generation 19 complete: 
2026-02-21T08:38:45.7479521Z ok=10
2026-02-21T08:38:45.7479707Z min=0.0428
2026-02-21T08:38:45.7479899Z mid=0.0474
2026-02-21T08:38:45.7480108Z max=0.0569
2026-02-21T08:38:45.7480312Z best={'block_sizes': [1],
2026-02-21T08:38:45.7480742Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:38:45.7481439Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:45.7481917Z               'pointer'],
2026-02-21T08:38:45.7482288Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'last', ''],
2026-02-21T08:38:45.7482712Z  'num_stages': 6,
2026-02-21T08:38:45.7482920Z  'num_warps': 16,
2026-02-21T08:38:45.7483132Z  'pid_type': 'flat',
2026-02-21T08:38:45.7483356Z  'range_flattens': [None],
2026-02-21T08:38:45.7483602Z  'range_multi_buffers': [None],
2026-02-21T08:38:45.7483852Z  'range_num_stages': [0],
2026-02-21T08:38:45.7484244Z  'range_unroll_factors': [0],
2026-02-21T08:38:45.7484501Z  'range_warp_specializes': [],
2026-02-21T08:38:45.7484766Z  'reduction_loops': [None]}
2026-02-21T08:38:45.7521334Z [259s] Fitting surrogate: 827 points, 827 targets
2026-02-21T08:38:46.0466385Z [259s] Generation 20 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:38:47.0155201Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 5.9 configs/s
2026-02-21T08:38:47.5415019Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.9 configs/s
2026-02-21T08:38:48.8806744Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 741.6         
2026-02-21T08:38:48.8807493Z                                                                   configs/s     
2026-02-21T08:38:49.0043650Z [262s] Generation 20 complete: 
2026-02-21T08:38:49.0043927Z ok=10
2026-02-21T08:38:49.0044325Z min=0.0463
2026-02-21T08:38:49.0044511Z mid=0.0466
2026-02-21T08:38:49.0044675Z max=0.0563
2026-02-21T08:38:49.0044863Z best={'block_sizes': [2],
2026-02-21T08:38:49.0045300Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:38:49.0046458Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:38:49.0047020Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'last', 'first'],
2026-02-21T08:38:49.0047440Z  'num_stages': 6,
2026-02-21T08:38:49.0047637Z  'num_warps': 16,
2026-02-21T08:38:49.0047841Z  'pid_type': 'flat',
2026-02-21T08:38:49.0048060Z  'range_flattens': [None],
2026-02-21T08:38:49.0048290Z  'range_multi_buffers': [None],
2026-02-21T08:38:49.0048539Z  'range_num_stages': [0],
2026-02-21T08:38:49.0048765Z  'range_unroll_factors': [0],
2026-02-21T08:38:49.0049015Z  'range_warp_specializes': [],
2026-02-21T08:38:49.0049275Z  'reduction_loops': [None]}
2026-02-21T08:38:49.0087472Z [262s] Fitting surrogate: 837 points, 837 targets
2026-02-21T08:38:49.1662123Z [262s] Autotuning complete in 262.9s after searching 788 configs.
2026-02-21T08:38:49.1662558Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:38:49.1664940Z     @helion.kernel(config=helion.Config(block_sizes=[2], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last', '', 'last', 'first', 'first', 'last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:38:49.1666871Z 
2026-02-21T08:38:49.1667286Z [262s] Code of selected kernel: /tmp/torchinductor_root/zj/czjwycljanpp7mmpoikybqotv772ojjnivl2dyjnwapmti546at2.py
2026-02-21T08:38:50.1713170Z WARNING:tritonbench.utils.triton_op:Completed input ID 5:
2026-02-21T08:38:50.1713567Z (M, N)
2026-02-21T08:38:50.1713750Z ------------
2026-02-21T08:38:50.1713938Z (4096, 3584)
2026-02-21T08:38:50.1714952Z 
2026-02-21T08:38:50.1730863Z  20%|██        | 4/20 [20:22<1:19:15, 297.21s/it]WARNING:tritonbench.utils.triton_op:Running input ID 6:
2026-02-21T08:38:50.1731300Z (M, N)
2026-02-21T08:38:50.1731456Z ------------
2026-02-21T08:38:50.1731611Z (4096, 4096)
2026-02-21T08:38:50.1734205Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:38:51.7286679Z INFO:tritonbench.utils.triton_op:Took 3.42ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:38:54.8985185Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:38:56.4578999Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:38:56.4579352Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:38:56.4579636Z               'dtype': 'torch.float32',
2026-02-21T08:38:56.4579911Z               'shape': (4096, 4096),
2026-02-21T08:38:56.4580199Z               'stride': (4096, 1)},
2026-02-21T08:38:56.4580477Z             (4096,),
2026-02-21T08:38:56.4580724Z             { 'device': 'cuda:0',
2026-02-21T08:38:56.4581039Z               'dtype': 'torch.float32',
2026-02-21T08:38:56.4581314Z               'shape': (4096,),
2026-02-21T08:38:56.4581543Z               'stride': (1,)},
2026-02-21T08:38:56.4581765Z             { 'device': 'cuda:0',
2026-02-21T08:38:56.4582005Z               'dtype': 'torch.float32',
2026-02-21T08:38:56.4582785Z               'shape': (4096,),
2026-02-21T08:38:56.4583008Z               'stride': (1,)},
2026-02-21T08:38:56.4583221Z             1e-05),
2026-02-21T08:38:56.4583409Z   'kwargs': {}}
2026-02-21T08:38:56.4636713Z INFO:tritonbench.utils.triton_op:Took 6.30ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:38:56.4721184Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:38:56.4722069Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:38:56.4722708Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:38:56.4723063Z While processing:
2026-02-21T08:38:56.4723883Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:38:56.4724476Z     if bias is not None:
2026-02-21T08:38:56.4724701Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:38:56.4724844Z 
2026-02-21T08:38:56.6299922Z [0s] Autotune random seed: 2135381352
2026-02-21T08:38:56.7861400Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:39:31.2120991Z [34s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', '', 'last', 'last', '', '', 'last', 'last'], maxnreg=256, num_sm_multiplier=2, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[None], range_num_stages=[2], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T08:39:31.9539449Z [35s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:39:32.8605984Z [36s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:39:34.7546174Z [37s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'last', 'last', '', 'last', 'first', 'last', ''], maxnreg=128, num_sm_multiplier=1, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T08:39:35.5448901Z [38s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first', 'last', '', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=8, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:39:36.1788974Z [39s] Timeout after 30s compiling Config(block_sizes=[2048], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'first', '', 'last', 'last', 'first', 'first', 'last'], num_stages=8, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:39:36.1807831Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T08:39:41.7738986Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 18.0 configs/s
2026-02-21T08:39:41.7754953Z [44s] Adaptive compile timeout: 30s (90% percentile=13.4s, bounds=[30.0s, 30s])
2026-02-21T08:39:42.7736823Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 990.3 configs/s
2026-02-21T08:39:42.8711007Z [46s] Initial random population of 100, 5 starting points: 
2026-02-21T08:39:42.8711384Z error=10
2026-02-21T08:39:42.8711567Z timeout=6
2026-02-21T08:39:42.8711750Z ok=84
2026-02-21T08:39:42.8711921Z min=0.0484
2026-02-21T08:39:42.8712108Z mid=0.3005
2026-02-21T08:39:42.8712280Z max=16.6105
2026-02-21T08:39:42.8712490Z best={'block_sizes': [1],
2026-02-21T08:39:42.8712996Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:39:42.8714681Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:39:42.8715409Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:39:42.8715946Z  'num_stages': 1,
2026-02-21T08:39:42.8716304Z  'num_warps': 4,
2026-02-21T08:39:42.8716618Z  'pid_type': 'flat',
2026-02-21T08:39:42.8716984Z  'range_flattens': [None],
2026-02-21T08:39:42.8717366Z  'range_multi_buffers': [None],
2026-02-21T08:39:42.8717763Z  'range_num_stages': [0],
2026-02-21T08:39:42.8718128Z  'range_unroll_factors': [0],
2026-02-21T08:39:42.8718527Z  'range_warp_specializes': [],
2026-02-21T08:39:42.8718915Z  'reduction_loops': [None]}
2026-02-21T08:39:42.8733256Z [46s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:39:44.3749569Z [47s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T08:39:53.2877966Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 12.5 configs/s
2026-02-21T08:39:59.0689329Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.4 configs/s
2026-02-21T08:40:10.0541590Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 96.5 configs/s
2026-02-21T08:40:10.7395120Z [73s] Generation 1 complete: 
2026-02-21T08:40:10.7395547Z ok=95
2026-02-21T08:40:10.7395871Z min=0.0485
2026-02-21T08:40:10.7396143Z mid=0.0603
2026-02-21T08:40:10.7396441Z max=0.6299
2026-02-21T08:40:10.7396735Z best={'block_sizes': [2],
2026-02-21T08:40:10.7397410Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:40:10.7398255Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:40:10.7398939Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', ''],
2026-02-21T08:40:10.7399477Z  'num_stages': 1,
2026-02-21T08:40:10.7399782Z  'num_warps': 4,
2026-02-21T08:40:10.7400112Z  'pid_type': 'flat',
2026-02-21T08:40:10.7400457Z  'range_flattens': [None],
2026-02-21T08:40:10.7400829Z  'range_multi_buffers': [None],
2026-02-21T08:40:10.7401211Z  'range_num_stages': [0],
2026-02-21T08:40:10.7401591Z  'range_unroll_factors': [0],
2026-02-21T08:40:10.7401976Z  'range_warp_specializes': [],
2026-02-21T08:40:10.7402362Z  'reduction_loops': [None]}
2026-02-21T08:40:10.7418800Z [73s] Fitting surrogate: 195 points, 195 targets
2026-02-21T08:40:12.1167621Z [75s] Generation 2 starting: 82 neighbors, 5 active search path(s)
2026-02-21T08:40:20.8445954Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 5.1 configs/s
2026-02-21T08:40:26.0027808Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 16.6 configs/s
2026-02-21T08:40:35.6620969Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 104.7         
2026-02-21T08:40:35.6621635Z                                                                   configs/s     
2026-02-21T08:40:36.3052568Z [99s] Generation 2 complete: 
2026-02-21T08:40:36.3052910Z ok=88
2026-02-21T08:40:36.3053128Z min=0.0484
2026-02-21T08:40:36.3053325Z mid=0.0579
2026-02-21T08:40:36.3053544Z max=0.2376
2026-02-21T08:40:36.3053753Z best={'block_sizes': [2],
2026-02-21T08:40:36.3055551Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:40:36.3056211Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:40:36.3056765Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', ''],
2026-02-21T08:40:36.3057176Z  'num_stages': 1,
2026-02-21T08:40:36.3057407Z  'num_warps': 4,
2026-02-21T08:40:36.3057646Z  'pid_type': 'flat',
2026-02-21T08:40:36.3057884Z  'range_flattens': [None],
2026-02-21T08:40:36.3058153Z  'range_multi_buffers': [None],
2026-02-21T08:40:36.3058425Z  'range_num_stages': [0],
2026-02-21T08:40:36.3058698Z  'range_unroll_factors': [0],
2026-02-21T08:40:36.3058985Z  'range_warp_specializes': [],
2026-02-21T08:40:36.3059272Z  'reduction_loops': [None]}
2026-02-21T08:40:36.3082793Z [99s] Fitting surrogate: 283 points, 283 targets
2026-02-21T08:40:37.1300043Z [100s] Generation 3 starting: 47 neighbors, 5 active search path(s)
2026-02-21T08:40:41.3374955Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 22.1 configs/s
2026-02-21T08:40:44.1482299Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 17.0 configs/s
2026-02-21T08:40:51.7306632Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 143.1         
2026-02-21T08:40:51.7307298Z                                                                   configs/s     
2026-02-21T08:40:52.2160266Z [115s] Generation 3 complete: 
2026-02-21T08:40:52.2160651Z ok=52
2026-02-21T08:40:52.2160887Z min=0.0485
2026-02-21T08:40:52.2161130Z mid=0.0514
2026-02-21T08:40:52.2161351Z max=0.0777
2026-02-21T08:40:52.2161599Z best={'block_sizes': [2],
2026-02-21T08:40:52.2162193Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:40:52.2162913Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:40:52.2163379Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', ''],
2026-02-21T08:40:52.2163810Z  'num_stages': 1,
2026-02-21T08:40:52.2164567Z  'num_warps': 4,
2026-02-21T08:40:52.2164788Z  'pid_type': 'flat',
2026-02-21T08:40:52.2165024Z  'range_flattens': [None],
2026-02-21T08:40:52.2165290Z  'range_multi_buffers': [None],
2026-02-21T08:40:52.2165548Z  'range_num_stages': [0],
2026-02-21T08:40:52.2165784Z  'range_unroll_factors': [0],
2026-02-21T08:40:52.2166046Z  'range_warp_specializes': [],
2026-02-21T08:40:52.2166298Z  'reduction_loops': [None]}
2026-02-21T08:40:52.2185681Z [115s] Fitting surrogate: 335 points, 335 targets
2026-02-21T08:40:53.0631941Z [116s] Generation 4 starting: 50 neighbors, 5 active search path(s)
2026-02-21T08:40:57.9101899Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 23.6 configs/s
2026-02-21T08:41:01.1400050Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 16.9 configs/s
2026-02-21T08:41:08.2192932Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 142.7         
2026-02-21T08:41:08.2193650Z                                                                   configs/s     
2026-02-21T08:41:08.6995341Z [131s] Generation 4 complete: 
2026-02-21T08:41:08.6996833Z ok=55
2026-02-21T08:41:08.6997084Z min=0.0487
2026-02-21T08:41:08.6997971Z mid=0.0521
2026-02-21T08:41:08.6998198Z max=0.0971
2026-02-21T08:41:08.6998437Z best={'block_sizes': [2],
2026-02-21T08:41:08.6999014Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:41:08.6999754Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:41:08.7000340Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', ''],
2026-02-21T08:41:08.7000808Z  'num_stages': 1,
2026-02-21T08:41:08.7001056Z  'num_warps': 4,
2026-02-21T08:41:08.7001319Z  'pid_type': 'flat',
2026-02-21T08:41:08.7001596Z  'range_flattens': [None],
2026-02-21T08:41:08.7001896Z  'range_multi_buffers': [None],
2026-02-21T08:41:08.7002213Z  'range_num_stages': [0],
2026-02-21T08:41:08.7002857Z  'range_unroll_factors': [0],
2026-02-21T08:41:08.7003238Z  'range_warp_specializes': [],
2026-02-21T08:41:08.7003524Z  'reduction_loops': [None]}
2026-02-21T08:41:08.7025386Z [131s] Fitting surrogate: 390 points, 390 targets
2026-02-21T08:41:09.5304777Z [132s] Generation 5 starting: 48 neighbors, 5 active search path(s)
2026-02-21T08:41:14.1284480Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 25.6 configs/s
2026-02-21T08:41:17.1758114Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 17.0 configs/s
2026-02-21T08:41:23.9605513Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 160.4         
2026-02-21T08:41:23.9606096Z                                                                   configs/s     
2026-02-21T08:41:24.3976979Z [147s] Generation 5 complete: 
2026-02-21T08:41:24.3977318Z ok=53
2026-02-21T08:41:24.3977531Z min=0.0481
2026-02-21T08:41:24.3977737Z mid=0.0496
2026-02-21T08:41:24.3977931Z max=0.3471
2026-02-21T08:41:24.3978138Z best={'block_sizes': [2],
2026-02-21T08:41:24.3978718Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:41:24.3979410Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:41:24.3980005Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', ''],
2026-02-21T08:41:24.3980417Z  'num_stages': 1,
2026-02-21T08:41:24.3980642Z  'num_warps': 4,
2026-02-21T08:41:24.3980866Z  'pid_type': 'flat',
2026-02-21T08:41:24.3981103Z  'range_flattens': [None],
2026-02-21T08:41:24.3981384Z  'range_multi_buffers': [None],
2026-02-21T08:41:24.3981671Z  'range_num_stages': [0],
2026-02-21T08:41:24.3981953Z  'range_unroll_factors': [0],
2026-02-21T08:41:24.3982249Z  'range_warp_specializes': [],
2026-02-21T08:41:24.3982551Z  'reduction_loops': [None]}
2026-02-21T08:41:24.4006172Z [147s] Fitting surrogate: 443 points, 443 targets
2026-02-21T08:41:25.3140988Z [148s] Generation 6 starting: 54 neighbors, 5 active search path(s)
2026-02-21T08:41:30.0513767Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 27.0 configs/s
2026-02-21T08:41:33.2988302Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 17.2 configs/s
2026-02-21T08:41:40.7225994Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 136.2         
2026-02-21T08:41:40.7226567Z                                                                   configs/s     
2026-02-21T08:41:41.2337114Z [164s] Generation 6 complete: 
2026-02-21T08:41:41.2337448Z ok=59
2026-02-21T08:41:41.2337629Z min=0.0512
2026-02-21T08:41:41.2337800Z mid=0.0519
2026-02-21T08:41:41.2337968Z max=0.2644
2026-02-21T08:41:41.2338152Z best={'block_sizes': [2],
2026-02-21T08:41:41.2338606Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:41:41.2339195Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:41:41.2339712Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', 'first', ''],
2026-02-21T08:41:41.2340814Z  'num_stages': 1,
2026-02-21T08:41:41.2341054Z  'num_warps': 4,
2026-02-21T08:41:41.2341246Z  'pid_type': 'flat',
2026-02-21T08:41:41.2341448Z  'range_flattens': [None],
2026-02-21T08:41:41.2341707Z  'range_multi_buffers': [None],
2026-02-21T08:41:41.2341952Z  'range_num_stages': [0],
2026-02-21T08:41:41.2342178Z  'range_unroll_factors': [0],
2026-02-21T08:41:41.2342424Z  'range_warp_specializes': [],
2026-02-21T08:41:41.2342683Z  'reduction_loops': [None]}
2026-02-21T08:41:41.2372555Z [164s] Fitting surrogate: 502 points, 502 targets
2026-02-21T08:41:41.9822610Z [165s] Generation 7 starting: 43 neighbors, 4 active search path(s)
2026-02-21T08:41:46.2278702Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 22.7 configs/s
2026-02-21T08:41:49.0334566Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 17.0 configs/s
2026-02-21T08:41:54.7245506Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 193.7         
2026-02-21T08:41:54.7246075Z                                                                   configs/s     
2026-02-21T08:41:55.0863185Z [178s] Generation 7 complete: 
2026-02-21T08:41:55.0863432Z ok=48
2026-02-21T08:41:55.0863629Z min=0.0482
2026-02-21T08:41:55.0863804Z mid=0.0541
2026-02-21T08:41:55.0864094Z max=0.3733
2026-02-21T08:41:55.0864291Z best={'block_sizes': [1],
2026-02-21T08:41:55.0864970Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:41:55.0866137Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:41:55.0866814Z               'pointer'],
2026-02-21T08:41:55.0867370Z  'load_eviction_policies': ['', 'last', '', '', 'first', 'first', 'last', ''],
2026-02-21T08:41:55.0868002Z  'num_stages': 5,
2026-02-21T08:41:55.0868311Z  'num_warps': 4,
2026-02-21T08:41:55.0868627Z  'pid_type': 'flat',
2026-02-21T08:41:55.0868964Z  'range_flattens': [None],
2026-02-21T08:41:55.0869340Z  'range_multi_buffers': [None],
2026-02-21T08:41:55.0869733Z  'range_num_stages': [0],
2026-02-21T08:41:55.0870107Z  'range_unroll_factors': [0],
2026-02-21T08:41:55.0870499Z  'range_warp_specializes': [],
2026-02-21T08:41:55.0870926Z  'reduction_loops': [None]}
2026-02-21T08:41:55.0896397Z [178s] Fitting surrogate: 550 points, 550 targets
2026-02-21T08:41:55.8471469Z [179s] Generation 8 starting: 42 neighbors, 4 active search path(s)
2026-02-21T08:41:59.5726801Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 7.6 configs/s
2026-02-21T08:42:02.0414620Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 42/42 17.3 configs/s
2026-02-21T08:42:08.3679135Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 159.9         
2026-02-21T08:42:08.3679687Z                                                                   configs/s     
2026-02-21T08:42:08.8067776Z [192s] Generation 8 complete: 
2026-02-21T08:42:08.8068095Z ok=46
2026-02-21T08:42:08.8068285Z min=0.0511
2026-02-21T08:42:08.8068461Z mid=0.0522
2026-02-21T08:42:08.8068678Z max=0.0757
2026-02-21T08:42:08.8068881Z best={'block_sizes': [1],
2026-02-21T08:42:08.8069344Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:42:08.8070766Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:42:08.8071188Z               'pointer'],
2026-02-21T08:42:08.8071526Z  'load_eviction_policies': ['', 'last', '', '', 'first', '', 'last', ''],
2026-02-21T08:42:08.8071899Z  'num_stages': 5,
2026-02-21T08:42:08.8072100Z  'num_warps': 4,
2026-02-21T08:42:08.8072293Z  'pid_type': 'flat',
2026-02-21T08:42:08.8072509Z  'range_flattens': [None],
2026-02-21T08:42:08.8072745Z  'range_multi_buffers': [None],
2026-02-21T08:42:08.8072987Z  'range_num_stages': [0],
2026-02-21T08:42:08.8073231Z  'range_unroll_factors': [0],
2026-02-21T08:42:08.8073480Z  'range_warp_specializes': [],
2026-02-21T08:42:08.8073730Z  'reduction_loops': [None]}
2026-02-21T08:42:08.8106922Z [192s] Fitting surrogate: 596 points, 596 targets
2026-02-21T08:42:09.5022537Z [192s] Generation 9 starting: 34 neighbors, 4 active search path(s)
2026-02-21T08:42:13.6986341Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 5.5 configs/s
2026-02-21T08:42:15.9427301Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.3 configs/s
2026-02-21T08:42:20.6596835Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 213.7         
2026-02-21T08:42:20.6597375Z                                                                   configs/s     
2026-02-21T08:42:20.9928723Z [204s] Generation 9 complete: 
2026-02-21T08:42:20.9929050Z ok=39
2026-02-21T08:42:20.9929241Z min=0.0480
2026-02-21T08:42:20.9929419Z mid=0.0500
2026-02-21T08:42:20.9929605Z max=0.2644
2026-02-21T08:42:20.9929893Z best={'block_sizes': [2],
2026-02-21T08:42:20.9930366Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:42:20.9931058Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:42:20.9931533Z               'tensor_descriptor'],
2026-02-21T08:42:20.9931913Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', '', 'first'],
2026-02-21T08:42:20.9932332Z  'num_stages': 1,
2026-02-21T08:42:20.9932537Z  'num_warps': 4,
2026-02-21T08:42:20.9932739Z  'pid_type': 'flat',
2026-02-21T08:42:20.9932968Z  'range_flattens': [None],
2026-02-21T08:42:20.9933163Z  'range_multi_buffers': [None],
2026-02-21T08:42:20.9933370Z  'range_num_stages': [0],
2026-02-21T08:42:20.9933559Z  'range_unroll_factors': [0],
2026-02-21T08:42:20.9933768Z  'range_warp_specializes': [],
2026-02-21T08:42:20.9934422Z  'reduction_loops': [None]}
2026-02-21T08:42:20.9968028Z [204s] Fitting surrogate: 635 points, 635 targets
2026-02-21T08:42:21.7565858Z [204s] Generation 10 starting: 43 neighbors, 4 active search path(s)
2026-02-21T08:42:26.0290006Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 23.1 configs/s
2026-02-21T08:42:28.5441367Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 43/43 17.4 configs/s
2026-02-21T08:42:33.9149161Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 188.0         
2026-02-21T08:42:33.9149676Z                                                                   configs/s     
2026-02-21T08:42:34.3086850Z [217s] Generation 10 complete: 
2026-02-21T08:42:34.3087154Z ok=47
2026-02-21T08:42:34.3087339Z min=0.0481
2026-02-21T08:42:34.3087512Z mid=0.0490
2026-02-21T08:42:34.3087681Z max=0.3842
2026-02-21T08:42:34.3087859Z best={'block_sizes': [2],
2026-02-21T08:42:34.3088324Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:42:34.3089004Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:42:34.3089467Z               'tensor_descriptor'],
2026-02-21T08:42:34.3089938Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', '', 'first'],
2026-02-21T08:42:34.3090355Z  'num_stages': 1,
2026-02-21T08:42:34.3090560Z  'num_warps': 4,
2026-02-21T08:42:34.3090757Z  'pid_type': 'flat',
2026-02-21T08:42:34.3091518Z  'range_flattens': [None],
2026-02-21T08:42:34.3091779Z  'range_multi_buffers': [None],
2026-02-21T08:42:34.3092037Z  'range_num_stages': [0],
2026-02-21T08:42:34.3092251Z  'range_unroll_factors': [0],
2026-02-21T08:42:34.3092470Z  'range_warp_specializes': [],
2026-02-21T08:42:34.3092695Z  'reduction_loops': [None]}
2026-02-21T08:42:34.3126871Z [217s] Fitting surrogate: 682 points, 682 targets
2026-02-21T08:42:34.8733456Z [218s] Generation 11 starting: 27 neighbors, 3 active search path(s)
2026-02-21T08:42:37.3240110Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 10.5 configs/s
2026-02-21T08:42:38.9049334Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 27/27 17.6 configs/s
2026-02-21T08:42:42.8254880Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 256.7         
2026-02-21T08:42:42.8256088Z                                                                   configs/s     
2026-02-21T08:42:43.0965513Z [226s] Generation 11 complete: 
2026-02-21T08:42:43.0966087Z ok=30
2026-02-21T08:42:43.0966387Z min=0.0511
2026-02-21T08:42:43.0966660Z mid=0.0521
2026-02-21T08:42:43.0966921Z max=0.3471
2026-02-21T08:42:43.0967238Z best={'block_sizes': [2],
2026-02-21T08:42:43.0967973Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:42:43.0968775Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:42:43.0969234Z               'pointer'],
2026-02-21T08:42:43.0969561Z  'load_eviction_policies': ['', '', '', '', '', 'first', 'first', ''],
2026-02-21T08:42:43.0969996Z  'num_stages': 1,
2026-02-21T08:42:43.0970195Z  'num_warps': 4,
2026-02-21T08:42:43.0970396Z  'pid_type': 'flat',
2026-02-21T08:42:43.0970613Z  'range_flattens': [None],
2026-02-21T08:42:43.0970856Z  'range_multi_buffers': [None],
2026-02-21T08:42:43.0971100Z  'range_num_stages': [0],
2026-02-21T08:42:43.0971332Z  'range_unroll_factors': [0],
2026-02-21T08:42:43.0971574Z  'range_warp_specializes': [],
2026-02-21T08:42:43.0971828Z  'reduction_loops': [None]}
2026-02-21T08:42:43.1006728Z [226s] Fitting surrogate: 712 points, 712 targets
2026-02-21T08:42:43.6909263Z [226s] Generation 12 starting: 31 neighbors, 3 active search path(s)
2026-02-21T08:42:46.6819910Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 76.5 configs/s
2026-02-21T08:42:48.6906813Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 17.3 configs/s
2026-02-21T08:42:52.7407124Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 248.8         
2026-02-21T08:42:52.7407635Z                                                                   configs/s     
2026-02-21T08:42:53.0288315Z [236s] Generation 12 complete: 
2026-02-21T08:42:53.0288760Z ok=35
2026-02-21T08:42:53.0289038Z min=0.0479
2026-02-21T08:42:53.0289361Z mid=0.0505
2026-02-21T08:42:53.0289645Z max=0.3296
2026-02-21T08:42:53.0290056Z best={'block_sizes': [1],
2026-02-21T08:42:53.0290708Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:42:53.0291651Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:42:53.0292457Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:42:53.0293247Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', '', 'first'],
2026-02-21T08:42:53.0293865Z  'num_stages': 2,
2026-02-21T08:42:53.0294734Z  'num_warps': 4,
2026-02-21T08:42:53.0295107Z  'pid_type': 'flat',
2026-02-21T08:42:53.0295509Z  'range_flattens': [None],
2026-02-21T08:42:53.0295786Z  'range_multi_buffers': [None],
2026-02-21T08:42:53.0296016Z  'range_num_stages': [0],
2026-02-21T08:42:53.0296253Z  'range_unroll_factors': [0],
2026-02-21T08:42:53.0296497Z  'range_warp_specializes': [],
2026-02-21T08:42:53.0296734Z  'reduction_loops': [None]}
2026-02-21T08:42:53.0336015Z [236s] Fitting surrogate: 747 points, 747 targets
2026-02-21T08:42:53.6233939Z [236s] Generation 13 starting: 31 neighbors, 3 active search path(s)
2026-02-21T08:42:56.4780183Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 11.0 configs/s
2026-02-21T08:42:58.2902976Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 17.5 configs/s
2026-02-21T08:43:03.3397930Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 224.8         
2026-02-21T08:43:03.3398683Z                                                                   configs/s     
2026-02-21T08:43:03.6550473Z [246s] Generation 13 complete: 
2026-02-21T08:43:03.6550732Z ok=34
2026-02-21T08:43:03.6550897Z min=0.0514
2026-02-21T08:43:03.6551069Z mid=0.0518
2026-02-21T08:43:03.6551236Z max=0.1210
2026-02-21T08:43:03.6551421Z best={'block_sizes': [1],
2026-02-21T08:43:03.6552418Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:43:03.6553605Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:43:03.6554637Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:43:03.6555292Z  'load_eviction_policies': ['', '', '', '', '', 'first', 'first', ''],
2026-02-21T08:43:03.6555867Z  'num_stages': 2,
2026-02-21T08:43:03.6556196Z  'num_warps': 4,
2026-02-21T08:43:03.6556515Z  'pid_type': 'flat',
2026-02-21T08:43:03.6556851Z  'range_flattens': [None],
2026-02-21T08:43:03.6557231Z  'range_multi_buffers': [None],
2026-02-21T08:43:03.6557621Z  'range_num_stages': [0],
2026-02-21T08:43:03.6557981Z  'range_unroll_factors': [0],
2026-02-21T08:43:03.6558372Z  'range_warp_specializes': [],
2026-02-21T08:43:03.6558753Z  'reduction_loops': [None]}
2026-02-21T08:43:03.6590589Z [246s] Fitting surrogate: 781 points, 781 targets
2026-02-21T08:43:03.9242486Z [247s] Generation 14 starting: 7 neighbors, 1 active search path(s)
2026-02-21T08:43:05.0983860Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 6.6 configs/s
2026-02-21T08:43:05.5725484Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 18.8 configs/s
2026-02-21T08:43:06.6778096Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 891.6         
2026-02-21T08:43:06.6778651Z                                                                   configs/s     
2026-02-21T08:43:06.7818444Z [249s] Generation 14 complete: 
2026-02-21T08:43:06.7818706Z ok=9
2026-02-21T08:43:06.7818883Z min=0.0516
2026-02-21T08:43:06.7819061Z mid=0.0547
2026-02-21T08:43:06.7819228Z max=0.0808
2026-02-21T08:43:06.7819406Z best={'block_sizes': [2],
2026-02-21T08:43:06.7819840Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:43:06.7820484Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:43:06.7820941Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:43:06.7821337Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'first', ''],
2026-02-21T08:43:06.7821706Z  'num_stages': 2,
2026-02-21T08:43:06.7821898Z  'num_warps': 4,
2026-02-21T08:43:06.7822491Z  'pid_type': 'flat',
2026-02-21T08:43:06.7822700Z  'range_flattens': [None],
2026-02-21T08:43:06.7822923Z  'range_multi_buffers': [None],
2026-02-21T08:43:06.7823165Z  'range_num_stages': [0],
2026-02-21T08:43:06.7823384Z  'range_unroll_factors': [0],
2026-02-21T08:43:06.7823623Z  'range_warp_specializes': [],
2026-02-21T08:43:06.7823854Z  'reduction_loops': [None]}
2026-02-21T08:43:06.7858863Z [250s] Fitting surrogate: 790 points, 790 targets
2026-02-21T08:43:07.0926643Z [250s] Generation 15 starting: 11 neighbors, 1 active search path(s)
2026-02-21T08:43:08.4498464Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 14.0 configs/s
2026-02-21T08:43:09.1589667Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 18.1 configs/s
2026-02-21T08:43:10.5393886Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 719.6         
2026-02-21T08:43:10.5394771Z                                                                   configs/s     
2026-02-21T08:43:10.6596091Z [253s] Generation 15 complete: 
2026-02-21T08:43:10.6596554Z ok=13
2026-02-21T08:43:10.6596896Z min=0.0487
2026-02-21T08:43:10.6597181Z mid=0.0496
2026-02-21T08:43:10.6597454Z max=0.1569
2026-02-21T08:43:10.6597744Z best={'block_sizes': [1],
2026-02-21T08:43:10.6598537Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:43:10.6599551Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T08:43:10.6600261Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:43:10.6600935Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'first', ''],
2026-02-21T08:43:10.6601545Z  'num_stages': 2,
2026-02-21T08:43:10.6601884Z  'num_warps': 4,
2026-02-21T08:43:10.6602195Z  'pid_type': 'flat',
2026-02-21T08:43:10.6602590Z  'range_flattens': [None],
2026-02-21T08:43:10.6602973Z  'range_multi_buffers': [None],
2026-02-21T08:43:10.6603392Z  'range_num_stages': [0],
2026-02-21T08:43:10.6603779Z  'range_unroll_factors': [0],
2026-02-21T08:43:10.6604424Z  'range_warp_specializes': [],
2026-02-21T08:43:10.6604847Z  'reduction_loops': [None]}
2026-02-21T08:43:10.6638342Z [253s] Fitting surrogate: 803 points, 803 targets
2026-02-21T08:43:10.8252581Z [254s] Autotuning complete in 254.0s after searching 762 configs.
2026-02-21T08:43:10.8253090Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:43:10.8255535Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', '', '', '', 'last', 'first', 'first', ''], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:43:10.8257840Z 
2026-02-21T08:43:10.8258344Z [254s] Code of selected kernel: /tmp/torchinductor_root/l4/cl4k33ypby6nudgyssa5dxoejju2ujxd7v6qaiiox76dn4veu736.py
2026-02-21T08:43:11.9486897Z WARNING:tritonbench.utils.triton_op:Completed input ID 6:
2026-02-21T08:43:11.9487552Z (M, N)
2026-02-21T08:43:11.9487851Z ------------
2026-02-21T08:43:11.9505787Z (4096, 4096)
2026-02-21T08:43:11.9505991Z 
2026-02-21T08:43:11.9507111Z  25%|██▌       | 5/20 [24:44<1:11:06, 284.43s/it]WARNING:tritonbench.utils.triton_op:Running input ID 8:
2026-02-21T08:43:11.9507816Z (M, N)
2026-02-21T08:43:11.9508083Z ------------
2026-02-21T08:43:11.9508362Z (4096, 5120)
2026-02-21T08:43:11.9510048Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:43:13.4418679Z INFO:tritonbench.utils.triton_op:Took 3.21ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:43:16.9119825Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:43:18.4327098Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:43:18.4327465Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:43:18.4327749Z               'dtype': 'torch.float32',
2026-02-21T08:43:18.4328030Z               'shape': (4096, 5120),
2026-02-21T08:43:18.4328296Z               'stride': (5120, 1)},
2026-02-21T08:43:18.4328555Z             (5120,),
2026-02-21T08:43:18.4328776Z             { 'device': 'cuda:0',
2026-02-21T08:43:18.4329046Z               'dtype': 'torch.float32',
2026-02-21T08:43:18.4329340Z               'shape': (5120,),
2026-02-21T08:43:18.4329601Z               'stride': (1,)},
2026-02-21T08:43:18.4329938Z             { 'device': 'cuda:0',
2026-02-21T08:43:18.4330207Z               'dtype': 'torch.float32',
2026-02-21T08:43:18.4330487Z               'shape': (5120,),
2026-02-21T08:43:18.4331172Z               'stride': (1,)},
2026-02-21T08:43:18.4331439Z             1e-05),
2026-02-21T08:43:18.4331633Z   'kwargs': {}}
2026-02-21T08:43:18.4365364Z INFO:tritonbench.utils.triton_op:Took 4.20ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:43:18.4443419Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:43:18.4444677Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:43:18.4445328Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:43:18.4445709Z While processing:
2026-02-21T08:43:18.4448508Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:43:18.4448977Z     if bias is not None:
2026-02-21T08:43:18.4449208Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:43:18.4449352Z 
2026-02-21T08:43:18.6083635Z [0s] Autotune random seed: 2135381352
2026-02-21T08:43:18.8988788Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:43:53.7756362Z [34s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:43:54.7965274Z [35s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:43:54.7983773Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T08:44:00.4505696Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.8 configs/s
2026-02-21T08:44:00.4518405Z [41s] Adaptive compile timeout: 30s (90% percentile=6.5s, bounds=[30.0s, 30s])
2026-02-21T08:44:01.9103619Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 676.4 configs/s
2026-02-21T08:44:02.0294755Z [43s] Initial random population of 100, 5 starting points: 
2026-02-21T08:44:02.0295101Z error=12
2026-02-21T08:44:02.0295275Z timeout=2
2026-02-21T08:44:02.0295433Z ok=86
2026-02-21T08:44:02.0295585Z min=0.0644
2026-02-21T08:44:02.0295778Z mid=0.2493
2026-02-21T08:44:02.0295939Z max=21.5631
2026-02-21T08:44:02.0296114Z best={'block_sizes': [2],
2026-02-21T08:44:02.0296473Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:44:02.0297482Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:44:02.0297897Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:44:02.0298298Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:44:02.0298683Z  'maxnreg': 256,
2026-02-21T08:44:02.0298869Z  'num_sm_multiplier': 8,
2026-02-21T08:44:02.0299083Z  'num_stages': 8,
2026-02-21T08:44:02.0299272Z  'num_warps': 4,
2026-02-21T08:44:02.0299476Z  'pid_type': 'persistent_blocked',
2026-02-21T08:44:02.0299716Z  'range_flattens': [False],
2026-02-21T08:44:02.0299937Z  'range_multi_buffers': [None],
2026-02-21T08:44:02.0300160Z  'range_num_stages': [4],
2026-02-21T08:44:02.0300688Z  'range_unroll_factors': [2],
2026-02-21T08:44:02.0300926Z  'range_warp_specializes': [],
2026-02-21T08:44:02.0301160Z  'reduction_loops': [None]}
2026-02-21T08:44:02.0315893Z [43s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:44:03.4112180Z [44s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T08:44:21.6045210Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 0.4 configs/s
2026-02-21T08:44:26.6952308Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 16.6 configs/s
2026-02-21T08:44:38.7356311Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.2 configs/s
2026-02-21T08:44:39.4177780Z [80s] Generation 1 complete: 
2026-02-21T08:44:39.4181013Z error=2
2026-02-21T08:44:39.4181267Z ok=86
2026-02-21T08:44:39.4181471Z min=0.0606
2026-02-21T08:44:39.4181661Z mid=0.0740
2026-02-21T08:44:39.4181837Z max=0.8494
2026-02-21T08:44:39.4182024Z best={'block_sizes': [1],
2026-02-21T08:44:39.4182514Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:44:39.4183103Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:44:39.4183524Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:44:39.4183864Z  'num_stages': 1,
2026-02-21T08:44:39.4184421Z  'num_warps': 8,
2026-02-21T08:44:39.4184614Z  'pid_type': 'flat',
2026-02-21T08:44:39.4184834Z  'range_flattens': [None],
2026-02-21T08:44:39.4185087Z  'range_multi_buffers': [None],
2026-02-21T08:44:39.4185334Z  'range_num_stages': [0],
2026-02-21T08:44:39.4185572Z  'range_unroll_factors': [0],
2026-02-21T08:44:39.4185825Z  'range_warp_specializes': [],
2026-02-21T08:44:39.4186082Z  'reduction_loops': [None]}
2026-02-21T08:44:39.4203569Z [80s] Fitting surrogate: 188 points, 188 targets
2026-02-21T08:44:40.7316700Z [81s] Generation 2 starting: 75 neighbors, 5 active search path(s)
2026-02-21T08:44:49.3427905Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 8.9 configs/s
2026-02-21T08:44:53.6423742Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 18.3 configs/s
2026-02-21T08:45:02.8129616Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 117.2         
2026-02-21T08:45:02.8130280Z                                                                   configs/s     
2026-02-21T08:45:03.3501982Z [104s] Generation 2 complete: 
2026-02-21T08:45:03.3502268Z error=8
2026-02-21T08:45:03.3502436Z ok=73
2026-02-21T08:45:03.3502605Z min=0.0603
2026-02-21T08:45:03.3502770Z mid=0.0689
2026-02-21T08:45:03.3502952Z max=0.6304
2026-02-21T08:45:03.3503131Z best={'block_sizes': [1],
2026-02-21T08:45:03.3503574Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:45:03.3504431Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:45:03.3504836Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'last'],
2026-02-21T08:45:03.3505168Z  'num_stages': 2,
2026-02-21T08:45:03.3505376Z  'num_warps': 8,
2026-02-21T08:45:03.3505587Z  'pid_type': 'flat',
2026-02-21T08:45:03.3505793Z  'range_flattens': [None],
2026-02-21T08:45:03.3506024Z  'range_multi_buffers': [None],
2026-02-21T08:45:03.3506728Z  'range_num_stages': [0],
2026-02-21T08:45:03.3506940Z  'range_unroll_factors': [0],
2026-02-21T08:45:03.3507165Z  'range_warp_specializes': [],
2026-02-21T08:45:03.3507381Z  'reduction_loops': [None]}
2026-02-21T08:45:03.3528494Z [104s] Fitting surrogate: 269 points, 269 targets
2026-02-21T08:45:04.2505049Z [105s] Generation 3 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:45:09.6939849Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 24.0 configs/s
2026-02-21T08:45:12.8627194Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 17.0 configs/s
2026-02-21T08:45:20.7567819Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 127.8         
2026-02-21T08:45:20.7568996Z                                                                   configs/s     
2026-02-21T08:45:21.2528810Z [122s] Generation 3 complete: 
2026-02-21T08:45:21.2529095Z error=1
2026-02-21T08:45:21.2529267Z ok=56
2026-02-21T08:45:21.2529445Z min=0.0604
2026-02-21T08:45:21.2529637Z mid=0.0651
2026-02-21T08:45:21.2529888Z max=0.1176
2026-02-21T08:45:21.2530075Z best={'block_sizes': [1],
2026-02-21T08:45:21.2530535Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:45:21.2531094Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:45:21.2531517Z  'load_eviction_policies': ['', '', '', '', '', '', 'first', 'last'],
2026-02-21T08:45:21.2531858Z  'num_stages': 2,
2026-02-21T08:45:21.2532061Z  'num_warps': 8,
2026-02-21T08:45:21.2532264Z  'pid_type': 'flat',
2026-02-21T08:45:21.2532475Z  'range_flattens': [None],
2026-02-21T08:45:21.2532712Z  'range_multi_buffers': [None],
2026-02-21T08:45:21.2532953Z  'range_num_stages': [0],
2026-02-21T08:45:21.2533196Z  'range_unroll_factors': [0],
2026-02-21T08:45:21.2533460Z  'range_warp_specializes': [],
2026-02-21T08:45:21.2533708Z  'reduction_loops': [None]}
2026-02-21T08:45:21.2561736Z [122s] Fitting surrogate: 326 points, 326 targets
2026-02-21T08:45:22.1014394Z [123s] Generation 4 starting: 50 neighbors, 5 active search path(s)
2026-02-21T08:45:27.3033570Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 14.0 configs/s
2026-02-21T08:45:30.2502777Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 17.2 configs/s
2026-02-21T08:45:37.9068355Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 143.1         
2026-02-21T08:45:37.9069756Z                                                                   configs/s     
2026-02-21T08:45:38.3557597Z [139s] Generation 4 complete: 
2026-02-21T08:45:38.3558050Z error=2
2026-02-21T08:45:38.3558318Z ok=53
2026-02-21T08:45:38.3558608Z min=0.0603
2026-02-21T08:45:38.3558879Z mid=0.0658
2026-02-21T08:45:38.3559155Z max=0.9272
2026-02-21T08:45:38.3559494Z best={'block_sizes': [1],
2026-02-21T08:45:38.3560217Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:45:38.3561124Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:45:38.3561830Z  'load_eviction_policies': ['', '', '', '', '', '', 'first', 'last'],
2026-02-21T08:45:38.3562381Z  'num_stages': 2,
2026-02-21T08:45:38.3562680Z  'num_warps': 8,
2026-02-21T08:45:38.3562999Z  'pid_type': 'flat',
2026-02-21T08:45:38.3563380Z  'range_flattens': [None],
2026-02-21T08:45:38.3563754Z  'range_multi_buffers': [None],
2026-02-21T08:45:38.3564412Z  'range_num_stages': [0],
2026-02-21T08:45:38.3564781Z  'range_unroll_factors': [0],
2026-02-21T08:45:38.3565172Z  'range_warp_specializes': [],
2026-02-21T08:45:38.3565552Z  'reduction_loops': [None]}
2026-02-21T08:45:38.3584723Z [139s] Fitting surrogate: 381 points, 381 targets
2026-02-21T08:45:39.0382700Z [140s] Generation 5 starting: 33 neighbors, 4 active search path(s)
2026-02-21T08:45:42.6980890Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 11.1 configs/s
2026-02-21T08:45:44.6795669Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 33/33 17.0 configs/s
2026-02-21T08:45:50.3842492Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 176.5         
2026-02-21T08:45:50.3843014Z                                                                   configs/s     
2026-02-21T08:45:50.7512971Z [151s] Generation 5 complete: 
2026-02-21T08:45:50.7513431Z ok=37
2026-02-21T08:45:50.7513745Z min=0.0604
2026-02-21T08:45:50.7514304Z mid=0.0641
2026-02-21T08:45:50.7514607Z max=0.0896
2026-02-21T08:45:50.7514927Z best={'block_sizes': [1],
2026-02-21T08:45:50.7515665Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:45:50.7516580Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:45:50.7517924Z  'load_eviction_policies': ['', '', '', '', '', '', 'first', 'last'],
2026-02-21T08:45:50.7518619Z  'num_stages': 2,
2026-02-21T08:45:50.7518959Z  'num_warps': 8,
2026-02-21T08:45:50.7519157Z  'pid_type': 'flat',
2026-02-21T08:45:50.7519347Z  'range_flattens': [None],
2026-02-21T08:45:50.7519576Z  'range_multi_buffers': [None],
2026-02-21T08:45:50.7519794Z  'range_num_stages': [0],
2026-02-21T08:45:50.7520017Z  'range_unroll_factors': [0],
2026-02-21T08:45:50.7520242Z  'range_warp_specializes': [],
2026-02-21T08:45:50.7520474Z  'reduction_loops': [None]}
2026-02-21T08:45:50.7542252Z [151s] Fitting surrogate: 418 points, 418 targets
2026-02-21T08:45:51.2732755Z [152s] Generation 6 starting: 27 neighbors, 3 active search path(s)
2026-02-21T08:45:54.3332386Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 11.9 configs/s
2026-02-21T08:45:56.0218386Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 28/28 17.0 configs/s
2026-02-21T08:46:00.6510487Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 217.4         
2026-02-21T08:46:00.6511110Z                                                                   configs/s     
2026-02-21T08:46:00.9567568Z [162s] Generation 6 complete: 
2026-02-21T08:46:00.9567888Z ok=31
2026-02-21T08:46:00.9568121Z min=0.0599
2026-02-21T08:46:00.9568307Z mid=0.0667
2026-02-21T08:46:00.9568478Z max=0.0961
2026-02-21T08:46:00.9568660Z best={'block_sizes': [1],
2026-02-21T08:46:00.9569135Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:46:00.9569720Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:46:00.9570265Z  'load_eviction_policies': ['', '', '', '', '', '', 'first', 'last'],
2026-02-21T08:46:00.9570618Z  'num_stages': 2,
2026-02-21T08:46:00.9570833Z  'num_warps': 8,
2026-02-21T08:46:00.9571032Z  'pid_type': 'flat',
2026-02-21T08:46:00.9571274Z  'range_flattens': [None],
2026-02-21T08:46:00.9571536Z  'range_multi_buffers': [None],
2026-02-21T08:46:00.9571806Z  'range_num_stages': [0],
2026-02-21T08:46:00.9572086Z  'range_unroll_factors': [0],
2026-02-21T08:46:00.9572353Z  'range_warp_specializes': [],
2026-02-21T08:46:00.9572620Z  'reduction_loops': [None]}
2026-02-21T08:46:00.9596381Z [162s] Fitting surrogate: 449 points, 449 targets
2026-02-21T08:46:01.5153877Z [162s] Generation 7 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:46:04.7652383Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 7.4 configs/s
2026-02-21T08:46:06.5151194Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 29/29 17.0 configs/s
2026-02-21T08:46:11.7628516Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 214.1         
2026-02-21T08:46:11.7629046Z                                                                   configs/s     
2026-02-21T08:46:12.0770461Z [173s] Generation 7 complete: 
2026-02-21T08:46:12.0770928Z ok=33
2026-02-21T08:46:12.0771221Z min=0.0603
2026-02-21T08:46:12.0771511Z mid=0.0625
2026-02-21T08:46:12.0771774Z max=0.1180
2026-02-21T08:46:12.0772723Z best={'block_sizes': [1],
2026-02-21T08:46:12.0773478Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:46:12.0774427Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:46:12.0774888Z  'load_eviction_policies': ['', '', '', '', '', '', 'first', 'last'],
2026-02-21T08:46:12.0775251Z  'num_stages': 2,
2026-02-21T08:46:12.0775452Z  'num_warps': 8,
2026-02-21T08:46:12.0775677Z  'pid_type': 'flat',
2026-02-21T08:46:12.0775895Z  'range_flattens': [None],
2026-02-21T08:46:12.0776139Z  'range_multi_buffers': [None],
2026-02-21T08:46:12.0776392Z  'range_num_stages': [0],
2026-02-21T08:46:12.0776624Z  'range_unroll_factors': [0],
2026-02-21T08:46:12.0776873Z  'range_warp_specializes': [],
2026-02-21T08:46:12.0777114Z  'reduction_loops': [None]}
2026-02-21T08:46:12.0797187Z [173s] Fitting surrogate: 482 points, 482 targets
2026-02-21T08:46:12.6362275Z [173s] Generation 8 starting: 26 neighbors, 3 active search path(s)
2026-02-21T08:46:15.6781395Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 13.9 configs/s
2026-02-21T08:46:17.3657606Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 28/28 17.0 configs/s
2026-02-21T08:46:21.6349904Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 235.4         
2026-02-21T08:46:21.6350397Z                                                                   configs/s     
2026-02-21T08:46:21.9210290Z [183s] Generation 8 complete: 
2026-02-21T08:46:21.9210750Z ok=30
2026-02-21T08:46:21.9211035Z min=0.0606
2026-02-21T08:46:21.9211318Z mid=0.0652
2026-02-21T08:46:21.9211576Z max=0.0919
2026-02-21T08:46:21.9211898Z best={'block_sizes': [1],
2026-02-21T08:46:21.9212612Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:46:21.9213598Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:46:21.9214698Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', '', 'first'],
2026-02-21T08:46:21.9215314Z  'num_stages': 3,
2026-02-21T08:46:21.9215619Z  'num_warps': 16,
2026-02-21T08:46:21.9215938Z  'pid_type': 'flat',
2026-02-21T08:46:21.9216304Z  'range_flattens': [None],
2026-02-21T08:46:21.9216673Z  'range_multi_buffers': [None],
2026-02-21T08:46:21.9217064Z  'range_num_stages': [0],
2026-02-21T08:46:21.9217423Z  'range_unroll_factors': [0],
2026-02-21T08:46:21.9217816Z  'range_warp_specializes': [],
2026-02-21T08:46:21.9218189Z  'reduction_loops': [4096]}
2026-02-21T08:46:21.9241816Z [183s] Fitting surrogate: 512 points, 512 targets
2026-02-21T08:46:22.4841659Z [183s] Generation 9 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:46:25.8351703Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 20.1 configs/s
2026-02-21T08:46:27.6552379Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 30/30 16.9 configs/s
2026-02-21T08:46:32.0538248Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 228.6         
2026-02-21T08:46:32.0538914Z                                                                   configs/s     
2026-02-21T08:46:32.3513770Z [193s] Generation 9 complete: 
2026-02-21T08:46:32.3514722Z ok=32
2026-02-21T08:46:32.3514888Z min=0.0603
2026-02-21T08:46:32.3515063Z mid=0.0645
2026-02-21T08:46:32.3515225Z max=0.1324
2026-02-21T08:46:32.3515407Z best={'block_sizes': [1],
2026-02-21T08:46:32.3515843Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:46:32.3516471Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:46:32.3517008Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', '', 'first'],
2026-02-21T08:46:32.3517399Z  'num_stages': 3,
2026-02-21T08:46:32.3517592Z  'num_warps': 16,
2026-02-21T08:46:32.3517777Z  'pid_type': 'flat',
2026-02-21T08:46:32.3517988Z  'range_flattens': [None],
2026-02-21T08:46:32.3518221Z  'range_multi_buffers': [None],
2026-02-21T08:46:32.3518741Z  'range_num_stages': [0],
2026-02-21T08:46:32.3518980Z  'range_unroll_factors': [0],
2026-02-21T08:46:32.3519217Z  'range_warp_specializes': [],
2026-02-21T08:46:32.3519456Z  'reduction_loops': [4096]}
2026-02-21T08:46:32.3549079Z [193s] Fitting surrogate: 544 points, 544 targets
2026-02-21T08:46:32.7946293Z [193s] Generation 10 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:46:35.2868744Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 8.6 configs/s
2026-02-21T08:46:36.5580606Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 17.1 configs/s
2026-02-21T08:46:39.7642361Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 312.4         
2026-02-21T08:46:39.7642884Z                                                                   configs/s     
2026-02-21T08:46:39.9886373Z [201s] Generation 10 complete: 
2026-02-21T08:46:39.9886680Z ok=23
2026-02-21T08:46:39.9886859Z min=0.0607
2026-02-21T08:46:39.9887042Z mid=0.0669
2026-02-21T08:46:39.9887233Z max=0.6631
2026-02-21T08:46:39.9887440Z best={'block_sizes': [1],
2026-02-21T08:46:39.9887894Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:46:39.9888551Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:46:39.9889090Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', '', 'first'],
2026-02-21T08:46:39.9889465Z  'num_stages': 3,
2026-02-21T08:46:39.9889666Z  'num_warps': 16,
2026-02-21T08:46:39.9889960Z  'pid_type': 'flat',
2026-02-21T08:46:39.9890186Z  'range_flattens': [None],
2026-02-21T08:46:39.9890421Z  'range_multi_buffers': [None],
2026-02-21T08:46:39.9890669Z  'range_num_stages': [0],
2026-02-21T08:46:39.9890894Z  'range_unroll_factors': [0],
2026-02-21T08:46:39.9891152Z  'range_warp_specializes': [],
2026-02-21T08:46:39.9891400Z  'reduction_loops': [4096]}
2026-02-21T08:46:39.9920217Z [201s] Fitting surrogate: 567 points, 567 targets
2026-02-21T08:46:40.4160137Z [201s] Generation 11 starting: 19 neighbors, 2 active search path(s)
2026-02-21T08:46:42.6895934Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 18.5 configs/s
2026-02-21T08:46:43.8426767Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 18.1 configs/s
2026-02-21T08:46:47.0435813Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 313.0         
2026-02-21T08:46:47.0436376Z                                                                   configs/s     
2026-02-21T08:46:47.2575598Z [208s] Generation 11 complete: 
2026-02-21T08:46:47.2575884Z error=1
2026-02-21T08:46:47.2576064Z ok=21
2026-02-21T08:46:47.2576271Z min=0.0607
2026-02-21T08:46:47.2576453Z mid=0.0644
2026-02-21T08:46:47.2576620Z max=0.0900
2026-02-21T08:46:47.2576825Z best={'block_sizes': [1],
2026-02-21T08:46:47.2577304Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:46:47.2578141Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:46:47.2578714Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', '', 'first'],
2026-02-21T08:46:47.2579117Z  'num_stages': 3,
2026-02-21T08:46:47.2580009Z  'num_warps': 16,
2026-02-21T08:46:47.2580209Z  'pid_type': 'flat',
2026-02-21T08:46:47.2580431Z  'range_flattens': [None],
2026-02-21T08:46:47.2580683Z  'range_multi_buffers': [None],
2026-02-21T08:46:47.2580942Z  'range_num_stages': [0],
2026-02-21T08:46:47.2581180Z  'range_unroll_factors': [0],
2026-02-21T08:46:47.2581442Z  'range_warp_specializes': [],
2026-02-21T08:46:47.2581703Z  'reduction_loops': [4096]}
2026-02-21T08:46:47.2610501Z [208s] Fitting surrogate: 589 points, 589 targets
2026-02-21T08:46:47.7114317Z [208s] Generation 12 starting: 21 neighbors, 2 active search path(s)
2026-02-21T08:46:50.7841602Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 13.4 configs/s
2026-02-21T08:46:52.1181406Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.1 configs/s
2026-02-21T08:46:55.1643742Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 328.8         
2026-02-21T08:46:55.1645597Z                                                                   configs/s     
2026-02-21T08:46:55.3779670Z [216s] Generation 12 complete: 
2026-02-21T08:46:55.3779953Z ok=24
2026-02-21T08:46:55.3780140Z min=0.0605
2026-02-21T08:46:55.3780323Z mid=0.0675
2026-02-21T08:46:55.3780490Z max=0.1121
2026-02-21T08:46:55.3780676Z best={'block_sizes': [1],
2026-02-21T08:46:55.3781080Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:46:55.3781704Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T08:46:55.3782155Z               'pointer'],
2026-02-21T08:46:55.3782519Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', '', 'first'],
2026-02-21T08:46:55.3782933Z  'num_stages': 7,
2026-02-21T08:46:55.3783180Z  'num_warps': 4,
2026-02-21T08:46:55.3783414Z  'pid_type': 'flat',
2026-02-21T08:46:55.3783615Z  'range_flattens': [None],
2026-02-21T08:46:55.3783845Z  'range_multi_buffers': [None],
2026-02-21T08:46:55.3784393Z  'range_num_stages': [0],
2026-02-21T08:46:55.3784627Z  'range_unroll_factors': [0],
2026-02-21T08:46:55.3784864Z  'range_warp_specializes': [],
2026-02-21T08:46:55.3785121Z  'reduction_loops': [None]}
2026-02-21T08:46:55.3816384Z [216s] Fitting surrogate: 613 points, 613 targets
2026-02-21T08:46:55.8211983Z [216s] Generation 13 starting: 21 neighbors, 2 active search path(s)
2026-02-21T08:46:58.0915493Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 15.5 configs/s
2026-02-21T08:46:59.3423064Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 17.4 configs/s
2026-02-21T08:47:02.7543926Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 294.1         
2026-02-21T08:47:02.7544594Z                                                                   configs/s     
2026-02-21T08:47:02.9945756Z [224s] Generation 13 complete: 
2026-02-21T08:47:02.9946022Z ok=23
2026-02-21T08:47:02.9946190Z min=0.0597
2026-02-21T08:47:02.9946366Z mid=0.0606
2026-02-21T08:47:02.9946530Z max=0.0683
2026-02-21T08:47:02.9946735Z best={'block_sizes': [1],
2026-02-21T08:47:02.9947122Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:02.9947730Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:02.9948180Z               'pointer', 'pointer'],
2026-02-21T08:47:02.9948688Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', 'last', 'first'],
2026-02-21T08:47:02.9949499Z  'num_stages': 7,
2026-02-21T08:47:02.9949822Z  'num_warps': 16,
2026-02-21T08:47:02.9950144Z  'pid_type': 'flat',
2026-02-21T08:47:02.9950489Z  'range_flattens': [None],
2026-02-21T08:47:02.9950856Z  'range_multi_buffers': [None],
2026-02-21T08:47:02.9951251Z  'range_num_stages': [0],
2026-02-21T08:47:02.9951624Z  'range_unroll_factors': [0],
2026-02-21T08:47:02.9952023Z  'range_warp_specializes': [],
2026-02-21T08:47:02.9952403Z  'reduction_loops': [None]}
2026-02-21T08:47:02.9984638Z [224s] Fitting surrogate: 636 points, 636 targets
2026-02-21T08:47:03.4405859Z [224s] Generation 14 starting: 22 neighbors, 2 active search path(s)
2026-02-21T08:47:06.0375154Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 8.1 configs/s
2026-02-21T08:47:07.4050062Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 17.4 configs/s
2026-02-21T08:47:11.0355311Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 276.3         
2026-02-21T08:47:11.0356230Z                                                                   configs/s     
2026-02-21T08:47:11.2838389Z [232s] Generation 14 complete: 
2026-02-21T08:47:11.2838836Z ok=25
2026-02-21T08:47:11.2839115Z min=0.0629
2026-02-21T08:47:11.2839386Z mid=0.0634
2026-02-21T08:47:11.2839650Z max=0.0919
2026-02-21T08:47:11.2840717Z best={'block_sizes': [1],
2026-02-21T08:47:11.2841397Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:11.2842383Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:11.2843161Z               'pointer', 'pointer'],
2026-02-21T08:47:11.2843799Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', 'last', 'first'],
2026-02-21T08:47:11.2844770Z  'num_stages': 7,
2026-02-21T08:47:11.2844954Z  'num_warps': 4,
2026-02-21T08:47:11.2845127Z  'pid_type': 'flat',
2026-02-21T08:47:11.2845332Z  'range_flattens': [None],
2026-02-21T08:47:11.2845540Z  'range_multi_buffers': [None],
2026-02-21T08:47:11.2845761Z  'range_num_stages': [0],
2026-02-21T08:47:11.2845976Z  'range_unroll_factors': [0],
2026-02-21T08:47:11.2846202Z  'range_warp_specializes': [],
2026-02-21T08:47:11.2846424Z  'reduction_loops': [None]}
2026-02-21T08:47:11.2881197Z [232s] Fitting surrogate: 661 points, 661 targets
2026-02-21T08:47:11.7165967Z [232s] Generation 15 starting: 19 neighbors, 2 active search path(s)
2026-02-21T08:47:14.0965972Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 8.3 configs/s
2026-02-21T08:47:15.3371165Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 17.6 configs/s
2026-02-21T08:47:18.5035247Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 316.6         
2026-02-21T08:47:18.5035780Z                                                                   configs/s     
2026-02-21T08:47:18.7272342Z [239s] Generation 15 complete: 
2026-02-21T08:47:18.7272647Z ok=22
2026-02-21T08:47:18.7272841Z min=0.0595
2026-02-21T08:47:18.7273039Z mid=0.0606
2026-02-21T08:47:18.7273229Z max=0.1285
2026-02-21T08:47:18.7273435Z best={'block_sizes': [1],
2026-02-21T08:47:18.7273942Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:18.7275094Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:18.7275619Z               'pointer', 'pointer'],
2026-02-21T08:47:18.7276058Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', 'last', 'first'],
2026-02-21T08:47:18.7277167Z  'num_stages': 7,
2026-02-21T08:47:18.7277387Z  'num_warps': 16,
2026-02-21T08:47:18.7277606Z  'pid_type': 'flat',
2026-02-21T08:47:18.7277844Z  'range_flattens': [None],
2026-02-21T08:47:18.7278124Z  'range_multi_buffers': [None],
2026-02-21T08:47:18.7278397Z  'range_num_stages': [0],
2026-02-21T08:47:18.7278662Z  'range_unroll_factors': [0],
2026-02-21T08:47:18.7278945Z  'range_warp_specializes': [],
2026-02-21T08:47:18.7279238Z  'reduction_loops': [None]}
2026-02-21T08:47:18.7312128Z [239s] Fitting surrogate: 683 points, 683 targets
2026-02-21T08:47:19.1640577Z [240s] Generation 16 starting: 19 neighbors, 2 active search path(s)
2026-02-21T08:47:21.1485757Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 - configs/s
2026-02-21T08:47:22.3199451Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.8 configs/s
2026-02-21T08:47:25.3519205Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 330.3         
2026-02-21T08:47:25.3519749Z                                                                   configs/s     
2026-02-21T08:47:25.5667872Z [246s] Generation 16 complete: 
2026-02-21T08:47:25.5668175Z ok=21
2026-02-21T08:47:25.5668353Z min=0.0627
2026-02-21T08:47:25.5668558Z mid=0.0638
2026-02-21T08:47:25.5668736Z max=0.0909
2026-02-21T08:47:25.5668932Z best={'block_sizes': [1],
2026-02-21T08:47:25.5669352Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:25.5669992Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:47:25.5670498Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:47:25.5670932Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', 'last', 'first'],
2026-02-21T08:47:25.5671359Z  'num_stages': 7,
2026-02-21T08:47:25.5671557Z  'num_warps': 4,
2026-02-21T08:47:25.5671760Z  'pid_type': 'flat',
2026-02-21T08:47:25.5671970Z  'range_flattens': [None],
2026-02-21T08:47:25.5672219Z  'range_multi_buffers': [None],
2026-02-21T08:47:25.5672462Z  'range_num_stages': [0],
2026-02-21T08:47:25.5672687Z  'range_unroll_factors': [0],
2026-02-21T08:47:25.5672932Z  'range_warp_specializes': [],
2026-02-21T08:47:25.5673168Z  'reduction_loops': [None]}
2026-02-21T08:47:25.5707567Z [246s] Fitting surrogate: 704 points, 704 targets
2026-02-21T08:47:26.0242617Z [247s] Generation 17 starting: 21 neighbors, 2 active search path(s)
2026-02-21T08:47:29.2185261Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 10.1 configs/s
2026-02-21T08:47:30.5766287Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 17.5 configs/s
2026-02-21T08:47:34.0462004Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 289.3         
2026-02-21T08:47:34.0462566Z                                                                   configs/s     
2026-02-21T08:47:34.2872985Z [255s] Generation 17 complete: 
2026-02-21T08:47:34.2873408Z ok=24
2026-02-21T08:47:34.2873710Z min=0.0596
2026-02-21T08:47:34.2873967Z mid=0.0613
2026-02-21T08:47:34.2874705Z max=0.0906
2026-02-21T08:47:34.2874975Z best={'block_sizes': [1],
2026-02-21T08:47:34.2875577Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:34.2876510Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:47:34.2877262Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:47:34.2877912Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', 'last', 'first'],
2026-02-21T08:47:34.2878509Z  'num_stages': 7,
2026-02-21T08:47:34.2878809Z  'num_warps': 4,
2026-02-21T08:47:34.2879100Z  'pid_type': 'flat',
2026-02-21T08:47:34.2879430Z  'range_flattens': [None],
2026-02-21T08:47:34.2879799Z  'range_multi_buffers': [None],
2026-02-21T08:47:34.2880197Z  'range_num_stages': [0],
2026-02-21T08:47:34.2880587Z  'range_unroll_factors': [0],
2026-02-21T08:47:34.2880849Z  'range_warp_specializes': [],
2026-02-21T08:47:34.2881579Z  'reduction_loops': [None]}
2026-02-21T08:47:34.2912363Z [255s] Fitting surrogate: 728 points, 728 targets
2026-02-21T08:47:34.7359523Z [255s] Generation 18 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:47:36.9190766Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 7.9 configs/s
2026-02-21T08:47:38.1641876Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 17.5 configs/s
2026-02-21T08:47:41.5800212Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 293.7         
2026-02-21T08:47:41.5801521Z                                                                   configs/s     
2026-02-21T08:47:41.8225971Z [262s] Generation 18 complete: 
2026-02-21T08:47:41.8226342Z ok=23
2026-02-21T08:47:41.8226570Z min=0.0594
2026-02-21T08:47:41.8227526Z mid=0.0604
2026-02-21T08:47:41.8227718Z max=0.0755
2026-02-21T08:47:41.8227908Z best={'block_sizes': [1],
2026-02-21T08:47:41.8228359Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:41.8229034Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:41.8229499Z               'pointer', 'pointer'],
2026-02-21T08:47:41.8229876Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'last', 'last', 'first'],
2026-02-21T08:47:41.8230268Z  'num_stages': 7,
2026-02-21T08:47:41.8230460Z  'num_warps': 16,
2026-02-21T08:47:41.8230661Z  'pid_type': 'flat',
2026-02-21T08:47:41.8230875Z  'range_flattens': [None],
2026-02-21T08:47:41.8231114Z  'range_multi_buffers': [None],
2026-02-21T08:47:41.8231353Z  'range_num_stages': [0],
2026-02-21T08:47:41.8231584Z  'range_unroll_factors': [0],
2026-02-21T08:47:41.8231854Z  'range_warp_specializes': [],
2026-02-21T08:47:41.8232098Z  'reduction_loops': [None]}
2026-02-21T08:47:41.8267722Z [262s] Fitting surrogate: 751 points, 751 targets
2026-02-21T08:47:42.1221922Z [263s] Generation 19 starting: 10 neighbors, 1 active search path(s)
2026-02-21T08:47:43.2724633Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 24.0 configs/s
2026-02-21T08:47:43.8582978Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.6 configs/s
2026-02-21T08:47:45.6789753Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 545.7         
2026-02-21T08:47:45.6790210Z                                                                   configs/s     
2026-02-21T08:47:45.8225790Z [266s] Generation 19 complete: 
2026-02-21T08:47:45.8226065Z ok=12
2026-02-21T08:47:45.8226242Z min=0.0636
2026-02-21T08:47:45.8226425Z mid=0.0664
2026-02-21T08:47:45.8226596Z max=0.0739
2026-02-21T08:47:45.8226791Z best={'block_sizes': [1],
2026-02-21T08:47:45.8227284Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:45.8227997Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:47:45.8228819Z               'pointer', 'pointer'],
2026-02-21T08:47:45.8229603Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'last', 'last', 'first'],
2026-02-21T08:47:45.8230221Z  'num_stages': 7,
2026-02-21T08:47:45.8230532Z  'num_warps': 16,
2026-02-21T08:47:45.8230838Z  'pid_type': 'flat',
2026-02-21T08:47:45.8231173Z  'range_flattens': [None],
2026-02-21T08:47:45.8231541Z  'range_multi_buffers': [None],
2026-02-21T08:47:45.8231912Z  'range_num_stages': [0],
2026-02-21T08:47:45.8232273Z  'range_unroll_factors': [0],
2026-02-21T08:47:45.8232657Z  'range_warp_specializes': [],
2026-02-21T08:47:45.8233041Z  'reduction_loops': [None]}
2026-02-21T08:47:45.8266701Z [266s] Fitting surrogate: 763 points, 763 targets
2026-02-21T08:47:45.9902075Z [267s] Autotuning complete in 267.1s after searching 715 configs.
2026-02-21T08:47:45.9902565Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:47:45.9904814Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'last', '', 'last', '', 'last', 'last', 'first'], num_stages=7, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:47:45.9907247Z 
2026-02-21T08:47:45.9907649Z [267s] Code of selected kernel: /tmp/torchinductor_root/3m/c3mvlhbt6u473jeld3w4oztb6y4rn5hrgetherhvvhpvmvhuaxp4.py
2026-02-21T08:47:47.0867126Z WARNING:tritonbench.utils.triton_op:Completed input ID 8:
2026-02-21T08:47:47.0867479Z (M, N)
2026-02-21T08:47:47.0867651Z ------------
2026-02-21T08:47:47.0867822Z (4096, 5120)
2026-02-21T08:47:47.0868497Z 
2026-02-21T08:47:47.0882272Z  30%|███       | 6/20 [29:19<1:05:37, 281.27s/it]WARNING:tritonbench.utils.triton_op:Running input ID 9:
2026-02-21T08:47:47.0882703Z (M, N)
2026-02-21T08:47:47.0882873Z ------------
2026-02-21T08:47:47.0883039Z (4096, 5632)
2026-02-21T08:47:47.0885348Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:47:48.5534610Z INFO:tritonbench.utils.triton_op:Took 3.22ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:47:52.0301008Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:47:53.5695461Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:47:53.5695791Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:47:53.5696067Z               'dtype': 'torch.float32',
2026-02-21T08:47:53.5696328Z               'shape': (4096, 5632),
2026-02-21T08:47:53.5696583Z               'stride': (5632, 1)},
2026-02-21T08:47:53.5696822Z             (5632,),
2026-02-21T08:47:53.5697048Z             { 'device': 'cuda:0',
2026-02-21T08:47:53.5697291Z               'dtype': 'torch.float32',
2026-02-21T08:47:53.5697547Z               'shape': (5632,),
2026-02-21T08:47:53.5697782Z               'stride': (1,)},
2026-02-21T08:47:53.5698004Z             { 'device': 'cuda:0',
2026-02-21T08:47:53.5698238Z               'dtype': 'torch.float32',
2026-02-21T08:47:53.5698488Z               'shape': (5632,),
2026-02-21T08:47:53.5698724Z               'stride': (1,)},
2026-02-21T08:47:53.5698936Z             1e-05),
2026-02-21T08:47:53.5699122Z   'kwargs': {}}
2026-02-21T08:47:53.5733630Z INFO:tritonbench.utils.triton_op:Took 4.20ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:47:53.5811573Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:47:53.5813020Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:47:53.5814401Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:47:53.5814841Z While processing:
2026-02-21T08:47:53.5815284Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:47:53.5815716Z     if bias is not None:
2026-02-21T08:47:53.5815924Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:47:53.5816060Z 
2026-02-21T08:47:53.7400726Z [0s] Autotune random seed: 2135381352
2026-02-21T08:47:54.0312530Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:48:29.1185505Z [35s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:48:30.2507519Z [36s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:48:30.2527034Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T08:48:33.6479006Z [39s] Skipping config with accuracy mismatch: helion.Config(block_sizes=[64], indexing=['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'last', '', '', 'first', 'first', 'last', ''], maxnreg=32, num_sm_multiplier=8, num_stages=1, num_warps=1, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[3], range_unroll_factors=[1], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:48:33.6481314Z Tensor-likes are not close!
2026-02-21T08:48:33.6481498Z 
2026-02-21T08:48:33.6481610Z Mismatched elements: 19 / 4096 (0.5%)
2026-02-21T08:48:33.6482110Z Greatest absolute difference: 0.06162595748901367 at index (3978,) (up to 0.01 allowed)
2026-02-21T08:48:33.6482664Z Greatest relative difference: 0.030559774488210678 at index (1290,) (up to 0.01 allowed)
2026-02-21T08:48:33.6483009Z 
2026-02-21T08:48:33.6483094Z The failure occurred for item [2]
2026-02-21T08:48:33.6483397Z Use HELION_AUTOTUNE_ACCURACY_CHECK=0 to disable this check.
2026-02-21T08:48:33.6483636Z 
2026-02-21T08:48:35.9519202Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.7 configs/s
2026-02-21T08:48:35.9532162Z [41s] Adaptive compile timeout: 30s (90% percentile=7.1s, bounds=[30.0s, 30s])
2026-02-21T08:48:37.4778400Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 646.8 configs/s
2026-02-21T08:48:37.5975540Z [43s] Initial random population of 100, 5 starting points: 
2026-02-21T08:48:37.5975916Z error=13
2026-02-21T08:48:37.5976087Z timeout=2
2026-02-21T08:48:37.5976255Z ok=85
2026-02-21T08:48:37.5976415Z min=0.0701
2026-02-21T08:48:37.5976586Z mid=0.2615
2026-02-21T08:48:37.5976747Z max=23.5758
2026-02-21T08:48:37.5976940Z best={'block_sizes': [2],
2026-02-21T08:48:37.5977333Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:48:37.5977949Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:48:37.5978381Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:48:37.5978790Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:48:37.5979207Z  'maxnreg': 256,
2026-02-21T08:48:37.5979401Z  'num_sm_multiplier': 8,
2026-02-21T08:48:37.5979618Z  'num_stages': 8,
2026-02-21T08:48:37.5979801Z  'num_warps': 4,
2026-02-21T08:48:37.5980001Z  'pid_type': 'persistent_blocked',
2026-02-21T08:48:37.5980252Z  'range_flattens': [False],
2026-02-21T08:48:37.5980475Z  'range_multi_buffers': [None],
2026-02-21T08:48:37.5980713Z  'range_num_stages': [4],
2026-02-21T08:48:37.5980930Z  'range_unroll_factors': [2],
2026-02-21T08:48:37.5981167Z  'range_warp_specializes': [],
2026-02-21T08:48:37.5981395Z  'reduction_loops': [None]}
2026-02-21T08:48:37.5998565Z [43s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:48:39.0795233Z [45s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T08:48:49.5391749Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 17.7 configs/s
2026-02-21T08:48:54.7284828Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.7 configs/s
2026-02-21T08:49:06.8470480Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 83.3 configs/s
2026-02-21T08:49:07.5375490Z [73s] Generation 1 complete: 
2026-02-21T08:49:07.5378393Z error=2
2026-02-21T08:49:07.5378608Z ok=86
2026-02-21T08:49:07.5378811Z min=0.0665
2026-02-21T08:49:07.5379007Z mid=0.0808
2026-02-21T08:49:07.5379190Z max=0.3678
2026-02-21T08:49:07.5379395Z best={'block_sizes': [1],
2026-02-21T08:49:07.5379880Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:49:07.5380499Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:49:07.5381421Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:49:07.5381777Z  'num_stages': 1,
2026-02-21T08:49:07.5381982Z  'num_warps': 8,
2026-02-21T08:49:07.5382673Z  'pid_type': 'flat',
2026-02-21T08:49:07.5382916Z  'range_flattens': [None],
2026-02-21T08:49:07.5383165Z  'range_multi_buffers': [None],
2026-02-21T08:49:07.5383429Z  'range_num_stages': [0],
2026-02-21T08:49:07.5383689Z  'range_unroll_factors': [0],
2026-02-21T08:49:07.5384164Z  'range_warp_specializes': [],
2026-02-21T08:49:07.5384429Z  'reduction_loops': [None]}
2026-02-21T08:49:07.5399688Z [73s] Fitting surrogate: 188 points, 188 targets
2026-02-21T08:49:08.5326008Z [74s] Generation 2 starting: 60 neighbors, 5 active search path(s)
2026-02-21T08:49:20.0996504Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 1.3 configs/s
2026-02-21T08:49:23.7904988Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 17.6 configs/s
2026-02-21T08:49:32.8940257Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 119.2         
2026-02-21T08:49:32.8945936Z                                                                   configs/s     
2026-02-21T08:49:33.3998560Z [99s] Generation 2 complete: 
2026-02-21T08:49:33.3998872Z error=4
2026-02-21T08:49:33.3999069Z ok=62
2026-02-21T08:49:33.3999252Z min=0.0663
2026-02-21T08:49:33.3999432Z mid=0.0729
2026-02-21T08:49:33.3999624Z max=0.8061
2026-02-21T08:49:33.3999807Z best={'block_sizes': [1],
2026-02-21T08:49:33.4000271Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:49:33.4000835Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:49:33.4001239Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:49:33.4001569Z  'num_stages': 1,
2026-02-21T08:49:33.4001773Z  'num_warps': 16,
2026-02-21T08:49:33.4001973Z  'pid_type': 'flat',
2026-02-21T08:49:33.4002186Z  'range_flattens': [None],
2026-02-21T08:49:33.4002428Z  'range_multi_buffers': [None],
2026-02-21T08:49:33.4002670Z  'range_num_stages': [0],
2026-02-21T08:49:33.4002909Z  'range_unroll_factors': [0],
2026-02-21T08:49:33.4003164Z  'range_warp_specializes': [],
2026-02-21T08:49:33.4003427Z  'reduction_loops': [None]}
2026-02-21T08:49:33.4022061Z [99s] Fitting surrogate: 254 points, 254 targets
2026-02-21T08:49:34.4121836Z [100s] Generation 3 starting: 59 neighbors, 5 active search path(s)
2026-02-21T08:49:41.5128214Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 13.4 configs/s
2026-02-21T08:49:44.8902849Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 18.6 configs/s
2026-02-21T08:49:53.1609030Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.9         
2026-02-21T08:49:53.1609582Z                                                                   configs/s     
2026-02-21T08:49:53.6606052Z [119s] Generation 3 complete: 
2026-02-21T08:49:53.6606371Z error=7
2026-02-21T08:49:53.6606561Z ok=57
2026-02-21T08:49:53.6606736Z min=0.0659
2026-02-21T08:49:53.6606938Z mid=0.0745
2026-02-21T08:49:53.6607114Z max=0.3180
2026-02-21T08:49:53.6607310Z best={'block_sizes': [1],
2026-02-21T08:49:53.6607856Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:49:53.6608506Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:49:53.6609551Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:49:53.6609876Z  'num_stages': 1,
2026-02-21T08:49:53.6610200Z  'num_warps': 16,
2026-02-21T08:49:53.6610398Z  'pid_type': 'flat',
2026-02-21T08:49:53.6610615Z  'range_flattens': [None],
2026-02-21T08:49:53.6610843Z  'range_multi_buffers': [None],
2026-02-21T08:49:53.6611085Z  'range_num_stages': [0],
2026-02-21T08:49:53.6611307Z  'range_unroll_factors': [0],
2026-02-21T08:49:53.6611550Z  'range_warp_specializes': [],
2026-02-21T08:49:53.6611782Z  'reduction_loops': [None]}
2026-02-21T08:49:53.6635033Z [119s] Fitting surrogate: 318 points, 318 targets
2026-02-21T08:49:54.4833310Z [120s] Generation 4 starting: 44 neighbors, 5 active search path(s)
2026-02-21T08:50:00.1023905Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 6.8 configs/s
2026-02-21T08:50:02.9636939Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.7 configs/s
2026-02-21T08:50:10.9992980Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 136.0         
2026-02-21T08:50:10.9993576Z                                                                   configs/s     
2026-02-21T08:50:11.4519199Z [137s] Generation 4 complete: 
2026-02-21T08:50:11.4519495Z ok=49
2026-02-21T08:50:11.4519700Z min=0.0661
2026-02-21T08:50:11.4519901Z mid=0.0732
2026-02-21T08:50:11.4520091Z max=0.1295
2026-02-21T08:50:11.4520406Z best={'block_sizes': [1],
2026-02-21T08:50:11.4521200Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:50:11.4522097Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:50:11.4522752Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:50:11.4523256Z  'num_stages': 1,
2026-02-21T08:50:11.4523595Z  'num_warps': 16,
2026-02-21T08:50:11.4523923Z  'pid_type': 'flat',
2026-02-21T08:50:11.4524787Z  'range_flattens': [None],
2026-02-21T08:50:11.4525170Z  'range_multi_buffers': [None],
2026-02-21T08:50:11.4525581Z  'range_num_stages': [0],
2026-02-21T08:50:11.4525968Z  'range_unroll_factors': [0],
2026-02-21T08:50:11.4526370Z  'range_warp_specializes': [],
2026-02-21T08:50:11.4526762Z  'reduction_loops': [None]}
2026-02-21T08:50:11.4547312Z [137s] Fitting surrogate: 367 points, 367 targets
2026-02-21T08:50:12.1414497Z [138s] Generation 5 starting: 38 neighbors, 4 active search path(s)
2026-02-21T08:50:16.7545089Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 14.1 configs/s
2026-02-21T08:50:19.0811354Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 40/40 17.5 configs/s
2026-02-21T08:50:25.5299563Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 156.2         
2026-02-21T08:50:25.5300259Z                                                                   configs/s     
2026-02-21T08:50:25.9231943Z [151s] Generation 5 complete: 
2026-02-21T08:50:25.9232256Z error=2
2026-02-21T08:50:25.9232445Z ok=41
2026-02-21T08:50:25.9232649Z min=0.0659
2026-02-21T08:50:25.9233463Z mid=0.0727
2026-02-21T08:50:25.9233666Z max=0.6630
2026-02-21T08:50:25.9233872Z best={'block_sizes': [1],
2026-02-21T08:50:25.9234553Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:50:25.9235192Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:50:25.9235648Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:50:25.9236015Z  'num_stages': 1,
2026-02-21T08:50:25.9236237Z  'num_warps': 16,
2026-02-21T08:50:25.9236457Z  'pid_type': 'flat',
2026-02-21T08:50:25.9236697Z  'range_flattens': [None],
2026-02-21T08:50:25.9236954Z  'range_multi_buffers': [None],
2026-02-21T08:50:25.9237228Z  'range_num_stages': [0],
2026-02-21T08:50:25.9237479Z  'range_unroll_factors': [0],
2026-02-21T08:50:25.9238074Z  'range_warp_specializes': [],
2026-02-21T08:50:25.9238359Z  'reduction_loops': [None]}
2026-02-21T08:50:25.9262209Z [151s] Fitting surrogate: 410 points, 410 targets
2026-02-21T08:50:26.5268995Z [152s] Generation 6 starting: 32 neighbors, 3 active search path(s)
2026-02-21T08:50:30.6915865Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 16.4 configs/s
2026-02-21T08:50:32.6505008Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 33/33 17.2 configs/s
2026-02-21T08:50:37.2598016Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 218.0         
2026-02-21T08:50:37.2598608Z                                                                   configs/s     
2026-02-21T08:50:37.5562687Z [163s] Generation 6 complete: 
2026-02-21T08:50:37.5562997Z error=1
2026-02-21T08:50:37.5563182Z ok=35
2026-02-21T08:50:37.5563348Z min=0.0659
2026-02-21T08:50:37.5563531Z mid=0.0706
2026-02-21T08:50:37.5563699Z max=0.2255
2026-02-21T08:50:37.5563915Z best={'block_sizes': [1],
2026-02-21T08:50:37.5564827Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:50:37.5565388Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:50:37.5565813Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:50:37.5566126Z  'num_stages': 1,
2026-02-21T08:50:37.5566328Z  'num_warps': 16,
2026-02-21T08:50:37.5566517Z  'pid_type': 'flat',
2026-02-21T08:50:37.5566750Z  'range_flattens': [None],
2026-02-21T08:50:37.5567003Z  'range_multi_buffers': [None],
2026-02-21T08:50:37.5567242Z  'range_num_stages': [0],
2026-02-21T08:50:37.5567474Z  'range_unroll_factors': [0],
2026-02-21T08:50:37.5567713Z  'range_warp_specializes': [],
2026-02-21T08:50:37.5567959Z  'reduction_loops': [None]}
2026-02-21T08:50:37.5593431Z [163s] Fitting surrogate: 446 points, 446 targets
2026-02-21T08:50:38.0153104Z [163s] Generation 7 starting: 21 neighbors, 2 active search path(s)
2026-02-21T08:50:41.4387139Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 9.1 configs/s
2026-02-21T08:50:42.7724528Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 22/22 17.1 configs/s
2026-02-21T08:50:46.4564906Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 272.0         
2026-02-21T08:50:46.4565459Z                                                                   configs/s     
2026-02-21T08:50:46.6974777Z [172s] Generation 7 complete: 
2026-02-21T08:50:46.6975119Z ok=24
2026-02-21T08:50:46.6975298Z min=0.0663
2026-02-21T08:50:46.6975464Z mid=0.0705
2026-02-21T08:50:46.6975631Z max=0.1011
2026-02-21T08:50:46.6975805Z best={'block_sizes': [1],
2026-02-21T08:50:46.6976247Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:50:46.6976792Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:50:46.6977197Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:50:46.6977545Z  'num_stages': 1,
2026-02-21T08:50:46.6977745Z  'num_warps': 16,
2026-02-21T08:50:46.6977942Z  'pid_type': 'flat',
2026-02-21T08:50:46.6978147Z  'range_flattens': [None],
2026-02-21T08:50:46.6978913Z  'range_multi_buffers': [None],
2026-02-21T08:50:46.6979150Z  'range_num_stages': [0],
2026-02-21T08:50:46.6979375Z  'range_unroll_factors': [0],
2026-02-21T08:50:46.6979611Z  'range_warp_specializes': [],
2026-02-21T08:50:46.6979855Z  'reduction_loops': [None]}
2026-02-21T08:50:46.7004780Z [172s] Fitting surrogate: 470 points, 470 targets
2026-02-21T08:50:47.0007560Z [172s] Generation 8 starting: 11 neighbors, 1 active search path(s)
2026-02-21T08:50:48.6355949Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 14.4 configs/s
2026-02-21T08:50:49.3138208Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 12/12 19.1 configs/s
2026-02-21T08:50:51.1113126Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 551.0         
2026-02-21T08:50:51.1114418Z                                                                   configs/s     
2026-02-21T08:50:51.2468960Z [177s] Generation 8 complete: 
2026-02-21T08:50:51.2469590Z error=1
2026-02-21T08:50:51.2469915Z ok=12
2026-02-21T08:50:51.2470261Z min=0.0664
2026-02-21T08:50:51.2470532Z mid=0.0806
2026-02-21T08:50:51.2470800Z max=0.1012
2026-02-21T08:50:51.2471083Z best={'block_sizes': [1],
2026-02-21T08:50:51.2471815Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:50:51.2472726Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:50:51.2473372Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:50:51.2473891Z  'num_stages': 1,
2026-02-21T08:50:51.2474688Z  'num_warps': 16,
2026-02-21T08:50:51.2475009Z  'pid_type': 'flat',
2026-02-21T08:50:51.2475341Z  'range_flattens': [None],
2026-02-21T08:50:51.2475714Z  'range_multi_buffers': [None],
2026-02-21T08:50:51.2476110Z  'range_num_stages': [0],
2026-02-21T08:50:51.2476500Z  'range_unroll_factors': [0],
2026-02-21T08:50:51.2476884Z  'range_warp_specializes': [],
2026-02-21T08:50:51.2477271Z  'reduction_loops': [None]}
2026-02-21T08:50:51.2497479Z [177s] Fitting surrogate: 483 points, 483 targets
2026-02-21T08:50:51.5393290Z [177s] Generation 9 starting: 11 neighbors, 1 active search path(s)
2026-02-21T08:50:55.5780599Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.2 configs/s
2026-02-21T08:50:56.2520748Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 12/12 19.3 configs/s
2026-02-21T08:50:57.8445472Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 620.8         
2026-02-21T08:50:57.8449166Z                                                                   configs/s     
2026-02-21T08:50:57.9704506Z [183s] Generation 9 complete: 
2026-02-21T08:50:57.9704783Z error=1
2026-02-21T08:50:57.9704945Z ok=12
2026-02-21T08:50:57.9705107Z min=0.0658
2026-02-21T08:50:57.9705274Z mid=0.0776
2026-02-21T08:50:57.9705438Z max=0.2322
2026-02-21T08:50:57.9705636Z best={'block_sizes': [1],
2026-02-21T08:50:57.9706077Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:50:57.9706649Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:50:57.9707043Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:50:57.9707357Z  'num_stages': 1,
2026-02-21T08:50:57.9707541Z  'num_warps': 16,
2026-02-21T08:50:57.9707730Z  'pid_type': 'flat',
2026-02-21T08:50:57.9707930Z  'range_flattens': [None],
2026-02-21T08:50:57.9708159Z  'range_multi_buffers': [None],
2026-02-21T08:50:57.9708389Z  'range_num_stages': [0],
2026-02-21T08:50:57.9708613Z  'range_unroll_factors': [0],
2026-02-21T08:50:57.9708854Z  'range_warp_specializes': [],
2026-02-21T08:50:57.9709092Z  'reduction_loops': [None]}
2026-02-21T08:50:57.9738871Z [183s] Fitting surrogate: 496 points, 496 targets
2026-02-21T08:50:58.2598584Z [184s] Generation 10 starting: 11 neighbors, 1 active search path(s)
2026-02-21T08:50:59.6583869Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 32.4 configs/s
2026-02-21T08:51:00.3269456Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 19.4 configs/s
2026-02-21T08:51:02.2703892Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 510.5         
2026-02-21T08:51:02.2705176Z                                                                   configs/s     
2026-02-21T08:51:02.4141614Z [188s] Generation 10 complete: 
2026-02-21T08:51:02.4141877Z error=1
2026-02-21T08:51:02.4142041Z ok=12
2026-02-21T08:51:02.4142206Z min=0.0662
2026-02-21T08:51:02.4142375Z mid=0.0722
2026-02-21T08:51:02.4142539Z max=0.0946
2026-02-21T08:51:02.4142713Z best={'block_sizes': [1],
2026-02-21T08:51:02.4143175Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:51:02.4143720Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:51:02.4145089Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:51:02.4145424Z  'num_stages': 1,
2026-02-21T08:51:02.4145615Z  'num_warps': 16,
2026-02-21T08:51:02.4145827Z  'pid_type': 'flat',
2026-02-21T08:51:02.4146048Z  'range_flattens': [None],
2026-02-21T08:51:02.4146280Z  'range_multi_buffers': [None],
2026-02-21T08:51:02.4146516Z  'range_num_stages': [0],
2026-02-21T08:51:02.4146744Z  'range_unroll_factors': [0],
2026-02-21T08:51:02.4146969Z  'range_warp_specializes': [],
2026-02-21T08:51:02.4147204Z  'reduction_loops': [None]}
2026-02-21T08:51:02.4171471Z [188s] Fitting surrogate: 509 points, 509 targets
2026-02-21T08:51:02.7079686Z [188s] Generation 11 starting: 10 neighbors, 1 active search path(s)
2026-02-21T08:51:04.2236119Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 14.4 configs/s
2026-02-21T08:51:04.7186561Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 25.5 configs/s
2026-02-21T08:51:06.0612797Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 731.6         
2026-02-21T08:51:06.0613332Z                                                                   configs/s     
2026-02-21T08:51:06.1726696Z [192s] Generation 11 complete: 
2026-02-21T08:51:06.1726989Z error=3
2026-02-21T08:51:06.1727162Z ok=9
2026-02-21T08:51:06.1727325Z min=0.0664
2026-02-21T08:51:06.1727500Z mid=0.0927
2026-02-21T08:51:06.1727687Z max=0.1051
2026-02-21T08:51:06.1727870Z best={'block_sizes': [1],
2026-02-21T08:51:06.1728319Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:51:06.1728867Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:51:06.1729289Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T08:51:06.1729616Z  'num_stages': 1,
2026-02-21T08:51:06.1729819Z  'num_warps': 16,
2026-02-21T08:51:06.1730010Z  'pid_type': 'flat',
2026-02-21T08:51:06.1730323Z  'range_flattens': [None],
2026-02-21T08:51:06.1730575Z  'range_multi_buffers': [None],
2026-02-21T08:51:06.1730814Z  'range_num_stages': [0],
2026-02-21T08:51:06.1731051Z  'range_unroll_factors': [0],
2026-02-21T08:51:06.1731293Z  'range_warp_specializes': [],
2026-02-21T08:51:06.1731544Z  'reduction_loops': [None]}
2026-02-21T08:51:06.1758016Z [192s] Fitting surrogate: 521 points, 521 targets
2026-02-21T08:51:06.4563796Z [192s] Generation 12 starting: 10 neighbors, 1 active search path(s)
2026-02-21T08:51:08.1885791Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 6.9 configs/s
2026-02-21T08:51:08.8504707Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.9 configs/s
2026-02-21T08:51:10.7678837Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 518.0         
2026-02-21T08:51:10.7679341Z                                                                   configs/s     
2026-02-21T08:51:10.9115502Z [196s] Generation 12 complete: 
2026-02-21T08:51:10.9115748Z ok=12
2026-02-21T08:51:10.9115923Z min=0.0657
2026-02-21T08:51:10.9116623Z mid=0.0728
2026-02-21T08:51:10.9116805Z max=0.0921
2026-02-21T08:51:10.9116980Z best={'block_sizes': [1],
2026-02-21T08:51:10.9117391Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:51:10.9118220Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:51:10.9118699Z               'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:51:10.9119142Z  'load_eviction_policies': ['', '', 'first', 'last', 'first', 'last', 'last', 'first'],
2026-02-21T08:51:10.9119543Z  'num_stages': 7,
2026-02-21T08:51:10.9119729Z  'num_warps': 16,
2026-02-21T08:51:10.9119926Z  'pid_type': 'flat',
2026-02-21T08:51:10.9120129Z  'range_flattens': [None],
2026-02-21T08:51:10.9120359Z  'range_multi_buffers': [None],
2026-02-21T08:51:10.9120591Z  'range_num_stages': [0],
2026-02-21T08:51:10.9120813Z  'range_unroll_factors': [0],
2026-02-21T08:51:10.9121051Z  'range_warp_specializes': [],
2026-02-21T08:51:10.9121298Z  'reduction_loops': [None]}
2026-02-21T08:51:10.9146423Z [196s] Fitting surrogate: 533 points, 533 targets
2026-02-21T08:51:11.1863652Z [197s] Generation 13 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:51:12.4821898Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 9.2 configs/s
2026-02-21T08:51:12.9606221Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 21.3 configs/s
2026-02-21T08:51:14.4055605Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 681.9         
2026-02-21T08:51:14.4056104Z                                                                   configs/s     
2026-02-21T08:51:14.5233545Z [200s] Generation 13 complete: 
2026-02-21T08:51:14.5233802Z error=1
2026-02-21T08:51:14.5234287Z ok=9
2026-02-21T08:51:14.5234460Z min=0.0718
2026-02-21T08:51:14.5234641Z mid=0.0772
2026-02-21T08:51:14.5234820Z max=0.0950
2026-02-21T08:51:14.5234994Z best={'block_sizes': [1],
2026-02-21T08:51:14.5235404Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:51:14.5236005Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:51:14.5236483Z               'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:51:14.5236938Z  'load_eviction_policies': ['', '', 'first', 'last', 'first', 'last', 'last', 'first'],
2026-02-21T08:51:14.5237332Z  'num_stages': 7,
2026-02-21T08:51:14.5237526Z  'num_warps': 16,
2026-02-21T08:51:14.5237711Z  'pid_type': 'flat',
2026-02-21T08:51:14.5237920Z  'range_flattens': [None],
2026-02-21T08:51:14.5238142Z  'range_multi_buffers': [None],
2026-02-21T08:51:14.5238384Z  'range_num_stages': [0],
2026-02-21T08:51:14.5238608Z  'range_unroll_factors': [0],
2026-02-21T08:51:14.5238844Z  'range_warp_specializes': [],
2026-02-21T08:51:14.5239083Z  'reduction_loops': [None]}
2026-02-21T08:51:14.5271111Z [200s] Fitting surrogate: 543 points, 543 targets
2026-02-21T08:51:14.6860895Z [200s] Autotuning complete in 200.7s after searching 519 configs.
2026-02-21T08:51:14.6861371Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:51:14.6863566Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', '', 'first', 'last', 'first', 'last', 'last', 'first'], num_stages=7, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:51:14.6866312Z 
2026-02-21T08:51:14.6866709Z [200s] Code of selected kernel: /tmp/torchinductor_root/4h/c4hozkrqde6t7z3ogp2atu46mdizwo4zochk22km3p46ndic3rjg.py
2026-02-21T08:51:15.8460793Z WARNING:tritonbench.utils.triton_op:Completed input ID 9:
2026-02-21T08:51:15.8461148Z (M, N)
2026-02-21T08:51:15.8461641Z ------------
2026-02-21T08:51:15.8461836Z (4096, 5632)
2026-02-21T08:51:15.8461946Z 
2026-02-21T08:51:15.8481219Z  35%|███▌      | 7/20 [32:48<55:48, 257.56s/it]  WARNING:tritonbench.utils.triton_op:Running input ID 11:
2026-02-21T08:51:15.8481674Z (M, N)
2026-02-21T08:51:15.8481833Z ------------
2026-02-21T08:51:15.8482009Z (4096, 6656)
2026-02-21T08:51:15.8484345Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:51:17.2638736Z INFO:tritonbench.utils.triton_op:Took 3.15ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:51:20.8372017Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:51:22.3534541Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:51:22.3535137Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:51:22.3535581Z               'dtype': 'torch.float32',
2026-02-21T08:51:22.3536028Z               'shape': (4096, 6656),
2026-02-21T08:51:22.3536477Z               'stride': (6656, 1)},
2026-02-21T08:51:22.3536854Z             (6656,),
2026-02-21T08:51:22.3537188Z             { 'device': 'cuda:0',
2026-02-21T08:51:22.3537575Z               'dtype': 'torch.float32',
2026-02-21T08:51:22.3538008Z               'shape': (6656,),
2026-02-21T08:51:22.3538378Z               'stride': (1,)},
2026-02-21T08:51:22.3538753Z             { 'device': 'cuda:0',
2026-02-21T08:51:22.3539133Z               'dtype': 'torch.float32',
2026-02-21T08:51:22.3539663Z               'shape': (6656,),
2026-02-21T08:51:22.3540107Z               'stride': (1,)},
2026-02-21T08:51:22.3540342Z             1e-05),
2026-02-21T08:51:22.3540544Z   'kwargs': {}}
2026-02-21T08:51:22.3569802Z INFO:tritonbench.utils.triton_op:Took 3.95ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:51:22.3648741Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:51:22.3650269Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:51:22.3651256Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:51:22.3651821Z While processing:
2026-02-21T08:51:22.3656064Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:51:22.3656797Z     if bias is not None:
2026-02-21T08:51:22.3657160Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:51:22.3657384Z 
2026-02-21T08:51:22.5305046Z [0s] Autotune random seed: 2135381352
2026-02-21T08:51:22.8164210Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:51:58.7540132Z [35s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:52:00.0235166Z [37s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:52:00.0255005Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T08:52:05.8071470Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.4 configs/s
2026-02-21T08:52:05.8085246Z [42s] Adaptive compile timeout: 30s (90% percentile=8.0s, bounds=[30.0s, 30s])
2026-02-21T08:52:07.4585250Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 596.2 configs/s
2026-02-21T08:52:07.5829691Z [44s] Initial random population of 100, 5 starting points: 
2026-02-21T08:52:07.5830051Z error=12
2026-02-21T08:52:07.5830216Z timeout=2
2026-02-21T08:52:07.5830385Z ok=86
2026-02-21T08:52:07.5830545Z min=0.0817
2026-02-21T08:52:07.5830716Z mid=0.3079
2026-02-21T08:52:07.5830894Z max=27.9639
2026-02-21T08:52:07.5831133Z best={'block_sizes': [2],
2026-02-21T08:52:07.5831610Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:52:07.5832287Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:52:07.5832749Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:52:07.5833190Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:52:07.5833598Z  'maxnreg': 256,
2026-02-21T08:52:07.5833801Z  'num_sm_multiplier': 8,
2026-02-21T08:52:07.5834259Z  'num_stages': 8,
2026-02-21T08:52:07.5834452Z  'num_warps': 4,
2026-02-21T08:52:07.5834671Z  'pid_type': 'persistent_blocked',
2026-02-21T08:52:07.5834937Z  'range_flattens': [False],
2026-02-21T08:52:07.5835183Z  'range_multi_buffers': [None],
2026-02-21T08:52:07.5835421Z  'range_num_stages': [4],
2026-02-21T08:52:07.5835651Z  'range_unroll_factors': [2],
2026-02-21T08:52:07.5835906Z  'range_warp_specializes': [],
2026-02-21T08:52:07.5836152Z  'reduction_loops': [None]}
2026-02-21T08:52:07.5851767Z [44s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:52:08.9614446Z [46s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T08:52:19.8333714Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 8.8 configs/s
2026-02-21T08:52:25.1203288Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.4 configs/s
2026-02-21T08:52:38.5999220Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 74.8 configs/s
2026-02-21T08:52:39.3283208Z [76s] Generation 1 complete: 
2026-02-21T08:52:39.3283532Z ok=88
2026-02-21T08:52:39.3283722Z min=0.0778
2026-02-21T08:52:39.3283905Z mid=0.0994
2026-02-21T08:52:39.3284482Z max=0.3305
2026-02-21T08:52:39.3284678Z best={'block_sizes': [1],
2026-02-21T08:52:39.3285090Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:52:39.3285606Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:52:39.3286022Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T08:52:39.3286368Z  'num_stages': 1,
2026-02-21T08:52:39.3286559Z  'num_warps': 8,
2026-02-21T08:52:39.3286760Z  'pid_type': 'flat',
2026-02-21T08:52:39.3286970Z  'range_flattens': [None],
2026-02-21T08:52:39.3287209Z  'range_multi_buffers': [None],
2026-02-21T08:52:39.3287471Z  'range_num_stages': [0],
2026-02-21T08:52:39.3287698Z  'range_unroll_factors': [0],
2026-02-21T08:52:39.3287947Z  'range_warp_specializes': [],
2026-02-21T08:52:39.3288184Z  'reduction_loops': [None]}
2026-02-21T08:52:39.3307869Z [76s] Fitting surrogate: 188 points, 188 targets
2026-02-21T08:52:40.4529364Z [77s] Generation 2 starting: 68 neighbors, 5 active search path(s)
2026-02-21T08:52:55.2295093Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70/70 0.9 configs/s
2026-02-21T08:52:59.2919564Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 70/70 17.2 configs/s
2026-02-21T08:53:09.4785094Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.9 configs/s
2026-02-21T08:53:10.0380854Z [107s] Generation 2 complete: 
2026-02-21T08:53:10.0381136Z error=4
2026-02-21T08:53:10.0381314Z ok=69
2026-02-21T08:53:10.0381493Z min=0.0765
2026-02-21T08:53:10.0381709Z mid=0.0860
2026-02-21T08:53:10.0381888Z max=0.4336
2026-02-21T08:53:10.0382091Z best={'block_sizes': [1],
2026-02-21T08:53:10.0383031Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:53:10.0383684Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:53:10.0384523Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:53:10.0384958Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:53:10.0385354Z  'num_stages': 8,
2026-02-21T08:53:10.0385542Z  'num_warps': 32,
2026-02-21T08:53:10.0385737Z  'pid_type': 'flat',
2026-02-21T08:53:10.0385940Z  'range_flattens': [None],
2026-02-21T08:53:10.0386173Z  'range_multi_buffers': [None],
2026-02-21T08:53:10.0386405Z  'range_num_stages': [0],
2026-02-21T08:53:10.0386632Z  'range_unroll_factors': [0],
2026-02-21T08:53:10.0386871Z  'range_warp_specializes': [],
2026-02-21T08:53:10.0387110Z  'reduction_loops': [None]}
2026-02-21T08:53:10.0407507Z [107s] Fitting surrogate: 261 points, 261 targets
2026-02-21T08:53:10.8760015Z [108s] Generation 3 starting: 50 neighbors, 5 active search path(s)
2026-02-21T08:53:43.7291158Z [140s] Timeout after 30s compiling Config(block_sizes=[4], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', '', '', 'first', '', 'last', 'last', 'last'], maxnreg=128, num_sm_multiplier=128, num_stages=1, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[4096])
2026-02-21T08:53:43.7313323Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 0.2 configs/s
2026-02-21T08:53:46.7146797Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 17.7 configs/s
2026-02-21T08:53:54.6594844Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 126.7         
2026-02-21T08:53:54.6597646Z                                                                   configs/s     
2026-02-21T08:53:55.1094755Z [152s] Generation 3 complete: 
2026-02-21T08:53:55.1095017Z error=2
2026-02-21T08:53:55.1095172Z timeout=1
2026-02-21T08:53:55.1095314Z ok=53
2026-02-21T08:53:55.1095459Z min=0.0769
2026-02-21T08:53:55.1095608Z mid=0.0822
2026-02-21T08:53:55.1095773Z max=1.0588
2026-02-21T08:53:55.1095955Z best={'block_sizes': [1],
2026-02-21T08:53:55.1096356Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:53:55.1096873Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:53:55.1097287Z  'load_eviction_policies': ['', '', '', 'last', '', '', '', 'first'],
2026-02-21T08:53:55.1097629Z  'num_stages': 1,
2026-02-21T08:53:55.1097817Z  'num_warps': 16,
2026-02-21T08:53:55.1098013Z  'pid_type': 'flat',
2026-02-21T08:53:55.1098216Z  'range_flattens': [None],
2026-02-21T08:53:55.1098459Z  'range_multi_buffers': [None],
2026-02-21T08:53:55.1098701Z  'range_num_stages': [0],
2026-02-21T08:53:55.1098922Z  'range_unroll_factors': [0],
2026-02-21T08:53:55.1099166Z  'range_warp_specializes': [],
2026-02-21T08:53:55.1099711Z  'reduction_loops': [None]}
2026-02-21T08:53:55.1120266Z [152s] Fitting surrogate: 317 points, 317 targets
2026-02-21T08:53:55.8579475Z [153s] Generation 4 starting: 37 neighbors, 5 active search path(s)
2026-02-21T08:54:01.1956673Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 5.3 configs/s
2026-02-21T08:54:03.2423090Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 18.0 configs/s
2026-02-21T08:54:09.5030927Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 160.7         
2026-02-21T08:54:09.5031417Z                                                                   configs/s     
2026-02-21T08:54:09.8728018Z [167s] Generation 4 complete: 
2026-02-21T08:54:09.8728297Z error=3
2026-02-21T08:54:09.8728473Z ok=39
2026-02-21T08:54:09.8729125Z min=0.0769
2026-02-21T08:54:09.8729306Z mid=0.0794
2026-02-21T08:54:09.8729473Z max=0.5304
2026-02-21T08:54:09.8729652Z best={'block_sizes': [2],
2026-02-21T08:54:09.8730146Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:54:09.8730765Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:54:09.8731218Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:54:09.8731620Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:54:09.8732011Z  'num_stages': 7,
2026-02-21T08:54:09.8732211Z  'num_warps': 16,
2026-02-21T08:54:09.8732401Z  'pid_type': 'flat',
2026-02-21T08:54:09.8732620Z  'range_flattens': [None],
2026-02-21T08:54:09.8732851Z  'range_multi_buffers': [None],
2026-02-21T08:54:09.8733099Z  'range_num_stages': [0],
2026-02-21T08:54:09.8733477Z  'range_unroll_factors': [0],
2026-02-21T08:54:09.8733731Z  'range_warp_specializes': [],
2026-02-21T08:54:09.8734305Z  'reduction_loops': [None]}
2026-02-21T08:54:09.8751748Z [167s] Fitting surrogate: 359 points, 359 targets
2026-02-21T08:54:10.3839553Z [167s] Generation 5 starting: 25 neighbors, 3 active search path(s)
2026-02-21T08:54:13.8479869Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 3.2 configs/s
2026-02-21T08:54:15.2465408Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 25/25 18.5 configs/s
2026-02-21T08:54:19.5877774Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 231.2         
2026-02-21T08:54:19.5878260Z                                                                   configs/s     
2026-02-21T08:54:19.8478524Z [177s] Generation 5 complete: 
2026-02-21T08:54:19.8478958Z error=1
2026-02-21T08:54:19.8479217Z ok=27
2026-02-21T08:54:19.8479479Z min=0.0768
2026-02-21T08:54:19.8479741Z mid=0.0778
2026-02-21T08:54:19.8479990Z max=0.5235
2026-02-21T08:54:19.8480272Z best={'block_sizes': [1],
2026-02-21T08:54:19.8480919Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:54:19.8481825Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:54:19.8482508Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:54:19.8483241Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:54:19.8483742Z  'num_stages': 6,
2026-02-21T08:54:19.8483940Z  'num_warps': 16,
2026-02-21T08:54:19.8484500Z  'pid_type': 'flat',
2026-02-21T08:54:19.8484718Z  'range_flattens': [None],
2026-02-21T08:54:19.8484964Z  'range_multi_buffers': [None],
2026-02-21T08:54:19.8485215Z  'range_num_stages': [0],
2026-02-21T08:54:19.8485461Z  'range_unroll_factors': [0],
2026-02-21T08:54:19.8485716Z  'range_warp_specializes': [],
2026-02-21T08:54:19.8485986Z  'reduction_loops': [None]}
2026-02-21T08:54:19.8503589Z [177s] Fitting surrogate: 387 points, 387 targets
2026-02-21T08:54:20.3096014Z [177s] Generation 6 starting: 17 neighbors, 3 active search path(s)
2026-02-21T08:54:22.7224388Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 5.9 configs/s
2026-02-21T08:54:23.8399248Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 19/19 17.7 configs/s
2026-02-21T08:54:27.1637507Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 300.9         
2026-02-21T08:54:27.1638019Z                                                                   configs/s     
2026-02-21T08:54:27.3801002Z [184s] Generation 6 complete: 
2026-02-21T08:54:27.3801417Z ok=21
2026-02-21T08:54:27.3801686Z min=0.0792
2026-02-21T08:54:27.3801964Z mid=0.0799
2026-02-21T08:54:27.3802223Z max=0.1503
2026-02-21T08:54:27.3802523Z best={'block_sizes': [1],
2026-02-21T08:54:27.3803166Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:54:27.3804580Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T08:54:27.3806145Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:54:27.3806958Z  'load_eviction_policies': ['', '', '', 'first', '', 'last', 'last', 'first'],
2026-02-21T08:54:27.3807570Z  'num_stages': 2,
2026-02-21T08:54:27.3807895Z  'num_warps': 16,
2026-02-21T08:54:27.3808224Z  'pid_type': 'flat',
2026-02-21T08:54:27.3808619Z  'range_flattens': [None],
2026-02-21T08:54:27.3809035Z  'range_multi_buffers': [None],
2026-02-21T08:54:27.3809417Z  'range_num_stages': [0],
2026-02-21T08:54:27.3809620Z  'range_unroll_factors': [0],
2026-02-21T08:54:27.3809920Z  'range_warp_specializes': [],
2026-02-21T08:54:27.3810138Z  'reduction_loops': [None]}
2026-02-21T08:54:27.3826214Z [184s] Fitting surrogate: 408 points, 408 targets
2026-02-21T08:54:27.9376920Z [185s] Generation 7 starting: 27 neighbors, 3 active search path(s)
2026-02-21T08:54:31.5724579Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 7.6 configs/s
2026-02-21T08:54:33.3472345Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 30/30 17.3 configs/s
2026-02-21T08:54:38.3815220Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 199.5         
2026-02-21T08:54:38.3815745Z                                                                   configs/s     
2026-02-21T08:54:38.6932592Z [195s] Generation 7 complete: 
2026-02-21T08:54:38.6933042Z ok=31
2026-02-21T08:54:38.6933325Z min=0.0765
2026-02-21T08:54:38.6933601Z mid=0.0777
2026-02-21T08:54:38.6933876Z max=0.1503
2026-02-21T08:54:38.6934624Z best={'block_sizes': [1],
2026-02-21T08:54:38.6935376Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:54:38.6936486Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:54:38.6937494Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:54:38.6937879Z  'num_stages': 7,
2026-02-21T08:54:38.6938074Z  'num_warps': 16,
2026-02-21T08:54:38.6938268Z  'pid_type': 'flat',
2026-02-21T08:54:38.6938496Z  'range_flattens': [None],
2026-02-21T08:54:38.6938729Z  'range_multi_buffers': [None],
2026-02-21T08:54:38.6938964Z  'range_num_stages': [0],
2026-02-21T08:54:38.6939190Z  'range_unroll_factors': [0],
2026-02-21T08:54:38.6939949Z  'range_warp_specializes': [],
2026-02-21T08:54:38.6940194Z  'reduction_loops': [None]}
2026-02-21T08:54:38.6964493Z [195s] Fitting surrogate: 439 points, 439 targets
2026-02-21T08:54:39.2533653Z [196s] Generation 8 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:54:42.5825548Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 350.1 configs/s
2026-02-21T08:54:44.3128149Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 30/30 17.8 configs/s
2026-02-21T08:54:50.3835756Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 187.3         
2026-02-21T08:54:50.3836277Z                                                                   configs/s     
2026-02-21T08:54:50.7053675Z [207s] Generation 8 complete: 
2026-02-21T08:54:50.7054663Z ok=32
2026-02-21T08:54:50.7054898Z min=0.0791
2026-02-21T08:54:50.7055115Z mid=0.0798
2026-02-21T08:54:50.7055303Z max=0.1064
2026-02-21T08:54:50.7055481Z best={'block_sizes': [1],
2026-02-21T08:54:50.7055946Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:54:50.7056550Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:54:50.7057110Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:54:50.7057501Z  'num_stages': 6,
2026-02-21T08:54:50.7057689Z  'num_warps': 32,
2026-02-21T08:54:50.7057878Z  'pid_type': 'flat',
2026-02-21T08:54:50.7058081Z  'range_flattens': [None],
2026-02-21T08:54:50.7058313Z  'range_multi_buffers': [None],
2026-02-21T08:54:50.7058553Z  'range_num_stages': [0],
2026-02-21T08:54:50.7058780Z  'range_unroll_factors': [0],
2026-02-21T08:54:50.7059016Z  'range_warp_specializes': [],
2026-02-21T08:54:50.7059260Z  'reduction_loops': [None]}
2026-02-21T08:54:50.7080274Z [207s] Fitting surrogate: 471 points, 471 targets
2026-02-21T08:54:51.2076218Z [208s] Generation 9 starting: 24 neighbors, 3 active search path(s)
2026-02-21T08:54:54.4499150Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 10.5 configs/s
2026-02-21T08:54:55.9920798Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 27/27 18.1 configs/s
2026-02-21T08:55:00.4218394Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 226.4         
2026-02-21T08:55:00.4218981Z                                                                   configs/s     
2026-02-21T08:55:00.6927442Z [217s] Generation 9 complete: 
2026-02-21T08:55:00.6927705Z error=1
2026-02-21T08:55:00.6927874Z ok=27
2026-02-21T08:55:00.6928053Z min=0.0764
2026-02-21T08:55:00.6928227Z mid=0.0783
2026-02-21T08:55:00.6928400Z max=0.1427
2026-02-21T08:55:00.6928577Z best={'block_sizes': [1],
2026-02-21T08:55:00.6929037Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:55:00.6929613Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:55:00.6930177Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:55:00.6930586Z  'num_stages': 6,
2026-02-21T08:55:00.6930774Z  'num_warps': 16,
2026-02-21T08:55:00.6930970Z  'pid_type': 'flat',
2026-02-21T08:55:00.6931176Z  'range_flattens': [None],
2026-02-21T08:55:00.6931408Z  'range_multi_buffers': [None],
2026-02-21T08:55:00.6931644Z  'range_num_stages': [0],
2026-02-21T08:55:00.6931878Z  'range_unroll_factors': [0],
2026-02-21T08:55:00.6932115Z  'range_warp_specializes': [],
2026-02-21T08:55:00.6932354Z  'reduction_loops': [None]}
2026-02-21T08:55:00.6957850Z [217s] Fitting surrogate: 499 points, 499 targets
2026-02-21T08:55:01.2067627Z [218s] Generation 10 starting: 26 neighbors, 3 active search path(s)
2026-02-21T08:55:04.5147972Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 7.3 configs/s
2026-02-21T08:55:05.9812901Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 18.3 configs/s
2026-02-21T08:55:10.5337679Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 220.3         
2026-02-21T08:55:10.5338942Z                                                                   configs/s     
2026-02-21T08:55:10.8125845Z [227s] Generation 10 complete: 
2026-02-21T08:55:10.8126268Z error=1
2026-02-21T08:55:10.8126545Z ok=28
2026-02-21T08:55:10.8126809Z min=0.0792
2026-02-21T08:55:10.8127095Z mid=0.0798
2026-02-21T08:55:10.8127362Z max=0.1504
2026-02-21T08:55:10.8127663Z best={'block_sizes': [1],
2026-02-21T08:55:10.8128363Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:55:10.8129321Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:55:10.8130036Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', 'first'],
2026-02-21T08:55:10.8130772Z  'num_stages': 6,
2026-02-21T08:55:10.8130994Z  'num_warps': 16,
2026-02-21T08:55:10.8131190Z  'pid_type': 'flat',
2026-02-21T08:55:10.8131426Z  'range_flattens': [None],
2026-02-21T08:55:10.8131673Z  'range_multi_buffers': [None],
2026-02-21T08:55:10.8131928Z  'range_num_stages': [0],
2026-02-21T08:55:10.8132165Z  'range_unroll_factors': [0],
2026-02-21T08:55:10.8132426Z  'range_warp_specializes': [],
2026-02-21T08:55:10.8132687Z  'reduction_loops': [None]}
2026-02-21T08:55:10.8157079Z [227s] Fitting surrogate: 528 points, 528 targets
2026-02-21T08:55:11.2097126Z [228s] Generation 11 starting: 16 neighbors, 2 active search path(s)
2026-02-21T08:55:13.2925215Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 32.5 configs/s
2026-02-21T08:55:14.3539762Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.7 configs/s
2026-02-21T08:55:17.3450484Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 333.9         
2026-02-21T08:55:17.3450955Z                                                                   configs/s     
2026-02-21T08:55:17.5425420Z [234s] Generation 11 complete: 
2026-02-21T08:55:17.5425676Z ok=19
2026-02-21T08:55:17.5425867Z min=0.0765
2026-02-21T08:55:17.5426045Z mid=0.0772
2026-02-21T08:55:17.5426208Z max=0.1237
2026-02-21T08:55:17.5426393Z best={'block_sizes': [1],
2026-02-21T08:55:17.5426794Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:55:17.5427413Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:55:17.5427860Z               'pointer'],
2026-02-21T08:55:17.5428160Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T08:55:17.5428512Z  'num_stages': 1,
2026-02-21T08:55:17.5428704Z  'num_warps': 8,
2026-02-21T08:55:17.5428907Z  'pid_type': 'flat',
2026-02-21T08:55:17.5429115Z  'range_flattens': [None],
2026-02-21T08:55:17.5429347Z  'range_multi_buffers': [None],
2026-02-21T08:55:17.5429597Z  'range_num_stages': [0],
2026-02-21T08:55:17.5429824Z  'range_unroll_factors': [0],
2026-02-21T08:55:17.5430063Z  'range_warp_specializes': [],
2026-02-21T08:55:17.5430305Z  'reduction_loops': [None]}
2026-02-21T08:55:17.5455558Z [234s] Fitting surrogate: 547 points, 547 targets
2026-02-21T08:55:17.9849022Z [235s] Generation 12 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:55:20.2735166Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 29.3 configs/s
2026-02-21T08:55:21.4399439Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.9 configs/s
2026-02-21T08:55:25.1289882Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 271.5         
2026-02-21T08:55:25.1290368Z                                                                   configs/s     
2026-02-21T08:55:25.3623803Z [242s] Generation 12 complete: 
2026-02-21T08:55:25.3624378Z ok=22
2026-02-21T08:55:25.3624548Z min=0.0792
2026-02-21T08:55:25.3624724Z mid=0.0801
2026-02-21T08:55:25.3624922Z max=0.1010
2026-02-21T08:55:25.3625100Z best={'block_sizes': [1],
2026-02-21T08:55:25.3625549Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:55:25.3626808Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:55:25.3627274Z               'pointer'],
2026-02-21T08:55:25.3627568Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T08:55:25.3627906Z  'num_stages': 1,
2026-02-21T08:55:25.3628096Z  'num_warps': 32,
2026-02-21T08:55:25.3628284Z  'pid_type': 'flat',
2026-02-21T08:55:25.3628491Z  'range_flattens': [None],
2026-02-21T08:55:25.3628714Z  'range_multi_buffers': [None],
2026-02-21T08:55:25.3628955Z  'range_num_stages': [0],
2026-02-21T08:55:25.3629173Z  'range_unroll_factors': [0],
2026-02-21T08:55:25.3629416Z  'range_warp_specializes': [],
2026-02-21T08:55:25.3629650Z  'reduction_loops': [None]}
2026-02-21T08:55:25.3660633Z [242s] Fitting surrogate: 569 points, 569 targets
2026-02-21T08:55:25.6512835Z [242s] Generation 13 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:55:26.8837258Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 35.6 configs/s
2026-02-21T08:55:27.4709542Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.6 configs/s
2026-02-21T08:55:29.3360699Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 531.7         
2026-02-21T08:55:29.3361211Z                                                                   configs/s     
2026-02-21T08:55:29.4728018Z [246s] Generation 13 complete: 
2026-02-21T08:55:29.4728287Z ok=11
2026-02-21T08:55:29.4728468Z min=0.0799
2026-02-21T08:55:29.4728640Z mid=0.0808
2026-02-21T08:55:29.4728837Z max=0.1044
2026-02-21T08:55:29.4729021Z best={'block_sizes': [1],
2026-02-21T08:55:29.4729480Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:55:29.4730231Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:55:29.4730686Z               'pointer'],
2026-02-21T08:55:29.4731023Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', 'first'],
2026-02-21T08:55:29.4731403Z  'num_stages': 2,
2026-02-21T08:55:29.4731623Z  'num_warps': 32,
2026-02-21T08:55:29.4731845Z  'pid_type': 'flat',
2026-02-21T08:55:29.4732076Z  'range_flattens': [None],
2026-02-21T08:55:29.4732285Z  'range_multi_buffers': [None],
2026-02-21T08:55:29.4732516Z  'range_num_stages': [0],
2026-02-21T08:55:29.4732722Z  'range_unroll_factors': [0],
2026-02-21T08:55:29.4732954Z  'range_warp_specializes': [],
2026-02-21T08:55:29.4733180Z  'reduction_loops': [None]}
2026-02-21T08:55:29.4760520Z [246s] Fitting surrogate: 580 points, 580 targets
2026-02-21T08:55:29.6338333Z [246s] Autotuning complete in 246.8s after searching 547 configs.
2026-02-21T08:55:29.6338768Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:55:29.6340721Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', '', '', '', '', 'first', '', 'first'], num_stages=2, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:55:29.6342625Z 
2026-02-21T08:55:29.6343034Z [246s] Code of selected kernel: /tmp/torchinductor_root/3k/c3kungaoj2ucrorcmrf52jflnnphofy27aghnaisstjjpcmqpysc.py
2026-02-21T08:55:30.7675428Z WARNING:tritonbench.utils.triton_op:Completed input ID 11:
2026-02-21T08:55:30.7675968Z (M, N)
2026-02-21T08:55:30.7676233Z ------------
2026-02-21T08:55:30.7676506Z (4096, 6656)
2026-02-21T08:55:30.7676675Z 
2026-02-21T08:55:30.7695204Z  40%|████      | 8/20 [37:03<51:20, 256.72s/it]WARNING:tritonbench.utils.triton_op:Running input ID 12:
2026-02-21T08:55:30.7695664Z (M, N)
2026-02-21T08:55:30.7695836Z ------------
2026-02-21T08:55:30.7696016Z (4096, 7168)
2026-02-21T08:55:30.7698945Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:55:32.1680519Z INFO:tritonbench.utils.triton_op:Took 3.43ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:55:35.7801914Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:55:37.2656098Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:55:37.2656517Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:55:37.2656909Z               'dtype': 'torch.float32',
2026-02-21T08:55:37.2657306Z               'shape': (4096, 7168),
2026-02-21T08:55:37.2657674Z               'stride': (7168, 1)},
2026-02-21T08:55:37.2658030Z             (7168,),
2026-02-21T08:55:37.2658247Z             { 'device': 'cuda:0',
2026-02-21T08:55:37.2658886Z               'dtype': 'torch.float32',
2026-02-21T08:55:37.2659147Z               'shape': (7168,),
2026-02-21T08:55:37.2659377Z               'stride': (1,)},
2026-02-21T08:55:37.2659599Z             { 'device': 'cuda:0',
2026-02-21T08:55:37.2659855Z               'dtype': 'torch.float32',
2026-02-21T08:55:37.2660104Z               'shape': (7168,),
2026-02-21T08:55:37.2660321Z               'stride': (1,)},
2026-02-21T08:55:37.2660535Z             1e-05),
2026-02-21T08:55:37.2660717Z   'kwargs': {}}
2026-02-21T08:55:37.2705356Z INFO:tritonbench.utils.triton_op:Took 5.43ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:55:37.2791854Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:55:37.2792953Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:55:37.2793679Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:55:37.2794461Z While processing:
2026-02-21T08:55:37.2795020Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:55:37.2795526Z     if bias is not None:
2026-02-21T08:55:37.2795806Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:55:37.2795963Z 
2026-02-21T08:55:37.4383553Z [0s] Autotune random seed: 2135381352
2026-02-21T08:55:37.7226954Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:56:13.8909559Z [36s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:56:15.2938215Z [37s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:56:15.2958840Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T08:56:21.1158581Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.3 configs/s
2026-02-21T08:56:21.1173086Z [43s] Adaptive compile timeout: 30s (90% percentile=8.8s, bounds=[30.0s, 30s])
2026-02-21T08:56:22.8495425Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 567.7 configs/s
2026-02-21T08:56:22.9765754Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T08:56:22.9766721Z error=12
2026-02-21T08:56:22.9766908Z timeout=2
2026-02-21T08:56:22.9767085Z ok=86
2026-02-21T08:56:22.9767248Z min=0.0869
2026-02-21T08:56:22.9767425Z mid=0.3459
2026-02-21T08:56:22.9767589Z max=30.0893
2026-02-21T08:56:22.9767789Z best={'block_sizes': [2],
2026-02-21T08:56:22.9768206Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:56:22.9768883Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T08:56:22.9769398Z               'tensor_descriptor', 'pointer'],
2026-02-21T08:56:22.9769933Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T08:56:22.9770378Z  'maxnreg': 256,
2026-02-21T08:56:22.9770586Z  'num_sm_multiplier': 8,
2026-02-21T08:56:22.9771133Z  'num_stages': 8,
2026-02-21T08:56:22.9771338Z  'num_warps': 4,
2026-02-21T08:56:22.9771562Z  'pid_type': 'persistent_blocked',
2026-02-21T08:56:22.9771834Z  'range_flattens': [False],
2026-02-21T08:56:22.9772092Z  'range_multi_buffers': [None],
2026-02-21T08:56:22.9772341Z  'range_num_stages': [4],
2026-02-21T08:56:22.9772587Z  'range_unroll_factors': [2],
2026-02-21T08:56:22.9772850Z  'range_warp_specializes': [],
2026-02-21T08:56:22.9773103Z  'reduction_loops': [None]}
2026-02-21T08:56:22.9787253Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:56:24.3454305Z [46s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T08:56:35.4062923Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 14.0 configs/s
2026-02-21T08:56:40.6747432Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.5 configs/s
2026-02-21T08:56:53.9042637Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 76.1 configs/s
2026-02-21T08:56:54.5834554Z [76s] Generation 1 complete: 
2026-02-21T08:56:54.5834865Z ok=88
2026-02-21T08:56:54.5835042Z min=0.0848
2026-02-21T08:56:54.5835216Z mid=0.1034
2026-02-21T08:56:54.5835381Z max=0.2954
2026-02-21T08:56:54.5835622Z best={'block_sizes': [1],
2026-02-21T08:56:54.5836038Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:56:54.5836557Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T08:56:54.5836976Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T08:56:54.5837308Z  'num_stages': 1,
2026-02-21T08:56:54.5837508Z  'num_warps': 8,
2026-02-21T08:56:54.5837711Z  'pid_type': 'flat',
2026-02-21T08:56:54.5837938Z  'range_flattens': [None],
2026-02-21T08:56:54.5838169Z  'range_multi_buffers': [None],
2026-02-21T08:56:54.5838413Z  'range_num_stages': [0],
2026-02-21T08:56:54.5838638Z  'range_unroll_factors': [0],
2026-02-21T08:56:54.5838886Z  'range_warp_specializes': [],
2026-02-21T08:56:54.5839139Z  'reduction_loops': [None]}
2026-02-21T08:56:54.5860477Z [76s] Fitting surrogate: 188 points, 188 targets
2026-02-21T08:56:55.6991023Z [77s] Generation 2 starting: 69 neighbors, 5 active search path(s)
2026-02-21T08:57:05.7504322Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 9.8 configs/s
2026-02-21T08:57:09.8940718Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 17.3 configs/s
2026-02-21T08:57:22.1012008Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 82.6 configs/s
2026-02-21T08:57:22.7629292Z [105s] Generation 2 complete: 
2026-02-21T08:57:22.7629584Z error=3
2026-02-21T08:57:22.7629763Z ok=72
2026-02-21T08:57:22.7629923Z min=0.0835
2026-02-21T08:57:22.7630099Z mid=0.0879
2026-02-21T08:57:22.7630271Z max=0.6755
2026-02-21T08:57:22.7630446Z best={'block_sizes': [1],
2026-02-21T08:57:22.7630926Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:57:22.7632324Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:57:22.7632824Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T08:57:22.7633170Z  'num_stages': 1,
2026-02-21T08:57:22.7633394Z  'num_warps': 32,
2026-02-21T08:57:22.7633588Z  'pid_type': 'flat',
2026-02-21T08:57:22.7633804Z  'range_flattens': [None],
2026-02-21T08:57:22.7634484Z  'range_multi_buffers': [None],
2026-02-21T08:57:22.7634732Z  'range_num_stages': [0],
2026-02-21T08:57:22.7634965Z  'range_unroll_factors': [0],
2026-02-21T08:57:22.7635206Z  'range_warp_specializes': [],
2026-02-21T08:57:22.7635446Z  'reduction_loops': [None]}
2026-02-21T08:57:22.7654337Z [105s] Fitting surrogate: 263 points, 263 targets
2026-02-21T08:57:23.6654566Z [105s] Generation 3 starting: 54 neighbors, 5 active search path(s)
2026-02-21T08:57:30.7499206Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 13.0 configs/s
2026-02-21T08:57:33.9966856Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 17.2 configs/s
2026-02-21T08:57:43.3437278Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 107.7         
2026-02-21T08:57:43.3437805Z                                                                   configs/s     
2026-02-21T08:57:43.8524326Z [126s] Generation 3 complete: 
2026-02-21T08:57:43.8524660Z error=1
2026-02-21T08:57:43.8524842Z ok=58
2026-02-21T08:57:43.8525008Z min=0.0832
2026-02-21T08:57:43.8525188Z mid=0.0864
2026-02-21T08:57:43.8525351Z max=0.3234
2026-02-21T08:57:43.8525542Z best={'block_sizes': [1],
2026-02-21T08:57:43.8525958Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T08:57:43.8526511Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:57:43.8526970Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T08:57:43.8527313Z  'num_stages': 1,
2026-02-21T08:57:43.8527515Z  'num_warps': 32,
2026-02-21T08:57:43.8527710Z  'pid_type': 'flat',
2026-02-21T08:57:43.8527965Z  'range_flattens': [None],
2026-02-21T08:57:43.8528199Z  'range_multi_buffers': [None],
2026-02-21T08:57:43.8528447Z  'range_num_stages': [0],
2026-02-21T08:57:43.8528669Z  'range_unroll_factors': [0],
2026-02-21T08:57:43.8528941Z  'range_warp_specializes': [],
2026-02-21T08:57:43.8529198Z  'reduction_loops': [None]}
2026-02-21T08:57:43.8552623Z [126s] Fitting surrogate: 322 points, 322 targets
2026-02-21T08:57:45.3987789Z [127s] Generation 4 starting: 42 neighbors, 4 active search path(s)
2026-02-21T08:57:50.8816620Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 98.2 configs/s
2026-02-21T08:57:53.3650194Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 17.6 configs/s
2026-02-21T08:58:00.6634257Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 137.9         
2026-02-21T08:58:00.6634814Z                                                                   configs/s     
2026-02-21T08:58:01.0525926Z [143s] Generation 4 complete: 
2026-02-21T08:58:01.0526238Z error=2
2026-02-21T08:58:01.0526406Z ok=45
2026-02-21T08:58:01.0526578Z min=0.0826
2026-02-21T08:58:01.0526777Z mid=0.0868
2026-02-21T08:58:01.0526947Z max=1.0481
2026-02-21T08:58:01.0527594Z best={'block_sizes': [1],
2026-02-21T08:58:01.0528084Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:01.0529013Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:58:01.0529834Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:58:01.0530711Z  'load_eviction_policies': ['', '', '', 'first', '', 'last', 'last', 'last'],
2026-02-21T08:58:01.0531259Z  'num_stages': 2,
2026-02-21T08:58:01.0531549Z  'num_warps': 32,
2026-02-21T08:58:01.0531844Z  'pid_type': 'flat',
2026-02-21T08:58:01.0532157Z  'range_flattens': [None],
2026-02-21T08:58:01.0532509Z  'range_multi_buffers': [None],
2026-02-21T08:58:01.0532871Z  'range_num_stages': [0],
2026-02-21T08:58:01.0533582Z  'range_unroll_factors': [0],
2026-02-21T08:58:01.0534417Z  'range_warp_specializes': [],
2026-02-21T08:58:01.0534814Z  'reduction_loops': [None]}
2026-02-21T08:58:01.0552334Z [143s] Fitting surrogate: 369 points, 369 targets
2026-02-21T08:58:01.8366475Z [144s] Generation 5 starting: 40 neighbors, 4 active search path(s)
2026-02-21T08:58:11.9315970Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 0.6 configs/s
2026-02-21T08:58:14.3979538Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 41/41 16.9 configs/s
2026-02-21T08:58:20.8849652Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 154.9         
2026-02-21T08:58:20.8850277Z                                                                   configs/s     
2026-02-21T08:58:21.2542215Z [163s] Generation 5 complete: 
2026-02-21T08:58:21.2542495Z ok=44
2026-02-21T08:58:21.2542682Z min=0.0831
2026-02-21T08:58:21.2542853Z mid=0.0932
2026-02-21T08:58:21.2543023Z max=0.3043
2026-02-21T08:58:21.2543224Z best={'block_sizes': [1],
2026-02-21T08:58:21.2543624Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:21.2544395Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:58:21.2544961Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:58:21.2545439Z  'load_eviction_policies': ['', '', '', 'first', '', 'last', 'last', 'last'],
2026-02-21T08:58:21.2545802Z  'num_stages': 2,
2026-02-21T08:58:21.2546001Z  'num_warps': 32,
2026-02-21T08:58:21.2546189Z  'pid_type': 'flat',
2026-02-21T08:58:21.2546398Z  'range_flattens': [None],
2026-02-21T08:58:21.2546621Z  'range_multi_buffers': [None],
2026-02-21T08:58:21.2546866Z  'range_num_stages': [0],
2026-02-21T08:58:21.2547091Z  'range_unroll_factors': [0],
2026-02-21T08:58:21.2547327Z  'range_warp_specializes': [],
2026-02-21T08:58:21.2547564Z  'reduction_loops': [None]}
2026-02-21T08:58:21.2574785Z [163s] Fitting surrogate: 413 points, 413 targets
2026-02-21T08:58:21.6341512Z [163s] Generation 6 starting: 17 neighbors, 2 active search path(s)
2026-02-21T08:58:24.1860132Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 9.5 configs/s
2026-02-21T08:58:25.2767206Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 17.2 configs/s
2026-02-21T08:58:28.7785936Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 285.4         
2026-02-21T08:58:28.7786438Z                                                                   configs/s     
2026-02-21T08:58:28.9960103Z [171s] Generation 6 complete: 
2026-02-21T08:58:28.9960386Z ok=20
2026-02-21T08:58:28.9960569Z min=0.0831
2026-02-21T08:58:28.9960739Z mid=0.0851
2026-02-21T08:58:28.9960908Z max=0.1121
2026-02-21T08:58:28.9961092Z best={'block_sizes': [1],
2026-02-21T08:58:28.9961511Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:28.9962176Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:58:28.9962751Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:58:28.9963246Z  'load_eviction_policies': ['', '', '', 'first', '', 'last', 'last', 'last'],
2026-02-21T08:58:28.9964534Z  'num_stages': 2,
2026-02-21T08:58:28.9964742Z  'num_warps': 32,
2026-02-21T08:58:28.9964937Z  'pid_type': 'flat',
2026-02-21T08:58:28.9965155Z  'range_flattens': [None],
2026-02-21T08:58:28.9965392Z  'range_multi_buffers': [None],
2026-02-21T08:58:28.9965658Z  'range_num_stages': [0],
2026-02-21T08:58:28.9965886Z  'range_unroll_factors': [0],
2026-02-21T08:58:28.9966136Z  'range_warp_specializes': [],
2026-02-21T08:58:28.9966378Z  'reduction_loops': [None]}
2026-02-21T08:58:28.9985759Z [171s] Fitting surrogate: 433 points, 433 targets
2026-02-21T08:58:29.3930368Z [171s] Generation 7 starting: 17 neighbors, 2 active search path(s)
2026-02-21T08:58:31.9084613Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 16.0 configs/s
2026-02-21T08:58:32.9854955Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 17.4 configs/s
2026-02-21T08:58:36.2325184Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 307.7         
2026-02-21T08:58:36.2325729Z                                                                   configs/s     
2026-02-21T08:58:36.4417983Z [178s] Generation 7 complete: 
2026-02-21T08:58:36.4418364Z ok=20
2026-02-21T08:58:36.4418626Z min=0.0823
2026-02-21T08:58:36.4418879Z mid=0.0838
2026-02-21T08:58:36.4419169Z max=0.1353
2026-02-21T08:58:36.4419445Z best={'block_sizes': [1],
2026-02-21T08:58:36.4420043Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:36.4420932Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:58:36.4421649Z               'pointer', 'pointer'],
2026-02-21T08:58:36.4422262Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', '', ''],
2026-02-21T08:58:36.4422978Z  'num_stages': 7,
2026-02-21T08:58:36.4423201Z  'num_warps': 32,
2026-02-21T08:58:36.4423403Z  'pid_type': 'flat',
2026-02-21T08:58:36.4423631Z  'range_flattens': [None],
2026-02-21T08:58:36.4423879Z  'range_multi_buffers': [None],
2026-02-21T08:58:36.4424441Z  'range_num_stages': [0],
2026-02-21T08:58:36.4424683Z  'range_unroll_factors': [0],
2026-02-21T08:58:36.4424948Z  'range_warp_specializes': [],
2026-02-21T08:58:36.4425210Z  'reduction_loops': [None]}
2026-02-21T08:58:36.4447446Z [178s] Fitting surrogate: 453 points, 453 targets
2026-02-21T08:58:36.8178950Z [179s] Generation 8 starting: 15 neighbors, 2 active search path(s)
2026-02-21T08:58:39.9175329Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 6.8 configs/s
2026-02-21T08:58:40.8088959Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 15/15 17.8 configs/s
2026-02-21T08:58:43.5395525Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 365.0         
2026-02-21T08:58:43.5396091Z                                                                   configs/s     
2026-02-21T08:58:43.7226764Z [186s] Generation 8 complete: 
2026-02-21T08:58:43.7227015Z ok=17
2026-02-21T08:58:43.7227206Z min=0.0823
2026-02-21T08:58:43.7227380Z mid=0.0828
2026-02-21T08:58:43.7227604Z max=0.1302
2026-02-21T08:58:43.7227963Z best={'block_sizes': [1],
2026-02-21T08:58:43.7228670Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:43.7229661Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T08:58:43.7230400Z               'pointer', 'pointer'],
2026-02-21T08:58:43.7230980Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', '', ''],
2026-02-21T08:58:43.7231579Z  'num_stages': 7,
2026-02-21T08:58:43.7231896Z  'num_warps': 32,
2026-02-21T08:58:43.7232225Z  'pid_type': 'flat',
2026-02-21T08:58:43.7232566Z  'range_flattens': [None],
2026-02-21T08:58:43.7232956Z  'range_multi_buffers': [None],
2026-02-21T08:58:43.7233346Z  'range_num_stages': [0],
2026-02-21T08:58:43.7233722Z  'range_unroll_factors': [0],
2026-02-21T08:58:43.7234613Z  'range_warp_specializes': [],
2026-02-21T08:58:43.7235576Z  'reduction_loops': [None]}
2026-02-21T08:58:43.7253526Z [186s] Fitting surrogate: 470 points, 470 targets
2026-02-21T08:58:44.1579255Z [186s] Generation 9 starting: 19 neighbors, 2 active search path(s)
2026-02-21T08:58:46.8021744Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 12.5 configs/s
2026-02-21T08:58:47.9359140Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 19/19 17.5 configs/s
2026-02-21T08:58:51.0199448Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 323.8         
2026-02-21T08:58:51.0199982Z                                                                   configs/s     
2026-02-21T08:58:51.2207612Z [193s] Generation 9 complete: 
2026-02-21T08:58:51.2207888Z ok=21
2026-02-21T08:58:51.2208063Z min=0.0820
2026-02-21T08:58:51.2208632Z mid=0.0836
2026-02-21T08:58:51.2208807Z max=0.6811
2026-02-21T08:58:51.2208996Z best={'block_sizes': [1],
2026-02-21T08:58:51.2209437Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:51.2210192Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:58:51.2210611Z               'pointer'],
2026-02-21T08:58:51.2210955Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', '', ''],
2026-02-21T08:58:51.2211348Z  'num_stages': 7,
2026-02-21T08:58:51.2211540Z  'num_warps': 16,
2026-02-21T08:58:51.2211738Z  'pid_type': 'flat',
2026-02-21T08:58:51.2211960Z  'range_flattens': [None],
2026-02-21T08:58:51.2212201Z  'range_multi_buffers': [None],
2026-02-21T08:58:51.2212442Z  'range_num_stages': [0],
2026-02-21T08:58:51.2212702Z  'range_unroll_factors': [0],
2026-02-21T08:58:51.2212981Z  'range_warp_specializes': [],
2026-02-21T08:58:51.2213214Z  'reduction_loops': [None]}
2026-02-21T08:58:51.2235545Z [193s] Fitting surrogate: 491 points, 491 targets
2026-02-21T08:58:51.4843895Z [193s] Generation 10 starting: 9 neighbors, 1 active search path(s)
2026-02-21T08:58:52.8236450Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 24.1 configs/s
2026-02-21T08:58:53.4183903Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.3 configs/s
2026-02-21T08:58:55.2954496Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 527.5         
2026-02-21T08:58:55.2955091Z                                                                   configs/s     
2026-02-21T08:58:55.4342212Z [197s] Generation 10 complete: 
2026-02-21T08:58:55.4342451Z ok=11
2026-02-21T08:58:55.4342630Z min=0.0853
2026-02-21T08:58:55.4342815Z mid=0.0855
2026-02-21T08:58:55.4342988Z max=0.0880
2026-02-21T08:58:55.4343173Z best={'block_sizes': [1],
2026-02-21T08:58:55.4343597Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:55.4344516Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:58:55.4344922Z               'pointer'],
2026-02-21T08:58:55.4345253Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', '', ''],
2026-02-21T08:58:55.4346113Z  'num_stages': 7,
2026-02-21T08:58:55.4346314Z  'num_warps': 16,
2026-02-21T08:58:55.4346507Z  'pid_type': 'flat',
2026-02-21T08:58:55.4346729Z  'range_flattens': [None],
2026-02-21T08:58:55.4346955Z  'range_multi_buffers': [None],
2026-02-21T08:58:55.4347192Z  'range_num_stages': [0],
2026-02-21T08:58:55.4347416Z  'range_unroll_factors': [0],
2026-02-21T08:58:55.4347664Z  'range_warp_specializes': [],
2026-02-21T08:58:55.4347897Z  'reduction_loops': [None]}
2026-02-21T08:58:55.4370217Z [197s] Fitting surrogate: 502 points, 502 targets
2026-02-21T08:58:55.7082132Z [197s] Generation 11 starting: 8 neighbors, 1 active search path(s)
2026-02-21T08:58:57.0629620Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 11.2 configs/s
2026-02-21T08:58:57.5934394Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.7 configs/s
2026-02-21T08:58:59.2777498Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 586.9         
2026-02-21T08:58:59.2778085Z                                                                   configs/s     
2026-02-21T08:58:59.4062437Z [201s] Generation 11 complete: 
2026-02-21T08:58:59.4062692Z ok=10
2026-02-21T08:58:59.4062885Z min=0.0822
2026-02-21T08:58:59.4063064Z mid=0.0832
2026-02-21T08:58:59.4063235Z max=0.0869
2026-02-21T08:58:59.4063430Z best={'block_sizes': [1],
2026-02-21T08:58:59.4063878Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:58:59.4064840Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:58:59.4065271Z               'pointer'],
2026-02-21T08:58:59.4065617Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', '', ''],
2026-02-21T08:58:59.4066018Z  'num_stages': 7,
2026-02-21T08:58:59.4066217Z  'num_warps': 16,
2026-02-21T08:58:59.4066431Z  'pid_type': 'flat',
2026-02-21T08:58:59.4066653Z  'range_flattens': [None],
2026-02-21T08:58:59.4066907Z  'range_multi_buffers': [None],
2026-02-21T08:58:59.4067161Z  'range_num_stages': [0],
2026-02-21T08:58:59.4067402Z  'range_unroll_factors': [0],
2026-02-21T08:58:59.4067660Z  'range_warp_specializes': [],
2026-02-21T08:58:59.4067916Z  'reduction_loops': [None]}
2026-02-21T08:58:59.4092502Z [201s] Fitting surrogate: 512 points, 512 targets
2026-02-21T08:58:59.6608021Z [201s] Generation 12 starting: 7 neighbors, 1 active search path(s)
2026-02-21T08:59:00.8560464Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 15.6 configs/s
2026-02-21T08:59:01.3285365Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 18.9 configs/s
2026-02-21T08:59:02.8496993Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 648.0         
2026-02-21T08:59:02.8497510Z                                                                   configs/s     
2026-02-21T08:59:02.9697710Z [205s] Generation 12 complete: 
2026-02-21T08:59:02.9697986Z ok=9
2026-02-21T08:59:02.9698175Z min=0.0853
2026-02-21T08:59:02.9698473Z mid=0.0853
2026-02-21T08:59:02.9698665Z max=0.0861
2026-02-21T08:59:02.9698857Z best={'block_sizes': [1],
2026-02-21T08:59:02.9699311Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:59:02.9699936Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:59:02.9700369Z               'pointer'],
2026-02-21T08:59:02.9700773Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', 'first', ''],
2026-02-21T08:59:02.9701299Z  'num_stages': 8,
2026-02-21T08:59:02.9701508Z  'num_warps': 32,
2026-02-21T08:59:02.9701717Z  'pid_type': 'flat',
2026-02-21T08:59:02.9701942Z  'range_flattens': [None],
2026-02-21T08:59:02.9702185Z  'range_multi_buffers': [None],
2026-02-21T08:59:02.9702450Z  'range_num_stages': [0],
2026-02-21T08:59:02.9702685Z  'range_unroll_factors': [0],
2026-02-21T08:59:02.9702946Z  'range_warp_specializes': [],
2026-02-21T08:59:02.9703200Z  'reduction_loops': [None]}
2026-02-21T08:59:02.9728105Z [205s] Fitting surrogate: 521 points, 521 targets
2026-02-21T08:59:03.2278922Z [205s] Generation 13 starting: 7 neighbors, 1 active search path(s)
2026-02-21T08:59:04.4942538Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 11.0 configs/s
2026-02-21T08:59:04.9663134Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 19.0 configs/s
2026-02-21T08:59:06.5002140Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 642.2         
2026-02-21T08:59:06.5002655Z                                                                   configs/s     
2026-02-21T08:59:06.6211625Z [208s] Generation 13 complete: 
2026-02-21T08:59:06.6211896Z ok=9
2026-02-21T08:59:06.6212079Z min=0.0819
2026-02-21T08:59:06.6212254Z mid=0.0824
2026-02-21T08:59:06.6212857Z max=0.1111
2026-02-21T08:59:06.6213061Z best={'block_sizes': [1],
2026-02-21T08:59:06.6213567Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:59:06.6214447Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:59:06.6214847Z               'pointer'],
2026-02-21T08:59:06.6215178Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', 'first', ''],
2026-02-21T08:59:06.6215548Z  'num_stages': 8,
2026-02-21T08:59:06.6215740Z  'num_warps': 16,
2026-02-21T08:59:06.6215929Z  'pid_type': 'flat',
2026-02-21T08:59:06.6216147Z  'range_flattens': [None],
2026-02-21T08:59:06.6216375Z  'range_multi_buffers': [None],
2026-02-21T08:59:06.6216608Z  'range_num_stages': [0],
2026-02-21T08:59:06.6216842Z  'range_unroll_factors': [0],
2026-02-21T08:59:06.6217079Z  'range_warp_specializes': [],
2026-02-21T08:59:06.6217318Z  'reduction_loops': [None]}
2026-02-21T08:59:06.6244949Z [208s] Fitting surrogate: 530 points, 530 targets
2026-02-21T08:59:06.8857579Z [209s] Generation 14 starting: 6 neighbors, 1 active search path(s)
2026-02-21T08:59:07.6998977Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6/6 107.2 configs/s
2026-02-21T08:59:08.0512847Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 6/6 20.1 configs/s
2026-02-21T08:59:09.2291983Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 830.1         
2026-02-21T08:59:09.2292658Z                                                                   configs/s     
2026-02-21T08:59:09.3321381Z [211s] Generation 14 complete: 
2026-02-21T08:59:09.3321649Z ok=7
2026-02-21T08:59:09.3321847Z min=0.0853
2026-02-21T08:59:09.3322029Z mid=0.0854
2026-02-21T08:59:09.3322196Z max=0.0870
2026-02-21T08:59:09.3322385Z best={'block_sizes': [1],
2026-02-21T08:59:09.3322820Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T08:59:09.3323455Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T08:59:09.3323868Z               'pointer'],
2026-02-21T08:59:09.3324535Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'first', ''],
2026-02-21T08:59:09.3324936Z  'num_stages': 8,
2026-02-21T08:59:09.3325142Z  'num_warps': 32,
2026-02-21T08:59:09.3325382Z  'pid_type': 'flat',
2026-02-21T08:59:09.3325626Z  'range_flattens': [None],
2026-02-21T08:59:09.3325845Z  'range_multi_buffers': [None],
2026-02-21T08:59:09.3326060Z  'range_num_stages': [0],
2026-02-21T08:59:09.3326270Z  'range_unroll_factors': [0],
2026-02-21T08:59:09.3326488Z  'range_warp_specializes': [],
2026-02-21T08:59:09.3326711Z  'reduction_loops': [None]}
2026-02-21T08:59:09.3353858Z [211s] Fitting surrogate: 537 points, 537 targets
2026-02-21T08:59:09.4914418Z [211s] Autotuning complete in 211.8s after searching 505 configs.
2026-02-21T08:59:09.4914854Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:59:09.4916755Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'last', 'last', 'last', '', '', 'first', ''], num_stages=8, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T08:59:09.4918939Z 
2026-02-21T08:59:09.4919337Z [211s] Code of selected kernel: /tmp/torchinductor_root/mj/cmjxaqwihxfslkmwnp7vakvriwbu6vbw4u4cpx5waepuxnpb4byg.py
2026-02-21T08:59:10.5962934Z WARNING:tritonbench.utils.triton_op:Completed input ID 12:
2026-02-21T08:59:10.5963303Z (M, N)
2026-02-21T08:59:10.5963490Z ------------
2026-02-21T08:59:10.5963676Z (4096, 7168)
2026-02-21T08:59:10.5964632Z 
2026-02-21T08:59:10.5988694Z  45%|████▌     | 9/20 [40:43<44:57, 245.19s/it]WARNING:tritonbench.utils.triton_op:Running input ID 14:
2026-02-21T08:59:10.5989141Z (M, N)
2026-02-21T08:59:10.5989290Z ------------
2026-02-21T08:59:10.5989458Z (4096, 8192)
2026-02-21T08:59:10.5992197Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T08:59:11.9719690Z INFO:tritonbench.utils.triton_op:Took 3.45ms to get benchmark function for torch_compile_layer_norm
2026-02-21T08:59:15.4320241Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T08:59:16.9309611Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:59:16.9309924Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:59:16.9310190Z               'dtype': 'torch.float32',
2026-02-21T08:59:16.9310460Z               'shape': (4096, 8192),
2026-02-21T08:59:16.9310738Z               'stride': (8192, 1)},
2026-02-21T08:59:16.9311163Z             (8192,),
2026-02-21T08:59:16.9311523Z             { 'device': 'cuda:0',
2026-02-21T08:59:16.9311987Z               'dtype': 'torch.float32',
2026-02-21T08:59:16.9312379Z               'shape': (8192,),
2026-02-21T08:59:16.9312758Z               'stride': (1,)},
2026-02-21T08:59:16.9313114Z             { 'device': 'cuda:0',
2026-02-21T08:59:16.9313514Z               'dtype': 'torch.float32',
2026-02-21T08:59:16.9313899Z               'shape': (8192,),
2026-02-21T08:59:16.9314782Z               'stride': (1,)},
2026-02-21T08:59:16.9315123Z             1e-05),
2026-02-21T08:59:16.9315403Z   'kwargs': {}}
2026-02-21T08:59:16.9355533Z INFO:tritonbench.utils.triton_op:Took 4.95ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T08:59:16.9478473Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T08:59:16.9479361Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T08:59:16.9479967Z If this is not a tensor operation, please report this as a bug.
2026-02-21T08:59:16.9480316Z While processing:
2026-02-21T08:59:16.9480760Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T08:59:16.9481280Z     if bias is not None:
2026-02-21T08:59:16.9481549Z        ^^^^^^^^^^^^^^^^
2026-02-21T08:59:16.9481706Z 
2026-02-21T08:59:17.1086504Z [0s] Autotune random seed: 2135381352
2026-02-21T08:59:17.3571144Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:59:53.1159736Z [35s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T08:59:54.6542153Z [37s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T08:59:54.6562201Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T09:00:00.4596548Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.4 configs/s
2026-02-21T09:00:00.4608703Z [43s] Adaptive compile timeout: 30s (90% percentile=9.7s, bounds=[30.0s, 30s])
2026-02-21T09:00:02.3296695Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 526.1 configs/s
2026-02-21T09:00:02.4604618Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T09:00:02.4605354Z error=13
2026-02-21T09:00:02.4605616Z timeout=2
2026-02-21T09:00:02.4605956Z ok=85
2026-02-21T09:00:02.4619544Z min=0.1017
2026-02-21T09:00:02.4619794Z mid=0.3668
2026-02-21T09:00:02.4619962Z max=29.6807
2026-02-21T09:00:02.4620147Z best={'block_sizes': [2],
2026-02-21T09:00:02.4620524Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:00:02.4621071Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:00:02.4621488Z               'tensor_descriptor', 'pointer'],
2026-02-21T09:00:02.4621874Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T09:00:02.4622252Z  'maxnreg': 256,
2026-02-21T09:00:02.4622434Z  'num_sm_multiplier': 8,
2026-02-21T09:00:02.4622667Z  'num_stages': 8,
2026-02-21T09:00:02.4622852Z  'num_warps': 4,
2026-02-21T09:00:02.4623053Z  'pid_type': 'persistent_blocked',
2026-02-21T09:00:02.4623290Z  'range_flattens': [False],
2026-02-21T09:00:02.4623512Z  'range_multi_buffers': [None],
2026-02-21T09:00:02.4623737Z  'range_num_stages': [4],
2026-02-21T09:00:02.4623946Z  'range_unroll_factors': [2],
2026-02-21T09:00:02.4624351Z  'range_warp_specializes': [],
2026-02-21T09:00:02.4624574Z  'reduction_loops': [None]}
2026-02-21T09:00:02.4626398Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:00:03.7813753Z [46s] Generation 1 starting: 81 neighbors, 5 active search path(s)
2026-02-21T09:00:20.3575701Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84/84 0.8 configs/s
2026-02-21T09:00:25.4335961Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 84/84 16.7 configs/s
2026-02-21T09:00:38.6606873Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 76.1 configs/s
2026-02-21T09:00:39.2962766Z [81s] Generation 1 complete: 
2026-02-21T09:00:39.2963054Z error=1
2026-02-21T09:00:39.2963236Z ok=86
2026-02-21T09:00:39.2963410Z min=0.0952
2026-02-21T09:00:39.2963726Z mid=0.1195
2026-02-21T09:00:39.2963942Z max=1.3889
2026-02-21T09:00:39.2964389Z best={'block_sizes': [2],
2026-02-21T09:00:39.2964843Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:00:39.2965487Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:00:39.2966005Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T09:00:39.2966380Z  'num_stages': 1,
2026-02-21T09:00:39.2966607Z  'num_warps': 8,
2026-02-21T09:00:39.2966855Z  'pid_type': 'flat',
2026-02-21T09:00:39.2967108Z  'range_flattens': [None],
2026-02-21T09:00:39.2967397Z  'range_multi_buffers': [None],
2026-02-21T09:00:39.2967667Z  'range_num_stages': [0],
2026-02-21T09:00:39.2967906Z  'range_unroll_factors': [0],
2026-02-21T09:00:39.2968226Z  'range_warp_specializes': [],
2026-02-21T09:00:39.2968562Z  'reduction_loops': [None]}
2026-02-21T09:00:39.2994684Z [81s] Fitting surrogate: 187 points, 187 targets
2026-02-21T09:00:40.4690892Z [83s] Generation 2 starting: 69 neighbors, 5 active search path(s)
2026-02-21T09:00:49.7298060Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 14.5 configs/s
2026-02-21T09:00:53.6310719Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 18.7 configs/s
2026-02-21T09:01:05.7665459Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.7 configs/s
2026-02-21T09:01:06.3817709Z [109s] Generation 2 complete: 
2026-02-21T09:01:06.3817994Z error=8
2026-02-21T09:01:06.3818170Z ok=67
2026-02-21T09:01:06.3818341Z min=0.0938
2026-02-21T09:01:06.3818510Z mid=0.0995
2026-02-21T09:01:06.3818789Z max=0.7075
2026-02-21T09:01:06.3819008Z best={'block_sizes': [1],
2026-02-21T09:01:06.3819419Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:01:06.3820411Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:01:06.3820864Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T09:01:06.3821218Z  'num_stages': 1,
2026-02-21T09:01:06.3821408Z  'num_warps': 32,
2026-02-21T09:01:06.3821603Z  'pid_type': 'flat',
2026-02-21T09:01:06.3821810Z  'range_flattens': [None],
2026-02-21T09:01:06.3822042Z  'range_multi_buffers': [None],
2026-02-21T09:01:06.3822279Z  'range_num_stages': [0],
2026-02-21T09:01:06.3822508Z  'range_unroll_factors': [0],
2026-02-21T09:01:06.3822746Z  'range_warp_specializes': [],
2026-02-21T09:01:06.3823006Z  'reduction_loops': [None]}
2026-02-21T09:01:06.3848373Z [109s] Fitting surrogate: 262 points, 262 targets
2026-02-21T09:01:07.1521868Z [109s] Generation 3 starting: 43 neighbors, 5 active search path(s)
2026-02-21T09:01:12.8815687Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 11.1 configs/s
2026-02-21T09:01:15.4741337Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 17.3 configs/s
2026-02-21T09:01:24.0414788Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 117.4         
2026-02-21T09:01:24.0415313Z                                                                   configs/s     
2026-02-21T09:01:24.4983030Z [127s] Generation 3 complete: 
2026-02-21T09:01:24.4983300Z ok=49
2026-02-21T09:01:24.4983481Z min=0.0938
2026-02-21T09:01:24.4983652Z mid=0.0959
2026-02-21T09:01:24.4983821Z max=0.5191
2026-02-21T09:01:24.4984299Z best={'block_sizes': [1],
2026-02-21T09:01:24.4984691Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:01:24.4985232Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:01:24.4985659Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T09:01:24.4985977Z  'num_stages': 1,
2026-02-21T09:01:24.4986165Z  'num_warps': 32,
2026-02-21T09:01:24.4986358Z  'pid_type': 'flat',
2026-02-21T09:01:24.4986581Z  'range_flattens': [None],
2026-02-21T09:01:24.4986814Z  'range_multi_buffers': [None],
2026-02-21T09:01:24.4987058Z  'range_num_stages': [0],
2026-02-21T09:01:24.4987281Z  'range_unroll_factors': [0],
2026-02-21T09:01:24.4987912Z  'range_warp_specializes': [],
2026-02-21T09:01:24.4988150Z  'reduction_loops': [None]}
2026-02-21T09:01:24.5009816Z [127s] Fitting surrogate: 311 points, 311 targets
2026-02-21T09:01:25.2127092Z [127s] Generation 4 starting: 36 neighbors, 5 active search path(s)
2026-02-21T09:01:29.9348207Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 89.7 configs/s
2026-02-21T09:01:32.0765949Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 17.7 configs/s
2026-02-21T09:01:39.2960913Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 139.2         
2026-02-21T09:01:39.2961407Z                                                                   configs/s     
2026-02-21T09:01:39.6885662Z [142s] Generation 4 complete: 
2026-02-21T09:01:39.6886476Z error=1
2026-02-21T09:01:39.6886699Z ok=41
2026-02-21T09:01:39.6886875Z min=0.0939
2026-02-21T09:01:39.6887071Z mid=0.0956
2026-02-21T09:01:39.6887243Z max=0.1490
2026-02-21T09:01:39.6887457Z best={'block_sizes': [1],
2026-02-21T09:01:39.6887865Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:01:39.6888422Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:01:39.6888861Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T09:01:39.6889187Z  'num_stages': 1,
2026-02-21T09:01:39.6889394Z  'num_warps': 32,
2026-02-21T09:01:39.6889587Z  'pid_type': 'flat',
2026-02-21T09:01:39.6889822Z  'range_flattens': [None],
2026-02-21T09:01:39.6890204Z  'range_multi_buffers': [None],
2026-02-21T09:01:39.6890502Z  'range_num_stages': [0],
2026-02-21T09:01:39.6890784Z  'range_unroll_factors': [0],
2026-02-21T09:01:39.6891038Z  'range_warp_specializes': [],
2026-02-21T09:01:39.6891276Z  'reduction_loops': [None]}
2026-02-21T09:01:39.6911919Z [142s] Fitting surrogate: 353 points, 353 targets
2026-02-21T09:01:40.2424361Z [142s] Generation 5 starting: 25 neighbors, 4 active search path(s)
2026-02-21T09:01:43.5796721Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 16.3 configs/s
2026-02-21T09:01:45.0536636Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 26/26 18.2 configs/s
2026-02-21T09:01:50.3992139Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 187.6         
2026-02-21T09:01:50.3992626Z                                                                   configs/s     
2026-02-21T09:01:50.7009239Z [153s] Generation 5 complete: 
2026-02-21T09:01:50.7009680Z error=1
2026-02-21T09:01:50.7010119Z ok=29
2026-02-21T09:01:50.7010397Z min=0.0935
2026-02-21T09:01:50.7010670Z mid=0.0951
2026-02-21T09:01:50.7010943Z max=0.1192
2026-02-21T09:01:50.7011241Z best={'block_sizes': [1],
2026-02-21T09:01:50.7012005Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:01:50.7013051Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:01:50.7013945Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:01:50.7015112Z  'num_stages': 8,
2026-02-21T09:01:50.7015431Z  'num_warps': 32,
2026-02-21T09:01:50.7015745Z  'pid_type': 'flat',
2026-02-21T09:01:50.7016096Z  'range_flattens': [None],
2026-02-21T09:01:50.7016503Z  'range_multi_buffers': [None],
2026-02-21T09:01:50.7016917Z  'range_num_stages': [0],
2026-02-21T09:01:50.7017289Z  'range_unroll_factors': [0],
2026-02-21T09:01:50.7017692Z  'range_warp_specializes': [],
2026-02-21T09:01:50.7018167Z  'reduction_loops': [None]}
2026-02-21T09:01:50.7034784Z [153s] Fitting surrogate: 383 points, 383 targets
2026-02-21T09:01:51.0824972Z [153s] Generation 6 starting: 17 neighbors, 2 active search path(s)
2026-02-21T09:01:53.7917734Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 5.9 configs/s
2026-02-21T09:01:54.7619574Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 19.6 configs/s
2026-02-21T09:01:57.5501657Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 356.9         
2026-02-21T09:01:57.5502563Z                                                                   configs/s     
2026-02-21T09:01:57.7320420Z [160s] Generation 6 complete: 
2026-02-21T09:01:57.7320687Z error=2
2026-02-21T09:01:57.7320856Z ok=17
2026-02-21T09:01:57.7321027Z min=0.0927
2026-02-21T09:01:57.7321196Z mid=0.0963
2026-02-21T09:01:57.7321370Z max=0.2110
2026-02-21T09:01:57.7321547Z best={'block_sizes': [1],
2026-02-21T09:01:57.7321992Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:01:57.7322575Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:01:57.7323073Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:01:57.7323856Z  'num_stages': 8,
2026-02-21T09:01:57.7324389Z  'num_warps': 32,
2026-02-21T09:01:57.7324602Z  'pid_type': 'flat',
2026-02-21T09:01:57.7324814Z  'range_flattens': [None],
2026-02-21T09:01:57.7325060Z  'range_multi_buffers': [None],
2026-02-21T09:01:57.7325301Z  'range_num_stages': [0],
2026-02-21T09:01:57.7325526Z  'range_unroll_factors': [0],
2026-02-21T09:01:57.7325775Z  'range_warp_specializes': [],
2026-02-21T09:01:57.7326013Z  'reduction_loops': [None]}
2026-02-21T09:01:57.7345538Z [160s] Fitting surrogate: 402 points, 402 targets
2026-02-21T09:01:57.9846782Z [160s] Generation 7 starting: 8 neighbors, 1 active search path(s)
2026-02-21T09:01:59.1521993Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 10.1 configs/s
2026-02-21T09:01:59.6236966Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━━ 8/8 19.0 configs/s
2026-02-21T09:02:01.2653096Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 599.3         
2026-02-21T09:02:01.2653657Z                                                                   configs/s     
2026-02-21T09:02:01.3886710Z [164s] Generation 7 complete: 
2026-02-21T09:02:01.3886974Z ok=9
2026-02-21T09:02:01.3887170Z min=0.0968
2026-02-21T09:02:01.3887369Z mid=0.0970
2026-02-21T09:02:01.3887560Z max=0.1162
2026-02-21T09:02:01.3887743Z best={'block_sizes': [1],
2026-02-21T09:02:01.3888187Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:02:01.3888772Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:02:01.3889266Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:02:01.3889644Z  'num_stages': 7,
2026-02-21T09:02:01.3889843Z  'num_warps': 8,
2026-02-21T09:02:01.3890129Z  'pid_type': 'flat',
2026-02-21T09:02:01.3890345Z  'range_flattens': [None],
2026-02-21T09:02:01.3890584Z  'range_multi_buffers': [None],
2026-02-21T09:02:01.3890822Z  'range_num_stages': [0],
2026-02-21T09:02:01.3891063Z  'range_unroll_factors': [0],
2026-02-21T09:02:01.3891309Z  'range_warp_specializes': [],
2026-02-21T09:02:01.3891551Z  'reduction_loops': [None]}
2026-02-21T09:02:01.3914945Z [164s] Fitting surrogate: 411 points, 411 targets
2026-02-21T09:02:01.6597296Z [164s] Generation 8 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:02:04.2745390Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 5.4 configs/s
2026-02-21T09:02:04.8836927Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 11/11 19.7 configs/s
2026-02-21T09:02:06.5123132Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 604.3         
2026-02-21T09:02:06.5123640Z                                                                   configs/s     
2026-02-21T09:02:06.6359405Z [169s] Generation 8 complete: 
2026-02-21T09:02:06.6359661Z error=1
2026-02-21T09:02:06.6359855Z ok=11
2026-02-21T09:02:06.6360027Z min=0.0965
2026-02-21T09:02:06.6360198Z mid=0.0974
2026-02-21T09:02:06.6360367Z max=0.1686
2026-02-21T09:02:06.6360570Z best={'block_sizes': [1],
2026-02-21T09:02:06.6361016Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:02:06.6362086Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:02:06.6362582Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:02:06.6362961Z  'num_stages': 7,
2026-02-21T09:02:06.6363175Z  'num_warps': 8,
2026-02-21T09:02:06.6363374Z  'pid_type': 'flat',
2026-02-21T09:02:06.6363590Z  'range_flattens': [None],
2026-02-21T09:02:06.6363825Z  'range_multi_buffers': [None],
2026-02-21T09:02:06.6364397Z  'range_num_stages': [0],
2026-02-21T09:02:06.6364632Z  'range_unroll_factors': [0],
2026-02-21T09:02:06.6364875Z  'range_warp_specializes': [],
2026-02-21T09:02:06.6365117Z  'reduction_loops': [None]}
2026-02-21T09:02:06.6382931Z [169s] Fitting surrogate: 423 points, 423 targets
2026-02-21T09:02:06.9321846Z [169s] Generation 9 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:02:08.6527087Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 8.7 configs/s
2026-02-21T09:02:09.3107957Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 11/11 18.0 configs/s
2026-02-21T09:02:11.5438354Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 443.9         
2026-02-21T09:02:11.5438873Z                                                                   configs/s     
2026-02-21T09:02:11.6941869Z [174s] Generation 9 complete: 
2026-02-21T09:02:11.6942140Z ok=12
2026-02-21T09:02:11.6942318Z min=0.0932
2026-02-21T09:02:11.6942516Z mid=0.0967
2026-02-21T09:02:11.6942737Z max=0.1168
2026-02-21T09:02:11.6942966Z best={'block_sizes': [1],
2026-02-21T09:02:11.6943492Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:02:11.6944375Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:02:11.6944902Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:02:11.6945279Z  'num_stages': 7,
2026-02-21T09:02:11.6945468Z  'num_warps': 32,
2026-02-21T09:02:11.6945651Z  'pid_type': 'flat',
2026-02-21T09:02:11.6945868Z  'range_flattens': [None],
2026-02-21T09:02:11.6946093Z  'range_multi_buffers': [None],
2026-02-21T09:02:11.6946332Z  'range_num_stages': [0],
2026-02-21T09:02:11.6946557Z  'range_unroll_factors': [0],
2026-02-21T09:02:11.6946792Z  'range_warp_specializes': [],
2026-02-21T09:02:11.6947029Z  'reduction_loops': [None]}
2026-02-21T09:02:11.6966215Z [174s] Fitting surrogate: 435 points, 435 targets
2026-02-21T09:02:11.9341203Z [174s] Generation 10 starting: 6 neighbors, 1 active search path(s)
2026-02-21T09:02:12.7696890Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6/6 61.1 configs/s
2026-02-21T09:02:13.1225173Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 6/6 20.0 configs/s
2026-02-21T09:02:14.3560075Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 791.8         
2026-02-21T09:02:14.3560541Z                                                                   configs/s     
2026-02-21T09:02:14.4638395Z [177s] Generation 10 complete: 
2026-02-21T09:02:14.4639107Z ok=7
2026-02-21T09:02:14.4639266Z min=0.0937
2026-02-21T09:02:14.4639426Z mid=0.0937
2026-02-21T09:02:14.4639576Z max=0.0969
2026-02-21T09:02:14.4639745Z best={'block_sizes': [1],
2026-02-21T09:02:14.4640144Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:02:14.4640702Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:02:14.4641191Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:02:14.4641539Z  'num_stages': 7,
2026-02-21T09:02:14.4641718Z  'num_warps': 8,
2026-02-21T09:02:14.4641897Z  'pid_type': 'flat',
2026-02-21T09:02:14.4642090Z  'range_flattens': [None],
2026-02-21T09:02:14.4642302Z  'range_multi_buffers': [None],
2026-02-21T09:02:14.4642527Z  'range_num_stages': [0],
2026-02-21T09:02:14.4642746Z  'range_unroll_factors': [0],
2026-02-21T09:02:14.4642967Z  'range_warp_specializes': [],
2026-02-21T09:02:14.4643196Z  'reduction_loops': [None]}
2026-02-21T09:02:14.4668344Z [177s] Fitting surrogate: 442 points, 442 targets
2026-02-21T09:02:14.7566335Z [177s] Generation 11 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:02:16.0787572Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 48.9 configs/s
2026-02-21T09:02:16.6584883Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.9 configs/s
2026-02-21T09:02:18.6533288Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 496.1         
2026-02-21T09:02:18.6533931Z                                                                   configs/s     
2026-02-21T09:02:18.7959900Z [181s] Generation 11 complete: 
2026-02-21T09:02:18.7960225Z ok=11
2026-02-21T09:02:18.7960430Z min=0.0967
2026-02-21T09:02:18.7961157Z mid=0.0968
2026-02-21T09:02:18.7961391Z max=0.1004
2026-02-21T09:02:18.7961621Z best={'block_sizes': [1],
2026-02-21T09:02:18.7962098Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:02:18.7962878Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:02:18.7963441Z               'pointer'],
2026-02-21T09:02:18.7963861Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:02:18.7964733Z  'num_stages': 7,
2026-02-21T09:02:18.7964967Z  'num_warps': 8,
2026-02-21T09:02:18.7965207Z  'pid_type': 'flat',
2026-02-21T09:02:18.7965460Z  'range_flattens': [None],
2026-02-21T09:02:18.7965744Z  'range_multi_buffers': [None],
2026-02-21T09:02:18.7966036Z  'range_num_stages': [0],
2026-02-21T09:02:18.7966316Z  'range_unroll_factors': [0],
2026-02-21T09:02:18.7966616Z  'range_warp_specializes': [],
2026-02-21T09:02:18.7966908Z  'reduction_loops': [None]}
2026-02-21T09:02:18.7985915Z [181s] Fitting surrogate: 453 points, 453 targets
2026-02-21T09:02:18.9577064Z [181s] Autotuning complete in 181.6s after searching 425 configs.
2026-02-21T09:02:18.9577709Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:02:18.9580838Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last', 'last', 'first', '', 'first', '', ''], num_stages=7, num_warps=8, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:02:18.9583741Z 
2026-02-21T09:02:18.9584666Z [181s] Code of selected kernel: /tmp/torchinductor_root/ba/cba35jcyym4cmkhpg26voqsb2aeyh6ywevrlm4zo4i6diywqtjue.py
2026-02-21T09:02:20.1778479Z WARNING:tritonbench.utils.triton_op:Completed input ID 14:
2026-02-21T09:02:20.1779361Z (M, N)
2026-02-21T09:02:20.1779656Z ------------
2026-02-21T09:02:20.1779886Z (4096, 8192)
2026-02-21T09:02:20.1780036Z 
2026-02-21T09:02:20.1795825Z  50%|█████     | 10/20 [43:52<38:00, 228.02s/it]WARNING:tritonbench.utils.triton_op:Running input ID 15:
2026-02-21T09:02:20.1796447Z (M, N)
2026-02-21T09:02:20.1796663Z ------------
2026-02-21T09:02:20.1796895Z (4096, 8704)
2026-02-21T09:02:20.1798834Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:02:21.5305242Z INFO:tritonbench.utils.triton_op:Took 3.44ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:02:25.7287588Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:02:27.1654800Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:02:27.1655158Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:02:27.1655450Z               'dtype': 'torch.float32',
2026-02-21T09:02:27.1656182Z               'shape': (4096, 8704),
2026-02-21T09:02:27.1656460Z               'stride': (8704, 1)},
2026-02-21T09:02:27.1656707Z             (8704,),
2026-02-21T09:02:27.1656957Z             { 'device': 'cuda:0',
2026-02-21T09:02:27.1657222Z               'dtype': 'torch.float32',
2026-02-21T09:02:27.1657497Z               'shape': (8704,),
2026-02-21T09:02:27.1657737Z               'stride': (1,)},
2026-02-21T09:02:27.1657981Z             { 'device': 'cuda:0',
2026-02-21T09:02:27.1658238Z               'dtype': 'torch.float32',
2026-02-21T09:02:27.1658505Z               'shape': (8704,),
2026-02-21T09:02:27.1658745Z               'stride': (1,)},
2026-02-21T09:02:27.1658971Z             1e-05),
2026-02-21T09:02:27.1659174Z   'kwargs': {}}
2026-02-21T09:02:27.1689489Z INFO:tritonbench.utils.triton_op:Took 3.87ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:02:27.1816386Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:02:27.1817369Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:02:27.1818018Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:02:27.1818395Z While processing:
2026-02-21T09:02:27.1820924Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:02:27.1821398Z     if bias is not None:
2026-02-21T09:02:27.1821636Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:02:27.1821777Z 
2026-02-21T09:02:27.3506867Z [0s] Autotune random seed: 2135381352
2026-02-21T09:02:27.6593654Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:03:03.6292809Z [35s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:03:05.2519341Z [37s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:03:05.2542875Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T09:03:11.4983467Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.1 configs/s
2026-02-21T09:03:11.4996366Z [43s] Adaptive compile timeout: 30s (90% percentile=10.2s, bounds=[30.0s, 30s])
2026-02-21T09:03:13.3018456Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 542.9 configs/s
2026-02-21T09:03:13.4297489Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T09:03:13.4297945Z error=12
2026-02-21T09:03:13.4298130Z timeout=2
2026-02-21T09:03:13.4298302Z ok=86
2026-02-21T09:03:13.4298479Z min=0.1172
2026-02-21T09:03:13.4298657Z mid=0.3995
2026-02-21T09:03:13.4298834Z max=36.5496
2026-02-21T09:03:13.4299027Z best={'block_sizes': [1],
2026-02-21T09:03:13.4299448Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:03:13.4300007Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:03:13.4300997Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T09:03:13.4301343Z  'num_stages': 1,
2026-02-21T09:03:13.4301551Z  'num_warps': 4,
2026-02-21T09:03:13.4301761Z  'pid_type': 'flat',
2026-02-21T09:03:13.4302007Z  'range_flattens': [None],
2026-02-21T09:03:13.4302264Z  'range_multi_buffers': [None],
2026-02-21T09:03:13.4302524Z  'range_num_stages': [0],
2026-02-21T09:03:13.4302778Z  'range_unroll_factors': [0],
2026-02-21T09:03:13.4303050Z  'range_warp_specializes': [],
2026-02-21T09:03:13.4303309Z  'reduction_loops': [4096]}
2026-02-21T09:03:13.4320029Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:03:14.8535271Z [47s] Generation 1 starting: 81 neighbors, 5 active search path(s)
2026-02-21T09:03:27.4703593Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 7.5 configs/s
2026-02-21T09:03:32.7931146Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.3 configs/s
2026-02-21T09:03:44.5486071Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 92.1 configs/s
2026-02-21T09:03:45.0640601Z [77s] Generation 1 complete: 
2026-02-21T09:03:45.0640917Z ok=87
2026-02-21T09:03:45.0641105Z min=0.1046
2026-02-21T09:03:45.0641320Z mid=0.1413
2026-02-21T09:03:45.0641485Z max=2.2379
2026-02-21T09:03:45.0641663Z best={'block_sizes': [1],
2026-02-21T09:03:45.0642129Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:03:45.0642799Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:03:45.0643255Z               'tensor_descriptor'],
2026-02-21T09:03:45.0643646Z  'load_eviction_policies': ['last', '', 'first', 'last', '', 'first', '', 'first'],
2026-02-21T09:03:45.0644219Z  'maxnreg': 256,
2026-02-21T09:03:45.0644428Z  'num_sm_multiplier': 16,
2026-02-21T09:03:45.0644650Z  'num_stages': 4,
2026-02-21T09:03:45.0644847Z  'num_warps': 16,
2026-02-21T09:03:45.0645053Z  'pid_type': 'persistent_blocked',
2026-02-21T09:03:45.0645333Z  'range_flattens': [False],
2026-02-21T09:03:45.0645581Z  'range_multi_buffers': [True],
2026-02-21T09:03:45.0645823Z  'range_num_stages': [4],
2026-02-21T09:03:45.0646061Z  'range_unroll_factors': [0],
2026-02-21T09:03:45.0646331Z  'range_warp_specializes': [],
2026-02-21T09:03:45.0646589Z  'reduction_loops': [2048]}
2026-02-21T09:03:45.0663497Z [77s] Fitting surrogate: 187 points, 187 targets
2026-02-21T09:03:46.4604147Z [78s] Generation 2 starting: 80 neighbors, 5 active search path(s)
2026-02-21T09:03:58.9389669Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 12.2 configs/s
2026-02-21T09:04:04.1732787Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 16.4 configs/s
2026-02-21T09:04:20.5056051Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 61.7 configs/s
2026-02-21T09:04:21.2860937Z [113s] Generation 2 complete: 
2026-02-21T09:04:21.2861376Z ok=86
2026-02-21T09:04:21.2861646Z min=0.1007
2026-02-21T09:04:21.2861931Z mid=0.1157
2026-02-21T09:04:21.2862227Z max=0.6647
2026-02-21T09:04:21.2862518Z best={'block_sizes': [1],
2026-02-21T09:04:21.2863336Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:04:21.2864681Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:04:21.2865129Z  'load_eviction_policies': ['', '', '', '', '', '', 'first', ''],
2026-02-21T09:04:21.2865496Z  'num_stages': 1,
2026-02-21T09:04:21.2865701Z  'num_warps': 8,
2026-02-21T09:04:21.2865906Z  'pid_type': 'flat',
2026-02-21T09:04:21.2866128Z  'range_flattens': [None],
2026-02-21T09:04:21.2866373Z  'range_multi_buffers': [None],
2026-02-21T09:04:21.2866629Z  'range_num_stages': [0],
2026-02-21T09:04:21.2866864Z  'range_unroll_factors': [0],
2026-02-21T09:04:21.2867124Z  'range_warp_specializes': [],
2026-02-21T09:04:21.2867376Z  'reduction_loops': [None]}
2026-02-21T09:04:21.2893645Z [113s] Fitting surrogate: 273 points, 273 targets
2026-02-21T09:04:22.5205164Z [114s] Generation 3 starting: 74 neighbors, 5 active search path(s)
2026-02-21T09:04:34.7941805Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 9.5 configs/s
2026-02-21T09:04:39.5128891Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 16.7 configs/s
2026-02-21T09:04:53.8331615Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.3 configs/s
2026-02-21T09:04:54.4926611Z [146s] Generation 3 complete: 
2026-02-21T09:04:54.4930425Z error=1
2026-02-21T09:04:54.4930801Z ok=79
2026-02-21T09:04:54.4931105Z min=0.0997
2026-02-21T09:04:54.4931387Z mid=0.1061
2026-02-21T09:04:54.4931670Z max=0.5476
2026-02-21T09:04:54.4931999Z best={'block_sizes': [1],
2026-02-21T09:04:54.4932688Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:04:54.4933635Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:04:54.4934682Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:04:54.4935418Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', '', 'first', ''],
2026-02-21T09:04:54.4936047Z  'maxnreg': 128,
2026-02-21T09:04:54.4936420Z  'num_sm_multiplier': 64,
2026-02-21T09:04:54.4936872Z  'num_stages': 3,
2026-02-21T09:04:54.4937209Z  'num_warps': 4,
2026-02-21T09:04:54.4937427Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:04:54.4937702Z  'range_flattens': [True],
2026-02-21T09:04:54.4937945Z  'range_multi_buffers': [None],
2026-02-21T09:04:54.4938178Z  'range_num_stages': [0],
2026-02-21T09:04:54.4938400Z  'range_unroll_factors': [1],
2026-02-21T09:04:54.4938635Z  'range_warp_specializes': [],
2026-02-21T09:04:54.4938877Z  'reduction_loops': [None]}
2026-02-21T09:04:54.4956044Z [146s] Fitting surrogate: 353 points, 353 targets
2026-02-21T09:04:55.5303268Z [147s] Generation 4 starting: 62 neighbors, 5 active search path(s)
2026-02-21T09:05:04.5086964Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 7.2 configs/s
2026-02-21T09:05:08.1162295Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 17.4 configs/s
2026-02-21T09:05:19.5651403Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 87.9 configs/s
2026-02-21T09:05:20.1458921Z [172s] Generation 4 complete: 
2026-02-21T09:05:20.1459171Z error=3
2026-02-21T09:05:20.1459339Z ok=64
2026-02-21T09:05:20.1459511Z min=0.0999
2026-02-21T09:05:20.1459682Z mid=0.1027
2026-02-21T09:05:20.1459848Z max=0.5475
2026-02-21T09:05:20.1460024Z best={'block_sizes': [1],
2026-02-21T09:05:20.1460422Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:05:20.1461002Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:05:20.1461457Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:05:20.1461867Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', '', 'first', ''],
2026-02-21T09:05:20.1462257Z  'maxnreg': 128,
2026-02-21T09:05:20.1462463Z  'num_sm_multiplier': 64,
2026-02-21T09:05:20.1462697Z  'num_stages': 3,
2026-02-21T09:05:20.1462882Z  'num_warps': 4,
2026-02-21T09:05:20.1463089Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:05:20.1463362Z  'range_flattens': [True],
2026-02-21T09:05:20.1463943Z  'range_multi_buffers': [None],
2026-02-21T09:05:20.1464343Z  'range_num_stages': [1],
2026-02-21T09:05:20.1464560Z  'range_unroll_factors': [1],
2026-02-21T09:05:20.1464805Z  'range_warp_specializes': [],
2026-02-21T09:05:20.1465044Z  'reduction_loops': [None]}
2026-02-21T09:05:20.1490538Z [172s] Fitting surrogate: 420 points, 420 targets
2026-02-21T09:05:21.1641086Z [173s] Generation 5 starting: 60 neighbors, 5 active search path(s)
2026-02-21T09:05:30.9665162Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 8.2 configs/s
2026-02-21T09:05:34.5172109Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 17.1 configs/s
2026-02-21T09:05:45.6306840Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 90.6 configs/s
2026-02-21T09:05:46.1899941Z [198s] Generation 5 complete: 
2026-02-21T09:05:46.1900234Z error=1
2026-02-21T09:05:46.1900403Z ok=64
2026-02-21T09:05:46.1900599Z min=0.1000
2026-02-21T09:05:46.1900793Z mid=0.1024
2026-02-21T09:05:46.1900988Z max=0.5475
2026-02-21T09:05:46.1901172Z best={'block_sizes': [1],
2026-02-21T09:05:46.1901590Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:05:46.1902211Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:05:46.1902831Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:05:46.1903320Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', '', 'first', ''],
2026-02-21T09:05:46.1903725Z  'maxnreg': 128,
2026-02-21T09:05:46.1903937Z  'num_sm_multiplier': 32,
2026-02-21T09:05:46.1904522Z  'num_stages': 3,
2026-02-21T09:05:46.1904725Z  'num_warps': 8,
2026-02-21T09:05:46.1904946Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:05:46.1905245Z  'range_flattens': [True],
2026-02-21T09:05:46.1905494Z  'range_multi_buffers': [None],
2026-02-21T09:05:46.1905746Z  'range_num_stages': [1],
2026-02-21T09:05:46.1905985Z  'range_unroll_factors': [1],
2026-02-21T09:05:46.1906244Z  'range_warp_specializes': [],
2026-02-21T09:05:46.1906499Z  'reduction_loops': [None]}
2026-02-21T09:05:46.1934298Z [198s] Fitting surrogate: 485 points, 485 targets
2026-02-21T09:05:47.2009912Z [199s] Generation 6 starting: 55 neighbors, 5 active search path(s)
2026-02-21T09:05:55.2631950Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 8.1 configs/s
2026-02-21T09:05:58.5449322Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 17.3 configs/s
2026-02-21T09:06:09.8615984Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.9 configs/s
2026-02-21T09:06:10.4329323Z [222s] Generation 6 complete: 
2026-02-21T09:06:10.4329741Z error=1
2026-02-21T09:06:10.4329994Z ok=59
2026-02-21T09:06:10.4330362Z min=0.0997
2026-02-21T09:06:10.4330619Z mid=0.1018
2026-02-21T09:06:10.4330902Z max=0.1606
2026-02-21T09:06:10.4331175Z best={'block_sizes': [1],
2026-02-21T09:06:10.4331791Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:06:10.4332717Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:06:10.4333610Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:06:10.4334715Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', '', 'first', ''],
2026-02-21T09:06:10.4335321Z  'maxnreg': 128,
2026-02-21T09:06:10.4335636Z  'num_sm_multiplier': 32,
2026-02-21T09:06:10.4335963Z  'num_stages': 3,
2026-02-21T09:06:10.4336253Z  'num_warps': 4,
2026-02-21T09:06:10.4336572Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:06:10.4336982Z  'range_flattens': [True],
2026-02-21T09:06:10.4337326Z  'range_multi_buffers': [None],
2026-02-21T09:06:10.4337679Z  'range_num_stages': [0],
2026-02-21T09:06:10.4338016Z  'range_unroll_factors': [1],
2026-02-21T09:06:10.4338379Z  'range_warp_specializes': [],
2026-02-21T09:06:10.4338743Z  'reduction_loops': [None]}
2026-02-21T09:06:10.4363685Z [222s] Fitting surrogate: 545 points, 545 targets
2026-02-21T09:06:11.2315578Z [223s] Generation 7 starting: 45 neighbors, 4 active search path(s)
2026-02-21T09:06:26.4688149Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 0.7 configs/s
2026-02-21T09:06:29.1662546Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 17.7 configs/s
2026-02-21T09:06:38.2996141Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.4         
2026-02-21T09:06:38.3005850Z                                                                   configs/s     
2026-02-21T09:06:38.7173384Z [251s] Generation 7 complete: 
2026-02-21T09:06:38.7173790Z error=3
2026-02-21T09:06:38.7174538Z ok=46
2026-02-21T09:06:38.7174811Z min=0.0996
2026-02-21T09:06:38.7175067Z mid=0.1023
2026-02-21T09:06:38.7175343Z max=5.0939
2026-02-21T09:06:38.7176228Z best={'block_sizes': [1],
2026-02-21T09:06:38.7176880Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:06:38.7177876Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:06:38.7178592Z               'pointer'],
2026-02-21T09:06:38.7179151Z  'load_eviction_policies': ['', '', 'last', 'first', 'last', 'first', 'last', ''],
2026-02-21T09:06:38.7179850Z  'num_stages': 5,
2026-02-21T09:06:38.7180066Z  'num_warps': 16,
2026-02-21T09:06:38.7180251Z  'pid_type': 'flat',
2026-02-21T09:06:38.7180459Z  'range_flattens': [None],
2026-02-21T09:06:38.7180684Z  'range_multi_buffers': [None],
2026-02-21T09:06:38.7180924Z  'range_num_stages': [0],
2026-02-21T09:06:38.7181142Z  'range_unroll_factors': [0],
2026-02-21T09:06:38.7181383Z  'range_warp_specializes': [],
2026-02-21T09:06:38.7181616Z  'reduction_loops': [None]}
2026-02-21T09:06:38.7214171Z [251s] Fitting surrogate: 594 points, 594 targets
2026-02-21T09:06:39.5281484Z [251s] Generation 8 starting: 45 neighbors, 4 active search path(s)
2026-02-21T09:06:46.6728950Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 5.6 configs/s
2026-02-21T09:06:49.4589001Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 17.1 configs/s
2026-02-21T09:06:57.6787299Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 122.2         
2026-02-21T09:06:57.6787798Z                                                                   configs/s     
2026-02-21T09:06:58.1012254Z [270s] Generation 8 complete: 
2026-02-21T09:06:58.1012535Z ok=49
2026-02-21T09:06:58.1012709Z min=0.0996
2026-02-21T09:06:58.1012976Z mid=0.1024
2026-02-21T09:06:58.1013220Z max=0.4167
2026-02-21T09:06:58.1013489Z best={'block_sizes': [1],
2026-02-21T09:06:58.1014312Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:06:58.1015279Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:06:58.1016024Z               'pointer', 'pointer'],
2026-02-21T09:06:58.1016594Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', '', 'first', ''],
2026-02-21T09:06:58.1017888Z  'maxnreg': 128,
2026-02-21T09:06:58.1018199Z  'num_sm_multiplier': 64,
2026-02-21T09:06:58.1018536Z  'num_stages': 3,
2026-02-21T09:06:58.1018818Z  'num_warps': 4,
2026-02-21T09:06:58.1019145Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:06:58.1019555Z  'range_flattens': [True],
2026-02-21T09:06:58.1019899Z  'range_multi_buffers': [None],
2026-02-21T09:06:58.1020284Z  'range_num_stages': [0],
2026-02-21T09:06:58.1020620Z  'range_unroll_factors': [1],
2026-02-21T09:06:58.1020984Z  'range_warp_specializes': [],
2026-02-21T09:06:58.1021335Z  'reduction_loops': [None]}
2026-02-21T09:06:58.1051104Z [270s] Fitting surrogate: 643 points, 643 targets
2026-02-21T09:06:58.8116194Z [271s] Generation 9 starting: 39 neighbors, 3 active search path(s)
2026-02-21T09:07:04.5147770Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 12.8 configs/s
2026-02-21T09:07:06.8912884Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 40/40 17.2 configs/s
2026-02-21T09:07:14.7056511Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.5         
2026-02-21T09:07:14.7057042Z                                                                   configs/s     
2026-02-21T09:07:15.1141426Z [287s] Generation 9 complete: 
2026-02-21T09:07:15.1141704Z ok=42
2026-02-21T09:07:15.1141875Z min=0.0995
2026-02-21T09:07:15.1142036Z mid=0.1034
2026-02-21T09:07:15.1142204Z max=0.1879
2026-02-21T09:07:15.1142376Z best={'block_sizes': [1],
2026-02-21T09:07:15.1142773Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:07:15.1143397Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:07:15.1143846Z               'pointer', 'pointer'],
2026-02-21T09:07:15.1144614Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', '', 'first', ''],
2026-02-21T09:07:15.1145008Z  'maxnreg': 128,
2026-02-21T09:07:15.1161498Z  'num_sm_multiplier': 64,
2026-02-21T09:07:15.1161834Z  'num_stages': 3,
2026-02-21T09:07:15.1162097Z  'num_warps': 4,
2026-02-21T09:07:15.1162371Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:07:15.1162638Z  'range_flattens': [True],
2026-02-21T09:07:15.1162846Z  'range_multi_buffers': [True],
2026-02-21T09:07:15.1163065Z  'range_num_stages': [0],
2026-02-21T09:07:15.1163265Z  'range_unroll_factors': [1],
2026-02-21T09:07:15.1163484Z  'range_warp_specializes': [],
2026-02-21T09:07:15.1163702Z  'reduction_loops': [None]}
2026-02-21T09:07:15.1182167Z [287s] Fitting surrogate: 685 points, 685 targets
2026-02-21T09:07:15.7741976Z [288s] Generation 10 starting: 36 neighbors, 3 active search path(s)
2026-02-21T09:07:21.5921136Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 9.9 configs/s
2026-02-21T09:07:23.7106048Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 38/38 18.4 configs/s
2026-02-21T09:07:29.6083753Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 170.0         
2026-02-21T09:07:29.6084605Z                                                                   configs/s     
2026-02-21T09:07:29.9296527Z [302s] Generation 10 complete: 
2026-02-21T09:07:29.9296826Z error=3
2026-02-21T09:07:29.9296997Z ok=36
2026-02-21T09:07:29.9297171Z min=0.0995
2026-02-21T09:07:29.9297341Z mid=0.1137
2026-02-21T09:07:29.9297516Z max=2.2597
2026-02-21T09:07:29.9297703Z best={'block_sizes': [1],
2026-02-21T09:07:29.9298099Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:07:29.9298685Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:07:29.9299139Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:07:29.9299561Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', '', 'first', ''],
2026-02-21T09:07:29.9299941Z  'maxnreg': 128,
2026-02-21T09:07:29.9300177Z  'num_sm_multiplier': 64,
2026-02-21T09:07:29.9300396Z  'num_stages': 3,
2026-02-21T09:07:29.9300590Z  'num_warps': 4,
2026-02-21T09:07:29.9300805Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:07:29.9301632Z  'range_flattens': [True],
2026-02-21T09:07:29.9301867Z  'range_multi_buffers': [True],
2026-02-21T09:07:29.9302102Z  'range_num_stages': [0],
2026-02-21T09:07:29.9302327Z  'range_unroll_factors': [1],
2026-02-21T09:07:29.9302564Z  'range_warp_specializes': [],
2026-02-21T09:07:29.9302807Z  'reduction_loops': [None]}
2026-02-21T09:07:29.9339981Z [302s] Fitting surrogate: 724 points, 724 targets
2026-02-21T09:07:30.5803203Z [302s] Generation 11 starting: 35 neighbors, 3 active search path(s)
2026-02-21T09:07:36.6179444Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 4.4 configs/s
2026-02-21T09:07:38.8576730Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.8 configs/s
2026-02-21T09:07:45.8060290Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 166.1         
2026-02-21T09:07:45.8060844Z                                                                   configs/s     
2026-02-21T09:07:46.1307165Z [318s] Generation 11 complete: 
2026-02-21T09:07:46.1307540Z ok=38
2026-02-21T09:07:46.1307724Z min=0.0993
2026-02-21T09:07:46.1307913Z mid=0.1042
2026-02-21T09:07:46.1308085Z max=0.4829
2026-02-21T09:07:46.1308288Z best={'block_sizes': [1],
2026-02-21T09:07:46.1308723Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:07:46.1309295Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:07:46.1309784Z  'load_eviction_policies': ['', '', 'last', '', 'first', 'first', 'first', ''],
2026-02-21T09:07:46.1310199Z  'num_stages': 1,
2026-02-21T09:07:46.1310407Z  'num_warps': 16,
2026-02-21T09:07:46.1310609Z  'pid_type': 'flat',
2026-02-21T09:07:46.1310858Z  'range_flattens': [None],
2026-02-21T09:07:46.1311109Z  'range_multi_buffers': [None],
2026-02-21T09:07:46.1311392Z  'range_num_stages': [0],
2026-02-21T09:07:46.1311633Z  'range_unroll_factors': [0],
2026-02-21T09:07:46.1311901Z  'range_warp_specializes': [],
2026-02-21T09:07:46.1312166Z  'reduction_loops': [None]}
2026-02-21T09:07:46.1343407Z [318s] Fitting surrogate: 762 points, 762 targets
2026-02-21T09:07:46.8344865Z [319s] Generation 12 starting: 37 neighbors, 3 active search path(s)
2026-02-21T09:07:54.6529909Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 1.5 configs/s
2026-02-21T09:07:56.7569977Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 38/38 18.5 configs/s
2026-02-21T09:08:03.3516278Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 152.2         
2026-02-21T09:08:03.3516804Z                                                                   configs/s     
2026-02-21T09:08:03.6978235Z [336s] Generation 12 complete: 
2026-02-21T09:08:03.6978729Z error=3
2026-02-21T09:08:03.6979045Z ok=37
2026-02-21T09:08:03.6979407Z min=0.0992
2026-02-21T09:08:03.6979707Z mid=0.1023
2026-02-21T09:08:03.6979882Z max=0.4485
2026-02-21T09:08:03.6980066Z best={'block_sizes': [1],
2026-02-21T09:08:03.6980492Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:08:03.6981056Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:08:03.6981508Z  'load_eviction_policies': ['', '', 'last', '', 'first', 'first', 'first', ''],
2026-02-21T09:08:03.6981897Z  'num_stages': 2,
2026-02-21T09:08:03.6982087Z  'num_warps': 16,
2026-02-21T09:08:03.6982283Z  'pid_type': 'flat',
2026-02-21T09:08:03.6982499Z  'range_flattens': [None],
2026-02-21T09:08:03.6982733Z  'range_multi_buffers': [None],
2026-02-21T09:08:03.6982976Z  'range_num_stages': [0],
2026-02-21T09:08:03.6983193Z  'range_unroll_factors': [0],
2026-02-21T09:08:03.6983435Z  'range_warp_specializes': [],
2026-02-21T09:08:03.6983672Z  'reduction_loops': [None]}
2026-02-21T09:08:03.7021839Z [336s] Fitting surrogate: 802 points, 802 targets
2026-02-21T09:08:04.2488810Z [336s] Generation 13 starting: 27 neighbors, 2 active search path(s)
2026-02-21T09:08:08.7975086Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 3.7 configs/s
2026-02-21T09:08:10.3744883Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 27/27 17.6 configs/s
2026-02-21T09:08:15.7627639Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 186.0         
2026-02-21T09:08:15.7628305Z                                                                   configs/s     
2026-02-21T09:08:16.0611704Z [348s] Generation 13 complete: 
2026-02-21T09:08:16.0612105Z ok=29
2026-02-21T09:08:16.0612370Z min=0.1026
2026-02-21T09:08:16.0612641Z mid=0.1031
2026-02-21T09:08:16.0612883Z max=0.3497
2026-02-21T09:08:16.0613166Z best={'block_sizes': [1],
2026-02-21T09:08:16.0613835Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:08:16.0615929Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:08:16.0616671Z  'load_eviction_policies': ['', '', 'last', '', 'first', 'first', 'first', ''],
2026-02-21T09:08:16.0617485Z  'num_stages': 3,
2026-02-21T09:08:16.0617990Z  'num_warps': 16,
2026-02-21T09:08:16.0618315Z  'pid_type': 'flat',
2026-02-21T09:08:16.0618597Z  'range_flattens': [None],
2026-02-21T09:08:16.0618904Z  'range_multi_buffers': [None],
2026-02-21T09:08:16.0619228Z  'range_num_stages': [0],
2026-02-21T09:08:16.0619523Z  'range_unroll_factors': [0],
2026-02-21T09:08:16.0619856Z  'range_warp_specializes': [],
2026-02-21T09:08:16.0620171Z  'reduction_loops': [None]}
2026-02-21T09:08:16.0656922Z [348s] Fitting surrogate: 831 points, 831 targets
2026-02-21T09:08:16.5132591Z [348s] Generation 14 starting: 19 neighbors, 1 active search path(s)
2026-02-21T09:08:20.1002627Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 5.3 configs/s
2026-02-21T09:08:21.2416446Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 18.3 configs/s
2026-02-21T09:08:23.9183668Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 371.1         
2026-02-21T09:08:23.9184637Z                                                                   configs/s     
2026-02-21T09:08:24.0892728Z [356s] Generation 14 complete: 
2026-02-21T09:08:24.0893030Z error=1
2026-02-21T09:08:24.0893230Z ok=20
2026-02-21T09:08:24.0893419Z min=0.0989
2026-02-21T09:08:24.0893629Z mid=0.1194
2026-02-21T09:08:24.0893820Z max=0.4826
2026-02-21T09:08:24.0894321Z best={'block_sizes': [1],
2026-02-21T09:08:24.0894850Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:08:24.0895526Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:08:24.0896072Z  'load_eviction_policies': ['', '', 'last', '', 'first', 'first', 'first', ''],
2026-02-21T09:08:24.0896534Z  'num_stages': 3,
2026-02-21T09:08:24.0896772Z  'num_warps': 16,
2026-02-21T09:08:24.0896995Z  'pid_type': 'flat',
2026-02-21T09:08:24.0897254Z  'range_flattens': [None],
2026-02-21T09:08:24.0897530Z  'range_multi_buffers': [None],
2026-02-21T09:08:24.0897810Z  'range_num_stages': [0],
2026-02-21T09:08:24.0898082Z  'range_unroll_factors': [0],
2026-02-21T09:08:24.0898372Z  'range_warp_specializes': [],
2026-02-21T09:08:24.0898658Z  'reduction_loops': [None]}
2026-02-21T09:08:24.0936264Z [356s] Fitting surrogate: 852 points, 852 targets
2026-02-21T09:08:24.4775415Z [356s] Generation 15 starting: 16 neighbors, 1 active search path(s)
2026-02-21T09:08:27.0964876Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 5.2 configs/s
2026-02-21T09:08:28.0322814Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 16/16 18.0 configs/s
2026-02-21T09:08:30.8796680Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 349.4         
2026-02-21T09:08:30.8797326Z                                                                   configs/s     
2026-02-21T09:08:31.0609481Z [363s] Generation 15 complete: 
2026-02-21T09:08:31.0609802Z ok=18
2026-02-21T09:08:31.0609993Z min=0.1025
2026-02-21T09:08:31.0610251Z mid=0.1030
2026-02-21T09:08:31.0610447Z max=0.3497
2026-02-21T09:08:31.0610654Z best={'block_sizes': [1],
2026-02-21T09:08:31.0611680Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:08:31.0612398Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:08:31.0612873Z               'pointer'],
2026-02-21T09:08:31.0613275Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'first', ''],
2026-02-21T09:08:31.0613737Z  'maxnreg': 128,
2026-02-21T09:08:31.0614336Z  'num_sm_multiplier': 32,
2026-02-21T09:08:31.0614594Z  'num_stages': 3,
2026-02-21T09:08:31.0614817Z  'num_warps': 4,
2026-02-21T09:08:31.0615072Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:08:31.0615392Z  'range_flattens': [True],
2026-02-21T09:08:31.0615658Z  'range_multi_buffers': [False],
2026-02-21T09:08:31.0616251Z  'range_num_stages': [0],
2026-02-21T09:08:31.0616511Z  'range_unroll_factors': [1],
2026-02-21T09:08:31.0616800Z  'range_warp_specializes': [],
2026-02-21T09:08:31.0617077Z  'reduction_loops': [None]}
2026-02-21T09:08:31.0653740Z [363s] Fitting surrogate: 870 points, 870 targets
2026-02-21T09:08:31.4943473Z [363s] Generation 16 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:08:34.5082001Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 11.5 configs/s
2026-02-21T09:08:35.6576626Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.2 configs/s
2026-02-21T09:08:39.1022862Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 289.4         
2026-02-21T09:08:39.1023600Z                                                                   configs/s     
2026-02-21T09:08:39.3080263Z [371s] Generation 16 complete: 
2026-02-21T09:08:39.3080600Z ok=20
2026-02-21T09:08:39.3080817Z min=0.1002
2026-02-21T09:08:39.3081023Z mid=0.1012
2026-02-21T09:08:39.3081265Z max=0.1879
2026-02-21T09:08:39.3081496Z best={'block_sizes': [1],
2026-02-21T09:08:39.3082040Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:08:39.3082812Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:08:39.3083351Z               'pointer'],
2026-02-21T09:08:39.3083868Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', 'first', ''],
2026-02-21T09:08:39.3084470Z  'maxnreg': 128,
2026-02-21T09:08:39.3084710Z  'num_sm_multiplier': 32,
2026-02-21T09:08:39.3084961Z  'num_stages': 2,
2026-02-21T09:08:39.3085183Z  'num_warps': 8,
2026-02-21T09:08:39.3085430Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:08:39.3085749Z  'range_flattens': [True],
2026-02-21T09:08:39.3086015Z  'range_multi_buffers': [False],
2026-02-21T09:08:39.3086300Z  'range_num_stages': [1],
2026-02-21T09:08:39.3086557Z  'range_unroll_factors': [1],
2026-02-21T09:08:39.3086847Z  'range_warp_specializes': [],
2026-02-21T09:08:39.3087127Z  'reduction_loops': [None]}
2026-02-21T09:08:39.3126109Z [371s] Fitting surrogate: 890 points, 890 targets
2026-02-21T09:08:39.7352481Z [372s] Generation 17 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:08:42.6087200Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 17.7 configs/s
2026-02-21T09:08:43.6416852Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 18.3 configs/s
2026-02-21T09:08:46.4796911Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 350.7         
2026-02-21T09:08:46.4797580Z                                                                   configs/s     
2026-02-21T09:08:46.6603253Z [379s] Generation 17 complete: 
2026-02-21T09:08:46.6603562Z error=1
2026-02-21T09:08:46.6603768Z ok=18
2026-02-21T09:08:46.6603960Z min=0.1026
2026-02-21T09:08:46.6604512Z mid=0.1031
2026-02-21T09:08:46.6604706Z max=0.1632
2026-02-21T09:08:46.6604944Z best={'block_sizes': [1],
2026-02-21T09:08:46.6605969Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:08:46.6606718Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:08:46.6607225Z               'pointer'],
2026-02-21T09:08:46.6607626Z  'load_eviction_policies': ['', 'last', '', '', 'first', 'first', 'first', ''],
2026-02-21T09:08:46.6608081Z  'num_stages': 2,
2026-02-21T09:08:46.6608303Z  'num_warps': 16,
2026-02-21T09:08:46.6608541Z  'pid_type': 'flat',
2026-02-21T09:08:46.6608781Z  'range_flattens': [None],
2026-02-21T09:08:46.6609055Z  'range_multi_buffers': [None],
2026-02-21T09:08:46.6609333Z  'range_num_stages': [0],
2026-02-21T09:08:46.6609601Z  'range_unroll_factors': [0],
2026-02-21T09:08:46.6609887Z  'range_warp_specializes': [],
2026-02-21T09:08:46.6610223Z  'reduction_loops': [None]}
2026-02-21T09:08:46.6650801Z [379s] Fitting surrogate: 909 points, 909 targets
2026-02-21T09:08:46.9599895Z [379s] Generation 18 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:08:49.0231921Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 9.0 configs/s
2026-02-21T09:08:49.6244828Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 20.1 configs/s
2026-02-21T09:08:51.1271477Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 653.0         
2026-02-21T09:08:51.1272221Z                                                                   configs/s     
2026-02-21T09:08:51.2442577Z [383s] Generation 18 complete: 
2026-02-21T09:08:51.2442854Z error=1
2026-02-21T09:08:51.2443039Z ok=11
2026-02-21T09:08:51.2443215Z min=0.0998
2026-02-21T09:08:51.2443402Z mid=0.1024
2026-02-21T09:08:51.2443573Z max=0.1877
2026-02-21T09:08:51.2443768Z best={'block_sizes': [1],
2026-02-21T09:08:51.2444573Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:08:51.2445278Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:08:51.2445738Z               'pointer'],
2026-02-21T09:08:51.2446104Z  'load_eviction_policies': ['', 'last', '', '', 'first', 'first', 'first', ''],
2026-02-21T09:08:51.2446519Z  'num_stages': 2,
2026-02-21T09:08:51.2446737Z  'num_warps': 16,
2026-02-21T09:08:51.2446943Z  'pid_type': 'flat',
2026-02-21T09:08:51.2447163Z  'range_flattens': [None],
2026-02-21T09:08:51.2447413Z  'range_multi_buffers': [None],
2026-02-21T09:08:51.2447664Z  'range_num_stages': [0],
2026-02-21T09:08:51.2447907Z  'range_unroll_factors': [0],
2026-02-21T09:08:51.2448169Z  'range_warp_specializes': [],
2026-02-21T09:08:51.2448423Z  'reduction_loops': [None]}
2026-02-21T09:08:51.2495187Z [383s] Fitting surrogate: 921 points, 921 targets
2026-02-21T09:08:52.5632221Z [384s] Generation 19 starting: 17 neighbors, 1 active search path(s)
2026-02-21T09:08:55.1299489Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 21.0 configs/s
2026-02-21T09:08:56.1400546Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 17.6 configs/s
2026-02-21T09:08:59.6000447Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 288.3         
2026-02-21T09:08:59.6001047Z                                                                   configs/s     
2026-02-21T09:08:59.8090955Z [392s] Generation 19 complete: 
2026-02-21T09:08:59.8091259Z ok=19
2026-02-21T09:08:59.8091447Z min=0.1028
2026-02-21T09:08:59.8091641Z mid=0.1033
2026-02-21T09:08:59.8091826Z max=0.1663
2026-02-21T09:08:59.8092026Z best={'block_sizes': [1],
2026-02-21T09:08:59.8092501Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:08:59.8093163Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:08:59.8093603Z               'pointer'],
2026-02-21T09:08:59.8093965Z  'load_eviction_policies': ['', 'last', '', '', 'first', 'first', 'first', ''],
2026-02-21T09:08:59.8094550Z  'maxnreg': 128,
2026-02-21T09:08:59.8094762Z  'num_sm_multiplier': 32,
2026-02-21T09:08:59.8095526Z  'num_stages': 3,
2026-02-21T09:08:59.8095738Z  'num_warps': 4,
2026-02-21T09:08:59.8095973Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:08:59.8096267Z  'range_flattens': [True],
2026-02-21T09:08:59.8096535Z  'range_multi_buffers': [True],
2026-02-21T09:08:59.8096799Z  'range_num_stages': [1],
2026-02-21T09:08:59.8097036Z  'range_unroll_factors': [1],
2026-02-21T09:08:59.8097300Z  'range_warp_specializes': [],
2026-02-21T09:08:59.8097614Z  'reduction_loops': [None]}
2026-02-21T09:08:59.8137412Z [392s] Fitting surrogate: 940 points, 940 targets
2026-02-21T09:09:00.1940853Z [392s] Generation 20 starting: 16 neighbors, 1 active search path(s)
2026-02-21T09:09:06.1367866Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 0.9 configs/s
2026-02-21T09:09:07.1027567Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 18.5 configs/s
2026-02-21T09:09:09.7868778Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 370.0         
2026-02-21T09:09:09.7869328Z                                                                   configs/s     
2026-02-21T09:09:09.9569702Z [402s] Generation 20 complete: 
2026-02-21T09:09:09.9570013Z error=1
2026-02-21T09:09:09.9570283Z ok=17
2026-02-21T09:09:09.9570463Z min=0.1026
2026-02-21T09:09:09.9570638Z mid=0.1033
2026-02-21T09:09:09.9570808Z max=0.3521
2026-02-21T09:09:09.9570992Z best={'block_sizes': [1],
2026-02-21T09:09:09.9571454Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:09:09.9572098Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:09:09.9572522Z               'pointer'],
2026-02-21T09:09:09.9572874Z  'load_eviction_policies': ['', 'last', '', '', 'first', 'first', 'first', ''],
2026-02-21T09:09:09.9573279Z  'num_stages': 3,
2026-02-21T09:09:09.9573479Z  'num_warps': 16,
2026-02-21T09:09:09.9573672Z  'pid_type': 'flat',
2026-02-21T09:09:09.9573893Z  'range_flattens': [None],
2026-02-21T09:09:09.9574502Z  'range_multi_buffers': [None],
2026-02-21T09:09:09.9574825Z  'range_num_stages': [0],
2026-02-21T09:09:09.9575126Z  'range_unroll_factors': [0],
2026-02-21T09:09:09.9575416Z  'range_warp_specializes': [],
2026-02-21T09:09:09.9575706Z  'reduction_loops': [None]}
2026-02-21T09:09:09.9618537Z [402s] Fitting surrogate: 958 points, 958 targets
2026-02-21T09:09:10.1285887Z [402s] Autotuning complete in 402.5s after searching 917 configs.
2026-02-21T09:09:10.1286364Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:09:10.1288409Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'last', '', '', 'first', 'first', 'first', ''], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:09:10.1290459Z 
2026-02-21T09:09:10.1290867Z [402s] Code of selected kernel: /tmp/torchinductor_root/qj/cqjmqy5eg6pnkiy7xnjivhesbictmypco7li5sptscipuvsz5i3w.py
2026-02-21T09:09:11.3561031Z WARNING:tritonbench.utils.triton_op:Completed input ID 15:
2026-02-21T09:09:11.3561368Z (M, N)
2026-02-21T09:09:11.3561534Z ------------
2026-02-21T09:09:11.3561699Z (4096, 8704)
2026-02-21T09:09:11.3561841Z 
2026-02-21T09:09:11.3582168Z  55%|█████▌    | 11/20 [50:43<42:36, 284.08s/it]WARNING:tritonbench.utils.triton_op:Running input ID 17:
2026-02-21T09:09:11.3582637Z (M, N)
2026-02-21T09:09:11.3582809Z ------------
2026-02-21T09:09:11.3582983Z (4096, 9728)
2026-02-21T09:09:11.3585296Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:09:12.6886430Z INFO:tritonbench.utils.triton_op:Took 3.23ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:09:16.7611740Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:09:18.2082053Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:09:18.2082589Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:09:18.2083009Z               'dtype': 'torch.float32',
2026-02-21T09:09:18.2083434Z               'shape': (4096, 9728),
2026-02-21T09:09:18.2083817Z               'stride': (9728, 1)},
2026-02-21T09:09:18.2084534Z             (9728,),
2026-02-21T09:09:18.2084847Z             { 'device': 'cuda:0',
2026-02-21T09:09:18.2085215Z               'dtype': 'torch.float32',
2026-02-21T09:09:18.2085641Z               'shape': (9728,),
2026-02-21T09:09:18.2085995Z               'stride': (1,)},
2026-02-21T09:09:18.2086341Z             { 'device': 'cuda:0',
2026-02-21T09:09:18.2086700Z               'dtype': 'torch.float32',
2026-02-21T09:09:18.2087088Z               'shape': (9728,),
2026-02-21T09:09:18.2087421Z               'stride': (1,)},
2026-02-21T09:09:18.2087765Z             1e-05),
2026-02-21T09:09:18.2088055Z   'kwargs': {}}
2026-02-21T09:09:18.2219269Z INFO:tritonbench.utils.triton_op:Took 14.14ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:09:18.2314504Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:09:18.2315334Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:09:18.2315908Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:09:18.2316247Z While processing:
2026-02-21T09:09:18.2316647Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:09:18.2317036Z     if bias is not None:
2026-02-21T09:09:18.2317231Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:09:18.2317356Z 
2026-02-21T09:09:18.3999831Z [0s] Autotune random seed: 2135381352
2026-02-21T09:09:18.7290836Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:09:54.9276135Z [36s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:09:56.7650911Z [38s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:09:56.7673376Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T09:10:03.1677003Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.7 configs/s
2026-02-21T09:10:03.1689769Z [44s] Adaptive compile timeout: 30s (90% percentile=10.9s, bounds=[30.0s, 30s])
2026-02-21T09:10:04.3366469Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 822.7 configs/s
2026-02-21T09:10:04.4407871Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T09:10:04.4408479Z error=12
2026-02-21T09:10:04.4408756Z timeout=2
2026-02-21T09:10:04.4409027Z ok=86
2026-02-21T09:10:04.4409285Z min=0.1293
2026-02-21T09:10:04.4409556Z mid=0.4441
2026-02-21T09:10:04.4410534Z max=40.7282
2026-02-21T09:10:04.4410900Z best={'block_sizes': [1],
2026-02-21T09:10:04.4411616Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:10:04.4412623Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:10:04.4413387Z               'pointer'],
2026-02-21T09:10:04.4413755Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:10:04.4414410Z  'num_stages': 6,
2026-02-21T09:10:04.4414586Z  'num_warps': 16,
2026-02-21T09:10:04.4414767Z  'pid_type': 'flat',
2026-02-21T09:10:04.4414958Z  'range_flattens': [None],
2026-02-21T09:10:04.4415164Z  'range_multi_buffers': [None],
2026-02-21T09:10:04.4415383Z  'range_num_stages': [0],
2026-02-21T09:10:04.4415582Z  'range_unroll_factors': [0],
2026-02-21T09:10:04.4415807Z  'range_warp_specializes': [],
2026-02-21T09:10:04.4416021Z  'reduction_loops': [8192]}
2026-02-21T09:10:04.4431225Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:10:05.8594654Z [47s] Generation 1 starting: 84 neighbors, 5 active search path(s)
2026-02-21T09:10:43.0256506Z [84s] Timeout after 30s compiling Config(block_sizes=[8], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last', 'last', 'last', '', 'first', '', 'first'], maxnreg=256, num_sm_multiplier=8, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T09:10:43.0277708Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 0.4 configs/s
2026-02-21T09:10:48.5235301Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 16.3 configs/s
2026-02-21T09:10:57.7433150Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.9         
2026-02-21T09:10:57.7435896Z                                                                   configs/s     
2026-02-21T09:10:58.1685136Z [99s] Generation 1 complete: 
2026-02-21T09:10:58.1685447Z timeout=1
2026-02-21T09:10:58.1685629Z ok=89
2026-02-21T09:10:58.1685796Z min=0.1107
2026-02-21T09:10:58.1685976Z mid=0.1853
2026-02-21T09:10:58.1686147Z max=1.9583
2026-02-21T09:10:58.1686334Z best={'block_sizes': [1],
2026-02-21T09:10:58.1686785Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:10:58.1687397Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:10:58.1687819Z               'pointer'],
2026-02-21T09:10:58.1688203Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', 'first'],
2026-02-21T09:10:58.1688611Z  'num_stages': 6,
2026-02-21T09:10:58.1688804Z  'num_warps': 16,
2026-02-21T09:10:58.1689019Z  'pid_type': 'flat',
2026-02-21T09:10:58.1689246Z  'range_flattens': [None],
2026-02-21T09:10:58.1689492Z  'range_multi_buffers': [None],
2026-02-21T09:10:58.1689732Z  'range_num_stages': [0],
2026-02-21T09:10:58.1689967Z  'range_unroll_factors': [0],
2026-02-21T09:10:58.1690710Z  'range_warp_specializes': [],
2026-02-21T09:10:58.1690957Z  'reduction_loops': [None]}
2026-02-21T09:10:58.1712224Z [99s] Fitting surrogate: 190 points, 190 targets
2026-02-21T09:10:59.2719457Z [100s] Generation 2 starting: 65 neighbors, 5 active search path(s)
2026-02-21T09:11:11.3968765Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69/69 8.5 configs/s
2026-02-21T09:11:15.5293537Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 69/69 16.9 configs/s
2026-02-21T09:11:25.7335655Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.5 configs/s
2026-02-21T09:11:26.2226922Z [127s] Generation 2 complete: 
2026-02-21T09:11:26.2227184Z error=2
2026-02-21T09:11:26.2227349Z ok=68
2026-02-21T09:11:26.2227517Z min=0.1104
2026-02-21T09:11:26.2228227Z mid=0.1279
2026-02-21T09:11:26.2228400Z max=0.8772
2026-02-21T09:11:26.2228582Z best={'block_sizes': [1],
2026-02-21T09:11:26.2229013Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:11:26.2229646Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:11:26.2230162Z               'pointer'],
2026-02-21T09:11:26.2230615Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', 'last', 'first'],
2026-02-21T09:11:26.2231067Z  'num_stages': 6,
2026-02-21T09:11:26.2231270Z  'num_warps': 16,
2026-02-21T09:11:26.2231480Z  'pid_type': 'flat',
2026-02-21T09:11:26.2231700Z  'range_flattens': [None],
2026-02-21T09:11:26.2231954Z  'range_multi_buffers': [None],
2026-02-21T09:11:26.2232207Z  'range_num_stages': [0],
2026-02-21T09:11:26.2232448Z  'range_unroll_factors': [0],
2026-02-21T09:11:26.2232698Z  'range_warp_specializes': [],
2026-02-21T09:11:26.2232960Z  'reduction_loops': [None]}
2026-02-21T09:11:26.2252654Z [127s] Fitting surrogate: 260 points, 260 targets
2026-02-21T09:11:27.0398304Z [128s] Generation 3 starting: 46 neighbors, 5 active search path(s)
2026-02-21T09:11:35.3573601Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 6.5 configs/s
2026-02-21T09:11:38.2136875Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 17.4 configs/s
2026-02-21T09:11:46.8424887Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.4         
2026-02-21T09:11:46.8425456Z                                                                   configs/s     
2026-02-21T09:11:47.2642788Z [148s] Generation 3 complete: 
2026-02-21T09:11:47.2643084Z error=2
2026-02-21T09:11:47.2643268Z ok=49
2026-02-21T09:11:47.2643440Z min=0.1106
2026-02-21T09:11:47.2643612Z mid=0.1229
2026-02-21T09:11:47.2643778Z max=0.4783
2026-02-21T09:11:47.2643961Z best={'block_sizes': [1],
2026-02-21T09:11:47.2644911Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:11:47.2645537Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:11:47.2645951Z               'pointer'],
2026-02-21T09:11:47.2647143Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', 'first', 'first'],
2026-02-21T09:11:47.2647564Z  'num_stages': 6,
2026-02-21T09:11:47.2647762Z  'num_warps': 16,
2026-02-21T09:11:47.2647952Z  'pid_type': 'flat',
2026-02-21T09:11:47.2648166Z  'range_flattens': [None],
2026-02-21T09:11:47.2648395Z  'range_multi_buffers': [None],
2026-02-21T09:11:47.2648635Z  'range_num_stages': [0],
2026-02-21T09:11:47.2648856Z  'range_unroll_factors': [0],
2026-02-21T09:11:47.2649100Z  'range_warp_specializes': [],
2026-02-21T09:11:47.2649338Z  'reduction_loops': [None]}
2026-02-21T09:11:47.2667836Z [148s] Fitting surrogate: 311 points, 311 targets
2026-02-21T09:11:48.0891283Z [149s] Generation 4 starting: 48 neighbors, 5 active search path(s)
2026-02-21T09:11:55.6497821Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 12.7 configs/s
2026-02-21T09:11:58.5890229Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.9 configs/s
2026-02-21T09:12:08.5038687Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 111.4         
2026-02-21T09:12:08.5040673Z                                                                   configs/s     
2026-02-21T09:12:08.9448168Z [170s] Generation 4 complete: 
2026-02-21T09:12:08.9448443Z ok=53
2026-02-21T09:12:08.9448622Z min=0.1106
2026-02-21T09:12:08.9448803Z mid=0.1133
2026-02-21T09:12:08.9448966Z max=0.6777
2026-02-21T09:12:08.9449158Z best={'block_sizes': [1],
2026-02-21T09:12:08.9449610Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:12:08.9450366Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:12:08.9450816Z               'pointer'],
2026-02-21T09:12:08.9451198Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', 'first', 'first'],
2026-02-21T09:12:08.9451610Z  'num_stages': 6,
2026-02-21T09:12:08.9451811Z  'num_warps': 16,
2026-02-21T09:12:08.9452034Z  'pid_type': 'flat',
2026-02-21T09:12:08.9452253Z  'range_flattens': [None],
2026-02-21T09:12:08.9452489Z  'range_multi_buffers': [None],
2026-02-21T09:12:08.9452727Z  'range_num_stages': [0],
2026-02-21T09:12:08.9452956Z  'range_unroll_factors': [0],
2026-02-21T09:12:08.9453198Z  'range_warp_specializes': [],
2026-02-21T09:12:08.9453443Z  'reduction_loops': [None]}
2026-02-21T09:12:08.9476048Z [170s] Fitting surrogate: 364 points, 364 targets
2026-02-21T09:12:09.7547783Z [171s] Generation 5 starting: 47 neighbors, 5 active search path(s)
2026-02-21T09:12:17.6935122Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 4.6 configs/s
2026-02-21T09:12:20.5713206Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 17.7 configs/s
2026-02-21T09:12:30.6558223Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 99.6 configs/s
2026-02-21T09:12:31.1391022Z [192s] Generation 5 complete: 
2026-02-21T09:12:31.1391282Z error=2
2026-02-21T09:12:31.1391554Z ok=50
2026-02-21T09:12:31.1391769Z min=0.1110
2026-02-21T09:12:31.1392022Z mid=0.1196
2026-02-21T09:12:31.1392200Z max=0.5780
2026-02-21T09:12:31.1392403Z best={'block_sizes': [1],
2026-02-21T09:12:31.1392839Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:12:31.1393462Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:12:31.1393926Z               'pointer'],
2026-02-21T09:12:31.1394613Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'last'],
2026-02-21T09:12:31.1394994Z  'num_stages': 1,
2026-02-21T09:12:31.1395207Z  'num_warps': 16,
2026-02-21T09:12:31.1395397Z  'pid_type': 'flat',
2026-02-21T09:12:31.1395603Z  'range_flattens': [None],
2026-02-21T09:12:31.1395829Z  'range_multi_buffers': [None],
2026-02-21T09:12:31.1396080Z  'range_num_stages': [0],
2026-02-21T09:12:31.1396300Z  'range_unroll_factors': [0],
2026-02-21T09:12:31.1396540Z  'range_warp_specializes': [],
2026-02-21T09:12:31.1397157Z  'reduction_loops': [None]}
2026-02-21T09:12:31.1422240Z [192s] Fitting surrogate: 416 points, 416 targets
2026-02-21T09:12:31.7979571Z [193s] Generation 6 starting: 36 neighbors, 4 active search path(s)
2026-02-21T09:12:37.4944464Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 18.8 configs/s
2026-02-21T09:12:39.5856399Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 18.1 configs/s
2026-02-21T09:12:47.4221171Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.0         
2026-02-21T09:12:47.4221671Z                                                                   configs/s     
2026-02-21T09:12:47.8047496Z [209s] Generation 6 complete: 
2026-02-21T09:12:47.8047926Z error=2
2026-02-21T09:12:47.8048190Z ok=38
2026-02-21T09:12:47.8048439Z min=0.1110
2026-02-21T09:12:47.8049265Z mid=0.1169
2026-02-21T09:12:47.8049535Z max=0.1898
2026-02-21T09:12:47.8049923Z best={'block_sizes': [1],
2026-02-21T09:12:47.8050599Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:12:47.8051604Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:12:47.8052280Z               'pointer'],
2026-02-21T09:12:47.8052807Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'first', 'first'],
2026-02-21T09:12:47.8053391Z  'num_stages': 6,
2026-02-21T09:12:47.8053685Z  'num_warps': 16,
2026-02-21T09:12:47.8054175Z  'pid_type': 'flat',
2026-02-21T09:12:47.8054529Z  'range_flattens': [None],
2026-02-21T09:12:47.8054877Z  'range_multi_buffers': [None],
2026-02-21T09:12:47.8055246Z  'range_num_stages': [0],
2026-02-21T09:12:47.8055581Z  'range_unroll_factors': [0],
2026-02-21T09:12:47.8055946Z  'range_warp_specializes': [],
2026-02-21T09:12:47.8056385Z  'reduction_loops': [None]}
2026-02-21T09:12:47.8084998Z [209s] Fitting surrogate: 456 points, 456 targets
2026-02-21T09:12:48.4722978Z [209s] Generation 7 starting: 36 neighbors, 4 active search path(s)
2026-02-21T09:12:54.7528013Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 2.9 configs/s
2026-02-21T09:12:56.9492435Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.2 configs/s
2026-02-21T09:13:04.4827287Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 133.2         
2026-02-21T09:13:04.4827788Z                                                                   configs/s     
2026-02-21T09:13:04.8555083Z [226s] Generation 7 complete: 
2026-02-21T09:13:04.8555361Z error=1
2026-02-21T09:13:04.8555549Z ok=39
2026-02-21T09:13:04.8555724Z min=0.1105
2026-02-21T09:13:04.8568588Z mid=0.1160
2026-02-21T09:13:04.8568810Z max=0.2167
2026-02-21T09:13:04.8568991Z best={'block_sizes': [1],
2026-02-21T09:13:04.8569410Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:04.8570057Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:04.8570452Z               'pointer'],
2026-02-21T09:13:04.8570743Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', 'first'],
2026-02-21T09:13:04.8571084Z  'num_stages': 6,
2026-02-21T09:13:04.8571246Z  'num_warps': 16,
2026-02-21T09:13:04.8571420Z  'pid_type': 'flat',
2026-02-21T09:13:04.8571597Z  'range_flattens': [None],
2026-02-21T09:13:04.8571796Z  'range_multi_buffers': [None],
2026-02-21T09:13:04.8572040Z  'range_num_stages': [0],
2026-02-21T09:13:04.8572268Z  'range_unroll_factors': [0],
2026-02-21T09:13:04.8572476Z  'range_warp_specializes': [],
2026-02-21T09:13:04.8572675Z  'reduction_loops': [None]}
2026-02-21T09:13:04.8587051Z [226s] Fitting surrogate: 496 points, 496 targets
2026-02-21T09:13:05.3992048Z [226s] Generation 8 starting: 28 neighbors, 3 active search path(s)
2026-02-21T09:13:10.1650188Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 7.2 configs/s
2026-02-21T09:13:11.8888490Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 29/29 17.3 configs/s
2026-02-21T09:13:19.1515145Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 158.0         
2026-02-21T09:13:19.1515691Z                                                                   configs/s     
2026-02-21T09:13:19.4674450Z [240s] Generation 8 complete: 
2026-02-21T09:13:19.4674746Z ok=31
2026-02-21T09:13:19.4674938Z min=0.1136
2026-02-21T09:13:19.4675117Z mid=0.1174
2026-02-21T09:13:19.4675294Z max=0.3085
2026-02-21T09:13:19.4675480Z best={'block_sizes': [1],
2026-02-21T09:13:19.4675918Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:19.4676547Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:13:19.4676966Z               'pointer'],
2026-02-21T09:13:19.4677744Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', 'first'],
2026-02-21T09:13:19.4678161Z  'num_stages': 6,
2026-02-21T09:13:19.4678388Z  'num_warps': 16,
2026-02-21T09:13:19.4678617Z  'pid_type': 'flat',
2026-02-21T09:13:19.4678879Z  'range_flattens': [None],
2026-02-21T09:13:19.4679100Z  'range_multi_buffers': [None],
2026-02-21T09:13:19.4679320Z  'range_num_stages': [0],
2026-02-21T09:13:19.4679534Z  'range_unroll_factors': [0],
2026-02-21T09:13:19.4679756Z  'range_warp_specializes': [],
2026-02-21T09:13:19.4679982Z  'reduction_loops': [None]}
2026-02-21T09:13:19.4712642Z [240s] Fitting surrogate: 527 points, 527 targets
2026-02-21T09:13:19.7743794Z [241s] Generation 9 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:13:22.1827642Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 7.3 configs/s
2026-02-21T09:13:22.9292635Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 12/12 17.1 configs/s
2026-02-21T09:13:25.0583013Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 462.8         
2026-02-21T09:13:25.0583511Z                                                                   configs/s     
2026-02-21T09:13:25.1980566Z [246s] Generation 9 complete: 
2026-02-21T09:13:25.1980814Z ok=13
2026-02-21T09:13:25.1980985Z min=0.1108
2026-02-21T09:13:25.1981143Z mid=0.1354
2026-02-21T09:13:25.1981287Z max=0.6728
2026-02-21T09:13:25.1981451Z best={'block_sizes': [1],
2026-02-21T09:13:25.1981827Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:25.1982403Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:13:25.1982822Z               'pointer'],
2026-02-21T09:13:25.1983168Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', 'first'],
2026-02-21T09:13:25.1983560Z  'num_stages': 6,
2026-02-21T09:13:25.1983744Z  'num_warps': 16,
2026-02-21T09:13:25.1983942Z  'pid_type': 'flat',
2026-02-21T09:13:25.1984396Z  'range_flattens': [None],
2026-02-21T09:13:25.1984634Z  'range_multi_buffers': [None],
2026-02-21T09:13:25.1984868Z  'range_num_stages': [0],
2026-02-21T09:13:25.1985093Z  'range_unroll_factors': [0],
2026-02-21T09:13:25.1985335Z  'range_warp_specializes': [],
2026-02-21T09:13:25.1985578Z  'reduction_loops': [None]}
2026-02-21T09:13:25.2011969Z [246s] Fitting surrogate: 540 points, 540 targets
2026-02-21T09:13:25.4835076Z [246s] Generation 10 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:13:28.3717000Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 3.7 configs/s
2026-02-21T09:13:28.9391178Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 19.4 configs/s
2026-02-21T09:13:30.4142490Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 660.8         
2026-02-21T09:13:30.4142967Z                                                                   configs/s     
2026-02-21T09:13:30.5286148Z [251s] Generation 10 complete: 
2026-02-21T09:13:30.5286428Z error=1
2026-02-21T09:13:30.5286618Z ok=10
2026-02-21T09:13:30.5286787Z min=0.1110
2026-02-21T09:13:30.5286952Z mid=0.1410
2026-02-21T09:13:30.5287124Z max=1.2958
2026-02-21T09:13:30.5287301Z best={'block_sizes': [1],
2026-02-21T09:13:30.5288052Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:30.5288673Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:13:30.5289103Z               'pointer'],
2026-02-21T09:13:30.5289442Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', 'first'],
2026-02-21T09:13:30.5289909Z  'num_stages': 6,
2026-02-21T09:13:30.5290105Z  'num_warps': 16,
2026-02-21T09:13:30.5290291Z  'pid_type': 'flat',
2026-02-21T09:13:30.5290501Z  'range_flattens': [None],
2026-02-21T09:13:30.5290729Z  'range_multi_buffers': [None],
2026-02-21T09:13:30.5290971Z  'range_num_stages': [0],
2026-02-21T09:13:30.5291190Z  'range_unroll_factors': [0],
2026-02-21T09:13:30.5291704Z  'range_warp_specializes': [],
2026-02-21T09:13:30.5291950Z  'reduction_loops': [None]}
2026-02-21T09:13:30.5322317Z [251s] Fitting surrogate: 551 points, 551 targets
2026-02-21T09:13:30.8215163Z [252s] Generation 11 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:13:34.9439203Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.1 configs/s
2026-02-21T09:13:35.5594381Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 19.5 configs/s
2026-02-21T09:13:36.9534291Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 699.6         
2026-02-21T09:13:36.9534762Z                                                                   configs/s     
2026-02-21T09:13:37.0649334Z [258s] Generation 11 complete: 
2026-02-21T09:13:37.0649612Z error=1
2026-02-21T09:13:37.0649912Z ok=11
2026-02-21T09:13:37.0650087Z min=0.1107
2026-02-21T09:13:37.0650271Z mid=0.1261
2026-02-21T09:13:37.0650440Z max=0.6481
2026-02-21T09:13:37.0650636Z best={'block_sizes': [1],
2026-02-21T09:13:37.0651115Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:37.0651756Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:13:37.0652192Z               'pointer'],
2026-02-21T09:13:37.0652552Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', 'first'],
2026-02-21T09:13:37.0652953Z  'num_stages': 6,
2026-02-21T09:13:37.0653148Z  'num_warps': 16,
2026-02-21T09:13:37.0653345Z  'pid_type': 'flat',
2026-02-21T09:13:37.0653556Z  'range_flattens': [None],
2026-02-21T09:13:37.0653797Z  'range_multi_buffers': [None],
2026-02-21T09:13:37.0654344Z  'range_num_stages': [0],
2026-02-21T09:13:37.0654600Z  'range_unroll_factors': [0],
2026-02-21T09:13:37.0654846Z  'range_warp_specializes': [],
2026-02-21T09:13:37.0655093Z  'reduction_loops': [None]}
2026-02-21T09:13:37.0686708Z [258s] Fitting surrogate: 563 points, 563 targets
2026-02-21T09:13:37.3490570Z [258s] Generation 12 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:13:41.0924397Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 3.0 configs/s
2026-02-21T09:13:41.6511269Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 21.9 configs/s
2026-02-21T09:13:43.0343931Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 705.4         
2026-02-21T09:13:43.0344740Z                                                                   configs/s     
2026-02-21T09:13:43.1459974Z [264s] Generation 12 complete: 
2026-02-21T09:13:43.1460241Z error=2
2026-02-21T09:13:43.1460417Z ok=10
2026-02-21T09:13:43.1460597Z min=0.1108
2026-02-21T09:13:43.1460778Z mid=0.1182
2026-02-21T09:13:43.1460970Z max=1.1221
2026-02-21T09:13:43.1461166Z best={'block_sizes': [1],
2026-02-21T09:13:43.1461627Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:43.1462831Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:13:43.1463284Z               'pointer'],
2026-02-21T09:13:43.1463672Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', 'first'],
2026-02-21T09:13:43.1464384Z  'num_stages': 6,
2026-02-21T09:13:43.1464597Z  'num_warps': 16,
2026-02-21T09:13:43.1464801Z  'pid_type': 'flat',
2026-02-21T09:13:43.1465023Z  'range_flattens': [None],
2026-02-21T09:13:43.1465272Z  'range_multi_buffers': [None],
2026-02-21T09:13:43.1465524Z  'range_num_stages': [0],
2026-02-21T09:13:43.1465767Z  'range_unroll_factors': [0],
2026-02-21T09:13:43.1466007Z  'range_warp_specializes': [],
2026-02-21T09:13:43.1466247Z  'reduction_loops': [None]}
2026-02-21T09:13:43.1495426Z [264s] Fitting surrogate: 575 points, 575 targets
2026-02-21T09:13:43.4311985Z [264s] Generation 13 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:13:45.1668057Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 4.9 configs/s
2026-02-21T09:13:45.7052899Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 20.6 configs/s
2026-02-21T09:13:47.7153493Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 490.7         
2026-02-21T09:13:47.7154403Z                                                                   configs/s     
2026-02-21T09:13:47.8549595Z [269s] Generation 13 complete: 
2026-02-21T09:13:47.8549882Z error=1
2026-02-21T09:13:47.8550054Z ok=11
2026-02-21T09:13:47.8550233Z min=0.1139
2026-02-21T09:13:47.8550407Z mid=0.1146
2026-02-21T09:13:47.8550576Z max=0.1895
2026-02-21T09:13:47.8550761Z best={'block_sizes': [1],
2026-02-21T09:13:47.8551219Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:13:47.8551853Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:13:47.8552296Z               'pointer'],
2026-02-21T09:13:47.8552656Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', 'first'],
2026-02-21T09:13:47.8553060Z  'num_stages': 6,
2026-02-21T09:13:47.8553261Z  'num_warps': 16,
2026-02-21T09:13:47.8553457Z  'pid_type': 'flat',
2026-02-21T09:13:47.8553673Z  'range_flattens': [None],
2026-02-21T09:13:47.8553925Z  'range_multi_buffers': [None],
2026-02-21T09:13:47.8554485Z  'range_num_stages': [0],
2026-02-21T09:13:47.8554719Z  'range_unroll_factors': [0],
2026-02-21T09:13:47.8554964Z  'range_warp_specializes': [],
2026-02-21T09:13:47.8555207Z  'reduction_loops': [None]}
2026-02-21T09:13:47.8582656Z [269s] Fitting surrogate: 587 points, 587 targets
2026-02-21T09:13:48.1603769Z [269s] Generation 14 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:13:53.5104507Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 0.8 configs/s
2026-02-21T09:13:54.1198393Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 21.7 configs/s
2026-02-21T09:13:56.1913335Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 476.1         
2026-02-21T09:13:56.1913825Z                                                                   configs/s     
2026-02-21T09:13:56.3316010Z [277s] Generation 14 complete: 
2026-02-21T09:13:56.3316290Z error=2
2026-02-21T09:13:56.3316459Z ok=11
2026-02-21T09:13:56.3317039Z min=0.1114
2026-02-21T09:13:56.3317210Z mid=0.1300
2026-02-21T09:13:56.3317380Z max=0.2917
2026-02-21T09:13:56.3317558Z best={'block_sizes': [2],
2026-02-21T09:13:56.3318012Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:13:56.3318652Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:13:56.3319176Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'first'],
2026-02-21T09:13:56.3319556Z  'num_stages': 2,
2026-02-21T09:13:56.3319759Z  'num_warps': 32,
2026-02-21T09:13:56.3319965Z  'pid_type': 'flat',
2026-02-21T09:13:56.3320200Z  'range_flattens': [None],
2026-02-21T09:13:56.3320445Z  'range_multi_buffers': [None],
2026-02-21T09:13:56.3320946Z  'range_num_stages': [0],
2026-02-21T09:13:56.3321197Z  'range_unroll_factors': [0],
2026-02-21T09:13:56.3321448Z  'range_warp_specializes': [],
2026-02-21T09:13:56.3321689Z  'reduction_loops': [None]}
2026-02-21T09:13:56.3355165Z [277s] Fitting surrogate: 600 points, 600 targets
2026-02-21T09:13:56.6377251Z [277s] Generation 15 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:13:58.3212209Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 22.9 configs/s
2026-02-21T09:13:58.9178419Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 20.2 configs/s
2026-02-21T09:14:01.1618551Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 440.1         
2026-02-21T09:14:01.1619080Z                                                                   configs/s     
2026-02-21T09:14:01.3095157Z [282s] Generation 15 complete: 
2026-02-21T09:14:01.3095444Z error=1
2026-02-21T09:14:01.3095623Z ok=11
2026-02-21T09:14:01.3095788Z min=0.1137
2026-02-21T09:14:01.3095969Z mid=0.1148
2026-02-21T09:14:01.3096174Z max=0.1430
2026-02-21T09:14:01.3096361Z best={'block_sizes': [1],
2026-02-21T09:14:01.3096830Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:14:01.3097497Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:14:01.3097997Z               'pointer'],
2026-02-21T09:14:01.3098315Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'first'],
2026-02-21T09:14:01.3098677Z  'num_stages': 2,
2026-02-21T09:14:01.3098861Z  'num_warps': 16,
2026-02-21T09:14:01.3099052Z  'pid_type': 'flat',
2026-02-21T09:14:01.3099254Z  'range_flattens': [None],
2026-02-21T09:14:01.3099483Z  'range_multi_buffers': [None],
2026-02-21T09:14:01.3099715Z  'range_num_stages': [0],
2026-02-21T09:14:01.3099939Z  'range_unroll_factors': [0],
2026-02-21T09:14:01.3100173Z  'range_warp_specializes': [],
2026-02-21T09:14:01.3100410Z  'reduction_loops': [None]}
2026-02-21T09:14:01.3129448Z [282s] Fitting surrogate: 612 points, 612 targets
2026-02-21T09:14:01.6031054Z [282s] Generation 16 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:14:05.9603926Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 1.1 configs/s
2026-02-21T09:14:06.3888838Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 30.7 configs/s
2026-02-21T09:14:07.9950901Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 610.1         
2026-02-21T09:14:07.9951400Z                                                                   configs/s     
2026-02-21T09:14:08.1165000Z [289s] Generation 16 complete: 
2026-02-21T09:14:08.1165246Z error=4
2026-02-21T09:14:08.1165405Z ok=8
2026-02-21T09:14:08.1165558Z min=0.1100
2026-02-21T09:14:08.1165735Z mid=0.1150
2026-02-21T09:14:08.1165885Z max=0.1373
2026-02-21T09:14:08.1166061Z best={'block_sizes': [1],
2026-02-21T09:14:08.1166455Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:14:08.1167047Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:14:08.1167431Z               'pointer'],
2026-02-21T09:14:08.1167730Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'first'],
2026-02-21T09:14:08.1168515Z  'num_stages': 2,
2026-02-21T09:14:08.1168689Z  'num_warps': 16,
2026-02-21T09:14:08.1168869Z  'pid_type': 'flat',
2026-02-21T09:14:08.1169056Z  'range_flattens': [None],
2026-02-21T09:14:08.1169269Z  'range_multi_buffers': [None],
2026-02-21T09:14:08.1169485Z  'range_num_stages': [0],
2026-02-21T09:14:08.1169695Z  'range_unroll_factors': [0],
2026-02-21T09:14:08.1170058Z  'range_warp_specializes': [],
2026-02-21T09:14:08.1170275Z  'reduction_loops': [None]}
2026-02-21T09:14:08.1200078Z [289s] Fitting surrogate: 624 points, 624 targets
2026-02-21T09:14:08.3939168Z [289s] Generation 17 starting: 7 neighbors, 1 active search path(s)
2026-02-21T09:14:09.5185739Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7/7 25.9 configs/s
2026-02-21T09:14:09.9332005Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 7/7 19.2 configs/s
2026-02-21T09:14:11.7825665Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 531.5         
2026-02-21T09:14:11.7826941Z                                                                   configs/s     
2026-02-21T09:14:11.9134993Z [293s] Generation 17 complete: 
2026-02-21T09:14:11.9135352Z ok=9
2026-02-21T09:14:11.9135541Z min=0.1137
2026-02-21T09:14:11.9135728Z mid=0.1148
2026-02-21T09:14:11.9135901Z max=0.1556
2026-02-21T09:14:11.9136097Z best={'block_sizes': [1],
2026-02-21T09:14:11.9136562Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:14:11.9137216Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:14:11.9137668Z               'pointer'],
2026-02-21T09:14:11.9138010Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'first'],
2026-02-21T09:14:11.9138427Z  'num_stages': 2,
2026-02-21T09:14:11.9138630Z  'num_warps': 16,
2026-02-21T09:14:11.9138835Z  'pid_type': 'flat',
2026-02-21T09:14:11.9139052Z  'range_flattens': [None],
2026-02-21T09:14:11.9139314Z  'range_multi_buffers': [None],
2026-02-21T09:14:11.9139577Z  'range_num_stages': [0],
2026-02-21T09:14:11.9139813Z  'range_unroll_factors': [0],
2026-02-21T09:14:11.9140078Z  'range_warp_specializes': [],
2026-02-21T09:14:11.9140332Z  'reduction_loops': [None]}
2026-02-21T09:14:11.9170533Z [293s] Fitting surrogate: 633 points, 633 targets
2026-02-21T09:14:12.2303773Z [293s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:14:14.1031039Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 40.2 configs/s
2026-02-21T09:14:14.6978872Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 20.3 configs/s
2026-02-21T09:14:16.8983701Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 449.3         
2026-02-21T09:14:16.8984622Z                                                                   configs/s     
2026-02-21T09:14:17.0460141Z [298s] Generation 18 complete: 
2026-02-21T09:14:17.0460508Z error=2
2026-02-21T09:14:17.0460781Z ok=11
2026-02-21T09:14:17.0460989Z min=0.1131
2026-02-21T09:14:17.0461229Z mid=0.1141
2026-02-21T09:14:17.0461436Z max=0.1356
2026-02-21T09:14:17.0461688Z best={'block_sizes': [1],
2026-02-21T09:14:17.0462161Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:14:17.0462850Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:14:17.0463304Z               'pointer'],
2026-02-21T09:14:17.0463692Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', '', 'first'],
2026-02-21T09:14:17.0464446Z  'num_stages': 2,
2026-02-21T09:14:17.0464677Z  'num_warps': 16,
2026-02-21T09:14:17.0464950Z  'pid_type': 'flat',
2026-02-21T09:14:17.0465200Z  'range_flattens': [None],
2026-02-21T09:14:17.0465510Z  'range_multi_buffers': [None],
2026-02-21T09:14:17.0465794Z  'range_num_stages': [0],
2026-02-21T09:14:17.0466085Z  'range_unroll_factors': [0],
2026-02-21T09:14:17.0466395Z  'range_warp_specializes': [],
2026-02-21T09:14:17.0467262Z  'reduction_loops': [None]}
2026-02-21T09:14:17.0496179Z [298s] Fitting surrogate: 646 points, 646 targets
2026-02-21T09:14:17.3327726Z [298s] Generation 19 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:14:19.2445770Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 5.4 configs/s
2026-02-21T09:14:19.7275274Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 23.7 configs/s
2026-02-21T09:14:21.5860233Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 528.6         
2026-02-21T09:14:21.5860816Z                                                                   configs/s     
2026-02-21T09:14:21.7176518Z [302s] Generation 19 complete: 
2026-02-21T09:14:21.7176877Z error=2
2026-02-21T09:14:21.7177149Z ok=9
2026-02-21T09:14:21.7178024Z min=0.1103
2026-02-21T09:14:21.7178315Z mid=0.1174
2026-02-21T09:14:21.7178568Z max=0.1509
2026-02-21T09:14:21.7178827Z best={'block_sizes': [1],
2026-02-21T09:14:21.7179389Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:14:21.7180112Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:14:21.7180610Z               'pointer'],
2026-02-21T09:14:21.7180973Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'last'],
2026-02-21T09:14:21.7181408Z  'num_stages': 2,
2026-02-21T09:14:21.7181681Z  'num_warps': 16,
2026-02-21T09:14:21.7182020Z  'pid_type': 'flat',
2026-02-21T09:14:21.7182306Z  'range_flattens': [None],
2026-02-21T09:14:21.7182633Z  'range_multi_buffers': [None],
2026-02-21T09:14:21.7182931Z  'range_num_stages': [0],
2026-02-21T09:14:21.7183240Z  'range_unroll_factors': [0],
2026-02-21T09:14:21.7183537Z  'range_warp_specializes': [],
2026-02-21T09:14:21.7183867Z  'reduction_loops': [None]}
2026-02-21T09:14:21.7213070Z [302s] Fitting surrogate: 657 points, 657 targets
2026-02-21T09:14:22.0093160Z [303s] Generation 20 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:14:23.6654863Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 36.3 configs/s
2026-02-21T09:14:24.2663055Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.1 configs/s
2026-02-21T09:14:26.2714320Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 491.6         
2026-02-21T09:14:26.2714909Z                                                                   configs/s     
2026-02-21T09:14:26.4096001Z [307s] Generation 20 complete: 
2026-02-21T09:14:26.4096331Z ok=11
2026-02-21T09:14:26.4096549Z min=0.1107
2026-02-21T09:14:26.4096791Z mid=0.1125
2026-02-21T09:14:26.4097003Z max=0.3729
2026-02-21T09:14:26.4097254Z best={'block_sizes': [1],
2026-02-21T09:14:26.4097751Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:14:26.4098443Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:14:26.4098891Z               'pointer'],
2026-02-21T09:14:26.4099685Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'last'],
2026-02-21T09:14:26.4100099Z  'num_stages': 3,
2026-02-21T09:14:26.4100330Z  'num_warps': 16,
2026-02-21T09:14:26.4100590Z  'pid_type': 'flat',
2026-02-21T09:14:26.4100843Z  'range_flattens': [None],
2026-02-21T09:14:26.4101140Z  'range_multi_buffers': [None],
2026-02-21T09:14:26.4101422Z  'range_num_stages': [0],
2026-02-21T09:14:26.4101712Z  'range_unroll_factors': [0],
2026-02-21T09:14:26.4101997Z  'range_warp_specializes': [],
2026-02-21T09:14:26.4102307Z  'reduction_loops': [None]}
2026-02-21T09:14:26.4132705Z [307s] Fitting surrogate: 668 points, 668 targets
2026-02-21T09:14:26.5732893Z [307s] Autotuning complete in 307.8s after searching 634 configs.
2026-02-21T09:14:26.5733428Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:14:26.5735970Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['', '', 'last', '', '', '', '', 'last'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:14:26.5737897Z 
2026-02-21T09:14:26.5738319Z [307s] Code of selected kernel: /tmp/torchinductor_root/by/cby5iz3zfqysttyc3rgg54qqguqewyubou33bonlhye56qoxana4.py
2026-02-21T09:14:27.7489917Z WARNING:tritonbench.utils.triton_op:Completed input ID 17:
2026-02-21T09:14:27.7490375Z (M, N)
2026-02-21T09:14:27.7490604Z ------------
2026-02-21T09:14:27.7490879Z (4096, 9728)
2026-02-21T09:14:27.7491254Z 
2026-02-21T09:14:27.7511243Z  60%|██████    | 12/20 [56:00<39:11, 293.91s/it]WARNING:tritonbench.utils.triton_op:Running input ID 18:
2026-02-21T09:14:27.7511785Z (M, N)
2026-02-21T09:14:27.7512047Z -------------
2026-02-21T09:14:27.7512291Z (4096, 10240)
2026-02-21T09:14:27.7514667Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:14:29.0664497Z INFO:tritonbench.utils.triton_op:Took 3.49ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:14:32.9513344Z INFO:tritonbench.utils.triton_op:Took 0.02ms to get benchmark function for liger_layer_norm
2026-02-21T09:14:34.3917493Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:14:34.3917934Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:14:34.3918262Z               'dtype': 'torch.float32',
2026-02-21T09:14:34.3918623Z               'shape': (4096, 10240),
2026-02-21T09:14:34.3918967Z               'stride': (10240, 1)},
2026-02-21T09:14:34.3919261Z             (10240,),
2026-02-21T09:14:34.3919585Z             { 'device': 'cuda:0',
2026-02-21T09:14:34.3919891Z               'dtype': 'torch.float32',
2026-02-21T09:14:34.3920229Z               'shape': (10240,),
2026-02-21T09:14:34.3920520Z               'stride': (1,)},
2026-02-21T09:14:34.3920886Z             { 'device': 'cuda:0',
2026-02-21T09:14:34.3921157Z               'dtype': 'torch.float32',
2026-02-21T09:14:34.3921460Z               'shape': (10240,),
2026-02-21T09:14:34.3921733Z               'stride': (1,)},
2026-02-21T09:14:34.3921972Z             1e-05),
2026-02-21T09:14:34.3922209Z   'kwargs': {}}
2026-02-21T09:14:34.3963942Z INFO:tritonbench.utils.triton_op:Took 5.07ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:14:34.4045177Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:14:34.4046201Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:14:34.4046895Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:14:34.4047357Z While processing:
2026-02-21T09:14:34.4047872Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:14:34.4048867Z     if bias is not None:
2026-02-21T09:14:34.4049140Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:14:34.4049334Z 
2026-02-21T09:14:34.5631740Z [0s] Autotune random seed: 2135381352
2026-02-21T09:14:34.8844796Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:15:11.1826128Z [36s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:15:13.1000657Z [38s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:15:13.1026773Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:15:20.5663315Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.5 configs/s
2026-02-21T09:15:20.5675530Z [45s] Adaptive compile timeout: 30s (90% percentile=11.7s, bounds=[30.0s, 30s])
2026-02-21T09:15:21.4401425Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1086.6 configs/s
2026-02-21T09:15:21.5339345Z [46s] Initial random population of 100, 5 starting points: 
2026-02-21T09:15:21.5339842Z error=12
2026-02-21T09:15:21.5340141Z timeout=2
2026-02-21T09:15:21.5340398Z ok=86
2026-02-21T09:15:21.5340678Z min=0.1207
2026-02-21T09:15:21.5340941Z mid=0.4666
2026-02-21T09:15:21.5341222Z max=43.1156
2026-02-21T09:15:21.5341502Z best={'block_sizes': [1],
2026-02-21T09:15:21.5342160Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:15:21.5343041Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:15:21.5343634Z               'pointer'],
2026-02-21T09:15:21.5344475Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:15:21.5345040Z  'num_stages': 6,
2026-02-21T09:15:21.5345370Z  'num_warps': 16,
2026-02-21T09:15:21.5345663Z  'pid_type': 'flat',
2026-02-21T09:15:21.5346008Z  'range_flattens': [None],
2026-02-21T09:15:21.5346349Z  'range_multi_buffers': [None],
2026-02-21T09:15:21.5346744Z  'range_num_stages': [0],
2026-02-21T09:15:21.5347105Z  'range_unroll_factors': [0],
2026-02-21T09:15:21.5347464Z  'range_warp_specializes': [],
2026-02-21T09:15:21.5347845Z  'reduction_loops': [8192]}
2026-02-21T09:15:21.5361233Z [46s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:15:22.9090349Z [48s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T09:15:41.8009133Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 2.0 configs/s
2026-02-21T09:15:47.0651608Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.5 configs/s
2026-02-21T09:15:59.3273913Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 82.0 configs/s
2026-02-21T09:15:59.8732689Z [84s] Generation 1 complete: 
2026-02-21T09:15:59.8733036Z error=2
2026-02-21T09:15:59.8733228Z ok=86
2026-02-21T09:15:59.8733443Z min=0.1167
2026-02-21T09:15:59.8733633Z mid=0.1495
2026-02-21T09:15:59.8733846Z max=1.4940
2026-02-21T09:15:59.8734681Z best={'block_sizes': [1],
2026-02-21T09:15:59.8735136Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:15:59.8735714Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:15:59.8736156Z               'pointer'],
2026-02-21T09:15:59.8736539Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', 'first'],
2026-02-21T09:15:59.8736955Z  'num_stages': 6,
2026-02-21T09:15:59.8737199Z  'num_warps': 16,
2026-02-21T09:15:59.8737406Z  'pid_type': 'flat',
2026-02-21T09:15:59.8737665Z  'range_flattens': [None],
2026-02-21T09:15:59.8737905Z  'range_multi_buffers': [None],
2026-02-21T09:15:59.8738185Z  'range_num_stages': [0],
2026-02-21T09:15:59.8738438Z  'range_unroll_factors': [0],
2026-02-21T09:15:59.8738968Z  'range_warp_specializes': [],
2026-02-21T09:15:59.8739269Z  'reduction_loops': [None]}
2026-02-21T09:15:59.8758869Z [84s] Fitting surrogate: 188 points, 188 targets
2026-02-21T09:16:01.0570337Z [86s] Generation 2 starting: 69 neighbors, 5 active search path(s)
2026-02-21T09:16:13.0955331Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 7.0 configs/s
2026-02-21T09:16:17.1602970Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 17.7 configs/s
2026-02-21T09:16:29.8331422Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 79.3 configs/s
2026-02-21T09:16:30.3783904Z [115s] Generation 2 complete: 
2026-02-21T09:16:30.3784532Z error=5
2026-02-21T09:16:30.3784781Z ok=69
2026-02-21T09:16:30.3784989Z min=0.1158
2026-02-21T09:16:30.3785271Z mid=0.1292
2026-02-21T09:16:30.3785485Z max=0.3597
2026-02-21T09:16:30.3785732Z best={'block_sizes': [1],
2026-02-21T09:16:30.3786236Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:16:30.3786931Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:16:30.3787395Z               'pointer'],
2026-02-21T09:16:30.3787829Z  'load_eviction_policies': ['', 'last', 'last', '', '', 'first', 'last', 'first'],
2026-02-21T09:16:30.3788292Z  'num_stages': 6,
2026-02-21T09:16:30.3788522Z  'num_warps': 16,
2026-02-21T09:16:30.3788781Z  'pid_type': 'flat',
2026-02-21T09:16:30.3789027Z  'range_flattens': [None],
2026-02-21T09:16:30.3789326Z  'range_multi_buffers': [None],
2026-02-21T09:16:30.3789606Z  'range_num_stages': [0],
2026-02-21T09:16:30.3789894Z  'range_unroll_factors': [0],
2026-02-21T09:16:30.3790176Z  'range_warp_specializes': [],
2026-02-21T09:16:30.3790480Z  'reduction_loops': [None]}
2026-02-21T09:16:30.3810612Z [115s] Fitting surrogate: 262 points, 262 targets
2026-02-21T09:16:32.2604508Z [117s] Generation 3 starting: 57 neighbors, 5 active search path(s)
2026-02-21T09:16:43.0124925Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 11.8 configs/s
2026-02-21T09:16:46.9324844Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 15.2 configs/s
2026-02-21T09:16:58.2218048Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 89.0 configs/s
2026-02-21T09:16:58.7548005Z [143s] Generation 3 complete: 
2026-02-21T09:16:58.7548338Z error=4
2026-02-21T09:16:58.7548569Z ok=59
2026-02-21T09:16:58.7548797Z min=0.1164
2026-02-21T09:16:58.7549013Z mid=0.1313
2026-02-21T09:16:58.7549254Z max=0.2027
2026-02-21T09:16:58.7549479Z best={'block_sizes': [1],
2026-02-21T09:16:58.7549981Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:16:58.7550679Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:16:58.7551131Z               'pointer'],
2026-02-21T09:16:58.7551552Z  'load_eviction_policies': ['', 'last', 'last', '', '', 'first', 'first', 'first'],
2026-02-21T09:16:58.7552027Z  'num_stages': 6,
2026-02-21T09:16:58.7552296Z  'num_warps': 16,
2026-02-21T09:16:58.7552526Z  'pid_type': 'flat',
2026-02-21T09:16:58.7552795Z  'range_flattens': [None],
2026-02-21T09:16:58.7553431Z  'range_multi_buffers': [None],
2026-02-21T09:16:58.7553726Z  'range_num_stages': [0],
2026-02-21T09:16:58.7554358Z  'range_unroll_factors': [0],
2026-02-21T09:16:58.7554630Z  'range_warp_specializes': [],
2026-02-21T09:16:58.7554921Z  'reduction_loops': [None]}
2026-02-21T09:16:58.7579264Z [143s] Fitting surrogate: 325 points, 325 targets
2026-02-21T09:16:59.6981485Z [144s] Generation 4 starting: 53 neighbors, 5 active search path(s)
2026-02-21T09:17:10.1268366Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 2.9 configs/s
2026-02-21T09:17:13.6396766Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 15.5 configs/s
2026-02-21T09:17:24.5796772Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 91.8 configs/s
2026-02-21T09:17:25.0704723Z [170s] Generation 4 complete: 
2026-02-21T09:17:25.0706237Z error=3
2026-02-21T09:17:25.0706539Z ok=55
2026-02-21T09:17:25.0706749Z min=0.1156
2026-02-21T09:17:25.0706989Z mid=0.1227
2026-02-21T09:17:25.0707220Z max=0.3951
2026-02-21T09:17:25.0707472Z best={'block_sizes': [1],
2026-02-21T09:17:25.0707923Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:17:25.0708589Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:17:25.0709076Z               'pointer'],
2026-02-21T09:17:25.0709468Z  'load_eviction_policies': ['', 'last', 'last', '', '', 'first', 'first', 'first'],
2026-02-21T09:17:25.0709932Z  'num_stages': 6,
2026-02-21T09:17:25.0710166Z  'num_warps': 16,
2026-02-21T09:17:25.0710435Z  'pid_type': 'flat',
2026-02-21T09:17:25.0710693Z  'range_flattens': [None],
2026-02-21T09:17:25.0710992Z  'range_multi_buffers': [None],
2026-02-21T09:17:25.0711263Z  'range_num_stages': [0],
2026-02-21T09:17:25.0711544Z  'range_unroll_factors': [0],
2026-02-21T09:17:25.0711838Z  'range_warp_specializes': [],
2026-02-21T09:17:25.0712105Z  'reduction_loops': [None]}
2026-02-21T09:17:25.0733035Z [170s] Fitting surrogate: 383 points, 383 targets
2026-02-21T09:17:25.9222283Z [171s] Generation 5 starting: 46 neighbors, 4 active search path(s)
2026-02-21T09:17:33.8319014Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 6.1 configs/s
2026-02-21T09:17:36.3580915Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 18.6 configs/s
2026-02-21T09:17:46.2512037Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 112.7         
2026-02-21T09:17:46.2512626Z                                                                   configs/s     
2026-02-21T09:17:46.6723729Z [191s] Generation 5 complete: 
2026-02-21T09:17:46.6724275Z error=5
2026-02-21T09:17:46.6724551Z ok=45
2026-02-21T09:17:46.6724822Z min=0.1173
2026-02-21T09:17:46.6725057Z mid=0.1200
2026-02-21T09:17:46.6725310Z max=0.3483
2026-02-21T09:17:46.6725588Z best={'block_sizes': [1],
2026-02-21T09:17:46.6726092Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:17:46.6726773Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:17:46.6727432Z               'tensor_descriptor', 'pointer'],
2026-02-21T09:17:46.6727910Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:17:46.6728398Z  'num_stages': 8,
2026-02-21T09:17:46.6728686Z  'num_warps': 32,
2026-02-21T09:17:46.6728934Z  'pid_type': 'flat',
2026-02-21T09:17:46.6729231Z  'range_flattens': [None],
2026-02-21T09:17:46.6729520Z  'range_multi_buffers': [None],
2026-02-21T09:17:46.6729948Z  'range_num_stages': [0],
2026-02-21T09:17:46.6730234Z  'range_unroll_factors': [0],
2026-02-21T09:17:46.6730561Z  'range_warp_specializes': [],
2026-02-21T09:17:46.6730857Z  'reduction_loops': [4096]}
2026-02-21T09:17:46.6752638Z [191s] Fitting surrogate: 433 points, 433 targets
2026-02-21T09:17:47.0864346Z [192s] Generation 6 starting: 18 neighbors, 2 active search path(s)
2026-02-21T09:17:51.5216175Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 2.1 configs/s
2026-02-21T09:17:52.6701132Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 19/19 17.2 configs/s
2026-02-21T09:17:56.9667910Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 232.3         
2026-02-21T09:17:56.9668455Z                                                                   configs/s     
2026-02-21T09:17:57.1978625Z [202s] Generation 6 complete: 
2026-02-21T09:17:57.1978985Z ok=21
2026-02-21T09:17:57.1979255Z min=0.1160
2026-02-21T09:17:57.1979502Z mid=0.1217
2026-02-21T09:17:57.1979755Z max=0.3439
2026-02-21T09:17:57.1979997Z best={'block_sizes': [1],
2026-02-21T09:17:57.1980556Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:17:57.1981916Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:17:57.1982548Z               'pointer'],
2026-02-21T09:17:57.1983035Z  'load_eviction_policies': ['', 'last', 'last', '', '', 'first', 'first', 'first'],
2026-02-21T09:17:57.1983489Z  'num_stages': 6,
2026-02-21T09:17:57.1983747Z  'num_warps': 16,
2026-02-21T09:17:57.1984317Z  'pid_type': 'flat',
2026-02-21T09:17:57.1984602Z  'range_flattens': [None],
2026-02-21T09:17:57.1984883Z  'range_multi_buffers': [None],
2026-02-21T09:17:57.1985203Z  'range_num_stages': [0],
2026-02-21T09:17:57.1985496Z  'range_unroll_factors': [0],
2026-02-21T09:17:57.1985777Z  'range_warp_specializes': [],
2026-02-21T09:17:57.1986081Z  'reduction_loops': [None]}
2026-02-21T09:17:57.2005710Z [202s] Fitting surrogate: 454 points, 454 targets
2026-02-21T09:17:57.6412802Z [202s] Generation 7 starting: 20 neighbors, 2 active search path(s)
2026-02-21T09:18:01.3464852Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 7.5 configs/s
2026-02-21T09:18:02.4979100Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 21/21 19.1 configs/s
2026-02-21T09:18:06.5012287Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 249.0         
2026-02-21T09:18:06.5012929Z                                                                   configs/s     
2026-02-21T09:18:06.7234660Z [211s] Generation 7 complete: 
2026-02-21T09:18:06.7235094Z error=2
2026-02-21T09:18:06.7235354Z ok=20
2026-02-21T09:18:06.7235577Z min=0.1164
2026-02-21T09:18:06.7235835Z mid=0.1209
2026-02-21T09:18:06.7236058Z max=0.1762
2026-02-21T09:18:06.7236332Z best={'block_sizes': [1],
2026-02-21T09:18:06.7236842Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:18:06.7237616Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:18:06.7238178Z               'pointer'],
2026-02-21T09:18:06.7238639Z  'load_eviction_policies': ['', 'last', 'last', '', '', 'first', 'first', 'first'],
2026-02-21T09:18:06.7239181Z  'num_stages': 6,
2026-02-21T09:18:06.7239401Z  'num_warps': 16,
2026-02-21T09:18:06.7239650Z  'pid_type': 'flat',
2026-02-21T09:18:06.7240402Z  'range_flattens': [None],
2026-02-21T09:18:06.7240687Z  'range_multi_buffers': [None],
2026-02-21T09:18:06.7240952Z  'range_num_stages': [0],
2026-02-21T09:18:06.7241230Z  'range_unroll_factors': [0],
2026-02-21T09:18:06.7241498Z  'range_warp_specializes': [],
2026-02-21T09:18:06.7241799Z  'reduction_loops': [None]}
2026-02-21T09:18:06.7262507Z [211s] Fitting surrogate: 476 points, 476 targets
2026-02-21T09:18:07.1096408Z [212s] Generation 8 starting: 15 neighbors, 2 active search path(s)
2026-02-21T09:18:10.0636579Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 10.4 configs/s
2026-02-21T09:18:11.0301700Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 16/16 17.4 configs/s
2026-02-21T09:18:13.7974411Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 358.0         
2026-02-21T09:18:13.7975545Z                                                                   configs/s     
2026-02-21T09:18:13.9663119Z [219s] Generation 8 complete: 
2026-02-21T09:18:13.9663508Z ok=17
2026-02-21T09:18:13.9663748Z min=0.1161
2026-02-21T09:18:13.9664257Z mid=0.1346
2026-02-21T09:18:13.9664533Z max=0.2353
2026-02-21T09:18:13.9664780Z best={'block_sizes': [1],
2026-02-21T09:18:13.9665323Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:18:13.9666072Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:18:13.9666633Z               'pointer'],
2026-02-21T09:18:13.9667058Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', 'first', 'first'],
2026-02-21T09:18:13.9667571Z  'num_stages': 6,
2026-02-21T09:18:13.9667839Z  'num_warps': 16,
2026-02-21T09:18:13.9668084Z  'pid_type': 'flat',
2026-02-21T09:18:13.9668375Z  'range_flattens': [None],
2026-02-21T09:18:13.9668670Z  'range_multi_buffers': [None],
2026-02-21T09:18:13.9668992Z  'range_num_stages': [0],
2026-02-21T09:18:13.9669274Z  'range_unroll_factors': [0],
2026-02-21T09:18:13.9669600Z  'range_warp_specializes': [],
2026-02-21T09:18:13.9681787Z  'reduction_loops': [None]}
2026-02-21T09:18:13.9693206Z [219s] Fitting surrogate: 493 points, 493 targets
2026-02-21T09:18:14.4644907Z [219s] Generation 9 starting: 22 neighbors, 2 active search path(s)
2026-02-21T09:18:19.9118574Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 3.9 configs/s
2026-02-21T09:18:21.1838515Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 23/23 18.0 configs/s
2026-02-21T09:18:25.0088449Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 260.4         
2026-02-21T09:18:25.0089032Z                                                                   configs/s     
2026-02-21T09:18:25.2224435Z [230s] Generation 9 complete: 
2026-02-21T09:18:25.2224753Z error=2
2026-02-21T09:18:25.2225006Z ok=22
2026-02-21T09:18:25.2225232Z min=0.1191
2026-02-21T09:18:25.2225486Z mid=0.1292
2026-02-21T09:18:25.2225726Z max=0.3633
2026-02-21T09:18:25.2225935Z best={'block_sizes': [1],
2026-02-21T09:18:25.2226472Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:18:25.2227167Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:18:25.2227685Z               'pointer'],
2026-02-21T09:18:25.2228072Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T09:18:25.2228535Z  'num_stages': 6,
2026-02-21T09:18:25.2228770Z  'num_warps': 16,
2026-02-21T09:18:25.2229035Z  'pid_type': 'flat',
2026-02-21T09:18:25.2229323Z  'range_flattens': [None],
2026-02-21T09:18:25.2229595Z  'range_multi_buffers': [None],
2026-02-21T09:18:25.2229903Z  'range_num_stages': [0],
2026-02-21T09:18:25.2230167Z  'range_unroll_factors': [0],
2026-02-21T09:18:25.2230489Z  'range_warp_specializes': [],
2026-02-21T09:18:25.2230770Z  'reduction_loops': [None]}
2026-02-21T09:18:25.2255840Z [230s] Fitting surrogate: 517 points, 517 targets
2026-02-21T09:18:25.6671681Z [230s] Generation 10 starting: 20 neighbors, 2 active search path(s)
2026-02-21T09:18:29.4706955Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 10.2 configs/s
2026-02-21T09:18:30.7923889Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.2 configs/s
2026-02-21T09:18:35.5473664Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 210.0         
2026-02-21T09:18:35.5474570Z                                                                   configs/s     
2026-02-21T09:18:35.7983057Z [240s] Generation 10 complete: 
2026-02-21T09:18:35.7983423Z ok=23
2026-02-21T09:18:35.7983651Z min=0.1160
2026-02-21T09:18:35.7983888Z mid=0.1204
2026-02-21T09:18:35.7984462Z max=0.1847
2026-02-21T09:18:35.7984710Z best={'block_sizes': [1],
2026-02-21T09:18:35.7985837Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:18:35.7986544Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:18:35.7987057Z               'tensor_descriptor', 'pointer'],
2026-02-21T09:18:35.7987524Z  'load_eviction_policies': ['', '', 'first', '', '', 'first', 'first', 'first'],
2026-02-21T09:18:35.7987980Z  'num_stages': 7,
2026-02-21T09:18:35.7988216Z  'num_warps': 32,
2026-02-21T09:18:35.7988488Z  'pid_type': 'flat',
2026-02-21T09:18:35.7988742Z  'range_flattens': [None],
2026-02-21T09:18:35.7989052Z  'range_multi_buffers': [None],
2026-02-21T09:18:35.7989342Z  'range_num_stages': [0],
2026-02-21T09:18:35.7989640Z  'range_unroll_factors': [0],
2026-02-21T09:18:35.7989925Z  'range_warp_specializes': [],
2026-02-21T09:18:35.7990227Z  'reduction_loops': [4096]}
2026-02-21T09:18:35.8015373Z [240s] Fitting surrogate: 540 points, 540 targets
2026-02-21T09:18:36.2310650Z [241s] Generation 11 starting: 19 neighbors, 2 active search path(s)
2026-02-21T09:18:39.7998473Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.2 configs/s
2026-02-21T09:18:40.9275939Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.6 configs/s
2026-02-21T09:18:45.3757054Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 224.4         
2026-02-21T09:18:45.3757675Z                                                                   configs/s     
2026-02-21T09:18:45.6205604Z [250s] Generation 11 complete: 
2026-02-21T09:18:45.6205994Z ok=21
2026-02-21T09:18:45.6206235Z min=0.1190
2026-02-21T09:18:45.6206503Z mid=0.1198
2026-02-21T09:18:45.6206730Z max=0.1684
2026-02-21T09:18:45.6207001Z best={'block_sizes': [1],
2026-02-21T09:18:45.6207472Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:18:45.6208188Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:18:45.6208797Z               'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:18:45.6209295Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T09:18:45.6209793Z  'num_stages': 6,
2026-02-21T09:18:45.6210178Z  'num_warps': 16,
2026-02-21T09:18:45.6210465Z  'pid_type': 'flat',
2026-02-21T09:18:45.6210749Z  'range_flattens': [None],
2026-02-21T09:18:45.6211075Z  'range_multi_buffers': [None],
2026-02-21T09:18:45.6211415Z  'range_num_stages': [0],
2026-02-21T09:18:45.6211698Z  'range_unroll_factors': [0],
2026-02-21T09:18:45.6212030Z  'range_warp_specializes': [],
2026-02-21T09:18:45.6212343Z  'reduction_loops': [None]}
2026-02-21T09:18:45.6242029Z [250s] Fitting surrogate: 561 points, 561 targets
2026-02-21T09:18:46.0694498Z [251s] Generation 12 starting: 19 neighbors, 2 active search path(s)
2026-02-21T09:18:49.8877285Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 2.1 configs/s
2026-02-21T09:18:51.0083218Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 19.7 configs/s
2026-02-21T09:18:54.5267986Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 282.9         
2026-02-21T09:18:54.5268556Z                                                                   configs/s     
2026-02-21T09:18:54.7293270Z [259s] Generation 12 complete: 
2026-02-21T09:18:54.7293681Z error=2
2026-02-21T09:18:54.7293919Z ok=20
2026-02-21T09:18:54.7294504Z min=0.1165
2026-02-21T09:18:54.7294744Z mid=0.1189
2026-02-21T09:18:54.7294988Z max=0.2068
2026-02-21T09:18:54.7295226Z best={'block_sizes': [1],
2026-02-21T09:18:54.7295740Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:18:54.7296456Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:18:54.7297044Z               'tensor_descriptor', 'pointer'],
2026-02-21T09:18:54.7297512Z  'load_eviction_policies': ['', '', 'first', '', '', 'first', '', 'first'],
2026-02-21T09:18:54.7297978Z  'num_stages': 7,
2026-02-21T09:18:54.7298849Z  'num_warps': 32,
2026-02-21T09:18:54.7299139Z  'pid_type': 'flat',
2026-02-21T09:18:54.7299452Z  'range_flattens': [None],
2026-02-21T09:18:54.7299743Z  'range_multi_buffers': [None],
2026-02-21T09:18:54.7300091Z  'range_num_stages': [0],
2026-02-21T09:18:54.7300379Z  'range_unroll_factors': [0],
2026-02-21T09:18:54.7300712Z  'range_warp_specializes': [],
2026-02-21T09:18:54.7301007Z  'reduction_loops': [4096]}
2026-02-21T09:18:54.7328223Z [259s] Fitting surrogate: 583 points, 583 targets
2026-02-21T09:18:55.1766892Z [260s] Generation 13 starting: 20 neighbors, 2 active search path(s)
2026-02-21T09:18:58.5600385Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 11.4 configs/s
2026-02-21T09:18:59.7347021Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.7 configs/s
2026-02-21T09:19:04.1346118Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 227.0         
2026-02-21T09:19:04.1346880Z                                                                   configs/s     
2026-02-21T09:19:04.3746903Z [269s] Generation 13 complete: 
2026-02-21T09:19:04.3747220Z ok=22
2026-02-21T09:19:04.3747457Z min=0.1161
2026-02-21T09:19:04.3747679Z mid=0.1200
2026-02-21T09:19:04.3747950Z max=0.1812
2026-02-21T09:19:04.3748215Z best={'block_sizes': [1],
2026-02-21T09:19:04.3748708Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:04.3749519Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T09:19:04.3750138Z               'pointer', 'pointer'],
2026-02-21T09:19:04.3750652Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', '', 'first'],
2026-02-21T09:19:04.3751109Z  'num_stages': 6,
2026-02-21T09:19:04.3751412Z  'num_warps': 16,
2026-02-21T09:19:04.3751712Z  'pid_type': 'flat',
2026-02-21T09:19:04.3751996Z  'range_flattens': [None],
2026-02-21T09:19:04.3752325Z  'range_multi_buffers': [None],
2026-02-21T09:19:04.3752641Z  'range_num_stages': [0],
2026-02-21T09:19:04.3752964Z  'range_unroll_factors': [0],
2026-02-21T09:19:04.3753259Z  'range_warp_specializes': [],
2026-02-21T09:19:04.3753538Z  'reduction_loops': [None]}
2026-02-21T09:19:04.3781122Z [269s] Fitting surrogate: 605 points, 605 targets
2026-02-21T09:19:04.8248785Z [269s] Generation 14 starting: 20 neighbors, 2 active search path(s)
2026-02-21T09:19:08.1746437Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 13.6 configs/s
2026-02-21T09:19:09.3319939Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 18.0 configs/s
2026-02-21T09:19:14.8592371Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 221.2         
2026-02-21T09:19:14.8596870Z                                                                   configs/s     
2026-02-21T09:19:15.1130686Z [280s] Generation 14 complete: 
2026-02-21T09:19:15.1130960Z ok=22
2026-02-21T09:19:15.1131125Z min=0.1168
2026-02-21T09:19:15.1131287Z mid=0.1175
2026-02-21T09:19:15.1131445Z max=0.1404
2026-02-21T09:19:15.1131648Z best={'block_sizes': [1],
2026-02-21T09:19:15.1132056Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:19:15.1133080Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:15.1133468Z               'pointer'],
2026-02-21T09:19:15.1133746Z  'load_eviction_policies': ['', '', 'first', '', '', 'first', '', 'last'],
2026-02-21T09:19:15.1134435Z  'num_stages': 6,
2026-02-21T09:19:15.1134606Z  'num_warps': 32,
2026-02-21T09:19:15.1134769Z  'pid_type': 'flat',
2026-02-21T09:19:15.1134952Z  'range_flattens': [None],
2026-02-21T09:19:15.1135147Z  'range_multi_buffers': [None],
2026-02-21T09:19:15.1135355Z  'range_num_stages': [0],
2026-02-21T09:19:15.1135545Z  'range_unroll_factors': [0],
2026-02-21T09:19:15.1135755Z  'range_warp_specializes': [],
2026-02-21T09:19:15.1135959Z  'reduction_loops': [4096]}
2026-02-21T09:19:15.1170034Z [280s] Fitting surrogate: 627 points, 627 targets
2026-02-21T09:19:15.5609645Z [280s] Generation 15 starting: 20 neighbors, 2 active search path(s)
2026-02-21T09:19:19.0089500Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 27.2 configs/s
2026-02-21T09:19:20.2425443Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 17.7 configs/s
2026-02-21T09:19:24.9916361Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 210.4         
2026-02-21T09:19:24.9916882Z                                                                   configs/s     
2026-02-21T09:19:25.2487374Z [290s] Generation 15 complete: 
2026-02-21T09:19:25.2487679Z ok=23
2026-02-21T09:19:25.2487863Z min=0.1167
2026-02-21T09:19:25.2488053Z mid=0.1189
2026-02-21T09:19:25.2488219Z max=0.1393
2026-02-21T09:19:25.2488410Z best={'block_sizes': [1],
2026-02-21T09:19:25.2488830Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:19:25.2489504Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:19:25.2490103Z               'tensor_descriptor', 'pointer'],
2026-02-21T09:19:25.2490485Z  'load_eviction_policies': ['', '', 'first', '', '', 'first', '', 'last'],
2026-02-21T09:19:25.2490877Z  'num_stages': 6,
2026-02-21T09:19:25.2491070Z  'num_warps': 32,
2026-02-21T09:19:25.2491269Z  'pid_type': 'flat',
2026-02-21T09:19:25.2491489Z  'range_flattens': [None],
2026-02-21T09:19:25.2491720Z  'range_multi_buffers': [None],
2026-02-21T09:19:25.2491969Z  'range_num_stages': [0],
2026-02-21T09:19:25.2492201Z  'range_unroll_factors': [0],
2026-02-21T09:19:25.2492465Z  'range_warp_specializes': [],
2026-02-21T09:19:25.2492704Z  'reduction_loops': [4096]}
2026-02-21T09:19:25.2523688Z [290s] Fitting surrogate: 650 points, 650 targets
2026-02-21T09:19:25.7062022Z [290s] Generation 16 starting: 21 neighbors, 2 active search path(s)
2026-02-21T09:19:29.4892142Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 7.8 configs/s
2026-02-21T09:19:30.6157983Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 20.5 configs/s
2026-02-21T09:19:34.8945273Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 233.0         
2026-02-21T09:19:34.8946409Z                                                                   configs/s     
2026-02-21T09:19:35.1255610Z [300s] Generation 16 complete: 
2026-02-21T09:19:35.1255859Z error=3
2026-02-21T09:19:35.1256005Z ok=20
2026-02-21T09:19:35.1256148Z min=0.1164
2026-02-21T09:19:35.1256294Z mid=0.1204
2026-02-21T09:19:35.1256441Z max=0.1700
2026-02-21T09:19:35.1256600Z best={'block_sizes': [1],
2026-02-21T09:19:35.1256987Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:35.1257555Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:35.1257941Z               'pointer', 'pointer'],
2026-02-21T09:19:35.1258293Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', '', 'last'],
2026-02-21T09:19:35.1258624Z  'num_stages': 6,
2026-02-21T09:19:35.1258804Z  'num_warps': 16,
2026-02-21T09:19:35.1258968Z  'pid_type': 'flat',
2026-02-21T09:19:35.1259152Z  'range_flattens': [None],
2026-02-21T09:19:35.1259361Z  'range_multi_buffers': [None],
2026-02-21T09:19:35.1259570Z  'range_num_stages': [0],
2026-02-21T09:19:35.1259767Z  'range_unroll_factors': [0],
2026-02-21T09:19:35.1259973Z  'range_warp_specializes': [],
2026-02-21T09:19:35.1260193Z  'reduction_loops': [None]}
2026-02-21T09:19:35.1292224Z [300s] Fitting surrogate: 673 points, 673 targets
2026-02-21T09:19:35.4201619Z [300s] Generation 17 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:19:36.9949331Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 15.6 configs/s
2026-02-21T09:19:37.5243353Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.7 configs/s
2026-02-21T09:19:39.5642434Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 483.3         
2026-02-21T09:19:39.5643864Z                                                                   configs/s     
2026-02-21T09:19:39.7030361Z [304s] Generation 17 complete: 
2026-02-21T09:19:39.7030660Z ok=10
2026-02-21T09:19:39.7030836Z min=0.1157
2026-02-21T09:19:39.7031015Z mid=0.1174
2026-02-21T09:19:39.7031183Z max=0.1437
2026-02-21T09:19:39.7031368Z best={'block_sizes': [1],
2026-02-21T09:19:39.7031805Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:39.7032447Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:39.7032902Z               'pointer', 'pointer'],
2026-02-21T09:19:39.7033266Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', '', 'last'],
2026-02-21T09:19:39.7033664Z  'num_stages': 6,
2026-02-21T09:19:39.7033884Z  'num_warps': 16,
2026-02-21T09:19:39.7034345Z  'pid_type': 'flat',
2026-02-21T09:19:39.7034543Z  'range_flattens': [None],
2026-02-21T09:19:39.7034765Z  'range_multi_buffers': [None],
2026-02-21T09:19:39.7034982Z  'range_num_stages': [0],
2026-02-21T09:19:39.7035190Z  'range_unroll_factors': [0],
2026-02-21T09:19:39.7035416Z  'range_warp_specializes': [],
2026-02-21T09:19:39.7035643Z  'reduction_loops': [None]}
2026-02-21T09:19:39.7074872Z [304s] Fitting surrogate: 683 points, 683 targets
2026-02-21T09:19:40.0018267Z [305s] Generation 18 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:19:41.6727649Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 44.5 configs/s
2026-02-21T09:19:42.2533910Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.8 configs/s
2026-02-21T09:19:44.4946918Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 440.6         
2026-02-21T09:19:44.4948111Z                                                                   configs/s     
2026-02-21T09:19:44.6426902Z [309s] Generation 18 complete: 
2026-02-21T09:19:44.6427171Z ok=11
2026-02-21T09:19:44.6427403Z min=0.1159
2026-02-21T09:19:44.6427643Z mid=0.1177
2026-02-21T09:19:44.6427859Z max=0.1334
2026-02-21T09:19:44.6428084Z best={'block_sizes': [1],
2026-02-21T09:19:44.6428572Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:44.6429688Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:44.6430163Z               'pointer', 'pointer'],
2026-02-21T09:19:44.6430531Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', '', ''],
2026-02-21T09:19:44.6430900Z  'num_stages': 6,
2026-02-21T09:19:44.6431097Z  'num_warps': 16,
2026-02-21T09:19:44.6431297Z  'pid_type': 'flat',
2026-02-21T09:19:44.6431520Z  'range_flattens': [None],
2026-02-21T09:19:44.6431763Z  'range_multi_buffers': [None],
2026-02-21T09:19:44.6432008Z  'range_num_stages': [0],
2026-02-21T09:19:44.6432248Z  'range_unroll_factors': [0],
2026-02-21T09:19:44.6432508Z  'range_warp_specializes': [],
2026-02-21T09:19:44.6433048Z  'reduction_loops': [None]}
2026-02-21T09:19:44.6473390Z [309s] Fitting surrogate: 694 points, 694 targets
2026-02-21T09:19:44.9381921Z [310s] Generation 19 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:19:46.9481817Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 5.6 configs/s
2026-02-21T09:19:47.4836465Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.5 configs/s
2026-02-21T09:19:49.5226805Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 483.6         
2026-02-21T09:19:49.5227359Z                                                                   configs/s     
2026-02-21T09:19:49.6616155Z [314s] Generation 19 complete: 
2026-02-21T09:19:49.6616401Z ok=10
2026-02-21T09:19:49.6616556Z min=0.1161
2026-02-21T09:19:49.6616703Z mid=0.1179
2026-02-21T09:19:49.6616847Z max=0.1333
2026-02-21T09:19:49.6617000Z best={'block_sizes': [1],
2026-02-21T09:19:49.6617416Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:49.6617996Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:19:49.6618393Z               'pointer', 'pointer'],
2026-02-21T09:19:49.6618731Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', '', ''],
2026-02-21T09:19:49.6619044Z  'num_stages': 6,
2026-02-21T09:19:49.6619214Z  'num_warps': 16,
2026-02-21T09:19:49.6619379Z  'pid_type': 'flat',
2026-02-21T09:19:49.6619562Z  'range_flattens': [None],
2026-02-21T09:19:49.6619757Z  'range_multi_buffers': [None],
2026-02-21T09:19:49.6619968Z  'range_num_stages': [0],
2026-02-21T09:19:49.6620160Z  'range_unroll_factors': [0],
2026-02-21T09:19:49.6620370Z  'range_warp_specializes': [],
2026-02-21T09:19:49.6620608Z  'reduction_loops': [None]}
2026-02-21T09:19:49.6661160Z [314s] Fitting surrogate: 704 points, 704 targets
2026-02-21T09:19:49.8261024Z [314s] Autotuning complete in 314.9s after searching 667 configs.
2026-02-21T09:19:49.8261488Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:19:49.8263571Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'last', 'last', 'last', '', '', '', ''], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:19:49.8265822Z 
2026-02-21T09:19:49.8266214Z [314s] Code of selected kernel: /tmp/torchinductor_root/yr/cyr5rk6vowjzi54efl46rq6lmkinsumibp64f5esmimseig4ocbi.py
2026-02-21T09:19:51.0193002Z WARNING:tritonbench.utils.triton_op:Completed input ID 18:
2026-02-21T09:19:51.0193383Z (M, N)
2026-02-21T09:19:51.0193566Z -------------
2026-02-21T09:19:51.0193762Z (4096, 10240)
2026-02-21T09:19:51.0194704Z 
2026-02-21T09:19:51.0216064Z  65%|██████▌   | 13/20 [1:01:23<35:19, 302.80s/it]WARNING:tritonbench.utils.triton_op:Running input ID 20:
2026-02-21T09:19:51.0216503Z (M, N)
2026-02-21T09:19:51.0217077Z -------------
2026-02-21T09:19:51.0217240Z (4096, 11264)
2026-02-21T09:19:51.0219583Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:19:52.3221952Z INFO:tritonbench.utils.triton_op:Took 3.35ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:19:56.4402535Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:19:57.8706386Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:19:57.8706791Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:19:57.8707119Z               'dtype': 'torch.float32',
2026-02-21T09:19:57.8707447Z               'shape': (4096, 11264),
2026-02-21T09:19:57.8707750Z               'stride': (11264, 1)},
2026-02-21T09:19:57.8708025Z             (11264,),
2026-02-21T09:19:57.8708720Z             { 'device': 'cuda:0',
2026-02-21T09:19:57.8708987Z               'dtype': 'torch.float32',
2026-02-21T09:19:57.8709261Z               'shape': (11264,),
2026-02-21T09:19:57.8709513Z               'stride': (1,)},
2026-02-21T09:19:57.8709749Z             { 'device': 'cuda:0',
2026-02-21T09:19:57.8709992Z               'dtype': 'torch.float32',
2026-02-21T09:19:57.8710254Z               'shape': (11264,),
2026-02-21T09:19:57.8710477Z               'stride': (1,)},
2026-02-21T09:19:57.8710704Z             1e-05),
2026-02-21T09:19:57.8710903Z   'kwargs': {}}
2026-02-21T09:19:57.8750196Z INFO:tritonbench.utils.triton_op:Took 4.76ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:19:57.8871880Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:19:57.8872778Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:19:57.8873382Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:19:57.8873723Z While processing:
2026-02-21T09:19:57.8874458Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:19:57.8874903Z     if bias is not None:
2026-02-21T09:19:57.8875114Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:19:57.8875248Z 
2026-02-21T09:19:58.0477910Z [0s] Autotune random seed: 2135381352
2026-02-21T09:19:58.3701891Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:20:34.9303673Z [36s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:20:37.0443805Z [38s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:20:37.0464744Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:20:43.6380643Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.3 configs/s
2026-02-21T09:20:43.6393739Z [45s] Adaptive compile timeout: 30s (90% percentile=12.7s, bounds=[30.0s, 30s])
2026-02-21T09:20:44.5607409Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1028.7 configs/s
2026-02-21T09:20:44.6573193Z [46s] Initial random population of 100, 5 starting points: 
2026-02-21T09:20:44.6573555Z error=12
2026-02-21T09:20:44.6573743Z timeout=2
2026-02-21T09:20:44.6573908Z ok=86
2026-02-21T09:20:44.6574257Z min=0.1387
2026-02-21T09:20:44.6574427Z mid=0.4977
2026-02-21T09:20:44.6574600Z max=47.2350
2026-02-21T09:20:44.6574787Z best={'block_sizes': [1],
2026-02-21T09:20:44.6575232Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:20:44.6575883Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:20:44.6576309Z               'pointer'],
2026-02-21T09:20:44.6576677Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:20:44.6577469Z  'num_stages': 6,
2026-02-21T09:20:44.6577695Z  'num_warps': 16,
2026-02-21T09:20:44.6577888Z  'pid_type': 'flat',
2026-02-21T09:20:44.6578104Z  'range_flattens': [None],
2026-02-21T09:20:44.6578347Z  'range_multi_buffers': [None],
2026-02-21T09:20:44.6578589Z  'range_num_stages': [0],
2026-02-21T09:20:44.6578824Z  'range_unroll_factors': [0],
2026-02-21T09:20:44.6579133Z  'range_warp_specializes': [],
2026-02-21T09:20:44.6579430Z  'reduction_loops': [8192]}
2026-02-21T09:20:44.6595872Z [46s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:20:46.0280087Z [47s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T09:21:22.5399874Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 0.5 configs/s
2026-02-21T09:21:28.8535609Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 13.7 configs/s
2026-02-21T09:21:40.9177636Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 83.2 configs/s
2026-02-21T09:21:41.4243754Z [103s] Generation 1 complete: 
2026-02-21T09:21:41.4244485Z error=2
2026-02-21T09:21:41.4244674Z ok=85
2026-02-21T09:21:41.4244843Z min=0.1282
2026-02-21T09:21:41.4245031Z mid=0.1675
2026-02-21T09:21:41.4245218Z max=1.3272
2026-02-21T09:21:41.4245407Z best={'block_sizes': [1],
2026-02-21T09:21:41.4245854Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:21:41.4246474Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:21:41.4246920Z               'pointer'],
2026-02-21T09:21:41.4247294Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', 'first'],
2026-02-21T09:21:41.4247706Z  'num_stages': 6,
2026-02-21T09:21:41.4247899Z  'num_warps': 16,
2026-02-21T09:21:41.4248100Z  'pid_type': 'flat',
2026-02-21T09:21:41.4248317Z  'range_flattens': [None],
2026-02-21T09:21:41.4248565Z  'range_multi_buffers': [None],
2026-02-21T09:21:41.4248833Z  'range_num_stages': [0],
2026-02-21T09:21:41.4249111Z  'range_unroll_factors': [0],
2026-02-21T09:21:41.4249357Z  'range_warp_specializes': [],
2026-02-21T09:21:41.4249580Z  'reduction_loops': [None]}
2026-02-21T09:21:41.4269001Z [103s] Fitting surrogate: 187 points, 187 targets
2026-02-21T09:21:42.7772527Z [104s] Generation 2 starting: 79 neighbors, 5 active search path(s)
2026-02-21T09:21:57.2326574Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 4.9 configs/s
2026-02-21T09:22:01.1100486Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 21.5 configs/s
2026-02-21T09:22:12.4849285Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.2 configs/s
2026-02-21T09:22:12.9884410Z [134s] Generation 2 complete: 
2026-02-21T09:22:12.9884766Z error=20
2026-02-21T09:22:12.9884966Z ok=64
2026-02-21T09:22:12.9885158Z min=0.1271
2026-02-21T09:22:12.9885348Z mid=0.1459
2026-02-21T09:22:12.9885541Z max=0.5206
2026-02-21T09:22:12.9885751Z best={'block_sizes': [1],
2026-02-21T09:22:12.9886286Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:22:12.9887045Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:22:12.9888183Z               'pointer'],
2026-02-21T09:22:12.9888604Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', 'first'],
2026-02-21T09:22:12.9889071Z  'num_stages': 6,
2026-02-21T09:22:12.9889293Z  'num_warps': 16,
2026-02-21T09:22:12.9889511Z  'pid_type': 'flat',
2026-02-21T09:22:12.9889755Z  'range_flattens': [None],
2026-02-21T09:22:12.9890129Z  'range_multi_buffers': [None],
2026-02-21T09:22:12.9890401Z  'range_num_stages': [0],
2026-02-21T09:22:12.9890662Z  'range_unroll_factors': [0],
2026-02-21T09:22:12.9890997Z  'range_warp_specializes': [],
2026-02-21T09:22:12.9891356Z  'reduction_loops': [None]}
2026-02-21T09:22:12.9914762Z [134s] Fitting surrogate: 271 points, 271 targets
2026-02-21T09:22:13.8233030Z [135s] Generation 3 starting: 46 neighbors, 5 active search path(s)
2026-02-21T09:22:21.9383214Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 13.3 configs/s
2026-02-21T09:22:24.7256875Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 17.1 configs/s
2026-02-21T09:22:35.2362919Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 95.6 configs/s
2026-02-21T09:22:35.7266255Z [157s] Generation 3 complete: 
2026-02-21T09:22:35.7269168Z error=1
2026-02-21T09:22:35.7269451Z ok=51
2026-02-21T09:22:35.7269678Z min=0.1271
2026-02-21T09:22:35.7269914Z mid=0.1348
2026-02-21T09:22:35.7270134Z max=0.8296
2026-02-21T09:22:35.7270386Z best={'block_sizes': [1],
2026-02-21T09:22:35.7270987Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:22:35.7271878Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:22:35.7272482Z               'pointer'],
2026-02-21T09:22:35.7272997Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:22:35.7273549Z  'num_stages': 6,
2026-02-21T09:22:35.7273801Z  'num_warps': 16,
2026-02-21T09:22:35.7274304Z  'pid_type': 'flat',
2026-02-21T09:22:35.7274607Z  'range_flattens': [None],
2026-02-21T09:22:35.7274916Z  'range_multi_buffers': [None],
2026-02-21T09:22:35.7275234Z  'range_num_stages': [0],
2026-02-21T09:22:35.7275539Z  'range_unroll_factors': [0],
2026-02-21T09:22:35.7275862Z  'range_warp_specializes': [],
2026-02-21T09:22:35.7276176Z  'reduction_loops': [None]}
2026-02-21T09:22:35.7292414Z [157s] Fitting surrogate: 323 points, 323 targets
2026-02-21T09:22:36.5590495Z [158s] Generation 4 starting: 46 neighbors, 5 active search path(s)
2026-02-21T09:22:46.2638888Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 6.9 configs/s
2026-02-21T09:22:49.0537120Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 17.9 configs/s
2026-02-21T09:22:58.8441030Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.5         
2026-02-21T09:22:58.8441578Z                                                                   configs/s     
2026-02-21T09:22:59.2878771Z [180s] Generation 4 complete: 
2026-02-21T09:22:59.2879756Z error=3
2026-02-21T09:22:59.2879939Z ok=48
2026-02-21T09:22:59.2880113Z min=0.1289
2026-02-21T09:22:59.2880289Z mid=0.1401
2026-02-21T09:22:59.2880462Z max=0.3054
2026-02-21T09:22:59.2880649Z best={'block_sizes': [1],
2026-02-21T09:22:59.2881068Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:22:59.2881704Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:22:59.2882176Z               'pointer'],
2026-02-21T09:22:59.2882562Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T09:22:59.2882985Z  'num_stages': 8,
2026-02-21T09:22:59.2883202Z  'num_warps': 16,
2026-02-21T09:22:59.2883446Z  'pid_type': 'flat',
2026-02-21T09:22:59.2883746Z  'range_flattens': [None],
2026-02-21T09:22:59.2884359Z  'range_multi_buffers': [None],
2026-02-21T09:22:59.2884620Z  'range_num_stages': [0],
2026-02-21T09:22:59.2884861Z  'range_unroll_factors': [0],
2026-02-21T09:22:59.2885124Z  'range_warp_specializes': [],
2026-02-21T09:22:59.2885393Z  'reduction_loops': [None]}
2026-02-21T09:22:59.2907937Z [180s] Fitting surrogate: 374 points, 374 targets
2026-02-21T09:23:00.0719212Z [181s] Generation 5 starting: 43 neighbors, 5 active search path(s)
2026-02-21T09:23:07.9106418Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 3.5 configs/s
2026-02-21T09:23:10.5277863Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 17.9 configs/s
2026-02-21T09:23:20.2791344Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.9         
2026-02-21T09:23:20.2792133Z                                                                   configs/s     
2026-02-21T09:23:20.7264608Z [202s] Generation 5 complete: 
2026-02-21T09:23:20.7265315Z error=2
2026-02-21T09:23:20.7265490Z ok=46
2026-02-21T09:23:20.7265658Z min=0.1272
2026-02-21T09:23:20.7265826Z mid=0.1392
2026-02-21T09:23:20.7265996Z max=0.2114
2026-02-21T09:23:20.7266202Z best={'block_sizes': [1],
2026-02-21T09:23:20.7266600Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:23:20.7267137Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:23:20.7267608Z  'load_eviction_policies': ['', '', 'first', '', 'last', '', '', ''],
2026-02-21T09:23:20.7267961Z  'num_stages': 1,
2026-02-21T09:23:20.7268147Z  'num_warps': 16,
2026-02-21T09:23:20.7268358Z  'pid_type': 'flat',
2026-02-21T09:23:20.7268563Z  'range_flattens': [None],
2026-02-21T09:23:20.7268794Z  'range_multi_buffers': [None],
2026-02-21T09:23:20.7269029Z  'range_num_stages': [0],
2026-02-21T09:23:20.7269256Z  'range_unroll_factors': [0],
2026-02-21T09:23:20.7269492Z  'range_warp_specializes': [],
2026-02-21T09:23:20.7269736Z  'reduction_loops': [None]}
2026-02-21T09:23:20.7294399Z [202s] Fitting surrogate: 422 points, 422 targets
2026-02-21T09:23:21.3619778Z [202s] Generation 6 starting: 34 neighbors, 4 active search path(s)
2026-02-21T09:23:27.7711664Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 6.5 configs/s
2026-02-21T09:23:29.7474422Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 18.7 configs/s
2026-02-21T09:23:37.4987580Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 129.3         
2026-02-21T09:23:37.4988223Z                                                                   configs/s     
2026-02-21T09:23:37.8488912Z [219s] Generation 6 complete: 
2026-02-21T09:23:37.8489225Z error=3
2026-02-21T09:23:37.8489404Z ok=35
2026-02-21T09:23:37.8489577Z min=0.1292
2026-02-21T09:23:37.8489752Z mid=0.1339
2026-02-21T09:23:37.8490026Z max=0.2332
2026-02-21T09:23:37.8490221Z best={'block_sizes': [2],
2026-02-21T09:23:37.8490716Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:23:37.8491345Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:23:37.8492523Z  'load_eviction_policies': ['', '', 'last', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:23:37.8492921Z  'num_stages': 5,
2026-02-21T09:23:37.8493117Z  'num_warps': 16,
2026-02-21T09:23:37.8493320Z  'pid_type': 'flat',
2026-02-21T09:23:37.8493532Z  'range_flattens': [None],
2026-02-21T09:23:37.8493773Z  'range_multi_buffers': [None],
2026-02-21T09:23:37.8494420Z  'range_num_stages': [0],
2026-02-21T09:23:37.8494675Z  'range_unroll_factors': [0],
2026-02-21T09:23:37.8494927Z  'range_warp_specializes': [],
2026-02-21T09:23:37.8495176Z  'reduction_loops': [None]}
2026-02-21T09:23:37.8518747Z [219s] Fitting surrogate: 460 points, 460 targets
2026-02-21T09:23:38.6844995Z [220s] Generation 7 starting: 47 neighbors, 4 active search path(s)
2026-02-21T09:23:47.0267863Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 7.3 configs/s
2026-02-21T09:23:49.2550910Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 21.6 configs/s
2026-02-21T09:23:58.2842253Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.1         
2026-02-21T09:23:58.2844320Z                                                                   configs/s     
2026-02-21T09:23:58.6618222Z [240s] Generation 7 complete: 
2026-02-21T09:23:58.6618508Z error=11
2026-02-21T09:23:58.6618678Z ok=40
2026-02-21T09:23:58.6618844Z min=0.1282
2026-02-21T09:23:58.6619010Z mid=0.1323
2026-02-21T09:23:58.6619176Z max=0.2433
2026-02-21T09:23:58.6619351Z best={'block_sizes': [1],
2026-02-21T09:23:58.6619794Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:23:58.6620401Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:23:58.6620977Z  'load_eviction_policies': ['', '', 'last', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:23:58.6621367Z  'num_stages': 6,
2026-02-21T09:23:58.6621552Z  'num_warps': 16,
2026-02-21T09:23:58.6621743Z  'pid_type': 'flat',
2026-02-21T09:23:58.6621961Z  'range_flattens': [None],
2026-02-21T09:23:58.6622192Z  'range_multi_buffers': [None],
2026-02-21T09:23:58.6622421Z  'range_num_stages': [0],
2026-02-21T09:23:58.6622656Z  'range_unroll_factors': [0],
2026-02-21T09:23:58.6622891Z  'range_warp_specializes': [],
2026-02-21T09:23:58.6623129Z  'reduction_loops': [None]}
2026-02-21T09:23:58.6649058Z [240s] Fitting surrogate: 511 points, 511 targets
2026-02-21T09:23:59.4692647Z [241s] Generation 8 starting: 45 neighbors, 4 active search path(s)
2026-02-21T09:24:07.2303009Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 19.1 configs/s
2026-02-21T09:24:09.4656195Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 21.1 configs/s
2026-02-21T09:24:18.0005505Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 117.5         
2026-02-21T09:24:18.0006057Z                                                                   configs/s     
2026-02-21T09:24:18.4072156Z [260s] Generation 8 complete: 
2026-02-21T09:24:18.4072507Z error=9
2026-02-21T09:24:18.4072693Z ok=40
2026-02-21T09:24:18.4072860Z min=0.1276
2026-02-21T09:24:18.4073035Z mid=0.1333
2026-02-21T09:24:18.4073194Z max=0.3188
2026-02-21T09:24:18.4073384Z best={'block_sizes': [1],
2026-02-21T09:24:18.4073836Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:24:18.4074936Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:24:18.4075483Z  'load_eviction_policies': ['', '', 'last', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:24:18.4075875Z  'num_stages': 7,
2026-02-21T09:24:18.4076073Z  'num_warps': 16,
2026-02-21T09:24:18.4076262Z  'pid_type': 'flat',
2026-02-21T09:24:18.4076477Z  'range_flattens': [None],
2026-02-21T09:24:18.4076731Z  'range_multi_buffers': [None],
2026-02-21T09:24:18.4076978Z  'range_num_stages': [0],
2026-02-21T09:24:18.4077229Z  'range_unroll_factors': [0],
2026-02-21T09:24:18.4077481Z  'range_warp_specializes': [],
2026-02-21T09:24:18.4078378Z  'reduction_loops': [None]}
2026-02-21T09:24:18.4112047Z [260s] Fitting surrogate: 560 points, 560 targets
2026-02-21T09:24:18.8196425Z [260s] Generation 9 starting: 17 neighbors, 2 active search path(s)
2026-02-21T09:24:22.3617429Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 4.1 configs/s
2026-02-21T09:24:23.4345771Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 17.5 configs/s
2026-02-21T09:24:27.3233442Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 255.8         
2026-02-21T09:24:27.3233917Z                                                                   configs/s     
2026-02-21T09:24:27.5296633Z [269s] Generation 9 complete: 
2026-02-21T09:24:27.5296887Z ok=19
2026-02-21T09:24:27.5297054Z min=0.1281
2026-02-21T09:24:27.5297702Z mid=0.1398
2026-02-21T09:24:27.5297870Z max=0.7960
2026-02-21T09:24:27.5298051Z best={'block_sizes': [1],
2026-02-21T09:24:27.5298488Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:24:27.5299122Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:24:27.5299658Z  'load_eviction_policies': ['', '', 'last', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:24:27.5300041Z  'num_stages': 7,
2026-02-21T09:24:27.5300235Z  'num_warps': 16,
2026-02-21T09:24:27.5300432Z  'pid_type': 'flat',
2026-02-21T09:24:27.5300654Z  'range_flattens': [None],
2026-02-21T09:24:27.5300879Z  'range_multi_buffers': [None],
2026-02-21T09:24:27.5301121Z  'range_num_stages': [0],
2026-02-21T09:24:27.5301348Z  'range_unroll_factors': [0],
2026-02-21T09:24:27.5301587Z  'range_warp_specializes': [],
2026-02-21T09:24:27.5301826Z  'reduction_loops': [None]}
2026-02-21T09:24:27.5328888Z [269s] Fitting surrogate: 579 points, 579 targets
2026-02-21T09:24:27.8950419Z [269s] Generation 10 starting: 13 neighbors, 2 active search path(s)
2026-02-21T09:24:30.2861366Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 17.9 configs/s
2026-02-21T09:24:31.0461287Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 19.8 configs/s
2026-02-21T09:24:34.1278437Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 321.8         
2026-02-21T09:24:34.1279511Z                                                                   configs/s     
2026-02-21T09:24:34.3048119Z [275s] Generation 10 complete: 
2026-02-21T09:24:34.3048407Z error=1
2026-02-21T09:24:34.3048590Z ok=14
2026-02-21T09:24:34.3048760Z min=0.1302
2026-02-21T09:24:34.3048936Z mid=0.1321
2026-02-21T09:24:34.3049112Z max=0.1740
2026-02-21T09:24:34.3049294Z best={'block_sizes': [1],
2026-02-21T09:24:34.3049876Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:24:34.3050524Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:24:34.3050943Z               'pointer'],
2026-02-21T09:24:34.3051294Z  'load_eviction_policies': ['', '', 'last', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:24:34.3051711Z  'num_stages': 7,
2026-02-21T09:24:34.3051905Z  'num_warps': 16,
2026-02-21T09:24:34.3052105Z  'pid_type': 'flat',
2026-02-21T09:24:34.3065452Z  'range_flattens': [None],
2026-02-21T09:24:34.3065734Z  'range_multi_buffers': [None],
2026-02-21T09:24:34.3065984Z  'range_num_stages': [0],
2026-02-21T09:24:34.3066223Z  'range_unroll_factors': [0],
2026-02-21T09:24:34.3066467Z  'range_warp_specializes': [],
2026-02-21T09:24:34.3066720Z  'reduction_loops': [None]}
2026-02-21T09:24:34.3080740Z [275s] Fitting surrogate: 594 points, 594 targets
2026-02-21T09:24:34.7370705Z [276s] Generation 11 starting: 21 neighbors, 2 active search path(s)
2026-02-21T09:24:38.9182025Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 5.2 configs/s
2026-02-21T09:24:40.4172906Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 15.8 configs/s
2026-02-21T09:24:45.8415726Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 184.1         
2026-02-21T09:24:45.8417078Z                                                                   configs/s     
2026-02-21T09:24:46.0998228Z [287s] Generation 11 complete: 
2026-02-21T09:24:46.0998484Z ok=24
2026-02-21T09:24:46.0998640Z min=0.1278
2026-02-21T09:24:46.0998796Z mid=0.1313
2026-02-21T09:24:46.0998959Z max=0.1999
2026-02-21T09:24:46.0999119Z best={'block_sizes': [1],
2026-02-21T09:24:46.0999506Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:24:46.1000034Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:24:46.1000387Z               'pointer'],
2026-02-21T09:24:46.1001323Z  'load_eviction_policies': ['', '', 'last', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:24:46.1001678Z  'num_stages': 6,
2026-02-21T09:24:46.1001850Z  'num_warps': 16,
2026-02-21T09:24:46.1002017Z  'pid_type': 'flat',
2026-02-21T09:24:46.1002205Z  'range_flattens': [None],
2026-02-21T09:24:46.1002417Z  'range_multi_buffers': [None],
2026-02-21T09:24:46.1002629Z  'range_num_stages': [0],
2026-02-21T09:24:46.1002829Z  'range_unroll_factors': [0],
2026-02-21T09:24:46.1003039Z  'range_warp_specializes': [],
2026-02-21T09:24:46.1003251Z  'reduction_loops': [None]}
2026-02-21T09:24:46.1032755Z [287s] Fitting surrogate: 618 points, 618 targets
2026-02-21T09:24:46.5205020Z [288s] Generation 12 starting: 18 neighbors, 2 active search path(s)
2026-02-21T09:24:49.6781353Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 10.6 configs/s
2026-02-21T09:24:50.6250768Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 18.9 configs/s
2026-02-21T09:24:54.5457569Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 254.1         
2026-02-21T09:24:54.5459251Z                                                                   configs/s     
2026-02-21T09:24:54.7602040Z [296s] Generation 12 complete: 
2026-02-21T09:24:54.7602330Z error=2
2026-02-21T09:24:54.7602549Z ok=18
2026-02-21T09:24:54.7602719Z min=0.1279
2026-02-21T09:24:54.7602901Z mid=0.1313
2026-02-21T09:24:54.7603075Z max=0.1400
2026-02-21T09:24:54.7603257Z best={'block_sizes': [1],
2026-02-21T09:24:54.7603708Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:24:54.7604574Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:24:54.7605074Z  'load_eviction_policies': ['', '', 'first', '', 'last', '', 'last', 'first'],
2026-02-21T09:24:54.7605451Z  'num_stages': 1,
2026-02-21T09:24:54.7605656Z  'num_warps': 16,
2026-02-21T09:24:54.7605855Z  'pid_type': 'flat',
2026-02-21T09:24:54.7606084Z  'range_flattens': [None],
2026-02-21T09:24:54.7606327Z  'range_multi_buffers': [None],
2026-02-21T09:24:54.7606582Z  'range_num_stages': [0],
2026-02-21T09:24:54.7606822Z  'range_unroll_factors': [0],
2026-02-21T09:24:54.7607067Z  'range_warp_specializes': [],
2026-02-21T09:24:54.7607323Z  'reduction_loops': [None]}
2026-02-21T09:24:54.7637228Z [296s] Fitting surrogate: 638 points, 638 targets
2026-02-21T09:24:55.0619674Z [296s] Generation 13 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:24:57.1673170Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 9.3 configs/s
2026-02-21T09:24:57.6967665Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.7 configs/s
2026-02-21T09:24:59.8633810Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 454.7         
2026-02-21T09:24:59.8634623Z                                                                   configs/s     
2026-02-21T09:25:00.0063688Z [301s] Generation 13 complete: 
2026-02-21T09:25:00.0063949Z error=1
2026-02-21T09:25:00.0064439Z ok=10
2026-02-21T09:25:00.0064606Z min=0.1300
2026-02-21T09:25:00.0065274Z mid=0.1328
2026-02-21T09:25:00.0065449Z max=0.1464
2026-02-21T09:25:00.0065636Z best={'block_sizes': [1],
2026-02-21T09:25:00.0066088Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:25:00.0066890Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:25:00.0067383Z  'load_eviction_policies': ['', '', 'first', '', 'last', '', 'last', 'first'],
2026-02-21T09:25:00.0067749Z  'num_stages': 1,
2026-02-21T09:25:00.0067941Z  'num_warps': 16,
2026-02-21T09:25:00.0068129Z  'pid_type': 'flat',
2026-02-21T09:25:00.0068337Z  'range_flattens': [None],
2026-02-21T09:25:00.0068562Z  'range_multi_buffers': [None],
2026-02-21T09:25:00.0068804Z  'range_num_stages': [0],
2026-02-21T09:25:00.0069031Z  'range_unroll_factors': [0],
2026-02-21T09:25:00.0069269Z  'range_warp_specializes': [],
2026-02-21T09:25:00.0069509Z  'reduction_loops': [None]}
2026-02-21T09:25:00.0097836Z [301s] Fitting surrogate: 649 points, 649 targets
2026-02-21T09:25:00.2766601Z [301s] Generation 14 starting: 6 neighbors, 1 active search path(s)
2026-02-21T09:25:01.5810161Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6/6 14.9 configs/s
2026-02-21T09:25:01.9379595Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 6/6 19.7 configs/s
2026-02-21T09:25:03.4879676Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 628.2         
2026-02-21T09:25:03.4881475Z                                                                   configs/s     
2026-02-21T09:25:03.6063641Z [305s] Generation 14 complete: 
2026-02-21T09:25:03.6063878Z ok=7
2026-02-21T09:25:03.6064204Z min=0.1314
2026-02-21T09:25:03.6064374Z mid=0.1460
2026-02-21T09:25:03.6064541Z max=0.1506
2026-02-21T09:25:03.6064728Z best={'block_sizes': [1],
2026-02-21T09:25:03.6065161Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:25:03.6065772Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:25:03.6066262Z  'load_eviction_policies': ['', '', 'first', '', 'last', '', 'last', 'first'],
2026-02-21T09:25:03.6066640Z  'num_stages': 1,
2026-02-21T09:25:03.6066852Z  'num_warps': 16,
2026-02-21T09:25:03.6067046Z  'pid_type': 'flat',
2026-02-21T09:25:03.6067257Z  'range_flattens': [None],
2026-02-21T09:25:03.6067494Z  'range_multi_buffers': [None],
2026-02-21T09:25:03.6067742Z  'range_num_stages': [0],
2026-02-21T09:25:03.6067965Z  'range_unroll_factors': [0],
2026-02-21T09:25:03.6068216Z  'range_warp_specializes': [],
2026-02-21T09:25:03.6068454Z  'reduction_loops': [None]}
2026-02-21T09:25:03.6102687Z [305s] Fitting surrogate: 656 points, 656 targets
2026-02-21T09:25:03.7707364Z [305s] Autotuning complete in 305.4s after searching 627 configs.
2026-02-21T09:25:03.7707849Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:25:03.7709923Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['', '', 'first', '', 'last', '', 'last', 'first'], num_stages=1, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:25:03.7712622Z 
2026-02-21T09:25:03.7713089Z [305s] Code of selected kernel: /tmp/torchinductor_root/ch/cchzjgwjoi32b26lhzzu3okrfx2vu3z7bd2ddwsb4zlyav2ujuhe.py
2026-02-21T09:25:04.9761484Z WARNING:tritonbench.utils.triton_op:Completed input ID 20:
2026-02-21T09:25:04.9761865Z (M, N)
2026-02-21T09:25:04.9762038Z -------------
2026-02-21T09:25:04.9762229Z (4096, 11264)
2026-02-21T09:25:04.9762566Z 
2026-02-21T09:25:04.9781282Z  70%|███████   | 14/20 [1:06:37<30:37, 306.17s/it]WARNING:tritonbench.utils.triton_op:Running input ID 21:
2026-02-21T09:25:04.9781762Z (M, N)
2026-02-21T09:25:04.9782335Z -------------
2026-02-21T09:25:04.9782517Z (4096, 11776)
2026-02-21T09:25:04.9785465Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:25:06.2683874Z INFO:tritonbench.utils.triton_op:Took 3.27ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:25:11.3063289Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:25:12.7266198Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:25:12.7266583Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:25:12.7266924Z               'dtype': 'torch.float32',
2026-02-21T09:25:12.7267222Z               'shape': (4096, 11776),
2026-02-21T09:25:12.7267497Z               'stride': (11776, 1)},
2026-02-21T09:25:12.7267751Z             (11776,),
2026-02-21T09:25:12.7267957Z             { 'device': 'cuda:0',
2026-02-21T09:25:12.7268235Z               'dtype': 'torch.float32',
2026-02-21T09:25:12.7268494Z               'shape': (11776,),
2026-02-21T09:25:12.7268755Z               'stride': (1,)},
2026-02-21T09:25:12.7268983Z             { 'device': 'cuda:0',
2026-02-21T09:25:12.7269249Z               'dtype': 'torch.float32',
2026-02-21T09:25:12.7269526Z               'shape': (11776,),
2026-02-21T09:25:12.7269757Z               'stride': (1,)},
2026-02-21T09:25:12.7269976Z             1e-05),
2026-02-21T09:25:12.7270168Z   'kwargs': {}}
2026-02-21T09:25:12.7317455Z INFO:tritonbench.utils.triton_op:Took 5.53ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:25:12.7441090Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:25:12.7441980Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:25:12.7442594Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:25:12.7442939Z While processing:
2026-02-21T09:25:12.7446155Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:25:12.7446587Z     if bias is not None:
2026-02-21T09:25:12.7446794Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:25:12.7446915Z 
2026-02-21T09:25:12.9010441Z [0s] Autotune random seed: 2135381352
2026-02-21T09:25:13.3159499Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:25:51.0833883Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:25:53.3074880Z [40s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:25:53.3096038Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:26:01.1776419Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.7 configs/s
2026-02-21T09:26:01.1788805Z [47s] Adaptive compile timeout: 30s (90% percentile=13.2s, bounds=[30.0s, 30s])
2026-02-21T09:26:02.5140264Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 718.1 configs/s
2026-02-21T09:26:02.6289831Z [49s] Initial random population of 100, 5 starting points: 
2026-02-21T09:26:02.6290275Z error=12
2026-02-21T09:26:02.6290484Z timeout=2
2026-02-21T09:26:02.6290724Z ok=86
2026-02-21T09:26:02.6290930Z min=0.1453
2026-02-21T09:26:02.6291156Z mid=0.5174
2026-02-21T09:26:02.6291374Z max=49.1845
2026-02-21T09:26:02.6291612Z best={'block_sizes': [1],
2026-02-21T09:26:02.6292202Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:26:02.6293021Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:26:02.6293575Z               'pointer'],
2026-02-21T09:26:02.6294377Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:26:02.6294919Z  'num_stages': 6,
2026-02-21T09:26:02.6295169Z  'num_warps': 16,
2026-02-21T09:26:02.6295424Z  'pid_type': 'flat',
2026-02-21T09:26:02.6295699Z  'range_flattens': [None],
2026-02-21T09:26:02.6296011Z  'range_multi_buffers': [None],
2026-02-21T09:26:02.6296333Z  'range_num_stages': [0],
2026-02-21T09:26:02.6296635Z  'range_unroll_factors': [0],
2026-02-21T09:26:02.6311151Z  'range_warp_specializes': [],
2026-02-21T09:26:02.6311548Z  'reduction_loops': [8192]}
2026-02-21T09:26:02.6311959Z [49s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:26:04.0167224Z [50s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T09:26:26.2721744Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 2.4 configs/s
2026-02-21T09:26:31.3940044Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 16.7 configs/s
2026-02-21T09:26:42.1684798Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.1 configs/s
2026-02-21T09:26:42.6070444Z [89s] Generation 1 complete: 
2026-02-21T09:26:42.6070826Z error=4
2026-02-21T09:26:42.6071062Z ok=83
2026-02-21T09:26:42.6071277Z min=0.1342
2026-02-21T09:26:42.6071521Z mid=0.1884
2026-02-21T09:26:42.6071765Z max=1.3951
2026-02-21T09:26:42.6072004Z best={'block_sizes': [1],
2026-02-21T09:26:42.6072587Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:26:42.6073429Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:26:42.6074453Z               'pointer'],
2026-02-21T09:26:42.6074940Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', 'first'],
2026-02-21T09:26:42.6075500Z  'num_stages': 6,
2026-02-21T09:26:42.6075754Z  'num_warps': 16,
2026-02-21T09:26:42.6076010Z  'pid_type': 'flat',
2026-02-21T09:26:42.6076289Z  'range_flattens': [None],
2026-02-21T09:26:42.6076610Z  'range_multi_buffers': [None],
2026-02-21T09:26:42.6076932Z  'range_num_stages': [0],
2026-02-21T09:26:42.6077231Z  'range_unroll_factors': [0],
2026-02-21T09:26:42.6077556Z  'range_warp_specializes': [],
2026-02-21T09:26:42.6077874Z  'reduction_loops': [None]}
2026-02-21T09:26:42.6100045Z [89s] Fitting surrogate: 187 points, 187 targets
2026-02-21T09:26:43.8651701Z [90s] Generation 2 starting: 74 neighbors, 5 active search path(s)
2026-02-21T09:27:03.2458413Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 4.7 configs/s
2026-02-21T09:27:08.4186938Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 15.0 configs/s
2026-02-21T09:27:20.3297472Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 84.3 configs/s
2026-02-21T09:27:20.8378409Z [127s] Generation 2 complete: 
2026-02-21T09:27:20.8378725Z error=19
2026-02-21T09:27:20.8378929Z ok=61
2026-02-21T09:27:20.8379110Z min=0.1327
2026-02-21T09:27:20.8379290Z mid=0.1481
2026-02-21T09:27:20.8379467Z max=0.8603
2026-02-21T09:27:20.8379649Z best={'block_sizes': [1],
2026-02-21T09:27:20.8380069Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:27:20.8380618Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:27:20.8381961Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T09:27:20.8382316Z  'num_stages': 1,
2026-02-21T09:27:20.8382525Z  'num_warps': 16,
2026-02-21T09:27:20.8382725Z  'pid_type': 'flat',
2026-02-21T09:27:20.8382965Z  'range_flattens': [None],
2026-02-21T09:27:20.8383208Z  'range_multi_buffers': [None],
2026-02-21T09:27:20.8383451Z  'range_num_stages': [0],
2026-02-21T09:27:20.8383690Z  'range_unroll_factors': [0],
2026-02-21T09:27:20.8383941Z  'range_warp_specializes': [],
2026-02-21T09:27:20.8384394Z  'reduction_loops': [None]}
2026-02-21T09:27:20.8409591Z [127s] Fitting surrogate: 267 points, 267 targets
2026-02-21T09:27:21.9120126Z [128s] Generation 3 starting: 63 neighbors, 5 active search path(s)
2026-02-21T09:27:36.6953843Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 5.0 configs/s
2026-02-21T09:27:43.4703676Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 63/63 9.3 configs/s
2026-02-21T09:27:57.7520345Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.4 configs/s
2026-02-21T09:27:58.3433405Z [165s] Generation 3 complete: 
2026-02-21T09:27:58.3433851Z error=4
2026-02-21T09:27:58.3434423Z ok=64
2026-02-21T09:27:58.3434733Z min=0.1327
2026-02-21T09:27:58.3435020Z mid=0.1414
2026-02-21T09:27:58.3435294Z max=0.5985
2026-02-21T09:27:58.3435599Z best={'block_sizes': [1],
2026-02-21T09:27:58.3436320Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:27:58.3437316Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:27:58.3438190Z  'load_eviction_policies': ['', 'last', 'last', '', '', 'first', 'last', 'first'],
2026-02-21T09:27:58.3438811Z  'num_stages': 6,
2026-02-21T09:27:58.3439127Z  'num_warps': 16,
2026-02-21T09:27:58.3439426Z  'pid_type': 'flat',
2026-02-21T09:27:58.3439765Z  'range_flattens': [None],
2026-02-21T09:27:58.3440151Z  'range_multi_buffers': [None],
2026-02-21T09:27:58.3440537Z  'range_num_stages': [0],
2026-02-21T09:27:58.3440926Z  'range_unroll_factors': [0],
2026-02-21T09:27:58.3441360Z  'range_warp_specializes': [],
2026-02-21T09:27:58.3441773Z  'reduction_loops': [None]}
2026-02-21T09:27:58.3458864Z [165s] Fitting surrogate: 335 points, 335 targets
2026-02-21T09:27:59.3313176Z [166s] Generation 4 starting: 56 neighbors, 5 active search path(s)
2026-02-21T09:28:13.1586315Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 8.0 configs/s
2026-02-21T09:28:16.8037731Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 15.8 configs/s
2026-02-21T09:28:28.4921733Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 85.9 configs/s
2026-02-21T09:28:28.9895952Z [195s] Generation 4 complete: 
2026-02-21T09:28:28.9896397Z error=3
2026-02-21T09:28:28.9896689Z ok=58
2026-02-21T09:28:28.9896967Z min=0.1335
2026-02-21T09:28:28.9897247Z mid=0.1416
2026-02-21T09:28:28.9897534Z max=0.3652
2026-02-21T09:28:28.9897832Z best={'block_sizes': [1],
2026-02-21T09:28:28.9898599Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:28:28.9899633Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:28:29.0102995Z  'load_eviction_policies': ['', 'last', 'last', '', '', 'first', 'last', 'first'],
2026-02-21T09:28:29.0103461Z  'num_stages': 6,
2026-02-21T09:28:29.0103652Z  'num_warps': 16,
2026-02-21T09:28:29.0103846Z  'pid_type': 'flat',
2026-02-21T09:28:29.0104388Z  'range_flattens': [None],
2026-02-21T09:28:29.0104627Z  'range_multi_buffers': [None],
2026-02-21T09:28:29.0104866Z  'range_num_stages': [0],
2026-02-21T09:28:29.0105109Z  'range_unroll_factors': [0],
2026-02-21T09:28:29.0105347Z  'range_warp_specializes': [],
2026-02-21T09:28:29.0105590Z  'reduction_loops': [None]}
2026-02-21T09:28:29.0105853Z [195s] Fitting surrogate: 396 points, 396 targets
2026-02-21T09:28:29.6393131Z [196s] Generation 5 starting: 32 neighbors, 4 active search path(s)
2026-02-21T09:28:39.6905069Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 5.1 configs/s
2026-02-21T09:28:42.0819541Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 32/32 13.3 configs/s
2026-02-21T09:28:49.8819095Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.4         
2026-02-21T09:28:49.8819584Z                                                                   configs/s     
2026-02-21T09:28:50.2476719Z [216s] Generation 5 complete: 
2026-02-21T09:28:50.2476993Z error=1
2026-02-21T09:28:50.2477183Z ok=35
2026-02-21T09:28:50.2477358Z min=0.1337
2026-02-21T09:28:50.2477540Z mid=0.1372
2026-02-21T09:28:50.2477718Z max=0.1993
2026-02-21T09:28:50.2477904Z best={'block_sizes': [1],
2026-02-21T09:28:50.2478330Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:28:50.2478906Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:28:50.2479382Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', ''],
2026-02-21T09:28:50.2479717Z  'num_stages': 2,
2026-02-21T09:28:50.2479908Z  'num_warps': 16,
2026-02-21T09:28:50.2480094Z  'pid_type': 'flat',
2026-02-21T09:28:50.2480300Z  'range_flattens': [None],
2026-02-21T09:28:50.2480545Z  'range_multi_buffers': [None],
2026-02-21T09:28:50.2480777Z  'range_num_stages': [0],
2026-02-21T09:28:50.2481002Z  'range_unroll_factors': [0],
2026-02-21T09:28:50.2481239Z  'range_warp_specializes': [],
2026-02-21T09:28:50.2481476Z  'reduction_loops': [None]}
2026-02-21T09:28:50.2505688Z [216s] Fitting surrogate: 432 points, 432 targets
2026-02-21T09:28:50.9124938Z [217s] Generation 6 starting: 33 neighbors, 4 active search path(s)
2026-02-21T09:28:59.0363640Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 6.6 configs/s
2026-02-21T09:29:00.8799994Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 35/35 19.0 configs/s
2026-02-21T09:29:08.1841582Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 137.1         
2026-02-21T09:29:08.1842134Z                                                                   configs/s     
2026-02-21T09:29:08.5335114Z [235s] Generation 6 complete: 
2026-02-21T09:29:08.5335411Z error=4
2026-02-21T09:29:08.5336009Z ok=33
2026-02-21T09:29:08.5336224Z min=0.1328
2026-02-21T09:29:08.5336434Z mid=0.1367
2026-02-21T09:29:08.5336627Z max=0.3650
2026-02-21T09:29:08.5336848Z best={'block_sizes': [1],
2026-02-21T09:29:08.5337326Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:29:08.5338019Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:29:08.5338614Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', ''],
2026-02-21T09:29:08.5339023Z  'num_stages': 2,
2026-02-21T09:29:08.5339250Z  'num_warps': 16,
2026-02-21T09:29:08.5339470Z  'pid_type': 'flat',
2026-02-21T09:29:08.5339727Z  'range_flattens': [None],
2026-02-21T09:29:08.5339995Z  'range_multi_buffers': [None],
2026-02-21T09:29:08.5340302Z  'range_num_stages': [0],
2026-02-21T09:29:08.5340571Z  'range_unroll_factors': [0],
2026-02-21T09:29:08.5340861Z  'range_warp_specializes': [],
2026-02-21T09:29:08.5341143Z  'reduction_loops': [None]}
2026-02-21T09:29:08.5365653Z [235s] Fitting surrogate: 469 points, 469 targets
2026-02-21T09:29:10.3698713Z [237s] Generation 7 starting: 38 neighbors, 4 active search path(s)
2026-02-21T09:29:20.3811951Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 2.6 configs/s
2026-02-21T09:29:22.6659758Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 40/40 17.9 configs/s
2026-02-21T09:29:31.5043474Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 113.5         
2026-02-21T09:29:31.5044331Z                                                                   configs/s     
2026-02-21T09:29:31.9154479Z [258s] Generation 7 complete: 
2026-02-21T09:29:31.9154953Z error=1
2026-02-21T09:29:31.9155228Z ok=41
2026-02-21T09:29:31.9155523Z min=0.1328
2026-02-21T09:29:31.9156683Z mid=0.1361
2026-02-21T09:29:31.9157023Z max=0.5973
2026-02-21T09:29:31.9157275Z best={'block_sizes': [1],
2026-02-21T09:29:31.9157744Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:29:31.9158414Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:29:31.9158941Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', ''],
2026-02-21T09:29:31.9159286Z  'num_stages': 2,
2026-02-21T09:29:31.9159487Z  'num_warps': 16,
2026-02-21T09:29:31.9159690Z  'pid_type': 'flat',
2026-02-21T09:29:31.9159935Z  'range_flattens': [None],
2026-02-21T09:29:31.9160182Z  'range_multi_buffers': [None],
2026-02-21T09:29:31.9160432Z  'range_num_stages': [0],
2026-02-21T09:29:31.9160661Z  'range_unroll_factors': [0],
2026-02-21T09:29:31.9160914Z  'range_warp_specializes': [],
2026-02-21T09:29:31.9161172Z  'reduction_loops': [None]}
2026-02-21T09:29:31.9187734Z [258s] Fitting surrogate: 511 points, 511 targets
2026-02-21T09:29:32.4687002Z [259s] Generation 8 starting: 27 neighbors, 3 active search path(s)
2026-02-21T09:29:38.7986651Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 1.4 configs/s
2026-02-21T09:29:40.3851013Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 28/28 18.2 configs/s
2026-02-21T09:29:47.0884858Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 149.3         
2026-02-21T09:29:47.0885557Z                                                                   configs/s     
2026-02-21T09:29:47.4111054Z [274s] Generation 8 complete: 
2026-02-21T09:29:47.4111524Z error=1
2026-02-21T09:29:47.4111810Z ok=29
2026-02-21T09:29:47.4112072Z min=0.1349
2026-02-21T09:29:47.4112351Z mid=0.1389
2026-02-21T09:29:47.4112611Z max=0.1853
2026-02-21T09:29:47.4112927Z best={'block_sizes': [1],
2026-02-21T09:29:47.4113670Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:29:47.4115261Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:29:47.4116078Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', ''],
2026-02-21T09:29:47.4116612Z  'num_stages': 2,
2026-02-21T09:29:47.4117910Z  'num_warps': 16,
2026-02-21T09:29:47.4118230Z  'pid_type': 'flat',
2026-02-21T09:29:47.4118432Z  'range_flattens': [None],
2026-02-21T09:29:47.4118642Z  'range_multi_buffers': [None],
2026-02-21T09:29:47.4118879Z  'range_num_stages': [0],
2026-02-21T09:29:47.4119086Z  'range_unroll_factors': [0],
2026-02-21T09:29:47.4119311Z  'range_warp_specializes': [],
2026-02-21T09:29:47.4119537Z  'reduction_loops': [None]}
2026-02-21T09:29:47.4142134Z [274s] Fitting surrogate: 541 points, 541 targets
2026-02-21T09:29:47.8218213Z [274s] Generation 9 starting: 17 neighbors, 2 active search path(s)
2026-02-21T09:29:51.9644383Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 4.7 configs/s
2026-02-21T09:29:53.1636723Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 15.5 configs/s
2026-02-21T09:29:56.8035177Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 272.9         
2026-02-21T09:29:56.8035716Z                                                                   configs/s     
2026-02-21T09:29:57.0043793Z [283s] Generation 9 complete: 
2026-02-21T09:29:57.0044498Z ok=19
2026-02-21T09:29:57.0044748Z min=0.1330
2026-02-21T09:29:57.0044922Z mid=0.1419
2026-02-21T09:29:57.0045111Z max=0.3404
2026-02-21T09:29:57.0045295Z best={'block_sizes': [1],
2026-02-21T09:29:57.0045751Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:29:57.0046335Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:29:57.0046804Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', ''],
2026-02-21T09:29:57.0047185Z  'num_stages': 2,
2026-02-21T09:29:57.0047377Z  'num_warps': 16,
2026-02-21T09:29:57.0047576Z  'pid_type': 'flat',
2026-02-21T09:29:57.0047803Z  'range_flattens': [None],
2026-02-21T09:29:57.0048042Z  'range_multi_buffers': [None],
2026-02-21T09:29:57.0048285Z  'range_num_stages': [0],
2026-02-21T09:29:57.0048510Z  'range_unroll_factors': [0],
2026-02-21T09:29:57.0048778Z  'range_warp_specializes': [],
2026-02-21T09:29:57.0049030Z  'reduction_loops': [None]}
2026-02-21T09:29:57.0076953Z [283s] Fitting surrogate: 560 points, 560 targets
2026-02-21T09:29:57.2887262Z [283s] Generation 10 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:30:05.1844416Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 1.4 configs/s
2026-02-21T09:30:05.8746910Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 15.3 configs/s
2026-02-21T09:30:07.7421740Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 523.6         
2026-02-21T09:30:07.7422352Z                                                                   configs/s     
2026-02-21T09:30:07.8721293Z [294s] Generation 10 complete: 
2026-02-21T09:30:07.8721669Z error=1
2026-02-21T09:30:07.8721855Z ok=10
2026-02-21T09:30:07.8722034Z min=0.1363
2026-02-21T09:30:07.8722206Z mid=0.1639
2026-02-21T09:30:07.8722378Z max=0.4153
2026-02-21T09:30:07.8722582Z best={'block_sizes': [1],
2026-02-21T09:30:07.8723030Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:30:07.8723607Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:30:07.8724578Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', ''],
2026-02-21T09:30:07.8724955Z  'num_stages': 2,
2026-02-21T09:30:07.8725152Z  'num_warps': 16,
2026-02-21T09:30:07.8725354Z  'pid_type': 'flat',
2026-02-21T09:30:07.8725570Z  'range_flattens': [None],
2026-02-21T09:30:07.8725812Z  'range_multi_buffers': [None],
2026-02-21T09:30:07.8726051Z  'range_num_stages': [0],
2026-02-21T09:30:07.8726298Z  'range_unroll_factors': [0],
2026-02-21T09:30:07.8726541Z  'range_warp_specializes': [],
2026-02-21T09:30:07.8726797Z  'reduction_loops': [None]}
2026-02-21T09:30:07.8760367Z [294s] Fitting surrogate: 571 points, 571 targets
2026-02-21T09:30:08.1788953Z [294s] Generation 11 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:30:12.7179443Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 5.1 configs/s
2026-02-21T09:30:13.5648547Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 14.8 configs/s
2026-02-21T09:30:15.9221146Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 417.4         
2026-02-21T09:30:15.9221633Z                                                                   configs/s     
2026-02-21T09:30:16.0692767Z [302s] Generation 11 complete: 
2026-02-21T09:30:16.0693036Z error=1
2026-02-21T09:30:16.0693231Z ok=12
2026-02-21T09:30:16.0693404Z min=0.1357
2026-02-21T09:30:16.0693572Z mid=0.1616
2026-02-21T09:30:16.0693758Z max=0.5881
2026-02-21T09:30:16.0693942Z best={'block_sizes': [1],
2026-02-21T09:30:16.0695354Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:30:16.0695940Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:30:16.0696441Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', ''],
2026-02-21T09:30:16.0696796Z  'num_stages': 2,
2026-02-21T09:30:16.0696987Z  'num_warps': 16,
2026-02-21T09:30:16.0697204Z  'pid_type': 'flat',
2026-02-21T09:30:16.0697460Z  'range_flattens': [None],
2026-02-21T09:30:16.0697742Z  'range_multi_buffers': [None],
2026-02-21T09:30:16.0697974Z  'range_num_stages': [0],
2026-02-21T09:30:16.0698202Z  'range_unroll_factors': [0],
2026-02-21T09:30:16.0698436Z  'range_warp_specializes': [],
2026-02-21T09:30:16.0698674Z  'reduction_loops': [None]}
2026-02-21T09:30:16.0732887Z [302s] Fitting surrogate: 584 points, 584 targets
2026-02-21T09:30:16.3487392Z [303s] Generation 12 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:30:19.1004442Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 7.7 configs/s
2026-02-21T09:30:19.6925437Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.4 configs/s
2026-02-21T09:30:22.2280400Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 388.9         
2026-02-21T09:30:22.2280909Z                                                                   configs/s     
2026-02-21T09:30:22.3833949Z [309s] Generation 12 complete: 
2026-02-21T09:30:22.3834648Z ok=11
2026-02-21T09:30:22.3834979Z min=0.1361
2026-02-21T09:30:22.3835264Z mid=0.1471
2026-02-21T09:30:22.3835529Z max=0.1633
2026-02-21T09:30:22.3835813Z best={'block_sizes': [1],
2026-02-21T09:30:22.3836558Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:30:22.3837561Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:30:22.3838328Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', ''],
2026-02-21T09:30:22.3838899Z  'num_stages': 2,
2026-02-21T09:30:22.3839249Z  'num_warps': 16,
2026-02-21T09:30:22.3839566Z  'pid_type': 'flat',
2026-02-21T09:30:22.3839906Z  'range_flattens': [None],
2026-02-21T09:30:22.3840312Z  'range_multi_buffers': [None],
2026-02-21T09:30:22.3840711Z  'range_num_stages': [0],
2026-02-21T09:30:22.3841087Z  'range_unroll_factors': [0],
2026-02-21T09:30:22.3841482Z  'range_warp_specializes': [],
2026-02-21T09:30:22.3841950Z  'reduction_loops': [None]}
2026-02-21T09:30:22.3869433Z [309s] Fitting surrogate: 595 points, 595 targets
2026-02-21T09:30:22.6724878Z [309s] Generation 13 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:30:26.1355620Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 6.0 configs/s
2026-02-21T09:30:26.8692753Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 15.9 configs/s
2026-02-21T09:30:29.1373183Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 434.3         
2026-02-21T09:30:29.1373753Z                                                                   configs/s     
2026-02-21T09:30:29.2844327Z [315s] Generation 13 complete: 
2026-02-21T09:30:29.2844637Z error=2
2026-02-21T09:30:29.2844818Z ok=10
2026-02-21T09:30:29.2845007Z min=0.1359
2026-02-21T09:30:29.2845889Z mid=0.1421
2026-02-21T09:30:29.2846070Z max=0.1552
2026-02-21T09:30:29.2846264Z best={'block_sizes': [1],
2026-02-21T09:30:29.2846748Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:30:29.2847364Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:30:29.2847864Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', ''],
2026-02-21T09:30:29.2848253Z  'num_stages': 2,
2026-02-21T09:30:29.2848457Z  'num_warps': 16,
2026-02-21T09:30:29.2848666Z  'pid_type': 'flat',
2026-02-21T09:30:29.2848887Z  'range_flattens': [None],
2026-02-21T09:30:29.2849136Z  'range_multi_buffers': [None],
2026-02-21T09:30:29.2849385Z  'range_num_stages': [0],
2026-02-21T09:30:29.2850004Z  'range_unroll_factors': [0],
2026-02-21T09:30:29.2850281Z  'range_warp_specializes': [],
2026-02-21T09:30:29.2850541Z  'reduction_loops': [None]}
2026-02-21T09:30:29.2878723Z [315s] Fitting surrogate: 607 points, 607 targets
2026-02-21T09:30:29.5883534Z [316s] Generation 14 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:30:32.5856187Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 4.2 configs/s
2026-02-21T09:30:33.1941060Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 19.8 configs/s
2026-02-21T09:30:35.4879170Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 429.3         
2026-02-21T09:30:35.4879645Z                                                                   configs/s     
2026-02-21T09:30:35.6352577Z [322s] Generation 14 complete: 
2026-02-21T09:30:35.6353063Z error=1
2026-02-21T09:30:35.6353337Z ok=11
2026-02-21T09:30:35.6353615Z min=0.1328
2026-02-21T09:30:35.6353899Z mid=0.1425
2026-02-21T09:30:35.6354656Z max=0.3572
2026-02-21T09:30:35.6354998Z best={'block_sizes': [1],
2026-02-21T09:30:35.6355737Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:30:35.6356819Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:30:35.6357709Z  'load_eviction_policies': ['', '', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:30:35.6358296Z  'num_stages': 5,
2026-02-21T09:30:35.6358609Z  'num_warps': 16,
2026-02-21T09:30:35.6358923Z  'pid_type': 'flat',
2026-02-21T09:30:35.6359256Z  'range_flattens': [None],
2026-02-21T09:30:35.6359632Z  'range_multi_buffers': [None],
2026-02-21T09:30:35.6360014Z  'range_num_stages': [0],
2026-02-21T09:30:35.6360385Z  'range_unroll_factors': [0],
2026-02-21T09:30:35.6360768Z  'range_warp_specializes': [],
2026-02-21T09:30:35.6361235Z  'reduction_loops': [None]}
2026-02-21T09:30:35.6386874Z [322s] Fitting surrogate: 619 points, 619 targets
2026-02-21T09:30:35.9405543Z [322s] Generation 15 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:30:37.8729035Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 17.4 configs/s
2026-02-21T09:30:38.4588388Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.6 configs/s
2026-02-21T09:30:40.9218369Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 400.5         
2026-02-21T09:30:40.9218862Z                                                                   configs/s     
2026-02-21T09:30:41.0766763Z [327s] Generation 15 complete: 
2026-02-21T09:30:41.0767218Z ok=11
2026-02-21T09:30:41.0767497Z min=0.1355
2026-02-21T09:30:41.0767772Z mid=0.1360
2026-02-21T09:30:41.0768040Z max=0.1752
2026-02-21T09:30:41.0768327Z best={'block_sizes': [1],
2026-02-21T09:30:41.0769058Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:30:41.0770242Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:30:41.0771853Z  'load_eviction_policies': ['', '', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:30:41.0772473Z  'num_stages': 6,
2026-02-21T09:30:41.0772789Z  'num_warps': 16,
2026-02-21T09:30:41.0773125Z  'pid_type': 'flat',
2026-02-21T09:30:41.0773459Z  'range_flattens': [None],
2026-02-21T09:30:41.0773841Z  'range_multi_buffers': [None],
2026-02-21T09:30:41.0774805Z  'range_num_stages': [0],
2026-02-21T09:30:41.0775248Z  'range_unroll_factors': [0],
2026-02-21T09:30:41.0775640Z  'range_warp_specializes': [],
2026-02-21T09:30:41.0775887Z  'reduction_loops': [None]}
2026-02-21T09:30:41.0801092Z [327s] Fitting surrogate: 630 points, 630 targets
2026-02-21T09:30:41.3670914Z [328s] Generation 16 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:30:43.5673920Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 5.5 configs/s
2026-02-21T09:30:44.1705192Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.0 configs/s
2026-02-21T09:30:46.6359603Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 400.1         
2026-02-21T09:30:46.6360130Z                                                                   configs/s     
2026-02-21T09:30:46.7899937Z [333s] Generation 16 complete: 
2026-02-21T09:30:46.7900196Z ok=11
2026-02-21T09:30:46.7900365Z min=0.1328
2026-02-21T09:30:46.7900529Z mid=0.1351
2026-02-21T09:30:46.7900704Z max=0.1759
2026-02-21T09:30:46.7900876Z best={'block_sizes': [1],
2026-02-21T09:30:46.7901325Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:30:46.7901984Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:30:46.7902569Z  'load_eviction_policies': ['', '', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:30:46.7902936Z  'num_stages': 6,
2026-02-21T09:30:46.7903136Z  'num_warps': 16,
2026-02-21T09:30:46.7903328Z  'pid_type': 'flat',
2026-02-21T09:30:46.7903551Z  'range_flattens': [None],
2026-02-21T09:30:46.7903803Z  'range_multi_buffers': [None],
2026-02-21T09:30:46.7905849Z  'range_num_stages': [0],
2026-02-21T09:30:46.7906090Z  'range_unroll_factors': [0],
2026-02-21T09:30:46.7906328Z  'range_warp_specializes': [],
2026-02-21T09:30:46.7906584Z  'reduction_loops': [None]}
2026-02-21T09:30:46.7934859Z [333s] Fitting surrogate: 641 points, 641 targets
2026-02-21T09:30:47.0819015Z [333s] Generation 17 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:30:49.5175948Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 5.0 configs/s
2026-02-21T09:30:50.0520714Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.5 configs/s
2026-02-21T09:30:52.5103898Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 401.3         
2026-02-21T09:30:52.5104632Z                                                                   configs/s     
2026-02-21T09:30:52.6628143Z [339s] Generation 17 complete: 
2026-02-21T09:30:52.6628399Z ok=11
2026-02-21T09:30:52.6628625Z min=0.1361
2026-02-21T09:30:52.6628802Z mid=0.1362
2026-02-21T09:30:52.6628965Z max=0.1653
2026-02-21T09:30:52.6629149Z best={'block_sizes': [1],
2026-02-21T09:30:52.6629611Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:30:52.6630736Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:30:52.6631268Z  'load_eviction_policies': ['', '', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:30:52.6631632Z  'num_stages': 7,
2026-02-21T09:30:52.6631832Z  'num_warps': 16,
2026-02-21T09:30:52.6632024Z  'pid_type': 'flat',
2026-02-21T09:30:52.6632237Z  'range_flattens': [None],
2026-02-21T09:30:52.6632477Z  'range_multi_buffers': [None],
2026-02-21T09:30:52.6632710Z  'range_num_stages': [0],
2026-02-21T09:30:52.6632944Z  'range_unroll_factors': [0],
2026-02-21T09:30:52.6633180Z  'range_warp_specializes': [],
2026-02-21T09:30:52.6633422Z  'reduction_loops': [None]}
2026-02-21T09:30:52.6663744Z [339s] Fitting surrogate: 652 points, 652 targets
2026-02-21T09:30:52.9615695Z [339s] Generation 18 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:30:55.9753018Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 6.2 configs/s
2026-02-21T09:30:56.5984613Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 19.2 configs/s
2026-02-21T09:30:59.0276535Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 406.3         
2026-02-21T09:30:59.0277081Z                                                                   configs/s     
2026-02-21T09:30:59.1802745Z [345s] Generation 18 complete: 
2026-02-21T09:30:59.1814954Z error=1
2026-02-21T09:30:59.1815172Z ok=11
2026-02-21T09:30:59.1815359Z min=0.1335
2026-02-21T09:30:59.1815550Z mid=0.1348
2026-02-21T09:30:59.1815741Z max=0.1500
2026-02-21T09:30:59.1815942Z best={'block_sizes': [1],
2026-02-21T09:30:59.1816431Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:30:59.1817133Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:30:59.1817723Z  'load_eviction_policies': ['', '', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T09:30:59.1818146Z  'num_stages': 7,
2026-02-21T09:30:59.1818332Z  'num_warps': 16,
2026-02-21T09:30:59.1818516Z  'pid_type': 'flat',
2026-02-21T09:30:59.1818707Z  'range_flattens': [None],
2026-02-21T09:30:59.1818928Z  'range_multi_buffers': [None],
2026-02-21T09:30:59.1819152Z  'range_num_stages': [0],
2026-02-21T09:30:59.1819371Z  'range_unroll_factors': [0],
2026-02-21T09:30:59.1819593Z  'range_warp_specializes': [],
2026-02-21T09:30:59.1819819Z  'reduction_loops': [None]}
2026-02-21T09:30:59.1838830Z [345s] Fitting surrogate: 664 points, 664 targets
2026-02-21T09:30:59.3539799Z [346s] Autotuning complete in 346.0s after searching 628 configs.
2026-02-21T09:30:59.3540442Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:30:59.3543149Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', '', 'last', 'last', '', 'first', '', 'first'], num_stages=7, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:30:59.3545990Z 
2026-02-21T09:30:59.3546542Z [346s] Code of selected kernel: /tmp/torchinductor_root/mq/cmqwajakvyijwjhxeaavsqyjehsvivchmdxfza4y652ad7sjw2bz.py
2026-02-21T09:31:00.5024528Z WARNING:tritonbench.utils.triton_op:Completed input ID 21:
2026-02-21T09:31:00.5024921Z (M, N)
2026-02-21T09:31:00.5025105Z -------------
2026-02-21T09:31:00.5025304Z (4096, 11776)
2026-02-21T09:31:00.5026297Z 
2026-02-21T09:31:00.5051059Z  75%|███████▌  | 15/20 [1:12:32<26:45, 321.05s/it]WARNING:tritonbench.utils.triton_op:Running input ID 23:
2026-02-21T09:31:00.5051831Z (M, N)
2026-02-21T09:31:00.5052097Z -------------
2026-02-21T09:31:00.5052396Z (4096, 12800)
2026-02-21T09:31:00.5055047Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:31:01.7813687Z INFO:tritonbench.utils.triton_op:Took 3.52ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:31:06.6462617Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:31:08.0520073Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:31:08.0520633Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:31:08.0521096Z               'dtype': 'torch.float32',
2026-02-21T09:31:08.0521571Z               'shape': (4096, 12800),
2026-02-21T09:31:08.0522027Z               'stride': (12800, 1)},
2026-02-21T09:31:08.0522449Z             (12800,),
2026-02-21T09:31:08.0522787Z             { 'device': 'cuda:0',
2026-02-21T09:31:08.0523859Z               'dtype': 'torch.float32',
2026-02-21T09:31:08.0524690Z               'shape': (12800,),
2026-02-21T09:31:08.0524928Z               'stride': (1,)},
2026-02-21T09:31:08.0525161Z             { 'device': 'cuda:0',
2026-02-21T09:31:08.0525402Z               'dtype': 'torch.float32',
2026-02-21T09:31:08.0525662Z               'shape': (12800,),
2026-02-21T09:31:08.0525885Z               'stride': (1,)},
2026-02-21T09:31:08.0526111Z             1e-05),
2026-02-21T09:31:08.0526303Z   'kwargs': {}}
2026-02-21T09:31:08.0547440Z INFO:tritonbench.utils.triton_op:Took 3.18ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:31:08.0668984Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:31:08.0670471Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:31:08.0671490Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:31:08.0672072Z While processing:
2026-02-21T09:31:08.0675547Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:31:08.0676002Z     if bias is not None:
2026-02-21T09:31:08.0676244Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:31:08.0676384Z 
2026-02-21T09:31:08.2279178Z [0s] Autotune random seed: 2135381352
2026-02-21T09:31:08.7403246Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:31:46.7014352Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:31:49.0457403Z [40s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:31:49.0482481Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T09:31:58.4299469Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 10.7 configs/s
2026-02-21T09:31:58.4312887Z [49s] Adaptive compile timeout: 30s (90% percentile=14.3s, bounds=[30.0s, 30s])
2026-02-21T09:31:59.8156852Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 691.8 configs/s
2026-02-21T09:31:59.9333493Z [51s] Initial random population of 100, 5 starting points: 
2026-02-21T09:31:59.9334558Z error=12
2026-02-21T09:31:59.9334762Z timeout=2
2026-02-21T09:31:59.9334935Z ok=86
2026-02-21T09:31:59.9335106Z min=0.1552
2026-02-21T09:31:59.9335275Z mid=0.5612
2026-02-21T09:31:59.9335581Z max=53.4590
2026-02-21T09:31:59.9335807Z best={'block_sizes': [1],
2026-02-21T09:31:59.9336330Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:31:59.9336971Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:31:59.9337389Z               'pointer'],
2026-02-21T09:31:59.9337751Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:31:59.9338144Z  'num_stages': 6,
2026-02-21T09:31:59.9338346Z  'num_warps': 16,
2026-02-21T09:31:59.9338863Z  'pid_type': 'flat',
2026-02-21T09:31:59.9339122Z  'range_flattens': [None],
2026-02-21T09:31:59.9339376Z  'range_multi_buffers': [None],
2026-02-21T09:31:59.9339619Z  'range_num_stages': [0],
2026-02-21T09:31:59.9339881Z  'range_unroll_factors': [0],
2026-02-21T09:31:59.9340176Z  'range_warp_specializes': [],
2026-02-21T09:31:59.9340473Z  'reduction_loops': [8192]}
2026-02-21T09:31:59.9356858Z [51s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:32:01.3196887Z [52s] Generation 1 starting: 84 neighbors, 5 active search path(s)
2026-02-21T09:32:40.9459151Z [92s] Timeout after 30s compiling Config(block_sizes=[2], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'last', 'last', 'last', '', 'first', '', 'first'], maxnreg=256, num_sm_multiplier=8, num_stages=8, num_warps=1, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[False], range_num_stages=[4], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T09:32:40.9477920Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 0.6 configs/s
2026-02-21T09:32:49.6262938Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 10.3 configs/s
2026-02-21T09:33:03.3661090Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 73.0 configs/s
2026-02-21T09:33:03.8938145Z [115s] Generation 1 complete: 
2026-02-21T09:33:03.8938421Z error=4
2026-02-21T09:33:03.8938604Z timeout=1
2026-02-21T09:33:03.8938790Z ok=85
2026-02-21T09:33:03.8938959Z min=0.1471
2026-02-21T09:33:03.8939145Z mid=0.2030
2026-02-21T09:33:03.8939320Z max=2.1463
2026-02-21T09:33:03.8939527Z best={'block_sizes': [2],
2026-02-21T09:33:03.8939941Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:33:03.8940623Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:33:03.8941111Z               'pointer'],
2026-02-21T09:33:03.8941493Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T09:33:03.8941947Z  'maxnreg': 256,
2026-02-21T09:33:03.8942154Z  'num_sm_multiplier': 8,
2026-02-21T09:33:03.8942398Z  'num_stages': 8,
2026-02-21T09:33:03.8942595Z  'num_warps': 8,
2026-02-21T09:33:03.8942822Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:33:03.8943118Z  'range_flattens': [False],
2026-02-21T09:33:03.8943361Z  'range_multi_buffers': [None],
2026-02-21T09:33:03.8943615Z  'range_num_stages': [4],
2026-02-21T09:33:03.8943860Z  'range_unroll_factors': [2],
2026-02-21T09:33:03.8944460Z  'range_warp_specializes': [],
2026-02-21T09:33:03.8944710Z  'reduction_loops': [None]}
2026-02-21T09:33:03.8963643Z [115s] Fitting surrogate: 190 points, 190 targets
2026-02-21T09:33:05.1773342Z [116s] Generation 2 starting: 77 neighbors, 5 active search path(s)
2026-02-21T09:33:25.6243512Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 3.4 configs/s
2026-02-21T09:33:29.8306127Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 19.3 configs/s
2026-02-21T09:33:47.2411723Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 61.2 configs/s
2026-02-21T09:33:47.9181226Z [159s] Generation 2 complete: 
2026-02-21T09:33:47.9181503Z error=12
2026-02-21T09:33:47.9181690Z ok=71
2026-02-21T09:33:47.9181864Z min=0.1438
2026-02-21T09:33:47.9182048Z mid=0.1675
2026-02-21T09:33:47.9182248Z max=1.0846
2026-02-21T09:33:47.9182475Z best={'block_sizes': [1],
2026-02-21T09:33:47.9182944Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:33:47.9183616Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:33:47.9184498Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:33:47.9184917Z  'num_stages': 6,
2026-02-21T09:33:47.9187417Z  'num_warps': 16,
2026-02-21T09:33:47.9187623Z  'pid_type': 'flat',
2026-02-21T09:33:47.9187848Z  'range_flattens': [None],
2026-02-21T09:33:47.9188073Z  'range_multi_buffers': [None],
2026-02-21T09:33:47.9188326Z  'range_num_stages': [0],
2026-02-21T09:33:47.9188543Z  'range_unroll_factors': [0],
2026-02-21T09:33:47.9188782Z  'range_warp_specializes': [],
2026-02-21T09:33:47.9189020Z  'reduction_loops': [None]}
2026-02-21T09:33:47.9208628Z [159s] Fitting surrogate: 273 points, 273 targets
2026-02-21T09:33:48.8166827Z [160s] Generation 3 starting: 49 neighbors, 5 active search path(s)
2026-02-21T09:34:00.0521975Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 14.5 configs/s
2026-02-21T09:34:03.2636785Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 16.1 configs/s
2026-02-21T09:34:14.2692034Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 91.2 configs/s
2026-02-21T09:34:14.7312986Z [185s] Generation 3 complete: 
2026-02-21T09:34:14.7313315Z error=4
2026-02-21T09:34:14.7313542Z ok=50
2026-02-21T09:34:14.7313718Z min=0.1445
2026-02-21T09:34:14.7313905Z mid=0.1600
2026-02-21T09:34:14.7314286Z max=0.4730
2026-02-21T09:34:14.7314487Z best={'block_sizes': [1],
2026-02-21T09:34:14.7314940Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:34:14.7315535Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:34:14.7316086Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:34:14.7316476Z  'num_stages': 6,
2026-02-21T09:34:14.7316676Z  'num_warps': 16,
2026-02-21T09:34:14.7316869Z  'pid_type': 'flat',
2026-02-21T09:34:14.7317090Z  'range_flattens': [None],
2026-02-21T09:34:14.7317327Z  'range_multi_buffers': [None],
2026-02-21T09:34:14.7317565Z  'range_num_stages': [0],
2026-02-21T09:34:14.7317814Z  'range_unroll_factors': [0],
2026-02-21T09:34:14.7318061Z  'range_warp_specializes': [],
2026-02-21T09:34:14.7318318Z  'reduction_loops': [None]}
2026-02-21T09:34:14.7341416Z [185s] Fitting surrogate: 327 points, 327 targets
2026-02-21T09:34:15.5302668Z [186s] Generation 4 starting: 40 neighbors, 5 active search path(s)
2026-02-21T09:34:51.4734549Z [222s] Timeout after 30s compiling Config(block_sizes=[1], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', '', 'last', 'first', 'first', 'last'], num_stages=6, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None])
2026-02-21T09:34:55.6109284Z [226s] Timeout after 31s compiling Config(block_sizes=[4], indexing=['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', '', '', 'last', 'first', 'first', 'last'], maxnreg=64, num_sm_multiplier=4, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T09:34:55.9390796Z [227s] Timeout after 33s compiling Config(block_sizes=[4], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', '', 'first', 'first', '', 'first', '', 'first'], num_sm_multiplier=16, num_stages=3, num_warps=4, pid_type='persistent_interleaved', range_flattens=[False], range_multi_buffers=[True], range_num_stages=[3], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T09:34:56.1762073Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 1.0 configs/s
2026-02-21T09:34:59.8671625Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 11.7 configs/s
2026-02-21T09:35:08.7210901Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 113.1         
2026-02-21T09:35:08.7211426Z                                                                   configs/s     
2026-02-21T09:35:09.1110145Z [240s] Generation 4 complete: 
2026-02-21T09:35:09.1110447Z error=2
2026-02-21T09:35:09.1110616Z timeout=3
2026-02-21T09:35:09.1110787Z ok=40
2026-02-21T09:35:09.1110950Z min=0.1446
2026-02-21T09:35:09.1111118Z mid=0.1526
2026-02-21T09:35:09.1111279Z max=0.9485
2026-02-21T09:35:09.1111461Z best={'block_sizes': [1],
2026-02-21T09:35:09.1111900Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:35:09.1112455Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:35:09.1112951Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:35:09.1113345Z  'num_stages': 6,
2026-02-21T09:35:09.1113537Z  'num_warps': 16,
2026-02-21T09:35:09.1113725Z  'pid_type': 'flat',
2026-02-21T09:35:09.1113948Z  'range_flattens': [None],
2026-02-21T09:35:09.1114524Z  'range_multi_buffers': [None],
2026-02-21T09:35:09.1114777Z  'range_num_stages': [0],
2026-02-21T09:35:09.1114998Z  'range_unroll_factors': [0],
2026-02-21T09:35:09.1115242Z  'range_warp_specializes': [],
2026-02-21T09:35:09.1115475Z  'reduction_loops': [None]}
2026-02-21T09:35:09.1142449Z [240s] Fitting surrogate: 372 points, 372 targets
2026-02-21T09:35:09.9234902Z [241s] Generation 5 starting: 43 neighbors, 5 active search path(s)
2026-02-21T09:35:33.4019850Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 2.1 configs/s
2026-02-21T09:35:36.0930400Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.6 configs/s
2026-02-21T09:35:46.8160065Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.5 configs/s
2026-02-21T09:35:47.2730390Z [278s] Generation 5 complete: 
2026-02-21T09:35:47.2730688Z error=4
2026-02-21T09:35:47.2730867Z ok=44
2026-02-21T09:35:47.2731039Z min=0.1451
2026-02-21T09:35:47.2731879Z mid=0.1489
2026-02-21T09:35:47.2732046Z max=0.2084
2026-02-21T09:35:47.2732235Z best={'block_sizes': [1],
2026-02-21T09:35:47.2732681Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:35:47.2733255Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:35:47.2733726Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:35:47.2734558Z  'num_stages': 5,
2026-02-21T09:35:47.2734773Z  'num_warps': 16,
2026-02-21T09:35:47.2734969Z  'pid_type': 'flat',
2026-02-21T09:35:47.2735186Z  'range_flattens': [None],
2026-02-21T09:35:47.2735417Z  'range_multi_buffers': [None],
2026-02-21T09:35:47.2735663Z  'range_num_stages': [0],
2026-02-21T09:35:47.2736257Z  'range_unroll_factors': [0],
2026-02-21T09:35:47.2736524Z  'range_warp_specializes': [],
2026-02-21T09:35:47.2736776Z  'reduction_loops': [None]}
2026-02-21T09:35:47.2762214Z [278s] Fitting surrogate: 420 points, 420 targets
2026-02-21T09:35:48.0026436Z [279s] Generation 6 starting: 37 neighbors, 4 active search path(s)
2026-02-21T09:35:57.6716569Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 7.7 configs/s
2026-02-21T09:35:59.7295770Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 18.4 configs/s
2026-02-21T09:36:09.4713292Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.9         
2026-02-21T09:36:09.4713841Z                                                                   configs/s     
2026-02-21T09:36:09.8673369Z [301s] Generation 6 complete: 
2026-02-21T09:36:09.8673636Z error=4
2026-02-21T09:36:09.8673813Z ok=37
2026-02-21T09:36:09.8674267Z min=0.1448
2026-02-21T09:36:09.8674452Z mid=0.1467
2026-02-21T09:36:09.8674621Z max=0.2462
2026-02-21T09:36:09.8674839Z best={'block_sizes': [1],
2026-02-21T09:36:09.8675278Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:36:09.8675833Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:36:09.8676302Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', 'last', ''],
2026-02-21T09:36:09.8676687Z  'num_stages': 6,
2026-02-21T09:36:09.8676886Z  'num_warps': 16,
2026-02-21T09:36:09.8677080Z  'pid_type': 'flat',
2026-02-21T09:36:09.8677308Z  'range_flattens': [None],
2026-02-21T09:36:09.8677547Z  'range_multi_buffers': [None],
2026-02-21T09:36:09.8677795Z  'range_num_stages': [0],
2026-02-21T09:36:09.8678024Z  'range_unroll_factors': [0],
2026-02-21T09:36:09.8678272Z  'range_warp_specializes': [],
2026-02-21T09:36:09.8678518Z  'reduction_loops': [None]}
2026-02-21T09:36:09.8708365Z [301s] Fitting surrogate: 461 points, 461 targets
2026-02-21T09:36:10.5524916Z [301s] Generation 7 starting: 36 neighbors, 4 active search path(s)
2026-02-21T09:36:21.7893693Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 3.5 configs/s
2026-02-21T09:36:24.3009320Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 14.9 configs/s
2026-02-21T09:36:32.6497272Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 120.0         
2026-02-21T09:36:32.6497784Z                                                                   configs/s     
2026-02-21T09:36:33.0213914Z [324s] Generation 7 complete: 
2026-02-21T09:36:33.0214444Z error=5
2026-02-21T09:36:33.0214593Z ok=35
2026-02-21T09:36:33.0214737Z min=0.1448
2026-02-21T09:36:33.0214897Z mid=0.1472
2026-02-21T09:36:33.0215057Z max=0.1945
2026-02-21T09:36:33.0215210Z best={'block_sizes': [1],
2026-02-21T09:36:33.0215592Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:36:33.0216066Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:36:33.0216482Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', 'last', ''],
2026-02-21T09:36:33.0216811Z  'num_stages': 5,
2026-02-21T09:36:33.0216986Z  'num_warps': 16,
2026-02-21T09:36:33.0217153Z  'pid_type': 'flat',
2026-02-21T09:36:33.1848533Z  'range_flattens': [None],
2026-02-21T09:36:33.1848817Z  'range_multi_buffers': [None],
2026-02-21T09:36:33.1849073Z  'range_num_stages': [0],
2026-02-21T09:36:33.1849315Z  'range_unroll_factors': [0],
2026-02-21T09:36:33.1849561Z  'range_warp_specializes': [],
2026-02-21T09:36:33.1849810Z  'reduction_loops': [None]}
2026-02-21T09:36:33.1850193Z [324s] Fitting surrogate: 501 points, 501 targets
2026-02-21T09:36:33.5506400Z [324s] Generation 8 starting: 24 neighbors, 3 active search path(s)
2026-02-21T09:36:41.4399818Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 2.5 configs/s
2026-02-21T09:36:42.9381918Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 25/25 17.2 configs/s
2026-02-21T09:36:48.6845665Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 173.8         
2026-02-21T09:36:48.6846419Z                                                                   configs/s     
2026-02-21T09:36:48.9635152Z [340s] Generation 8 complete: 
2026-02-21T09:36:48.9635509Z error=2
2026-02-21T09:36:48.9635745Z ok=25
2026-02-21T09:36:48.9635957Z min=0.1441
2026-02-21T09:36:48.9636184Z mid=0.1500
2026-02-21T09:36:48.9636397Z max=0.2253
2026-02-21T09:36:48.9636639Z best={'block_sizes': [1],
2026-02-21T09:36:48.9637219Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:36:48.9637983Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:36:48.9638634Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', '', 'last', ''],
2026-02-21T09:36:48.9639130Z  'num_stages': 5,
2026-02-21T09:36:48.9639384Z  'num_warps': 16,
2026-02-21T09:36:48.9639630Z  'pid_type': 'flat',
2026-02-21T09:36:48.9639908Z  'range_flattens': [None],
2026-02-21T09:36:48.9640220Z  'range_multi_buffers': [None],
2026-02-21T09:36:48.9640557Z  'range_num_stages': [0],
2026-02-21T09:36:48.9640860Z  'range_unroll_factors': [0],
2026-02-21T09:36:48.9641177Z  'range_warp_specializes': [],
2026-02-21T09:36:48.9641498Z  'reduction_loops': [None]}
2026-02-21T09:36:48.9667444Z [340s] Fitting surrogate: 528 points, 528 targets
2026-02-21T09:36:49.3965264Z [340s] Generation 9 starting: 19 neighbors, 2 active search path(s)
2026-02-21T09:36:54.7949795Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 5.7 configs/s
2026-02-21T09:36:55.9374319Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 19/19 17.3 configs/s
2026-02-21T09:37:00.9102563Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 200.4         
2026-02-21T09:37:00.9103105Z                                                                   configs/s     
2026-02-21T09:37:01.1611677Z [352s] Generation 9 complete: 
2026-02-21T09:37:01.1611949Z ok=21
2026-02-21T09:37:01.1612130Z min=0.1457
2026-02-21T09:37:01.1612346Z mid=0.1483
2026-02-21T09:37:01.1612518Z max=0.1754
2026-02-21T09:37:01.1612713Z best={'block_sizes': [1],
2026-02-21T09:37:01.1613176Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:37:01.1613811Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:37:01.1614688Z  'load_eviction_policies': ['last', 'last', 'last', 'first', '', '', 'last', ''],
2026-02-21T09:37:01.1615109Z  'num_stages': 5,
2026-02-21T09:37:01.1615318Z  'num_warps': 16,
2026-02-21T09:37:01.1615518Z  'pid_type': 'flat',
2026-02-21T09:37:01.1615757Z  'range_flattens': [None],
2026-02-21T09:37:01.1616012Z  'range_multi_buffers': [None],
2026-02-21T09:37:01.1616267Z  'range_num_stages': [0],
2026-02-21T09:37:01.1616517Z  'range_unroll_factors': [0],
2026-02-21T09:37:01.1616790Z  'range_warp_specializes': [],
2026-02-21T09:37:01.1617055Z  'reduction_loops': [None]}
2026-02-21T09:37:01.1647671Z [352s] Fitting surrogate: 549 points, 549 targets
2026-02-21T09:37:01.5604132Z [352s] Generation 10 starting: 16 neighbors, 2 active search path(s)
2026-02-21T09:37:06.7267225Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 3.9 configs/s
2026-02-21T09:37:07.7690932Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 16/16 16.0 configs/s
2026-02-21T09:37:11.6407083Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 256.5         
2026-02-21T09:37:11.6407609Z                                                                   configs/s     
2026-02-21T09:37:11.8422118Z [363s] Generation 10 complete: 
2026-02-21T09:37:11.8422423Z error=1
2026-02-21T09:37:11.8422618Z ok=17
2026-02-21T09:37:11.8422834Z min=0.1453
2026-02-21T09:37:11.8423034Z mid=0.1466
2026-02-21T09:37:11.8423232Z max=0.2212
2026-02-21T09:37:11.8423440Z best={'block_sizes': [2],
2026-02-21T09:37:11.8423920Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:37:11.8425554Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:37:11.8426123Z               'pointer', 'tensor_descriptor'],
2026-02-21T09:37:11.8426602Z  'load_eviction_policies': ['', '', 'last', 'first', '', 'first', '', 'first'],
2026-02-21T09:37:11.8427051Z  'num_stages': 3,
2026-02-21T09:37:11.8427275Z  'num_warps': 32,
2026-02-21T09:37:11.8427494Z  'pid_type': 'flat',
2026-02-21T09:37:11.8427747Z  'range_flattens': [None],
2026-02-21T09:37:11.8428021Z  'range_multi_buffers': [None],
2026-02-21T09:37:11.8428307Z  'range_num_stages': [0],
2026-02-21T09:37:11.8428549Z  'range_unroll_factors': [0],
2026-02-21T09:37:11.8428804Z  'range_warp_specializes': [],
2026-02-21T09:37:11.8429063Z  'reduction_loops': [None]}
2026-02-21T09:37:11.8456236Z [363s] Fitting surrogate: 567 points, 567 targets
2026-02-21T09:37:12.0047548Z [363s] Autotuning complete in 363.3s after searching 535 configs.
2026-02-21T09:37:12.0048061Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:37:12.0050452Z     @helion.kernel(config=helion.Config(block_sizes=[2], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', '', 'last', 'first', '', 'first', '', 'first'], num_stages=3, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:37:12.0052606Z 
2026-02-21T09:37:12.0053049Z [363s] Code of selected kernel: /tmp/torchinductor_root/v4/cv47avu5boh4uq6wswaaxf4lhmmbp74t56dcmzv5xmozhhqz5ynh.py
2026-02-21T09:37:13.1845579Z WARNING:tritonbench.utils.triton_op:Completed input ID 23:
2026-02-21T09:37:13.1846144Z (M, N)
2026-02-21T09:37:13.1846424Z -------------
2026-02-21T09:37:13.1846697Z (4096, 12800)
2026-02-21T09:37:13.1846873Z 
2026-02-21T09:37:13.1864560Z  80%|████████  | 16/20 [1:18:45<22:26, 336.59s/it]WARNING:tritonbench.utils.triton_op:Running input ID 24:
2026-02-21T09:37:13.1865070Z (M, N)
2026-02-21T09:37:13.1865253Z -------------
2026-02-21T09:37:13.1865468Z (4096, 13312)
2026-02-21T09:37:13.1868259Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:37:14.4559424Z INFO:tritonbench.utils.triton_op:Took 3.24ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:37:20.7288644Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:37:22.1265039Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:37:22.1265490Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:37:22.1265892Z               'dtype': 'torch.float32',
2026-02-21T09:37:22.1266266Z               'shape': (4096, 13312),
2026-02-21T09:37:22.1266604Z               'stride': (13312, 1)},
2026-02-21T09:37:22.1266931Z             (13312,),
2026-02-21T09:37:22.1267232Z             { 'device': 'cuda:0',
2026-02-21T09:37:22.1267582Z               'dtype': 'torch.float32',
2026-02-21T09:37:22.1267922Z               'shape': (13312,),
2026-02-21T09:37:22.1268238Z               'stride': (1,)},
2026-02-21T09:37:22.1269093Z             { 'device': 'cuda:0',
2026-02-21T09:37:22.1269418Z               'dtype': 'torch.float32',
2026-02-21T09:37:22.1269761Z               'shape': (13312,),
2026-02-21T09:37:22.1270060Z               'stride': (1,)},
2026-02-21T09:37:22.1270352Z             1e-05),
2026-02-21T09:37:22.1270610Z   'kwargs': {}}
2026-02-21T09:37:22.1312157Z INFO:tritonbench.utils.triton_op:Took 5.13ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:37:22.1399045Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:37:22.1400125Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:37:22.1401229Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:37:22.1401650Z While processing:
2026-02-21T09:37:22.1402138Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:37:22.1402638Z     if bias is not None:
2026-02-21T09:37:22.1402889Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:37:22.1403040Z 
2026-02-21T09:37:22.3018781Z [0s] Autotune random seed: 2135381352
2026-02-21T09:37:22.6133164Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:38:00.3343915Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:38:02.7694401Z [40s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:38:02.7717735Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:38:10.8186954Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.5 configs/s
2026-02-21T09:38:10.8200618Z [48s] Adaptive compile timeout: 30s (90% percentile=14.7s, bounds=[30.0s, 30s])
2026-02-21T09:38:12.2749837Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 658.5 configs/s
2026-02-21T09:38:12.3934313Z [49s] Initial random population of 100, 5 starting points: 
2026-02-21T09:38:12.3934673Z error=12
2026-02-21T09:38:12.3934856Z timeout=2
2026-02-21T09:38:12.3935038Z ok=86
2026-02-21T09:38:12.3935212Z min=0.1607
2026-02-21T09:38:12.3935389Z mid=0.5848
2026-02-21T09:38:12.3935554Z max=55.9465
2026-02-21T09:38:12.3935748Z best={'block_sizes': [1],
2026-02-21T09:38:12.3936187Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:38:12.3936809Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:38:12.3937223Z               'pointer'],
2026-02-21T09:38:12.3937581Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:38:12.3937998Z  'num_stages': 6,
2026-02-21T09:38:12.3938193Z  'num_warps': 16,
2026-02-21T09:38:12.3938511Z  'pid_type': 'flat',
2026-02-21T09:38:12.3938740Z  'range_flattens': [None],
2026-02-21T09:38:12.3939498Z  'range_multi_buffers': [None],
2026-02-21T09:38:12.3939766Z  'range_num_stages': [0],
2026-02-21T09:38:12.3940046Z  'range_unroll_factors': [0],
2026-02-21T09:38:12.3940347Z  'range_warp_specializes': [],
2026-02-21T09:38:12.3940590Z  'reduction_loops': [8192]}
2026-02-21T09:38:12.3957946Z [49s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:38:13.9331854Z [51s] Generation 1 starting: 84 neighbors, 5 active search path(s)
2026-02-21T09:38:45.7107185Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 4.5 configs/s
2026-02-21T09:38:52.8921050Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 12.3 configs/s
2026-02-21T09:39:06.4401685Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 74.0 configs/s
2026-02-21T09:39:06.9563330Z [104s] Generation 1 complete: 
2026-02-21T09:39:06.9564699Z error=5
2026-02-21T09:39:06.9564911Z ok=84
2026-02-21T09:39:06.9565088Z min=0.1521
2026-02-21T09:39:06.9565272Z mid=0.2144
2026-02-21T09:39:06.9565436Z max=2.3691
2026-02-21T09:39:06.9565649Z best={'block_sizes': [1],
2026-02-21T09:39:06.9566067Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:39:06.9566592Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:39:06.9567013Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T09:39:06.9567373Z  'num_stages': 1,
2026-02-21T09:39:06.9567578Z  'num_warps': 8,
2026-02-21T09:39:06.9567780Z  'pid_type': 'flat',
2026-02-21T09:39:06.9568036Z  'range_flattens': [None],
2026-02-21T09:39:06.9568319Z  'range_multi_buffers': [None],
2026-02-21T09:39:06.9568557Z  'range_num_stages': [0],
2026-02-21T09:39:06.9568776Z  'range_unroll_factors': [0],
2026-02-21T09:39:06.9569017Z  'range_warp_specializes': [],
2026-02-21T09:39:06.9569253Z  'reduction_loops': [None]}
2026-02-21T09:39:06.9587475Z [104s] Fitting surrogate: 189 points, 189 targets
2026-02-21T09:39:08.2592382Z [105s] Generation 2 starting: 78 neighbors, 5 active search path(s)
2026-02-21T09:39:28.9622604Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 6.4 configs/s
2026-02-21T09:39:33.8716329Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 16.9 configs/s
2026-02-21T09:39:50.2284377Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 61.4 configs/s
2026-02-21T09:39:50.8656886Z [148s] Generation 2 complete: 
2026-02-21T09:39:50.8657199Z error=16
2026-02-21T09:39:50.8657382Z ok=68
2026-02-21T09:39:50.8657547Z min=0.1503
2026-02-21T09:39:50.8657724Z mid=0.1670
2026-02-21T09:39:50.8657883Z max=0.2976
2026-02-21T09:39:50.8658065Z best={'block_sizes': [1],
2026-02-21T09:39:50.8658575Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:39:50.8659270Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:39:50.8659691Z               'pointer'],
2026-02-21T09:39:50.8660022Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:39:50.9021417Z  'num_stages': 6,
2026-02-21T09:39:50.9021611Z  'num_warps': 16,
2026-02-21T09:39:50.9021812Z  'pid_type': 'flat',
2026-02-21T09:39:50.9022017Z  'range_flattens': [None],
2026-02-21T09:39:50.9022250Z  'range_multi_buffers': [None],
2026-02-21T09:39:50.9022484Z  'range_num_stages': [0],
2026-02-21T09:39:50.9022709Z  'range_unroll_factors': [0],
2026-02-21T09:39:50.9022943Z  'range_warp_specializes': [],
2026-02-21T09:39:50.9023185Z  'reduction_loops': [None]}
2026-02-21T09:39:50.9023455Z [148s] Fitting surrogate: 273 points, 273 targets
2026-02-21T09:39:51.9241266Z [149s] Generation 3 starting: 60 neighbors, 5 active search path(s)
2026-02-21T09:40:12.3037055Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 5.0 configs/s
2026-02-21T09:40:16.1460707Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.0 configs/s
2026-02-21T09:40:28.4753028Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 81.4 configs/s
2026-02-21T09:40:28.9866138Z [186s] Generation 3 complete: 
2026-02-21T09:40:28.9866463Z error=11
2026-02-21T09:40:28.9866647Z ok=54
2026-02-21T09:40:28.9866817Z min=0.1501
2026-02-21T09:40:28.9866996Z mid=0.1585
2026-02-21T09:40:28.9867160Z max=1.0809
2026-02-21T09:40:28.9867350Z best={'block_sizes': [1],
2026-02-21T09:40:28.9867807Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:40:28.9868464Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:40:28.9868909Z               'pointer'],
2026-02-21T09:40:28.9869283Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:40:28.9869678Z  'num_stages': 6,
2026-02-21T09:40:28.9869875Z  'num_warps': 16,
2026-02-21T09:40:28.9870099Z  'pid_type': 'flat',
2026-02-21T09:40:28.9870317Z  'range_flattens': [None],
2026-02-21T09:40:28.9870557Z  'range_multi_buffers': [None],
2026-02-21T09:40:28.9870797Z  'range_num_stages': [0],
2026-02-21T09:40:28.9871052Z  'range_unroll_factors': [0],
2026-02-21T09:40:28.9871302Z  'range_warp_specializes': [],
2026-02-21T09:40:28.9871542Z  'reduction_loops': [None]}
2026-02-21T09:40:28.9898587Z [186s] Fitting surrogate: 338 points, 338 targets
2026-02-21T09:40:31.0683372Z [188s] Generation 4 starting: 45 neighbors, 5 active search path(s)
2026-02-21T09:40:44.0398286Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 3.8 configs/s
2026-02-21T09:40:46.7115388Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 17.5 configs/s
2026-02-21T09:40:57.0308148Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 97.2 configs/s
2026-02-21T09:40:57.4668446Z [214s] Generation 4 complete: 
2026-02-21T09:40:57.4668781Z error=6
2026-02-21T09:40:57.4668964Z ok=44
2026-02-21T09:40:57.4669170Z min=0.1499
2026-02-21T09:40:57.4669358Z mid=0.1557
2026-02-21T09:40:57.4669527Z max=0.3044
2026-02-21T09:40:57.4669706Z best={'block_sizes': [1],
2026-02-21T09:40:57.4670196Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:40:57.4670764Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:40:57.4671189Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T09:40:57.4671524Z  'num_stages': 2,
2026-02-21T09:40:57.4671721Z  'num_warps': 16,
2026-02-21T09:40:57.4671912Z  'pid_type': 'flat',
2026-02-21T09:40:57.4672133Z  'range_flattens': [None],
2026-02-21T09:40:57.4672372Z  'range_multi_buffers': [None],
2026-02-21T09:40:57.4672613Z  'range_num_stages': [0],
2026-02-21T09:40:57.4672846Z  'range_unroll_factors': [0],
2026-02-21T09:40:57.4673087Z  'range_warp_specializes': [],
2026-02-21T09:40:57.4673330Z  'reduction_loops': [None]}
2026-02-21T09:40:57.4696734Z [214s] Fitting surrogate: 388 points, 388 targets
2026-02-21T09:40:58.2495690Z [215s] Generation 5 starting: 43 neighbors, 4 active search path(s)
2026-02-21T09:41:07.2206888Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 7.6 configs/s
2026-02-21T09:41:09.4206810Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 20.0 configs/s
2026-02-21T09:41:18.9495969Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 105.1         
2026-02-21T09:41:18.9496508Z                                                                   configs/s     
2026-02-21T09:41:19.3325231Z [236s] Generation 5 complete: 
2026-02-21T09:41:19.3325524Z error=8
2026-02-21T09:41:19.3325704Z ok=39
2026-02-21T09:41:19.3325872Z min=0.1499
2026-02-21T09:41:19.3326052Z mid=0.1663
2026-02-21T09:41:19.3326215Z max=0.3041
2026-02-21T09:41:19.3326407Z best={'block_sizes': [1],
2026-02-21T09:41:19.3326863Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:41:19.3327996Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:41:19.3328455Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T09:41:19.3328817Z  'num_stages': 2,
2026-02-21T09:41:19.3329019Z  'num_warps': 16,
2026-02-21T09:41:19.3329211Z  'pid_type': 'flat',
2026-02-21T09:41:19.3329444Z  'range_flattens': [None],
2026-02-21T09:41:19.3329679Z  'range_multi_buffers': [None],
2026-02-21T09:41:19.3329926Z  'range_num_stages': [0],
2026-02-21T09:41:19.3330269Z  'range_unroll_factors': [0],
2026-02-21T09:41:19.3330529Z  'range_warp_specializes': [],
2026-02-21T09:41:19.3330798Z  'reduction_loops': [None]}
2026-02-21T09:41:19.3355398Z [236s] Fitting surrogate: 435 points, 435 targets
2026-02-21T09:41:19.6022646Z [236s] Generation 6 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:41:22.0204453Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 12.7 configs/s
2026-02-21T09:41:22.5239867Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 11/11 25.0 configs/s
2026-02-21T09:41:24.2738059Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 556.5         
2026-02-21T09:41:24.2738735Z                                                                   configs/s     
2026-02-21T09:41:24.4001394Z [241s] Generation 6 complete: 
2026-02-21T09:41:24.4001677Z error=3
2026-02-21T09:41:24.4001860Z ok=9
2026-02-21T09:41:24.4002024Z min=0.1500
2026-02-21T09:41:24.4002200Z mid=0.1719
2026-02-21T09:41:24.4002365Z max=0.3024
2026-02-21T09:41:24.4002554Z best={'block_sizes': [1],
2026-02-21T09:41:24.4003002Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:41:24.4003560Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:41:24.4004180Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T09:41:24.4004533Z  'num_stages': 2,
2026-02-21T09:41:24.4004735Z  'num_warps': 16,
2026-02-21T09:41:24.4004954Z  'pid_type': 'flat',
2026-02-21T09:41:24.4005190Z  'range_flattens': [None],
2026-02-21T09:41:24.4005424Z  'range_multi_buffers': [None],
2026-02-21T09:41:24.4005684Z  'range_num_stages': [0],
2026-02-21T09:41:24.4005932Z  'range_unroll_factors': [0],
2026-02-21T09:41:24.4006183Z  'range_warp_specializes': [],
2026-02-21T09:41:24.4006428Z  'reduction_loops': [None]}
2026-02-21T09:41:24.4031896Z [241s] Fitting surrogate: 447 points, 447 targets
2026-02-21T09:41:24.5423772Z [241s] Autotuning complete in 241.9s after searching 430 configs.
2026-02-21T09:41:24.5424598Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:41:24.5426560Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['', '', '', '', '', '', '', 'first'], num_stages=2, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:41:24.5428333Z 
2026-02-21T09:41:24.5428761Z [241s] Code of selected kernel: /tmp/torchinductor_root/yf/cyfewbg3qznf2fg2nbaq7rfz3u7aimufqdzwzjj7ggc3tyxci6p6.py
2026-02-21T09:41:25.7433166Z WARNING:tritonbench.utils.triton_op:Completed input ID 24:
2026-02-21T09:41:25.7433566Z (M, N)
2026-02-21T09:41:25.7433751Z -------------
2026-02-21T09:41:25.7433947Z (4096, 13312)
2026-02-21T09:41:25.7434241Z 
2026-02-21T09:41:25.7455857Z  85%|████████▌ | 17/20 [1:22:58<15:33, 311.32s/it]WARNING:tritonbench.utils.triton_op:Running input ID 26:
2026-02-21T09:41:25.7456338Z (M, N)
2026-02-21T09:41:25.7456499Z -------------
2026-02-21T09:41:25.7456676Z (4096, 14336)
2026-02-21T09:41:25.7458792Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:41:26.9959623Z INFO:tritonbench.utils.triton_op:Took 3.20ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:41:32.3835907Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:41:33.7691760Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:41:33.7692131Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:41:33.7692424Z               'dtype': 'torch.float32',
2026-02-21T09:41:33.7692707Z               'shape': (4096, 14336),
2026-02-21T09:41:33.7692967Z               'stride': (14336, 1)},
2026-02-21T09:41:33.7693214Z             (14336,),
2026-02-21T09:41:33.7693447Z             { 'device': 'cuda:0',
2026-02-21T09:41:33.7693698Z               'dtype': 'torch.float32',
2026-02-21T09:41:33.7694263Z               'shape': (14336,),
2026-02-21T09:41:33.7694533Z               'stride': (1,)},
2026-02-21T09:41:33.7694774Z             { 'device': 'cuda:0',
2026-02-21T09:41:33.7695019Z               'dtype': 'torch.float32',
2026-02-21T09:41:33.7695281Z               'shape': (14336,),
2026-02-21T09:41:33.7695528Z               'stride': (1,)},
2026-02-21T09:41:33.7695757Z             1e-05),
2026-02-21T09:41:33.7695954Z   'kwargs': {}}
2026-02-21T09:41:33.7729021Z INFO:tritonbench.utils.triton_op:Took 4.12ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:41:33.7849084Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:41:33.7850043Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:41:33.7850662Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:41:33.7851021Z While processing:
2026-02-21T09:41:33.7851469Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:41:33.7851899Z     if bias is not None:
2026-02-21T09:41:33.7852120Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:41:33.7852266Z 
2026-02-21T09:41:33.9441324Z [0s] Autotune random seed: 2135381352
2026-02-21T09:41:35.1216047Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:42:15.9966146Z [40s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:42:18.6066774Z [43s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:42:18.6089012Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:42:25.6502570Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.3 configs/s
2026-02-21T09:42:25.6515614Z [50s] Adaptive compile timeout: 30s (90% percentile=15.5s, bounds=[30.0s, 30s])
2026-02-21T09:42:26.8086386Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 817.0 configs/s
2026-02-21T09:42:26.9216365Z [51s] Initial random population of 100, 5 starting points: 
2026-02-21T09:42:26.9216958Z error=12
2026-02-21T09:42:26.9217257Z timeout=2
2026-02-21T09:42:26.9217737Z ok=86
2026-02-21T09:42:26.9218141Z min=0.1831
2026-02-21T09:42:26.9218911Z mid=0.6404
2026-02-21T09:42:26.9219120Z max=60.4233
2026-02-21T09:42:26.9219321Z best={'block_sizes': [1],
2026-02-21T09:42:26.9219768Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:42:26.9220401Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:42:26.9220817Z               'pointer'],
2026-02-21T09:42:26.9221164Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:42:26.9221553Z  'num_stages': 6,
2026-02-21T09:42:26.9221750Z  'num_warps': 16,
2026-02-21T09:42:26.9221936Z  'pid_type': 'flat',
2026-02-21T09:42:26.9222143Z  'range_flattens': [None],
2026-02-21T09:42:26.9222366Z  'range_multi_buffers': [None],
2026-02-21T09:42:26.9222606Z  'range_num_stages': [0],
2026-02-21T09:42:26.9222831Z  'range_unroll_factors': [0],
2026-02-21T09:42:26.9223081Z  'range_warp_specializes': [],
2026-02-21T09:42:26.9223320Z  'reduction_loops': [8192]}
2026-02-21T09:42:26.9238674Z [51s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:42:28.2841066Z [53s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T09:43:03.7304787Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 0.3 configs/s
2026-02-21T09:43:09.1129809Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 16.3 configs/s
2026-02-21T09:43:25.5316645Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 65.8 configs/s
2026-02-21T09:43:26.0871324Z [111s] Generation 1 complete: 
2026-02-21T09:43:26.0875375Z error=2
2026-02-21T09:43:26.0875727Z ok=86
2026-02-21T09:43:26.0876056Z min=0.1676
2026-02-21T09:43:26.0876334Z mid=0.2254
2026-02-21T09:43:26.0876627Z max=1.5496
2026-02-21T09:43:26.0876922Z best={'block_sizes': [2],
2026-02-21T09:43:26.0877687Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:43:26.0878734Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:43:26.0879488Z               'pointer'],
2026-02-21T09:43:26.0879946Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', 'first'],
2026-02-21T09:43:26.0880333Z  'num_stages': 8,
2026-02-21T09:43:26.0880515Z  'num_warps': 8,
2026-02-21T09:43:26.0880688Z  'pid_type': 'flat',
2026-02-21T09:43:26.0880885Z  'range_flattens': [None],
2026-02-21T09:43:26.0881093Z  'range_multi_buffers': [None],
2026-02-21T09:43:26.0881315Z  'range_num_stages': [0],
2026-02-21T09:43:26.0881522Z  'range_unroll_factors': [0],
2026-02-21T09:43:26.0881752Z  'range_warp_specializes': [],
2026-02-21T09:43:26.0881977Z  'reduction_loops': [None]}
2026-02-21T09:43:26.0896399Z [111s] Fitting surrogate: 188 points, 188 targets
2026-02-21T09:43:27.2758822Z [112s] Generation 2 starting: 69 neighbors, 5 active search path(s)
2026-02-21T09:43:48.6853476Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 1.8 configs/s
2026-02-21T09:43:54.5375479Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 12.4 configs/s
2026-02-21T09:44:10.1952139Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 64.1 configs/s
2026-02-21T09:44:10.7760599Z [155s] Generation 2 complete: 
2026-02-21T09:44:10.7760937Z error=2
2026-02-21T09:44:10.7761120Z ok=73
2026-02-21T09:44:10.7761290Z min=0.1610
2026-02-21T09:44:10.7761459Z mid=0.1873
2026-02-21T09:44:10.7767119Z max=1.4242
2026-02-21T09:44:10.7767393Z best={'block_sizes': [1],
2026-02-21T09:44:10.7767920Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:44:10.7768634Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:44:10.7769122Z               'pointer'],
2026-02-21T09:44:10.7769512Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:44:10.7770122Z  'num_stages': 6,
2026-02-21T09:44:10.7770359Z  'num_warps': 16,
2026-02-21T09:44:10.7771277Z  'pid_type': 'flat',
2026-02-21T09:44:10.7771505Z  'range_flattens': [None],
2026-02-21T09:44:10.7771738Z  'range_multi_buffers': [None],
2026-02-21T09:44:10.7771978Z  'range_num_stages': [0],
2026-02-21T09:44:10.7772217Z  'range_unroll_factors': [0],
2026-02-21T09:44:10.7772457Z  'range_warp_specializes': [],
2026-02-21T09:44:10.7772697Z  'reduction_loops': [None]}
2026-02-21T09:44:10.7793656Z [155s] Fitting surrogate: 263 points, 263 targets
2026-02-21T09:44:11.8224915Z [156s] Generation 3 starting: 62 neighbors, 5 active search path(s)
2026-02-21T09:44:26.5888394Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 4.5 configs/s
2026-02-21T09:44:31.4648745Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 13.8 configs/s
2026-02-21T09:44:47.4061419Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 63.0 configs/s
2026-02-21T09:44:48.0176892Z [193s] Generation 3 complete: 
2026-02-21T09:44:48.0177176Z error=4
2026-02-21T09:44:48.0177366Z ok=64
2026-02-21T09:44:48.0177551Z min=0.1615
2026-02-21T09:44:48.0177722Z mid=0.1714
2026-02-21T09:44:48.0177885Z max=1.5632
2026-02-21T09:44:48.0178060Z best={'block_sizes': [1],
2026-02-21T09:44:48.0178504Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:44:48.0179172Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:44:48.0179616Z               'pointer'],
2026-02-21T09:44:48.0179957Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:44:48.0180373Z  'num_stages': 6,
2026-02-21T09:44:48.0180563Z  'num_warps': 16,
2026-02-21T09:44:48.0180747Z  'pid_type': 'flat',
2026-02-21T09:44:48.0180952Z  'range_flattens': [None],
2026-02-21T09:44:48.0181175Z  'range_multi_buffers': [None],
2026-02-21T09:44:48.0181412Z  'range_num_stages': [0],
2026-02-21T09:44:48.0181631Z  'range_unroll_factors': [0],
2026-02-21T09:44:48.0181873Z  'range_warp_specializes': [],
2026-02-21T09:44:48.0182111Z  'reduction_loops': [None]}
2026-02-21T09:44:48.0211497Z [193s] Fitting surrogate: 331 points, 331 targets
2026-02-21T09:44:49.0132322Z [194s] Generation 4 starting: 58 neighbors, 5 active search path(s)
2026-02-21T09:45:02.8153551Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 6.1 configs/s
2026-02-21T09:45:06.2138488Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 17.9 configs/s
2026-02-21T09:45:18.0401570Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 84.8 configs/s
2026-02-21T09:45:18.5081811Z [223s] Generation 4 complete: 
2026-02-21T09:45:18.5085266Z error=5
2026-02-21T09:45:18.5085629Z ok=59
2026-02-21T09:45:18.5085977Z min=0.1610
2026-02-21T09:45:18.5086277Z mid=0.1734
2026-02-21T09:45:18.5086542Z max=0.9576
2026-02-21T09:45:18.5086859Z best={'block_sizes': [1],
2026-02-21T09:45:18.5087692Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:45:18.5088802Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:45:18.5089252Z               'pointer'],
2026-02-21T09:45:18.5089607Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'first', 'last', ''],
2026-02-21T09:45:18.5090119Z  'num_stages': 6,
2026-02-21T09:45:18.5090299Z  'num_warps': 16,
2026-02-21T09:45:18.5090476Z  'pid_type': 'flat',
2026-02-21T09:45:18.5090680Z  'range_flattens': [None],
2026-02-21T09:45:18.5090898Z  'range_multi_buffers': [None],
2026-02-21T09:45:18.5091124Z  'range_num_stages': [0],
2026-02-21T09:45:18.5091331Z  'range_unroll_factors': [0],
2026-02-21T09:45:18.5091547Z  'range_warp_specializes': [],
2026-02-21T09:45:18.5091783Z  'reduction_loops': [None]}
2026-02-21T09:45:18.5117992Z [223s] Fitting surrogate: 395 points, 395 targets
2026-02-21T09:45:19.2719895Z [224s] Generation 5 starting: 39 neighbors, 5 active search path(s)
2026-02-21T09:45:27.7044771Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 8.4 configs/s
2026-02-21T09:45:29.8177859Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 40/40 18.9 configs/s
2026-02-21T09:45:39.0316283Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.7         
2026-02-21T09:45:39.0316866Z                                                                   configs/s     
2026-02-21T09:45:39.4366491Z [244s] Generation 5 complete: 
2026-02-21T09:45:39.4366756Z error=5
2026-02-21T09:45:39.4366913Z ok=39
2026-02-21T09:45:39.4367062Z min=0.1605
2026-02-21T09:45:39.4367221Z mid=0.1652
2026-02-21T09:45:39.4367370Z max=0.6490
2026-02-21T09:45:39.4367543Z best={'block_sizes': [1],
2026-02-21T09:45:39.4367912Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:45:39.4368458Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:45:39.4368872Z               'tensor_descriptor', 'pointer'],
2026-02-21T09:45:39.4369279Z  'load_eviction_policies': ['', 'first', '', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:45:39.4369655Z  'num_stages': 6,
2026-02-21T09:45:39.4369828Z  'num_warps': 16,
2026-02-21T09:45:39.4370087Z  'pid_type': 'flat',
2026-02-21T09:45:39.4370292Z  'range_flattens': [None],
2026-02-21T09:45:39.4370511Z  'range_multi_buffers': [None],
2026-02-21T09:45:39.4370729Z  'range_num_stages': [0],
2026-02-21T09:45:39.4370940Z  'range_unroll_factors': [0],
2026-02-21T09:45:39.4371165Z  'range_warp_specializes': [],
2026-02-21T09:45:39.4371396Z  'reduction_loops': [None]}
2026-02-21T09:45:39.4399711Z [244s] Fitting surrogate: 439 points, 439 targets
2026-02-21T09:45:40.0774362Z [245s] Generation 6 starting: 31 neighbors, 4 active search path(s)
2026-02-21T09:45:46.4703370Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 12.0 configs/s
2026-02-21T09:45:48.2607868Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 32/32 18.4 configs/s
2026-02-21T09:45:56.6312099Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 119.6         
2026-02-21T09:45:56.6312620Z                                                                   configs/s     
2026-02-21T09:45:56.9926477Z [261s] Generation 6 complete: 
2026-02-21T09:45:56.9927162Z error=2
2026-02-21T09:45:56.9927348Z ok=34
2026-02-21T09:45:56.9927546Z min=0.1618
2026-02-21T09:45:56.9927726Z mid=0.1650
2026-02-21T09:45:56.9927904Z max=0.9144
2026-02-21T09:45:56.9928107Z best={'block_sizes': [1],
2026-02-21T09:45:56.9928549Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T09:45:56.9929233Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:45:56.9929770Z               'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:45:56.9930315Z  'load_eviction_policies': ['last', '', '', 'last', 'last', 'first', 'first', 'last'],
2026-02-21T09:45:56.9930746Z  'num_stages': 6,
2026-02-21T09:45:56.9930955Z  'num_warps': 16,
2026-02-21T09:45:56.9931416Z  'pid_type': 'flat',
2026-02-21T09:45:56.9931649Z  'range_flattens': [None],
2026-02-21T09:45:56.9931893Z  'range_multi_buffers': [None],
2026-02-21T09:45:56.9932153Z  'range_num_stages': [0],
2026-02-21T09:45:56.9932398Z  'range_unroll_factors': [0],
2026-02-21T09:45:56.9932662Z  'range_warp_specializes': [],
2026-02-21T09:45:56.9932914Z  'reduction_loops': [None]}
2026-02-21T09:45:56.9957591Z [261s] Fitting surrogate: 475 points, 475 targets
2026-02-21T09:45:57.4019983Z [262s] Generation 7 starting: 18 neighbors, 2 active search path(s)
2026-02-21T09:46:01.5958288Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 8.0 configs/s
2026-02-21T09:46:02.6208185Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 19/19 19.5 configs/s
2026-02-21T09:46:06.9757063Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 228.2         
2026-02-21T09:46:06.9757575Z                                                                   configs/s     
2026-02-21T09:46:07.1915398Z [272s] Generation 7 complete: 
2026-02-21T09:46:07.1915884Z error=2
2026-02-21T09:46:07.1916162Z ok=19
2026-02-21T09:46:07.1916435Z min=0.1611
2026-02-21T09:46:07.1916708Z mid=0.1632
2026-02-21T09:46:07.1916996Z max=0.2760
2026-02-21T09:46:07.1917280Z best={'block_sizes': [1],
2026-02-21T09:46:07.1918006Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:46:07.1919005Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:46:07.1919675Z               'pointer'],
2026-02-21T09:46:07.1920224Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', '', ''],
2026-02-21T09:46:07.1920806Z  'num_stages': 1,
2026-02-21T09:46:07.1921151Z  'num_warps': 16,
2026-02-21T09:46:07.1921492Z  'pid_type': 'flat',
2026-02-21T09:46:07.1921761Z  'range_flattens': [None],
2026-02-21T09:46:07.1921968Z  'range_multi_buffers': [None],
2026-02-21T09:46:07.1922187Z  'range_num_stages': [0],
2026-02-21T09:46:07.1922393Z  'range_unroll_factors': [0],
2026-02-21T09:46:07.1922617Z  'range_warp_specializes': [],
2026-02-21T09:46:07.1922836Z  'reduction_loops': [None]}
2026-02-21T09:46:07.1943833Z [272s] Fitting surrogate: 496 points, 496 targets
2026-02-21T09:46:07.4586688Z [272s] Generation 8 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:46:09.3911511Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 16.2 configs/s
2026-02-21T09:46:09.8709945Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━━ 9/9 18.6 configs/s
2026-02-21T09:46:12.0867701Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 442.9         
2026-02-21T09:46:12.0868229Z                                                                   configs/s     
2026-02-21T09:46:12.2297497Z [277s] Generation 8 complete: 
2026-02-21T09:46:12.2297751Z error=1
2026-02-21T09:46:12.2297911Z ok=9
2026-02-21T09:46:12.2298075Z min=0.1637
2026-02-21T09:46:12.2298253Z mid=0.1639
2026-02-21T09:46:12.2298428Z max=0.1696
2026-02-21T09:46:12.2298635Z best={'block_sizes': [1],
2026-02-21T09:46:12.2299080Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:46:12.2300155Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:46:12.2300574Z               'pointer'],
2026-02-21T09:46:12.2300908Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', '', 'last', ''],
2026-02-21T09:46:12.2301276Z  'num_stages': 1,
2026-02-21T09:46:12.2301468Z  'num_warps': 16,
2026-02-21T09:46:12.2301663Z  'pid_type': 'flat',
2026-02-21T09:46:12.2301872Z  'range_flattens': [None],
2026-02-21T09:46:12.2302106Z  'range_multi_buffers': [None],
2026-02-21T09:46:12.2302341Z  'range_num_stages': [0],
2026-02-21T09:46:12.2302568Z  'range_unroll_factors': [0],
2026-02-21T09:46:12.2302820Z  'range_warp_specializes': [],
2026-02-21T09:46:12.2303062Z  'reduction_loops': [None]}
2026-02-21T09:46:12.2326306Z [277s] Fitting surrogate: 506 points, 506 targets
2026-02-21T09:46:12.5159942Z [277s] Generation 9 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:46:15.1141515Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 3.7 configs/s
2026-02-21T09:46:15.6008395Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 10/10 23.4 configs/s
2026-02-21T09:46:17.8705132Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 432.1         
2026-02-21T09:46:17.8705630Z                                                                   configs/s     
2026-02-21T09:46:18.0146003Z [283s] Generation 9 complete: 
2026-02-21T09:46:18.0146252Z error=2
2026-02-21T09:46:18.0146422Z ok=9
2026-02-21T09:46:18.0146588Z min=0.1613
2026-02-21T09:46:18.0146762Z mid=0.1662
2026-02-21T09:46:18.0146926Z max=0.1969
2026-02-21T09:46:18.0147111Z best={'block_sizes': [1],
2026-02-21T09:46:18.0147553Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:46:18.0148224Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:46:18.0148678Z               'pointer'],
2026-02-21T09:46:18.0149010Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', 'last', ''],
2026-02-21T09:46:18.0149405Z  'num_stages': 1,
2026-02-21T09:46:18.0149591Z  'num_warps': 16,
2026-02-21T09:46:18.0149775Z  'pid_type': 'flat',
2026-02-21T09:46:18.0149979Z  'range_flattens': [None],
2026-02-21T09:46:18.0150195Z  'range_multi_buffers': [None],
2026-02-21T09:46:18.0150420Z  'range_num_stages': [0],
2026-02-21T09:46:18.0150624Z  'range_unroll_factors': [0],
2026-02-21T09:46:18.0150851Z  'range_warp_specializes': [],
2026-02-21T09:46:18.0151072Z  'reduction_loops': [None]}
2026-02-21T09:46:18.0175144Z [283s] Fitting surrogate: 517 points, 517 targets
2026-02-21T09:46:18.3026447Z [283s] Generation 10 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:46:20.2255586Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 20.7 configs/s
2026-02-21T09:46:20.6984564Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 21.6 configs/s
2026-02-21T09:46:22.9099066Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 443.8         
2026-02-21T09:46:22.9099534Z                                                                   configs/s     
2026-02-21T09:46:23.0536598Z [288s] Generation 10 complete: 
2026-02-21T09:46:23.0537079Z error=1
2026-02-21T09:46:23.0537373Z ok=9
2026-02-21T09:46:23.0537640Z min=0.1636
2026-02-21T09:46:23.0537922Z mid=0.1639
2026-02-21T09:46:23.0538191Z max=0.1664
2026-02-21T09:46:23.0538484Z best={'block_sizes': [1],
2026-02-21T09:46:23.0539236Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:46:23.0540314Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:46:23.0541056Z               'pointer'],
2026-02-21T09:46:23.0541634Z  'load_eviction_policies': ['', 'last', 'last', 'last', '', 'last', '', ''],
2026-02-21T09:46:23.0542371Z  'num_stages': 1,
2026-02-21T09:46:23.0542755Z  'num_warps': 16,
2026-02-21T09:46:23.0543104Z  'pid_type': 'flat',
2026-02-21T09:46:23.0543336Z  'range_flattens': [None],
2026-02-21T09:46:23.0543916Z  'range_multi_buffers': [None],
2026-02-21T09:46:23.0544533Z  'range_num_stages': [0],
2026-02-21T09:46:23.0544753Z  'range_unroll_factors': [0],
2026-02-21T09:46:23.0545006Z  'range_warp_specializes': [],
2026-02-21T09:46:23.0545249Z  'reduction_loops': [None]}
2026-02-21T09:46:23.0566730Z [288s] Fitting surrogate: 527 points, 527 targets
2026-02-21T09:46:23.2133561Z [288s] Autotuning complete in 288.2s after searching 503 configs.
2026-02-21T09:46:23.2134145Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:46:23.2136435Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'last', 'last', 'last', '', 'last', '', ''], num_stages=1, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:46:23.2138159Z 
2026-02-21T09:46:23.2138523Z [288s] Code of selected kernel: /tmp/torchinductor_root/sa/csaswu3fo2z6iyn5qqnkghtduz243nsyhhwyzbnjj7detqubrlkq.py
2026-02-21T09:46:24.3463915Z WARNING:tritonbench.utils.triton_op:Completed input ID 26:
2026-02-21T09:46:24.3464508Z (M, N)
2026-02-21T09:46:24.3464675Z -------------
2026-02-21T09:46:24.3464869Z (4096, 14336)
2026-02-21T09:46:24.3466599Z 
2026-02-21T09:46:24.3484560Z  90%|█████████ | 18/20 [1:27:56<10:15, 307.50s/it]WARNING:tritonbench.utils.triton_op:Running input ID 27:
2026-02-21T09:46:24.3485331Z (M, N)
2026-02-21T09:46:24.3485608Z -------------
2026-02-21T09:46:24.3485899Z (4096, 14848)
2026-02-21T09:46:24.3488191Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:46:25.6003791Z INFO:tritonbench.utils.triton_op:Took 3.61ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:46:29.3230321Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:46:30.6956727Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:46:30.6957227Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:46:30.6957648Z               'dtype': 'torch.float32',
2026-02-21T09:46:30.6958058Z               'shape': (4096, 14848),
2026-02-21T09:46:30.6958489Z               'stride': (14848, 1)},
2026-02-21T09:46:30.6958854Z             (14848,),
2026-02-21T09:46:30.6959167Z             { 'device': 'cuda:0',
2026-02-21T09:46:30.6959540Z               'dtype': 'torch.float32',
2026-02-21T09:46:30.6959928Z               'shape': (14848,),
2026-02-21T09:46:30.6960277Z               'stride': (1,)},
2026-02-21T09:46:30.6960673Z             { 'device': 'cuda:0',
2026-02-21T09:46:30.6961065Z               'dtype': 'torch.float32',
2026-02-21T09:46:30.6961471Z               'shape': (14848,),
2026-02-21T09:46:30.6961827Z               'stride': (1,)},
2026-02-21T09:46:30.6962868Z             1e-05),
2026-02-21T09:46:30.6963160Z   'kwargs': {}}
2026-02-21T09:46:30.7016792Z INFO:tritonbench.utils.triton_op:Took 6.40ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:46:30.7147821Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:46:30.7149298Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:46:30.7150198Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:46:30.7150723Z While processing:
2026-02-21T09:46:30.7151371Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:46:30.7152015Z     if bias is not None:
2026-02-21T09:46:30.7152343Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:46:30.7152549Z 
2026-02-21T09:46:30.8752821Z [0s] Autotune random seed: 2135381352
2026-02-21T09:46:31.2135438Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:47:08.9367099Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:47:11.7232403Z [40s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:47:11.7255433Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:47:18.8554340Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.1 configs/s
2026-02-21T09:47:18.8567168Z [47s] Adaptive compile timeout: 30s (90% percentile=16.4s, bounds=[30.0s, 30s])
2026-02-21T09:47:20.1176981Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 749.3 configs/s
2026-02-21T09:47:20.2384393Z [49s] Initial random population of 100, 5 starting points: 
2026-02-21T09:47:20.2384783Z error=12
2026-02-21T09:47:20.2384971Z timeout=2
2026-02-21T09:47:20.2385144Z ok=86
2026-02-21T09:47:20.2385334Z min=0.1950
2026-02-21T09:47:20.2385523Z mid=0.6612
2026-02-21T09:47:20.2385701Z max=62.5082
2026-02-21T09:47:20.2385902Z best={'block_sizes': [1],
2026-02-21T09:47:20.2386359Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:47:20.2387017Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:47:20.2387472Z               'pointer'],
2026-02-21T09:47:20.2387842Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:47:20.2388264Z  'num_stages': 6,
2026-02-21T09:47:20.2388469Z  'num_warps': 16,
2026-02-21T09:47:20.2388676Z  'pid_type': 'flat',
2026-02-21T09:47:20.2388909Z  'range_flattens': [None],
2026-02-21T09:47:20.2389160Z  'range_multi_buffers': [None],
2026-02-21T09:47:20.2389424Z  'range_num_stages': [0],
2026-02-21T09:47:20.2389661Z  'range_unroll_factors': [0],
2026-02-21T09:47:20.2389926Z  'range_warp_specializes': [],
2026-02-21T09:47:20.2390180Z  'reduction_loops': [8192]}
2026-02-21T09:47:20.2407175Z [49s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:47:22.9279410Z [51s] Generation 1 starting: 84 neighbors, 5 active search path(s)
2026-02-21T09:47:59.1341089Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 0.3 configs/s
2026-02-21T09:48:04.5149549Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 16.5 configs/s
2026-02-21T09:48:17.9638246Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 74.5 configs/s
2026-02-21T09:48:18.4383494Z [107s] Generation 1 complete: 
2026-02-21T09:48:18.4383800Z error=3
2026-02-21T09:48:18.4383964Z ok=86
2026-02-21T09:48:18.4384535Z min=0.1690
2026-02-21T09:48:18.4384701Z mid=0.2495
2026-02-21T09:48:18.4384867Z max=2.5901
2026-02-21T09:48:18.4385042Z best={'block_sizes': [1],
2026-02-21T09:48:18.4386125Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:48:18.4386762Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:48:18.4387193Z               'pointer'],
2026-02-21T09:48:18.4387524Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:48:18.4387911Z  'num_stages': 6,
2026-02-21T09:48:18.4388102Z  'num_warps': 8,
2026-02-21T09:48:18.4388288Z  'pid_type': 'flat',
2026-02-21T09:48:18.4388498Z  'range_flattens': [None],
2026-02-21T09:48:18.4388724Z  'range_multi_buffers': [None],
2026-02-21T09:48:18.4388973Z  'range_num_stages': [0],
2026-02-21T09:48:18.4389193Z  'range_unroll_factors': [0],
2026-02-21T09:48:18.4389437Z  'range_warp_specializes': [],
2026-02-21T09:48:18.4389672Z  'reduction_loops': [None]}
2026-02-21T09:48:18.4407834Z [107s] Fitting surrogate: 189 points, 189 targets
2026-02-21T09:48:19.6817528Z [108s] Generation 2 starting: 76 neighbors, 5 active search path(s)
2026-02-21T09:48:37.3134810Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 3.6 configs/s
2026-02-21T09:48:41.8236512Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 17.5 configs/s
2026-02-21T09:48:57.7325771Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 63.1 configs/s
2026-02-21T09:48:58.3253413Z [147s] Generation 2 complete: 
2026-02-21T09:48:58.3253738Z error=13
2026-02-21T09:48:58.3253929Z ok=68
2026-02-21T09:48:58.3254281Z min=0.1677
2026-02-21T09:48:58.3254464Z mid=0.1815
2026-02-21T09:48:58.3254646Z max=0.5316
2026-02-21T09:48:58.3254834Z best={'block_sizes': [1],
2026-02-21T09:48:58.3255246Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:48:58.3255874Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:48:58.3256363Z               'pointer', 'pointer'],
2026-02-21T09:48:58.3256785Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:48:58.3257173Z  'num_stages': 6,
2026-02-21T09:48:58.3257366Z  'num_warps': 8,
2026-02-21T09:48:58.3257562Z  'pid_type': 'flat',
2026-02-21T09:48:58.3257785Z  'range_flattens': [None],
2026-02-21T09:48:58.3258023Z  'range_multi_buffers': [None],
2026-02-21T09:48:58.3258262Z  'range_num_stages': [0],
2026-02-21T09:48:58.3258490Z  'range_unroll_factors': [0],
2026-02-21T09:48:58.3258732Z  'range_warp_specializes': [],
2026-02-21T09:48:58.3258979Z  'reduction_loops': [None]}
2026-02-21T09:48:58.3279003Z [147s] Fitting surrogate: 270 points, 270 targets
2026-02-21T09:48:59.3885247Z [148s] Generation 3 starting: 64 neighbors, 5 active search path(s)
2026-02-21T09:49:14.4959112Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 6.5 configs/s
2026-02-21T09:49:17.7069649Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 20.9 configs/s
2026-02-21T09:49:31.0757726Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 82.2 configs/s
2026-02-21T09:49:31.5504820Z [180s] Generation 3 complete: 
2026-02-21T09:49:31.5505068Z error=14
2026-02-21T09:49:31.5505241Z ok=55
2026-02-21T09:49:31.6518149Z min=0.1676
2026-02-21T09:49:31.6518319Z mid=0.1840
2026-02-21T09:49:31.6518480Z max=1.0601
2026-02-21T09:49:31.6518682Z best={'block_sizes': [1],
2026-02-21T09:49:31.6519060Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:49:31.6519611Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:49:31.6520029Z               'tensor_descriptor', 'pointer'],
2026-02-21T09:49:31.6520400Z  'load_eviction_policies': ['last', 'last', 'last', 'last', '', 'first', '', ''],
2026-02-21T09:49:31.6520765Z  'num_stages': 8,
2026-02-21T09:49:31.6520939Z  'num_warps': 8,
2026-02-21T09:49:31.6521122Z  'pid_type': 'flat',
2026-02-21T09:49:31.6521309Z  'range_flattens': [None],
2026-02-21T09:49:31.6521524Z  'range_multi_buffers': [None],
2026-02-21T09:49:31.6522070Z  'range_num_stages': [0],
2026-02-21T09:49:31.6522285Z  'range_unroll_factors': [0],
2026-02-21T09:49:31.6522512Z  'range_warp_specializes': [],
2026-02-21T09:49:31.6522748Z  'reduction_loops': [None]}
2026-02-21T09:49:31.6522992Z [180s] Fitting surrogate: 339 points, 339 targets
2026-02-21T09:49:32.3751829Z [181s] Generation 4 starting: 45 neighbors, 5 active search path(s)
2026-02-21T09:49:43.2056556Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 5.1 configs/s
2026-02-21T09:49:45.8397954Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 18.2 configs/s
2026-02-21T09:49:56.4548080Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 94.4 configs/s
2026-02-21T09:49:56.8661289Z [205s] Generation 4 complete: 
2026-02-21T09:49:56.8661842Z error=4
2026-02-21T09:49:56.8662171Z ok=46
2026-02-21T09:49:56.8662403Z min=0.1671
2026-02-21T09:49:56.8662570Z mid=0.1858
2026-02-21T09:49:56.8662739Z max=0.9762
2026-02-21T09:49:56.8662949Z best={'block_sizes': [1],
2026-02-21T09:49:56.8663349Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:49:56.8663956Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:49:56.8664765Z               'pointer', 'pointer'],
2026-02-21T09:49:56.8665147Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:49:56.8665530Z  'num_stages': 6,
2026-02-21T09:49:56.8665722Z  'num_warps': 8,
2026-02-21T09:49:56.8665906Z  'pid_type': 'flat',
2026-02-21T09:49:56.8666111Z  'range_flattens': [None],
2026-02-21T09:49:56.8666331Z  'range_multi_buffers': [None],
2026-02-21T09:49:56.8666567Z  'range_num_stages': [0],
2026-02-21T09:49:56.8666784Z  'range_unroll_factors': [0],
2026-02-21T09:49:56.8667032Z  'range_warp_specializes': [],
2026-02-21T09:49:56.8667274Z  'reduction_loops': [None]}
2026-02-21T09:49:56.8693275Z [205s] Fitting surrogate: 389 points, 389 targets
2026-02-21T09:49:57.3098562Z [206s] Generation 5 starting: 22 neighbors, 2 active search path(s)
2026-02-21T09:50:28.9229191Z [237s] Timeout after 30s compiling Config(block_sizes=[8], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', '', 'last', 'first', 'first', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=5, num_warps=2, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[True], range_num_stages=[1], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[None])
2026-02-21T09:50:28.9247317Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 0.3 configs/s
2026-02-21T09:50:30.0035027Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 24/24 23.6 configs/s
2026-02-21T09:50:33.4861888Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 283.8         
2026-02-21T09:50:33.4865618Z                                                                   configs/s     
2026-02-21T09:50:33.6688167Z [242s] Generation 5 complete: 
2026-02-21T09:50:33.6688532Z error=6
2026-02-21T09:50:33.6689550Z timeout=1
2026-02-21T09:50:33.6689727Z ok=18
2026-02-21T09:50:33.6689913Z min=0.1676
2026-02-21T09:50:33.6690090Z mid=0.1766
2026-02-21T09:50:33.6690360Z max=1.6373
2026-02-21T09:50:33.6690564Z best={'block_sizes': [1],
2026-02-21T09:50:33.6690985Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:50:33.6691625Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:50:33.6692125Z               'pointer', 'pointer'],
2026-02-21T09:50:33.6692510Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:50:33.6692896Z  'num_stages': 6,
2026-02-21T09:50:33.6693097Z  'num_warps': 8,
2026-02-21T09:50:33.6693298Z  'pid_type': 'flat',
2026-02-21T09:50:33.6693885Z  'range_flattens': [None],
2026-02-21T09:50:33.6694357Z  'range_multi_buffers': [None],
2026-02-21T09:50:33.6694601Z  'range_num_stages': [0],
2026-02-21T09:50:33.6694833Z  'range_unroll_factors': [0],
2026-02-21T09:50:33.6695089Z  'range_warp_specializes': [],
2026-02-21T09:50:33.6695340Z  'reduction_loops': [None]}
2026-02-21T09:50:33.6714821Z [242s] Fitting surrogate: 414 points, 414 targets
2026-02-21T09:50:34.0523734Z [242s] Generation 6 starting: 19 neighbors, 2 active search path(s)
2026-02-21T09:50:39.0702976Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 4.6 configs/s
2026-02-21T09:50:40.1858513Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 21/21 19.7 configs/s
2026-02-21T09:50:44.5434677Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 227.7         
2026-02-21T09:50:44.5435216Z                                                                   configs/s     
2026-02-21T09:50:44.7557456Z [253s] Generation 6 complete: 
2026-02-21T09:50:44.7557769Z error=3
2026-02-21T09:50:44.7557946Z ok=19
2026-02-21T09:50:44.7558120Z min=0.1678
2026-02-21T09:50:44.7558295Z mid=0.1914
2026-02-21T09:50:44.7558470Z max=0.9761
2026-02-21T09:50:44.7558671Z best={'block_sizes': [1],
2026-02-21T09:50:44.7559088Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T09:50:44.7559714Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:50:44.7560201Z               'pointer', 'pointer'],
2026-02-21T09:50:44.7560583Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', '', ''],
2026-02-21T09:50:44.7560973Z  'num_stages': 6,
2026-02-21T09:50:44.7561190Z  'num_warps': 8,
2026-02-21T09:50:44.7561389Z  'pid_type': 'flat',
2026-02-21T09:50:44.7561608Z  'range_flattens': [None],
2026-02-21T09:50:44.7561842Z  'range_multi_buffers': [None],
2026-02-21T09:50:44.7562091Z  'range_num_stages': [0],
2026-02-21T09:50:44.7562323Z  'range_unroll_factors': [0],
2026-02-21T09:50:44.7562588Z  'range_warp_specializes': [],
2026-02-21T09:50:44.7562842Z  'reduction_loops': [None]}
2026-02-21T09:50:44.7587082Z [253s] Fitting surrogate: 436 points, 436 targets
2026-02-21T09:50:45.1596880Z [253s] Generation 7 starting: 21 neighbors, 2 active search path(s)
2026-02-21T09:50:51.7925734Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 2.3 configs/s
2026-02-21T09:50:52.7957431Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 22/22 23.3 configs/s
2026-02-21T09:50:56.5208429Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 265.9         
2026-02-21T09:50:56.5208990Z                                                                   configs/s     
2026-02-21T09:50:56.7113697Z [265s] Generation 7 complete: 
2026-02-21T09:50:56.7114345Z error=6
2026-02-21T09:50:56.7114537Z ok=18
2026-02-21T09:50:56.7114704Z min=0.1683
2026-02-21T09:50:56.7114890Z mid=0.1910
2026-02-21T09:50:56.7115058Z max=0.9908
2026-02-21T09:50:56.7115279Z best={'block_sizes': [2],
2026-02-21T09:50:56.7115738Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:50:56.7116341Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:50:56.7117197Z               'tensor_descriptor'],
2026-02-21T09:50:56.7117563Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', '', 'last'],
2026-02-21T09:50:56.7117930Z  'num_stages': 4,
2026-02-21T09:50:56.7118141Z  'num_warps': 8,
2026-02-21T09:50:56.7118355Z  'pid_type': 'flat',
2026-02-21T09:50:56.7118571Z  'range_flattens': [None],
2026-02-21T09:50:56.7118812Z  'range_multi_buffers': [None],
2026-02-21T09:50:56.7119055Z  'range_num_stages': [0],
2026-02-21T09:50:56.7119301Z  'range_unroll_factors': [0],
2026-02-21T09:50:56.7119546Z  'range_warp_specializes': [],
2026-02-21T09:50:56.7119799Z  'reduction_loops': [None]}
2026-02-21T09:50:56.7145297Z [265s] Fitting surrogate: 460 points, 460 targets
2026-02-21T09:50:56.9494658Z [265s] Generation 8 starting: 7 neighbors, 1 active search path(s)
2026-02-21T09:51:03.4087933Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7/7 0.6 configs/s
2026-02-21T09:51:03.7130304Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━━ 7/7 24.7 configs/s
2026-02-21T09:51:04.9474737Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 777.4         
2026-02-21T09:51:04.9475252Z                                                                   configs/s     
2026-02-21T09:51:05.0561833Z [273s] Generation 8 complete: 
2026-02-21T09:51:05.0562145Z error=2
2026-02-21T09:51:05.0562323Z ok=6
2026-02-21T09:51:05.0562506Z min=0.1709
2026-02-21T09:51:05.0562681Z mid=0.1716
2026-02-21T09:51:05.0562854Z max=0.2800
2026-02-21T09:51:05.0563037Z best={'block_sizes': [2],
2026-02-21T09:51:05.0563524Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:51:05.0564451Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:51:05.0564853Z               'tensor_descriptor'],
2026-02-21T09:51:05.0565224Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', '', 'last'],
2026-02-21T09:51:05.0565607Z  'num_stages': 5,
2026-02-21T09:51:05.0565812Z  'num_warps': 32,
2026-02-21T09:51:05.0566003Z  'pid_type': 'flat',
2026-02-21T09:51:05.0566233Z  'range_flattens': [None],
2026-02-21T09:51:05.0566464Z  'range_multi_buffers': [None],
2026-02-21T09:51:05.0566710Z  'range_num_stages': [0],
2026-02-21T09:51:05.0566939Z  'range_unroll_factors': [0],
2026-02-21T09:51:05.0567188Z  'range_warp_specializes': [],
2026-02-21T09:51:05.0567435Z  'reduction_loops': [None]}
2026-02-21T09:51:05.0592300Z [273s] Fitting surrogate: 468 points, 468 targets
2026-02-21T09:51:05.3252346Z [274s] Generation 9 starting: 9 neighbors, 1 active search path(s)
2026-02-21T09:51:07.8736923Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 2.2 configs/s
2026-02-21T09:51:08.3617598Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 10/10 23.3 configs/s
2026-02-21T09:51:10.7249053Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 415.0         
2026-02-21T09:51:10.7250917Z                                                                   configs/s     
2026-02-21T09:51:10.8707934Z [279s] Generation 9 complete: 
2026-02-21T09:51:10.8708192Z error=2
2026-02-21T09:51:10.8708360Z ok=9
2026-02-21T09:51:10.8708541Z min=0.1683
2026-02-21T09:51:10.8708711Z mid=0.1707
2026-02-21T09:51:10.8708879Z max=0.2435
2026-02-21T09:51:10.8709054Z best={'block_sizes': [2],
2026-02-21T09:51:10.8709499Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:51:10.8710116Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:51:10.8710529Z               'tensor_descriptor'],
2026-02-21T09:51:10.8710880Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', '', 'last'],
2026-02-21T09:51:10.8711578Z  'num_stages': 5,
2026-02-21T09:51:10.8711783Z  'num_warps': 16,
2026-02-21T09:51:10.8711971Z  'pid_type': 'flat',
2026-02-21T09:51:10.8712181Z  'range_flattens': [None],
2026-02-21T09:51:10.8712423Z  'range_multi_buffers': [None],
2026-02-21T09:51:10.8712668Z  'range_num_stages': [0],
2026-02-21T09:51:10.8712889Z  'range_unroll_factors': [0],
2026-02-21T09:51:10.8713132Z  'range_warp_specializes': [],
2026-02-21T09:51:10.8713369Z  'reduction_loops': [None]}
2026-02-21T09:51:10.8743873Z [279s] Fitting surrogate: 479 points, 479 targets
2026-02-21T09:51:11.1563149Z [279s] Generation 10 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:51:15.2163112Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 2.0 configs/s
2026-02-21T09:51:15.7007708Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 23.6 configs/s
2026-02-21T09:51:17.7079749Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 486.9         
2026-02-21T09:51:17.7080318Z                                                                   configs/s     
2026-02-21T09:51:17.8433629Z [286s] Generation 10 complete: 
2026-02-21T09:51:17.8433890Z error=2
2026-02-21T09:51:17.8434317Z ok=9
2026-02-21T09:51:17.8434495Z min=0.1700
2026-02-21T09:51:17.8434651Z mid=0.1709
2026-02-21T09:51:17.8434817Z max=0.9849
2026-02-21T09:51:17.8434986Z best={'block_sizes': [2],
2026-02-21T09:51:17.8435395Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:51:17.8435963Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:51:17.8436315Z               'tensor_descriptor'],
2026-02-21T09:51:17.8436663Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', '', 'last'],
2026-02-21T09:51:17.8437005Z  'num_stages': 5,
2026-02-21T09:51:17.8437190Z  'num_warps': 16,
2026-02-21T09:51:17.8437365Z  'pid_type': 'flat',
2026-02-21T09:51:17.8437564Z  'range_flattens': [None],
2026-02-21T09:51:17.8437799Z  'range_multi_buffers': [None],
2026-02-21T09:51:17.8438019Z  'range_num_stages': [0],
2026-02-21T09:51:17.8438234Z  'range_unroll_factors': [0],
2026-02-21T09:51:17.8438458Z  'range_warp_specializes': [],
2026-02-21T09:51:17.8438701Z  'reduction_loops': [None]}
2026-02-21T09:51:17.8461386Z [286s] Fitting surrogate: 490 points, 490 targets
2026-02-21T09:51:18.1361806Z [286s] Generation 11 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:51:20.6863545Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 4.6 configs/s
2026-02-21T09:51:21.1660810Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 23.9 configs/s
2026-02-21T09:51:23.4321787Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 432.8         
2026-02-21T09:51:23.4323558Z                                                                   configs/s     
2026-02-21T09:51:23.5780053Z [292s] Generation 11 complete: 
2026-02-21T09:51:23.5780518Z error=2
2026-02-21T09:51:23.5780812Z ok=9
2026-02-21T09:51:23.5781079Z min=0.1703
2026-02-21T09:51:23.5781436Z mid=0.1708
2026-02-21T09:51:23.5781761Z max=0.1717
2026-02-21T09:51:23.5782110Z best={'block_sizes': [2],
2026-02-21T09:51:23.5782598Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:51:23.5783633Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:51:23.5784296Z               'tensor_descriptor'],
2026-02-21T09:51:23.5784666Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', '', 'last'],
2026-02-21T09:51:23.5785022Z  'num_stages': 5,
2026-02-21T09:51:23.5785221Z  'num_warps': 16,
2026-02-21T09:51:23.5785406Z  'pid_type': 'flat',
2026-02-21T09:51:23.5785616Z  'range_flattens': [None],
2026-02-21T09:51:23.5785839Z  'range_multi_buffers': [None],
2026-02-21T09:51:23.5786076Z  'range_num_stages': [0],
2026-02-21T09:51:23.5786295Z  'range_unroll_factors': [0],
2026-02-21T09:51:23.5786536Z  'range_warp_specializes': [],
2026-02-21T09:51:23.5787040Z  'reduction_loops': [None]}
2026-02-21T09:51:23.5808449Z [292s] Fitting surrogate: 501 points, 501 targets
2026-02-21T09:51:23.7327843Z [292s] Autotuning complete in 292.5s after searching 480 configs.
2026-02-21T09:51:23.7328339Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:51:23.7330476Z     @helion.kernel(config=helion.Config(block_sizes=[2], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', '', 'last', 'first', '', '', '', 'last'], num_stages=5, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T09:51:23.7332364Z 
2026-02-21T09:51:23.7332775Z [292s] Code of selected kernel: /tmp/torchinductor_root/ub/cubnfjodi3zit2crfhk3gg2khfevf4srl4wecducowtie5q67ce7.py
2026-02-21T09:51:24.9153351Z WARNING:tritonbench.utils.triton_op:Completed input ID 27:
2026-02-21T09:51:24.9161926Z (M, N)
2026-02-21T09:51:24.9162272Z -------------
2026-02-21T09:51:24.9162637Z (4096, 14848)
2026-02-21T09:51:24.9162864Z 
2026-02-21T09:51:24.9177354Z  95%|█████████▌| 19/20 [1:32:57<05:05, 305.42s/it]WARNING:tritonbench.utils.triton_op:Running input ID 29:
2026-02-21T09:51:24.9177785Z (M, N)
2026-02-21T09:51:24.9177955Z -------------
2026-02-21T09:51:24.9178116Z (4096, 15872)
2026-02-21T09:51:24.9180766Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T09:51:26.1548169Z INFO:tritonbench.utils.triton_op:Took 3.26ms to get benchmark function for torch_compile_layer_norm
2026-02-21T09:51:30.0989059Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T09:51:31.4601213Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:51:31.4601775Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:51:31.4602281Z               'dtype': 'torch.float32',
2026-02-21T09:51:31.4602733Z               'shape': (4096, 15872),
2026-02-21T09:51:31.4603143Z               'stride': (15872, 1)},
2026-02-21T09:51:31.4603524Z             (15872,),
2026-02-21T09:51:31.4603907Z             { 'device': 'cuda:0',
2026-02-21T09:51:31.4604607Z               'dtype': 'torch.float32',
2026-02-21T09:51:31.4605054Z               'shape': (15872,),
2026-02-21T09:51:31.4605441Z               'stride': (1,)},
2026-02-21T09:51:31.4605806Z             { 'device': 'cuda:0',
2026-02-21T09:51:31.4606227Z               'dtype': 'torch.float32',
2026-02-21T09:51:31.4606626Z               'shape': (15872,),
2026-02-21T09:51:31.4607044Z               'stride': (1,)},
2026-02-21T09:51:31.4607420Z             1e-05),
2026-02-21T09:51:31.4607619Z   'kwargs': {}}
2026-02-21T09:51:31.4647218Z INFO:tritonbench.utils.triton_op:Took 4.96ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T09:51:31.4767953Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T09:51:31.4769387Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T09:51:31.4771086Z If this is not a tensor operation, please report this as a bug.
2026-02-21T09:51:31.4771691Z While processing:
2026-02-21T09:51:31.4772383Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T09:51:31.4773072Z     if bias is not None:
2026-02-21T09:51:31.4773447Z        ^^^^^^^^^^^^^^^^
2026-02-21T09:51:31.4773680Z 
2026-02-21T09:51:31.6335475Z [0s] Autotune random seed: 2135381352
2026-02-21T09:51:31.9527464Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:52:09.6996382Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'first', '', '', 'first', ''], num_sm_multiplier=16, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T09:52:12.5121918Z [40s] Timeout after 30s compiling Config(block_sizes=[512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'first', 'last', 'last', 'first', ''], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[4], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[64])
2026-02-21T09:52:12.5143598Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:52:19.7715218Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.8 configs/s
2026-02-21T09:52:19.7727456Z [47s] Adaptive compile timeout: 30s (90% percentile=16.9s, bounds=[30.0s, 30s])
2026-02-21T09:52:20.2942872Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━━ 947/947 1591.6 configs/s
2026-02-21T09:52:20.3905989Z [48s] Initial random population of 100, 5 starting points: 
2026-02-21T09:52:20.3906369Z error=12
2026-02-21T09:52:20.3906548Z timeout=2
2026-02-21T09:52:20.3906725Z ok=86
2026-02-21T09:52:20.3906893Z min=0.2090
2026-02-21T09:52:20.3907078Z mid=0.7206
2026-02-21T09:52:20.3907252Z max=66.5835
2026-02-21T09:52:20.3907463Z best={'block_sizes': [1],
2026-02-21T09:52:20.3908050Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:52:20.3908756Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:52:20.3909207Z               'pointer'],
2026-02-21T09:52:20.3909596Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:52:20.3910036Z  'num_stages': 6,
2026-02-21T09:52:20.3910247Z  'num_warps': 16,
2026-02-21T09:52:20.3910453Z  'pid_type': 'flat',
2026-02-21T09:52:20.3910690Z  'range_flattens': [None],
2026-02-21T09:52:20.3910932Z  'range_multi_buffers': [None],
2026-02-21T09:52:20.3911193Z  'range_num_stages': [0],
2026-02-21T09:52:20.3911430Z  'range_unroll_factors': [0],
2026-02-21T09:52:20.3911688Z  'range_warp_specializes': [],
2026-02-21T09:52:20.3911922Z  'reduction_loops': [8192]}
2026-02-21T09:52:20.3930954Z [48s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:52:21.7923803Z [49s] Generation 1 starting: 83 neighbors, 5 active search path(s)
2026-02-21T09:52:59.4133208Z [87s] Timeout after 30s compiling Config(block_sizes=[8], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'last', 'last', 'last', '', 'first', '', 'first'], maxnreg=256, num_sm_multiplier=8, num_stages=7, num_warps=4, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T09:52:59.4150721Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 0.6 configs/s
2026-02-21T09:53:04.7067810Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 16.6 configs/s
2026-02-21T09:53:20.0634698Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 65.3 configs/s
2026-02-21T09:53:20.6106383Z [108s] Generation 1 complete: 
2026-02-21T09:53:20.6106660Z error=3
2026-02-21T09:53:20.6106831Z timeout=1
2026-02-21T09:53:20.6107000Z ok=85
2026-02-21T09:53:20.6107161Z min=0.1867
2026-02-21T09:53:20.6107912Z mid=0.2668
2026-02-21T09:53:20.6108087Z max=1.9574
2026-02-21T09:53:20.6108269Z best={'block_sizes': [1],
2026-02-21T09:53:20.6108661Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:53:20.6109280Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:53:20.6109721Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T09:53:20.6110031Z  'num_stages': 1,
2026-02-21T09:53:20.6110220Z  'num_warps': 8,
2026-02-21T09:53:20.6110405Z  'pid_type': 'flat',
2026-02-21T09:53:20.6110625Z  'range_flattens': [None],
2026-02-21T09:53:20.6110861Z  'range_multi_buffers': [None],
2026-02-21T09:53:20.6111098Z  'range_num_stages': [0],
2026-02-21T09:53:20.6111321Z  'range_unroll_factors': [0],
2026-02-21T09:53:20.6111554Z  'range_warp_specializes': [],
2026-02-21T09:53:20.6111790Z  'reduction_loops': [None]}
2026-02-21T09:53:20.6132369Z [108s] Fitting surrogate: 189 points, 189 targets
2026-02-21T09:53:22.0316103Z [110s] Generation 2 starting: 86 neighbors, 5 active search path(s)
2026-02-21T09:53:44.5793216Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 2.0 configs/s
2026-02-21T09:53:49.2573060Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 19.0 configs/s
2026-02-21T09:54:06.7601181Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 57.3 configs/s
2026-02-21T09:54:07.3832399Z [155s] Generation 2 complete: 
2026-02-21T09:54:07.3832651Z error=13
2026-02-21T09:54:07.3832807Z ok=78
2026-02-21T09:54:07.3832967Z min=0.1811
2026-02-21T09:54:07.3833119Z mid=0.1968
2026-02-21T09:54:07.3833280Z max=1.3471
2026-02-21T09:54:07.3833443Z best={'block_sizes': [1],
2026-02-21T09:54:07.3833850Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:54:07.3834774Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:54:07.3835186Z               'pointer'],
2026-02-21T09:54:07.3835547Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:54:07.3835937Z  'num_stages': 6,
2026-02-21T09:54:07.3836120Z  'num_warps': 32,
2026-02-21T09:54:07.3836324Z  'pid_type': 'flat',
2026-02-21T09:54:07.3836525Z  'range_flattens': [None],
2026-02-21T09:54:07.3836740Z  'range_multi_buffers': [None],
2026-02-21T09:54:07.3836956Z  'range_num_stages': [0],
2026-02-21T09:54:07.3837166Z  'range_unroll_factors': [0],
2026-02-21T09:54:07.3837385Z  'range_warp_specializes': [],
2026-02-21T09:54:07.3837607Z  'reduction_loops': [None]}
2026-02-21T09:54:07.3861985Z [155s] Fitting surrogate: 280 points, 280 targets
2026-02-21T09:54:08.5058393Z [156s] Generation 3 starting: 67 neighbors, 5 active search path(s)
2026-02-21T09:54:26.0643140Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 2.2 configs/s
2026-02-21T09:54:29.8570056Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 17.9 configs/s
2026-02-21T09:54:45.9418791Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 62.4 configs/s
2026-02-21T09:54:46.5283663Z [194s] Generation 3 complete: 
2026-02-21T09:54:46.5284693Z error=6
2026-02-21T09:54:46.5285660Z ok=66
2026-02-21T09:54:46.5285955Z min=0.1810
2026-02-21T09:54:46.5286239Z mid=0.1880
2026-02-21T09:54:46.5286516Z max=0.6240
2026-02-21T09:54:46.5286801Z best={'block_sizes': [1],
2026-02-21T09:54:46.5287529Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T09:54:46.5288571Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T09:54:46.5289287Z               'pointer'],
2026-02-21T09:54:46.5289840Z  'load_eviction_policies': ['', 'last', 'last', 'first', '', 'first', 'last', ''],
2026-02-21T09:54:46.5290646Z  'num_stages': 6,
2026-02-21T09:54:46.5290969Z  'num_warps': 32,
2026-02-21T09:54:46.5291275Z  'pid_type': 'flat',
2026-02-21T09:54:46.5291616Z  'range_flattens': [None],
2026-02-21T09:54:46.5292461Z  'range_multi_buffers': [None],
2026-02-21T09:54:46.5292928Z  'range_num_stages': [0],
2026-02-21T09:54:46.5293254Z  'range_unroll_factors': [0],
2026-02-21T09:54:46.5293478Z  'range_warp_specializes': [],
2026-02-21T09:54:46.5293705Z  'reduction_loops': [None]}
2026-02-21T09:54:46.5313456Z [194s] Fitting surrogate: 352 points, 352 targets
2026-02-21T09:54:47.6271655Z [195s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T09:55:16.5038520Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 0.4 configs/s
2026-02-21T09:55:20.3726100Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 17.5 configs/s
2026-02-21T09:55:34.7822536Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 69.6 configs/s
2026-02-21T09:55:35.3145846Z [243s] Generation 4 complete: 
2026-02-21T09:55:35.3146150Z error=5
2026-02-21T09:55:35.3146353Z ok=66
2026-02-21T09:55:35.3146544Z min=0.1800
2026-02-21T09:55:35.3146875Z mid=0.1855
2026-02-21T09:55:35.3147292Z max=2.0524
2026-02-21T09:55:35.3147703Z best={'block_sizes': [1],
2026-02-21T09:55:35.3148494Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T09:55:35.3149624Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:55:35.3150337Z               'tensor_descriptor'],
2026-02-21T09:55:35.3150973Z  'load_eviction_policies': ['last', '', 'first', '', '', 'first', '', 'first'],
2026-02-21T09:55:35.3151651Z  'maxnreg': 256,
2026-02-21T09:55:35.3152002Z  'num_sm_multiplier': 32,
2026-02-21T09:55:35.3152377Z  'num_stages': 4,
2026-02-21T09:55:35.3152689Z  'num_warps': 8,
2026-02-21T09:55:35.3153041Z  'pid_type': 'persistent_blocked',
2026-02-21T09:55:35.3153470Z  'range_flattens': [False],
2026-02-21T09:55:35.3153865Z  'range_multi_buffers': [True],
2026-02-21T09:55:35.3154862Z  'range_num_stages': [4],
2026-02-21T09:55:35.3155263Z  'range_unroll_factors': [1],
2026-02-21T09:55:35.3155685Z  'range_warp_specializes': [],
2026-02-21T09:55:35.3156095Z  'reduction_loops': [8192]}
2026-02-21T09:55:35.3179456Z [243s] Fitting surrogate: 423 points, 423 targets
2026-02-21T09:55:36.0246672Z [244s] Generation 5 starting: 41 neighbors, 3 active search path(s)
2026-02-21T09:55:46.5507807Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 9.2 configs/s
2026-02-21T09:55:49.1039364Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 42/42 16.7 configs/s
2026-02-21T09:55:59.2958834Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.3 configs/s
2026-02-21T09:55:59.7105985Z [267s] Generation 5 complete: 
2026-02-21T09:55:59.7106250Z error=2
2026-02-21T09:55:59.7106414Z ok=42
2026-02-21T09:55:59.7106681Z min=0.1796
2026-02-21T09:55:59.7106878Z mid=0.1881
2026-02-21T09:55:59.7107163Z max=1.0059
2026-02-21T09:55:59.7109224Z best={'block_sizes': [2],
2026-02-21T09:55:59.7109866Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:55:59.7110983Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:55:59.7111491Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:55:59.7111876Z  'num_stages': 2,
2026-02-21T09:55:59.7112069Z  'num_warps': 32,
2026-02-21T09:55:59.7112272Z  'pid_type': 'flat',
2026-02-21T09:55:59.7112494Z  'range_flattens': [None],
2026-02-21T09:55:59.7112729Z  'range_multi_buffers': [None],
2026-02-21T09:55:59.7112964Z  'range_num_stages': [0],
2026-02-21T09:55:59.7113190Z  'range_unroll_factors': [0],
2026-02-21T09:55:59.7113428Z  'range_warp_specializes': [],
2026-02-21T09:55:59.7113662Z  'reduction_loops': [None]}
2026-02-21T09:55:59.7140238Z [267s] Fitting surrogate: 467 points, 467 targets
2026-02-21T09:56:00.4915894Z [268s] Generation 6 starting: 44 neighbors, 3 active search path(s)
2026-02-21T09:56:12.0112022Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 3.2 configs/s
2026-02-21T09:56:14.7382347Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 16.8 configs/s
2026-02-21T09:56:23.3769591Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 115.8         
2026-02-21T09:56:23.3770230Z                                                                   configs/s     
2026-02-21T09:56:23.7238493Z [291s] Generation 6 complete: 
2026-02-21T09:56:23.7238961Z error=1
2026-02-21T09:56:23.7239237Z ok=46
2026-02-21T09:56:23.7239531Z min=0.1792
2026-02-21T09:56:23.7239805Z mid=0.1946
2026-02-21T09:56:23.7240090Z max=1.8385
2026-02-21T09:56:23.7240382Z best={'block_sizes': [2],
2026-02-21T09:56:23.7241105Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:56:23.7242048Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:56:23.7242806Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:56:23.7243390Z  'num_stages': 2,
2026-02-21T09:56:23.7243696Z  'num_warps': 32,
2026-02-21T09:56:23.7244563Z  'pid_type': 'flat',
2026-02-21T09:56:23.7244954Z  'range_flattens': [None],
2026-02-21T09:56:23.7245356Z  'range_multi_buffers': [None],
2026-02-21T09:56:23.7245739Z  'range_num_stages': [0],
2026-02-21T09:56:23.7246146Z  'range_unroll_factors': [0],
2026-02-21T09:56:23.7246538Z  'range_warp_specializes': [],
2026-02-21T09:56:23.7246972Z  'reduction_loops': [None]}
2026-02-21T09:56:23.7272284Z [291s] Fitting surrogate: 514 points, 514 targets
2026-02-21T09:56:24.5546849Z [292s] Generation 7 starting: 43 neighbors, 3 active search path(s)
2026-02-21T09:56:35.4640999Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 2.9 configs/s
2026-02-21T09:56:38.1148421Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.9 configs/s
2026-02-21T09:56:48.5465957Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 95.9 configs/s
2026-02-21T09:56:48.9499044Z [316s] Generation 7 complete: 
2026-02-21T09:56:48.9499300Z error=1
2026-02-21T09:56:48.9499494Z ok=45
2026-02-21T09:56:48.9499654Z min=0.1795
2026-02-21T09:56:48.9499827Z mid=0.1905
2026-02-21T09:56:48.9500000Z max=1.0302
2026-02-21T09:56:48.9500188Z best={'block_sizes': [2],
2026-02-21T09:56:48.9501029Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:56:48.9501616Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:56:48.9502095Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:56:48.9502439Z  'num_stages': 2,
2026-02-21T09:56:48.9502647Z  'num_warps': 32,
2026-02-21T09:56:48.9502834Z  'pid_type': 'flat',
2026-02-21T09:56:48.9503042Z  'range_flattens': [None],
2026-02-21T09:56:48.9503272Z  'range_multi_buffers': [None],
2026-02-21T09:56:48.9503504Z  'range_num_stages': [0],
2026-02-21T09:56:48.9503729Z  'range_unroll_factors': [0],
2026-02-21T09:56:48.9504142Z  'range_warp_specializes': [],
2026-02-21T09:56:48.9504393Z  'reduction_loops': [None]}
2026-02-21T09:56:48.9539981Z [317s] Fitting surrogate: 560 points, 560 targets
2026-02-21T09:56:49.3578855Z [317s] Generation 8 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:56:54.1521192Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.3 configs/s
2026-02-21T09:56:55.3343762Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 19/19 16.7 configs/s
2026-02-21T09:57:00.3273324Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 198.9         
2026-02-21T09:57:00.3273862Z                                                                   configs/s     
2026-02-21T09:57:00.5526878Z [328s] Generation 8 complete: 
2026-02-21T09:57:00.5527302Z ok=20
2026-02-21T09:57:00.5527568Z min=0.1824
2026-02-21T09:57:00.5527856Z mid=0.2076
2026-02-21T09:57:00.5528108Z max=0.4658
2026-02-21T09:57:00.5528387Z best={'block_sizes': [2],
2026-02-21T09:57:00.5529040Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:57:00.5530085Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:57:00.5530814Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:57:00.5531360Z  'num_stages': 2,
2026-02-21T09:57:00.5531655Z  'num_warps': 32,
2026-02-21T09:57:00.5531941Z  'pid_type': 'flat',
2026-02-21T09:57:00.5532267Z  'range_flattens': [None],
2026-02-21T09:57:00.5532620Z  'range_multi_buffers': [None],
2026-02-21T09:57:00.5532979Z  'range_num_stages': [0],
2026-02-21T09:57:00.5533315Z  'range_unroll_factors': [0],
2026-02-21T09:57:00.5533683Z  'range_warp_specializes': [],
2026-02-21T09:57:00.5534466Z  'reduction_loops': [None]}
2026-02-21T09:57:00.5559054Z [328s] Fitting surrogate: 580 points, 580 targets
2026-02-21T09:57:00.9832511Z [329s] Generation 9 starting: 19 neighbors, 1 active search path(s)
2026-02-21T09:57:07.5533947Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 4.8 configs/s
2026-02-21T09:57:08.7466247Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 20/20 17.4 configs/s
2026-02-21T09:57:12.9318504Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 236.3         
2026-02-21T09:57:12.9319030Z                                                                   configs/s     
2026-02-21T09:57:13.1330393Z [341s] Generation 9 complete: 
2026-02-21T09:57:13.1330839Z error=1
2026-02-21T09:57:13.1331135Z ok=20
2026-02-21T09:57:13.1331402Z min=0.1796
2026-02-21T09:57:13.1331689Z mid=0.2389
2026-02-21T09:57:13.1331959Z max=1.7587
2026-02-21T09:57:13.1332255Z best={'block_sizes': [2],
2026-02-21T09:57:13.1332969Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:57:13.1333904Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:57:13.1335269Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:57:13.1335623Z  'num_stages': 2,
2026-02-21T09:57:13.1335815Z  'num_warps': 32,
2026-02-21T09:57:13.1336019Z  'pid_type': 'flat',
2026-02-21T09:57:13.1336231Z  'range_flattens': [None],
2026-02-21T09:57:13.1336460Z  'range_multi_buffers': [None],
2026-02-21T09:57:13.1336692Z  'range_num_stages': [0],
2026-02-21T09:57:13.1337465Z  'range_unroll_factors': [0],
2026-02-21T09:57:13.1337709Z  'range_warp_specializes': [],
2026-02-21T09:57:13.1337956Z  'reduction_loops': [None]}
2026-02-21T09:57:13.1370770Z [341s] Fitting surrogate: 601 points, 601 targets
2026-02-21T09:57:13.5586992Z [341s] Generation 10 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:57:18.3877202Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.2 configs/s
2026-02-21T09:57:19.5367705Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.2 configs/s
2026-02-21T09:57:20.9616753Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 672.2         
2026-02-21T09:57:20.9617246Z                                                                   configs/s     
2026-02-21T09:57:21.0810102Z [349s] Generation 10 complete: 
2026-02-21T09:57:21.0810595Z error=1
2026-02-21T09:57:21.0810861Z ok=19
2026-02-21T09:57:21.0811127Z min=0.1821
2026-02-21T09:57:21.0811415Z mid=0.3954
2026-02-21T09:57:21.0811715Z max=1.1844
2026-02-21T09:57:21.0812003Z best={'block_sizes': [2],
2026-02-21T09:57:21.0812714Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:57:21.0813688Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:57:21.0818102Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:57:21.0818667Z  'num_stages': 2,
2026-02-21T09:57:21.0818973Z  'num_warps': 32,
2026-02-21T09:57:21.0819283Z  'pid_type': 'flat',
2026-02-21T09:57:21.0819624Z  'range_flattens': [None],
2026-02-21T09:57:21.0820068Z  'range_multi_buffers': [None],
2026-02-21T09:57:21.0820530Z  'range_num_stages': [0],
2026-02-21T09:57:21.0820946Z  'range_unroll_factors': [0],
2026-02-21T09:57:21.0821207Z  'range_warp_specializes': [],
2026-02-21T09:57:21.0821459Z  'reduction_loops': [None]}
2026-02-21T09:57:21.0850780Z [349s] Fitting surrogate: 621 points, 621 targets
2026-02-21T09:57:21.4702405Z [349s] Generation 11 starting: 16 neighbors, 1 active search path(s)
2026-02-21T09:57:25.7642763Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 6.6 configs/s
2026-02-21T09:57:26.7751670Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 17.6 configs/s
2026-02-21T09:57:29.5608158Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 353.0         
2026-02-21T09:57:29.5608619Z                                                                   configs/s     
2026-02-21T09:57:29.7158118Z [357s] Generation 11 complete: 
2026-02-21T09:57:29.7158581Z error=1
2026-02-21T09:57:29.7158880Z ok=17
2026-02-21T09:57:29.7159173Z min=0.1823
2026-02-21T09:57:29.7159462Z mid=0.2060
2026-02-21T09:57:29.7159737Z max=0.8945
2026-02-21T09:57:29.7160021Z best={'block_sizes': [2],
2026-02-21T09:57:29.7160766Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:57:29.7161731Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:57:29.7162547Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:57:29.7163107Z  'num_stages': 2,
2026-02-21T09:57:29.7163434Z  'num_warps': 32,
2026-02-21T09:57:29.7163747Z  'pid_type': 'flat',
2026-02-21T09:57:29.7164599Z  'range_flattens': [None],
2026-02-21T09:57:29.7164998Z  'range_multi_buffers': [None],
2026-02-21T09:57:29.7165417Z  'range_num_stages': [0],
2026-02-21T09:57:29.7165801Z  'range_unroll_factors': [0],
2026-02-21T09:57:29.7166210Z  'range_warp_specializes': [],
2026-02-21T09:57:29.7166630Z  'reduction_loops': [None]}
2026-02-21T09:57:29.7193751Z [357s] Fitting surrogate: 639 points, 639 targets
2026-02-21T09:57:30.1337334Z [358s] Generation 12 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:57:34.8645647Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.7 configs/s
2026-02-21T09:57:35.9842007Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.7 configs/s
2026-02-21T09:57:40.5917258Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 215.3         
2026-02-21T09:57:40.5918192Z                                                                   configs/s     
2026-02-21T09:57:40.8064882Z [368s] Generation 12 complete: 
2026-02-21T09:57:40.8065302Z error=1
2026-02-21T09:57:40.8065582Z ok=19
2026-02-21T09:57:40.8065843Z min=0.1821
2026-02-21T09:57:40.8066125Z mid=0.2003
2026-02-21T09:57:40.8066389Z max=0.6481
2026-02-21T09:57:40.8066673Z best={'block_sizes': [2],
2026-02-21T09:57:40.8067381Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:57:40.8068307Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:57:40.8069857Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:57:40.8070459Z  'num_stages': 2,
2026-02-21T09:57:40.8070777Z  'num_warps': 32,
2026-02-21T09:57:40.8071106Z  'pid_type': 'flat',
2026-02-21T09:57:40.8071473Z  'range_flattens': [None],
2026-02-21T09:57:40.8071846Z  'range_multi_buffers': [None],
2026-02-21T09:57:40.8072227Z  'range_num_stages': [0],
2026-02-21T09:57:40.8072614Z  'range_unroll_factors': [0],
2026-02-21T09:57:40.8073002Z  'range_warp_specializes': [],
2026-02-21T09:57:40.8073392Z  'reduction_loops': [None]}
2026-02-21T09:57:40.8100645Z [368s] Fitting surrogate: 659 points, 659 targets
2026-02-21T09:57:41.2202900Z [369s] Generation 13 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:57:45.6857105Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 19.7 configs/s
2026-02-21T09:57:46.8595615Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.8 configs/s
2026-02-21T09:57:51.4180409Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 217.7         
2026-02-21T09:57:51.4180900Z                                                                   configs/s     
2026-02-21T09:57:51.6327789Z [379s] Generation 13 complete: 
2026-02-21T09:57:51.6328249Z ok=20
2026-02-21T09:57:51.6328542Z min=0.1800
2026-02-21T09:57:51.6328824Z mid=0.1963
2026-02-21T09:57:51.6329082Z max=0.8331
2026-02-21T09:57:51.6329374Z best={'block_sizes': [2],
2026-02-21T09:57:51.6330213Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T09:57:51.6331175Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T09:57:51.6331962Z  'load_eviction_policies': ['', 'last', '', 'first', '', '', '', ''],
2026-02-21T09:57:51.6332272Z  'num_stages': 2,
2026-02-21T09:57:51.6332437Z  'num_warps': 32,
2026-02-21T09:57:51.6332605Z  'pid_type': 'flat',
2026-02-21T09:57:51.6332788Z  'range_flattens': [None],
2026-02-21T09:57:51.6332984Z  'range_multi_buffers': [None],
2026-02-21T09:57:51.6333208Z  'range_num_stages': [0],
2026-02-21T09:57:51.6333400Z  'range_unroll_factors': [0],
2026-02-21T09:57:51.6333611Z  'range_warp_specializes': [],
2026-02-21T09:57:51.6333815Z  'reduction_loops': [None]}
2026-02-21T09:57:51.6364324Z [379s] Fitting surrogate: 679 points, 679 targets
2026-02-21T09:57:52.0587449Z [380s] Generation 14 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:57:56.6591225Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 7.2 configs/s
2026-02-21T09:57:57.7694585Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 16.9 configs/s
2026-02-21T09:58:02.7825247Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 198.1         
2026-02-21T09:58:02.7825755Z                                                                   configs/s     
2026-02-21T09:58:03.0139440Z [391s] Generation 14 complete: 
2026-02-21T09:58:03.0139950Z ok=20
2026-02-21T09:58:03.0140179Z min=0.1805
2026-02-21T09:58:03.0140350Z mid=0.1866
2026-02-21T09:58:03.0141017Z max=0.6825
2026-02-21T09:58:03.0141226Z best={'block_sizes': [1],
2026-02-21T09:58:03.0141638Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:03.0142246Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:03.0142674Z               'pointer'],
2026-02-21T09:58:03.0143015Z  'load_eviction_policies': ['', '', 'first', 'first', '', 'first', 'first', 'first'],
2026-02-21T09:58:03.0143411Z  'maxnreg': 64,
2026-02-21T09:58:03.0143602Z  'num_sm_multiplier': 64,
2026-02-21T09:58:03.0143821Z  'num_stages': 3,
2026-02-21T09:58:03.0144359Z  'num_warps': 32,
2026-02-21T09:58:03.0144590Z  'pid_type': 'persistent_blocked',
2026-02-21T09:58:03.0144845Z  'range_flattens': [False],
2026-02-21T09:58:03.0145080Z  'range_multi_buffers': [None],
2026-02-21T09:58:03.0145318Z  'range_num_stages': [1],
2026-02-21T09:58:03.0145554Z  'range_unroll_factors': [1],
2026-02-21T09:58:03.0145798Z  'range_warp_specializes': [],
2026-02-21T09:58:03.0146037Z  'reduction_loops': [4096]}
2026-02-21T09:58:03.0177178Z [391s] Fitting surrogate: 699 points, 699 targets
2026-02-21T09:58:03.4359935Z [391s] Generation 15 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:58:08.1882275Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 3.4 configs/s
2026-02-21T09:58:09.3025159Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 16.8 configs/s
2026-02-21T09:58:13.5787749Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 231.7         
2026-02-21T09:58:13.5788277Z                                                                   configs/s     
2026-02-21T09:58:13.7777785Z [401s] Generation 15 complete: 
2026-02-21T09:58:13.7778057Z ok=19
2026-02-21T09:58:13.7778229Z min=0.1838
2026-02-21T09:58:13.7778414Z mid=0.1914
2026-02-21T09:58:13.7778581Z max=0.4506
2026-02-21T09:58:13.7778763Z best={'block_sizes': [1],
2026-02-21T09:58:13.7779196Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:13.7779789Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:13.7780201Z               'pointer'],
2026-02-21T09:58:13.7780575Z  'load_eviction_policies': ['', '', 'first', 'first', 'last', 'first', 'first', 'first'],
2026-02-21T09:58:13.7780979Z  'maxnreg': 64,
2026-02-21T09:58:13.7781168Z  'num_sm_multiplier': 64,
2026-02-21T09:58:13.7781387Z  'num_stages': 3,
2026-02-21T09:58:13.7781569Z  'num_warps': 16,
2026-02-21T09:58:13.7781784Z  'pid_type': 'persistent_blocked',
2026-02-21T09:58:13.7782035Z  'range_flattens': [False],
2026-02-21T09:58:13.7782274Z  'range_multi_buffers': [None],
2026-02-21T09:58:13.7782506Z  'range_num_stages': [1],
2026-02-21T09:58:13.7782729Z  'range_unroll_factors': [1],
2026-02-21T09:58:13.7782970Z  'range_warp_specializes': [],
2026-02-21T09:58:13.7783202Z  'reduction_loops': [8192]}
2026-02-21T09:58:13.7819954Z [401s] Fitting surrogate: 718 points, 718 targets
2026-02-21T09:58:14.1886196Z [402s] Generation 16 starting: 18 neighbors, 1 active search path(s)
2026-02-21T09:58:18.9974396Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 9.6 configs/s
2026-02-21T09:58:20.2076585Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.3 configs/s
2026-02-21T09:58:24.4775966Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 232.0         
2026-02-21T09:58:24.4778312Z                                                                   configs/s     
2026-02-21T09:58:24.6828440Z [412s] Generation 16 complete: 
2026-02-21T09:58:24.6828870Z ok=20
2026-02-21T09:58:24.6829194Z min=0.1848
2026-02-21T09:58:24.6829475Z mid=0.2030
2026-02-21T09:58:24.6829749Z max=1.7724
2026-02-21T09:58:24.6830036Z best={'block_sizes': [1],
2026-02-21T09:58:24.6830732Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:24.6832589Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:24.6833285Z               'pointer'],
2026-02-21T09:58:24.6833874Z  'load_eviction_policies': ['', '', 'first', 'first', 'last', 'first', 'first', 'first'],
2026-02-21T09:58:24.6835176Z  'maxnreg': 64,
2026-02-21T09:58:24.6835369Z  'num_sm_multiplier': 64,
2026-02-21T09:58:24.6835568Z  'num_stages': 3,
2026-02-21T09:58:24.6835749Z  'num_warps': 16,
2026-02-21T09:58:24.6835940Z  'pid_type': 'persistent_blocked',
2026-02-21T09:58:24.6836196Z  'range_flattens': [False],
2026-02-21T09:58:24.6836416Z  'range_multi_buffers': [None],
2026-02-21T09:58:24.6836632Z  'range_num_stages': [1],
2026-02-21T09:58:24.6836854Z  'range_unroll_factors': [1],
2026-02-21T09:58:24.6837079Z  'range_warp_specializes': [],
2026-02-21T09:58:24.6837303Z  'reduction_loops': [8192]}
2026-02-21T09:58:24.6868763Z [412s] Fitting surrogate: 738 points, 738 targets
2026-02-21T09:58:25.0672567Z [413s] Generation 17 starting: 16 neighbors, 1 active search path(s)
2026-02-21T09:58:29.5126163Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 6.1 configs/s
2026-02-21T09:58:30.5153322Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 17.8 configs/s
2026-02-21T09:58:34.5274527Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 246.8         
2026-02-21T09:58:34.5275092Z                                                                   configs/s     
2026-02-21T09:58:34.7247732Z [422s] Generation 17 complete: 
2026-02-21T09:58:34.7248218Z error=1
2026-02-21T09:58:34.7248501Z ok=17
2026-02-21T09:58:34.7248766Z min=0.1833
2026-02-21T09:58:34.7249047Z mid=0.1895
2026-02-21T09:58:34.7249311Z max=0.4235
2026-02-21T09:58:34.7249616Z best={'block_sizes': [1],
2026-02-21T09:58:34.7250442Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:34.7251429Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:34.7251965Z               'pointer'],
2026-02-21T09:58:34.7252303Z  'load_eviction_policies': ['', '', 'first', 'first', 'last', 'first', 'first', 'first'],
2026-02-21T09:58:34.7252665Z  'maxnreg': 64,
2026-02-21T09:58:34.7252836Z  'num_sm_multiplier': 64,
2026-02-21T09:58:34.7253046Z  'num_stages': 3,
2026-02-21T09:58:34.7253215Z  'num_warps': 16,
2026-02-21T09:58:34.7253408Z  'pid_type': 'persistent_blocked',
2026-02-21T09:58:34.7253637Z  'range_flattens': [False],
2026-02-21T09:58:34.7253839Z  'range_multi_buffers': [None],
2026-02-21T09:58:34.7254453Z  'range_num_stages': [1],
2026-02-21T09:58:34.7254650Z  'range_unroll_factors': [1],
2026-02-21T09:58:34.7254867Z  'range_warp_specializes': [],
2026-02-21T09:58:34.7255070Z  'reduction_loops': [8192]}
2026-02-21T09:58:34.7288592Z [422s] Fitting surrogate: 756 points, 756 targets
2026-02-21T09:58:35.1724767Z [423s] Generation 18 starting: 19 neighbors, 1 active search path(s)
2026-02-21T09:58:40.0629786Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 10.3 configs/s
2026-02-21T09:58:41.3228504Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.4 configs/s
2026-02-21T09:58:44.5295998Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 307.2         
2026-02-21T09:58:44.5297057Z                                                                   configs/s     
2026-02-21T09:58:44.7024540Z [432s] Generation 18 complete: 
2026-02-21T09:58:44.7024796Z ok=21
2026-02-21T09:58:44.7024989Z min=0.1837
2026-02-21T09:58:44.7025156Z mid=0.2349
2026-02-21T09:58:44.7025322Z max=1.2422
2026-02-21T09:58:44.7025496Z best={'block_sizes': [1],
2026-02-21T09:58:44.7025916Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:44.7026501Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T09:58:44.7026922Z               'pointer'],
2026-02-21T09:58:44.7027282Z  'load_eviction_policies': ['', '', 'first', 'first', 'last', 'first', 'first', 'first'],
2026-02-21T09:58:44.7027687Z  'maxnreg': 64,
2026-02-21T09:58:44.7028235Z  'num_sm_multiplier': 64,
2026-02-21T09:58:44.7028456Z  'num_stages': 3,
2026-02-21T09:58:44.7028651Z  'num_warps': 16,
2026-02-21T09:58:44.7028853Z  'pid_type': 'persistent_blocked',
2026-02-21T09:58:44.7029119Z  'range_flattens': [False],
2026-02-21T09:58:44.7029355Z  'range_multi_buffers': [None],
2026-02-21T09:58:44.7029582Z  'range_num_stages': [1],
2026-02-21T09:58:44.7029785Z  'range_unroll_factors': [1],
2026-02-21T09:58:44.7030017Z  'range_warp_specializes': [],
2026-02-21T09:58:44.7030238Z  'reduction_loops': [8192]}
2026-02-21T09:58:44.7066434Z [432s] Fitting surrogate: 777 points, 777 targets
2026-02-21T09:58:44.8654886Z [432s] Autotuning complete in 432.9s after searching 742 configs.
2026-02-21T09:58:44.8655317Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:58:44.8657281Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'], load_eviction_policies=['', '', 'first', 'first', 'last', 'first', 'first', 'first'], maxnreg=64, num_sm_multiplier=64, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[False], range_multi_buffers=[None], range_num_stages=[1], range_unroll_factors=[1], range_warp_specializes=[], reduction_loops=[8192]), static_shapes=True)
2026-02-21T09:58:44.8659304Z 
2026-02-21T09:58:44.8659699Z [432s] Code of selected kernel: /tmp/torchinductor_root/xc/cxcl5p4uaxjheyulzmuw4go5fz4mzl6iaiopzi77j44dh5ar7ma4.py
2026-02-21T09:58:46.0108791Z WARNING:tritonbench.utils.triton_op:Completed input ID 29:
2026-02-21T09:58:46.0109217Z (M, N)
2026-02-21T09:58:46.0109574Z -------------
2026-02-21T09:58:46.0109939Z (4096, 15872)
2026-02-21T09:58:46.0110252Z 
2026-02-21T09:58:46.0111783Z 100%|██████████| 20/20 [1:40:18<00:00, 346.15s/it]
2026-02-21T09:58:46.0112447Z 100%|██████████| 20/20 [1:40:18<00:00, 300.92s/it]
2026-02-21T09:58:46.0153556Z INFO:tritonbench.utils.run_utils:[tritonbench] Output result csv to /tmp/tmpg6etrf5d.csv
2026-02-21T09:58:49.5133382Z        (M, N)    torch_compile_layer_norm-speedup    torch_compile_layer_norm-accuracy    liger_layer_norm-speedup    liger_layer_norm-accuracy    helion_layer_norm_tritonbench-speedup    helion_layer_norm_tritonbench-accuracy
2026-02-21T09:58:49.5135301Z -------------  ----------------------------------  -----------------------------------  --------------------------  ---------------------------  ---------------------------------------  ----------------------------------------
2026-02-21T09:58:49.5136355Z  (4096, 1024)                             1.33007                                    1                     1.28692                            1                                  1.44823                                         1
2026-02-21T09:58:49.5137217Z  (4096, 2048)                             1.25248                                    1                     1.24565                            1                                  1.31049                                         1
2026-02-21T09:58:49.5138076Z  (4096, 2560)                             1.22609                                    1                     1.26076                            1                                  1.2413                                          1
2026-02-21T09:58:49.5139427Z  (4096, 3584)                             1.29398                                    1                     1.29254                            1                                  1.28431                                         1
2026-02-21T09:58:49.5140261Z  (4096, 4096)                             1.34674                                    1                     1.33852                            1                                  1.33191                                         1
2026-02-21T09:58:49.5141388Z  (4096, 5120)                             1.43238                                    1                     1.36629                            1                                  1.41068                                         1
2026-02-21T09:58:49.5142399Z  (4096, 5632)                             1.4781                                     1                     1.45685                            1                                  1.36735                                         1
2026-02-21T09:58:49.5143249Z  (4096, 6656)                             1.51721                                    1                     1.51606                            1                                  1.50892                                         1
2026-02-21T09:58:49.5144262Z  (4096, 7168)                             1.53146                                    1                     1.52829                            1                                  1.53761                                         1
2026-02-21T09:58:49.5145130Z  (4096, 8192)                             1.55301                                    1                     1.53728                            1                                  1.54527                                         1
2026-02-21T09:58:49.5145980Z  (4096, 8704)                             1.56343                                    1                     1.3056                             1                                  1.55791                                         1
2026-02-21T09:58:49.5146844Z  (4096, 9728)                             1.56753                                    1                     1.39245                            1                                  1.56365                                         1
2026-02-21T09:58:49.5147696Z (4096, 10240)                             1.57455                                    1                     1.43189                            1                                  1.57345                                         1
2026-02-21T09:58:49.5148550Z (4096, 11264)                             1.56599                                    1                     1.50583                            1                                  1.49662                                         1
2026-02-21T09:58:49.5149400Z (4096, 11776)                             1.58773                                    1                     1.52912                            1                                  1.57325                                         1
2026-02-21T09:58:49.5150254Z (4096, 12800)                             1.56522                                    1                     1.56307                            1                                  1.55719                                         1
2026-02-21T09:58:49.5151109Z (4096, 13312)                             1.57749                                    1                     1.56946                            1                                  1.58117                                         1
2026-02-21T09:58:49.5151991Z (4096, 14336)                             1.57131                                    1                     1.57987                            1                                  1.58001                                         1
2026-02-21T09:58:49.5152794Z (4096, 14848)                             1.55955                                    1                     1.589                              1                                  1.57183                                         1
2026-02-21T09:58:49.5153646Z (4096, 15872)                             1.55834                                    1                     1.58603                            1                                  1.54786                                         1
2026-02-21T09:58:49.5154540Z       average                             1.48263                                    1                     1.44407                            1                                  1.47945                                         1
2026-02-21T10:01:02.5259274Z Using num_inputs=20 for layer_norm
2026-02-21T10:01:02.9996835Z Running layer_norm benchmark with Helion implementation...
2026-02-21T10:01:02.9997149Z 
2026-02-21T10:01:03.2606379Z Equally-spaced-k mode: Selected 20 equally spaced inputs (total available: 30)
2026-02-21T10:01:03.2607200Z WARNING:tritonbench.utils.triton_op:Input IDs to run: [0, 2, 3, 5, 6, 8, 9, 11, 12, 14, 15, 17, 18, 20, 21, 23, 24, 26, 27, 29]
2026-02-21T10:01:03.2613046Z 
2026-02-21T10:01:03.2622586Z   0%|          | 0/20 [00:00<?, ?it/s]WARNING:tritonbench.utils.triton_op:Running input ID 0:
2026-02-21T10:01:03.2623006Z (M, N)
2026-02-21T10:01:03.2623167Z ------------
2026-02-21T10:01:03.2623353Z (4096, 1024)
2026-02-21T10:01:03.2626101Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T10:01:05.0933371Z INFO:tritonbench.utils.triton_op:Took 53.90ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:01:06.8858586Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:01:07.3480633Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:01:07.3481014Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:01:07.3481303Z               'dtype': 'torch.float32',
2026-02-21T10:01:07.3481577Z               'shape': (4096, 1024),
2026-02-21T10:01:07.3481847Z               'stride': (1024, 1)},
2026-02-21T10:01:07.3482102Z             (1024,),
2026-02-21T10:01:07.3482312Z             { 'device': 'cuda:0',
2026-02-21T10:01:07.3482563Z               'dtype': 'torch.float32',
2026-02-21T10:01:07.3482827Z               'shape': (1024,),
2026-02-21T10:01:07.3483072Z               'stride': (1,)},
2026-02-21T10:01:07.3483314Z             { 'device': 'cuda:0',
2026-02-21T10:01:07.3483565Z               'dtype': 'torch.float32',
2026-02-21T10:01:07.3483814Z               'shape': (1024,),
2026-02-21T10:01:07.3484443Z               'stride': (1,)},
2026-02-21T10:01:07.3484697Z             1e-05),
2026-02-21T10:01:07.3484908Z   'kwargs': {}}
2026-02-21T10:01:07.3485360Z INFO:tritonbench.utils.triton_op:Took 0.93ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:01:07.3701913Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:01:07.3702837Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:01:07.3703457Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:01:07.3703811Z While processing:
2026-02-21T10:01:07.3704400Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:01:07.3704830Z     if bias is not None:
2026-02-21T10:01:07.3705043Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:01:07.3705170Z 
2026-02-21T10:01:07.5909794Z [0s] Autotune random seed: 2141537047
2026-02-21T10:01:07.6275516Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:02:12.1801705Z [64s] Timeout after 60s compiling Config(block_sizes=[32], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'first', 'first', 'last', 'last', 'last', 'first', ''], maxnreg=256, num_sm_multiplier=4, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[True], range_num_stages=[0], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:02:12.1827680Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━ 100/100 - configs/s
2026-02-21T10:02:17.8836909Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.7 configs/s
2026-02-21T10:02:17.8853810Z [70s] Adaptive compile timeout: 30s (90% percentile=2.9s, bounds=[30.0s, 60s])
2026-02-21T10:02:19.6413825Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 581.0 configs/s
2026-02-21T10:02:19.7789989Z [72s] Initial random population of 100, 5 starting points: 
2026-02-21T10:02:19.7790350Z error=8
2026-02-21T10:02:19.7791231Z timeout=1
2026-02-21T10:02:19.7791418Z ok=91
2026-02-21T10:02:19.7791583Z min=0.0154
2026-02-21T10:02:19.7791755Z mid=0.0699
2026-02-21T10:02:19.7791919Z max=2.7365
2026-02-21T10:02:19.7792126Z best={'block_sizes': [1],
2026-02-21T10:02:19.7792523Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:02:19.7793053Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:02:19.7793455Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:02:19.7793778Z  'num_stages': 1,
2026-02-21T10:02:19.7794304Z  'num_warps': 4,
2026-02-21T10:02:19.7794529Z  'pid_type': 'flat',
2026-02-21T10:02:19.7794743Z  'range_flattens': [None],
2026-02-21T10:02:19.7794976Z  'range_multi_buffers': [None],
2026-02-21T10:02:19.7795222Z  'range_num_stages': [0],
2026-02-21T10:02:19.7795446Z  'range_unroll_factors': [0],
2026-02-21T10:02:19.7795696Z  'range_warp_specializes': [],
2026-02-21T10:02:19.7795949Z  'reduction_loops': [None]}
2026-02-21T10:02:19.7816855Z [72s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:02:20.7718860Z [73s] Generation 1 starting: 63 neighbors, 5 active search path(s)
2026-02-21T10:02:25.0366449Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 34.7 configs/s
2026-02-21T10:02:29.0785921Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 16.2 configs/s
2026-02-21T10:02:35.6339049Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 155.5         
2026-02-21T10:02:35.6339651Z                                                                   configs/s     
2026-02-21T10:02:36.2401127Z [88s] Generation 1 complete: 
2026-02-21T10:02:36.2401454Z ok=68
2026-02-21T10:02:36.2401636Z min=0.0153
2026-02-21T10:02:36.2401815Z mid=0.0178
2026-02-21T10:02:36.2401986Z max=0.0530
2026-02-21T10:02:36.2402180Z best={'block_sizes': [1],
2026-02-21T10:02:36.2402644Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:02:36.2403312Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:02:36.2403743Z               'tensor_descriptor'],
2026-02-21T10:02:36.2404492Z  'load_eviction_policies': ['first', '', 'first', 'last', '', '', 'first', ''],
2026-02-21T10:02:36.2404892Z  'num_stages': 2,
2026-02-21T10:02:36.2405092Z  'num_warps': 4,
2026-02-21T10:02:36.2405286Z  'pid_type': 'flat',
2026-02-21T10:02:36.2405501Z  'range_flattens': [None],
2026-02-21T10:02:36.2405733Z  'range_multi_buffers': [None],
2026-02-21T10:02:36.2405978Z  'range_num_stages': [0],
2026-02-21T10:02:36.2406200Z  'range_unroll_factors': [0],
2026-02-21T10:02:36.2406448Z  'range_warp_specializes': [],
2026-02-21T10:02:36.2406694Z  'reduction_loops': [None]}
2026-02-21T10:02:36.2424890Z [88s] Fitting surrogate: 168 points, 168 targets
2026-02-21T10:02:37.4111355Z [89s] Generation 2 starting: 53 neighbors, 5 active search path(s)
2026-02-21T10:02:40.6730171Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 34.0 configs/s
2026-02-21T10:02:44.0731003Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.4 configs/s
2026-02-21T10:02:49.7001470Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 181.0         
2026-02-21T10:02:49.7002741Z                                                                   configs/s     
2026-02-21T10:02:50.2100275Z [102s] Generation 2 complete: 
2026-02-21T10:02:50.2100558Z ok=58
2026-02-21T10:02:50.2100746Z min=0.0149
2026-02-21T10:02:50.2100926Z mid=0.0156
2026-02-21T10:02:50.2101109Z max=0.0313
2026-02-21T10:02:50.2101304Z best={'block_sizes': [1],
2026-02-21T10:02:50.2101782Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:02:50.2102504Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:02:50.2102995Z               'tensor_descriptor'],
2026-02-21T10:02:50.2103736Z  'load_eviction_policies': ['first', '', 'first', 'last', '', '', 'first', ''],
2026-02-21T10:02:50.2104514Z  'num_stages': 2,
2026-02-21T10:02:50.2104725Z  'num_warps': 4,
2026-02-21T10:02:50.2104934Z  'pid_type': 'flat',
2026-02-21T10:02:50.2105159Z  'range_flattens': [None],
2026-02-21T10:02:50.2105408Z  'range_multi_buffers': [None],
2026-02-21T10:02:50.2105670Z  'range_num_stages': [0],
2026-02-21T10:02:50.2105919Z  'range_unroll_factors': [0],
2026-02-21T10:02:50.2106179Z  'range_warp_specializes': [],
2026-02-21T10:02:50.2106441Z  'reduction_loops': [None]}
2026-02-21T10:02:50.2123638Z [102s] Fitting surrogate: 226 points, 226 targets
2026-02-21T10:02:51.4704749Z [103s] Generation 3 starting: 56 neighbors, 5 active search path(s)
2026-02-21T10:02:54.9208421Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 28.0 configs/s
2026-02-21T10:02:58.4461060Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 16.4 configs/s
2026-02-21T10:03:04.2956404Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 174.3         
2026-02-21T10:03:04.2956953Z                                                                   configs/s     
2026-02-21T10:03:04.8188340Z [117s] Generation 3 complete: 
2026-02-21T10:03:04.8188612Z ok=61
2026-02-21T10:03:04.8188781Z min=0.0150
2026-02-21T10:03:04.8188949Z mid=0.0158
2026-02-21T10:03:04.8189123Z max=0.0529
2026-02-21T10:03:04.8189303Z best={'block_sizes': [1],
2026-02-21T10:03:04.8190081Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:03:04.8191298Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:03:04.8192039Z               'tensor_descriptor'],
2026-02-21T10:03:04.8192651Z  'load_eviction_policies': ['first', '', 'first', 'last', '', '', 'first', ''],
2026-02-21T10:03:04.8193254Z  'num_stages': 2,
2026-02-21T10:03:04.8193592Z  'num_warps': 4,
2026-02-21T10:03:04.8193902Z  'pid_type': 'flat',
2026-02-21T10:03:04.8194786Z  'range_flattens': [None],
2026-02-21T10:03:04.8195156Z  'range_multi_buffers': [None],
2026-02-21T10:03:04.8195539Z  'range_num_stages': [0],
2026-02-21T10:03:04.8195892Z  'range_unroll_factors': [0],
2026-02-21T10:03:04.8196913Z  'range_warp_specializes': [],
2026-02-21T10:03:04.8197306Z  'reduction_loops': [None]}
2026-02-21T10:03:04.8211812Z [117s] Fitting surrogate: 287 points, 287 targets
2026-02-21T10:03:05.9987920Z [118s] Generation 4 starting: 53 neighbors, 5 active search path(s)
2026-02-21T10:03:09.0914381Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 40.2 configs/s
2026-02-21T10:03:12.3607450Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 16.4 configs/s
2026-02-21T10:03:17.9419388Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 182.6         
2026-02-21T10:03:17.9419904Z                                                                   configs/s     
2026-02-21T10:03:18.4141677Z [130s] Generation 4 complete: 
2026-02-21T10:03:18.4141940Z ok=58
2026-02-21T10:03:18.4142607Z min=0.0155
2026-02-21T10:03:18.4142804Z mid=0.0157
2026-02-21T10:03:18.4142974Z max=0.0400
2026-02-21T10:03:18.4143155Z best={'block_sizes': [1],
2026-02-21T10:03:18.4143593Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:03:18.4144426Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:03:18.4144904Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:03:18.4145325Z  'load_eviction_policies': ['', 'last', '', '', '', 'last', 'last', ''],
2026-02-21T10:03:18.4145680Z  'num_stages': 8,
2026-02-21T10:03:18.4145871Z  'num_warps': 4,
2026-02-21T10:03:18.4146069Z  'pid_type': 'flat',
2026-02-21T10:03:18.4146272Z  'range_flattens': [None],
2026-02-21T10:03:18.4146516Z  'range_multi_buffers': [None],
2026-02-21T10:03:18.4146758Z  'range_num_stages': [0],
2026-02-21T10:03:18.4146987Z  'range_unroll_factors': [0],
2026-02-21T10:03:18.4147234Z  'range_warp_specializes': [],
2026-02-21T10:03:18.4147478Z  'reduction_loops': [None]}
2026-02-21T10:03:18.4166936Z [130s] Fitting surrogate: 345 points, 345 targets
2026-02-21T10:03:19.4118366Z [131s] Generation 5 starting: 58 neighbors, 5 active search path(s)
2026-02-21T10:03:23.3900035Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 42.4 configs/s
2026-02-21T10:03:27.3243103Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 16.2 configs/s
2026-02-21T10:03:33.3270716Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 169.9         
2026-02-21T10:03:33.3271250Z                                                                   configs/s     
2026-02-21T10:03:33.8250342Z [146s] Generation 5 complete: 
2026-02-21T10:03:33.8250802Z ok=64
2026-02-21T10:03:33.8251090Z min=0.0153
2026-02-21T10:03:33.8251371Z mid=0.0163
2026-02-21T10:03:33.8251672Z max=0.1570
2026-02-21T10:03:33.8251959Z best={'block_sizes': [1],
2026-02-21T10:03:33.8252639Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:03:33.8253628Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:03:33.8254722Z               'pointer'],
2026-02-21T10:03:33.8255200Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:03:33.8255720Z  'num_stages': 2,
2026-02-21T10:03:33.8256034Z  'num_warps': 4,
2026-02-21T10:03:33.8256341Z  'pid_type': 'flat',
2026-02-21T10:03:33.8256684Z  'range_flattens': [None],
2026-02-21T10:03:33.8257048Z  'range_multi_buffers': [None],
2026-02-21T10:03:33.8257436Z  'range_num_stages': [0],
2026-02-21T10:03:33.8257797Z  'range_unroll_factors': [0],
2026-02-21T10:03:33.8258192Z  'range_warp_specializes': [],
2026-02-21T10:03:33.8258573Z  'reduction_loops': [None]}
2026-02-21T10:03:33.8278814Z [146s] Fitting surrogate: 409 points, 409 targets
2026-02-21T10:03:34.6916842Z [147s] Generation 6 starting: 52 neighbors, 5 active search path(s)
2026-02-21T10:03:38.1691843Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 23.3 configs/s
2026-02-21T10:03:41.4958898Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.7 configs/s
2026-02-21T10:03:46.6981463Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 195.9         
2026-02-21T10:03:46.6981979Z                                                                   configs/s     
2026-02-21T10:03:47.1652345Z [159s] Generation 6 complete: 
2026-02-21T10:03:47.1652653Z ok=57
2026-02-21T10:03:47.1652856Z min=0.0150
2026-02-21T10:03:47.1653033Z mid=0.0159
2026-02-21T10:03:47.1653210Z max=0.1565
2026-02-21T10:03:47.1653392Z best={'block_sizes': [1],
2026-02-21T10:03:47.1653876Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:03:47.1654923Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:03:47.1655421Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:03:47.1656506Z  'load_eviction_policies': ['', 'last', '', '', '', '', 'last', 'first'],
2026-02-21T10:03:47.1656901Z  'num_stages': 8,
2026-02-21T10:03:47.1657105Z  'num_warps': 4,
2026-02-21T10:03:47.1657313Z  'pid_type': 'flat',
2026-02-21T10:03:47.1657544Z  'range_flattens': [None],
2026-02-21T10:03:47.1657773Z  'range_multi_buffers': [None],
2026-02-21T10:03:47.1658019Z  'range_num_stages': [0],
2026-02-21T10:03:47.1658245Z  'range_unroll_factors': [0],
2026-02-21T10:03:47.1658503Z  'range_warp_specializes': [],
2026-02-21T10:03:47.1658784Z  'reduction_loops': [None]}
2026-02-21T10:03:47.1681653Z [159s] Fitting surrogate: 466 points, 466 targets
2026-02-21T10:03:48.0194249Z [160s] Generation 7 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:03:50.6343540Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 21.8 configs/s
2026-02-21T10:03:53.8364754Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 15.5 configs/s
2026-02-21T10:03:59.4417369Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 181.7         
2026-02-21T10:03:59.4417997Z                                                                   configs/s     
2026-02-21T10:03:59.9254475Z [172s] Generation 7 complete: 
2026-02-21T10:03:59.9254813Z ok=54
2026-02-21T10:03:59.9254996Z min=0.0150
2026-02-21T10:03:59.9255179Z mid=0.0158
2026-02-21T10:03:59.9255342Z max=0.0204
2026-02-21T10:03:59.9255526Z best={'block_sizes': [1],
2026-02-21T10:03:59.9255939Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:03:59.9256533Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:03:59.9256985Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:03:59.9257348Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:03:59.9257724Z  'num_stages': 2,
2026-02-21T10:03:59.9257953Z  'num_warps': 4,
2026-02-21T10:03:59.9258196Z  'pid_type': 'flat',
2026-02-21T10:03:59.9258463Z  'range_flattens': [None],
2026-02-21T10:03:59.9258700Z  'range_multi_buffers': [None],
2026-02-21T10:03:59.9258941Z  'range_num_stages': [0],
2026-02-21T10:03:59.9259158Z  'range_unroll_factors': [0],
2026-02-21T10:03:59.9259416Z  'range_warp_specializes': [],
2026-02-21T10:03:59.9259647Z  'reduction_loops': [None]}
2026-02-21T10:03:59.9283088Z [172s] Fitting surrogate: 520 points, 520 targets
2026-02-21T10:04:00.5614818Z [172s] Generation 8 starting: 35 neighbors, 4 active search path(s)
2026-02-21T10:04:02.7322008Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 24.2 configs/s
2026-02-21T10:04:04.9118365Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 16.9 configs/s
2026-02-21T10:04:08.9211963Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 272.0         
2026-02-21T10:04:08.9213115Z                                                                   configs/s     
2026-02-21T10:04:09.2450900Z [181s] Generation 8 complete: 
2026-02-21T10:04:09.2451245Z ok=40
2026-02-21T10:04:09.2451432Z min=0.0152
2026-02-21T10:04:09.2451607Z mid=0.0157
2026-02-21T10:04:09.2451781Z max=0.1572
2026-02-21T10:04:09.2451964Z best={'block_sizes': [1],
2026-02-21T10:04:09.2452987Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:04:09.2453576Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:04:09.2454268Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:04:09.2454825Z  'load_eviction_policies': ['', 'last', '', '', '', '', 'last', 'first'],
2026-02-21T10:04:09.2455228Z  'num_stages': 7,
2026-02-21T10:04:09.2455418Z  'num_warps': 4,
2026-02-21T10:04:09.2455604Z  'pid_type': 'flat',
2026-02-21T10:04:09.2455813Z  'range_flattens': [None],
2026-02-21T10:04:09.2456038Z  'range_multi_buffers': [None],
2026-02-21T10:04:09.2456275Z  'range_num_stages': [0],
2026-02-21T10:04:09.2456493Z  'range_unroll_factors': [0],
2026-02-21T10:04:09.2457118Z  'range_warp_specializes': [],
2026-02-21T10:04:09.2457361Z  'reduction_loops': [None]}
2026-02-21T10:04:09.2479460Z [181s] Fitting surrogate: 560 points, 560 targets
2026-02-21T10:04:09.9596238Z [182s] Generation 9 starting: 40 neighbors, 4 active search path(s)
2026-02-21T10:04:12.4948226Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 23.1 configs/s
2026-02-21T10:04:15.0339617Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 42/42 16.8 configs/s
2026-02-21T10:04:19.5992979Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 223.1         
2026-02-21T10:04:19.5993524Z                                                                   configs/s     
2026-02-21T10:04:20.0121870Z [192s] Generation 9 complete: 
2026-02-21T10:04:20.0122172Z ok=44
2026-02-21T10:04:20.0122355Z min=0.0149
2026-02-21T10:04:20.0122546Z mid=0.0154
2026-02-21T10:04:20.0122713Z max=0.0216
2026-02-21T10:04:20.0122905Z best={'block_sizes': [1],
2026-02-21T10:04:20.0123352Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:04:20.0123953Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:04:20.0124672Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:04:20.0125134Z  'load_eviction_policies': ['', 'last', '', '', '', 'first', 'last', 'first'],
2026-02-21T10:04:20.0125529Z  'num_stages': 7,
2026-02-21T10:04:20.0125728Z  'num_warps': 4,
2026-02-21T10:04:20.0125927Z  'pid_type': 'flat',
2026-02-21T10:04:20.0126140Z  'range_flattens': [None],
2026-02-21T10:04:20.0126381Z  'range_multi_buffers': [None],
2026-02-21T10:04:20.0126620Z  'range_num_stages': [0],
2026-02-21T10:04:20.0126855Z  'range_unroll_factors': [0],
2026-02-21T10:04:20.0127100Z  'range_warp_specializes': [],
2026-02-21T10:04:20.0127340Z  'reduction_loops': [None]}
2026-02-21T10:04:20.0157275Z [192s] Fitting surrogate: 604 points, 604 targets
2026-02-21T10:04:20.7355681Z [193s] Generation 10 starting: 40 neighbors, 4 active search path(s)
2026-02-21T10:04:23.4481356Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 16.0 configs/s
2026-02-21T10:04:25.8395032Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 17.0 configs/s
2026-02-21T10:04:30.2968342Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 228.2         
2026-02-21T10:04:30.2968904Z                                                                   configs/s     
2026-02-21T10:04:30.7019462Z [203s] Generation 10 complete: 
2026-02-21T10:04:30.7019795Z ok=44
2026-02-21T10:04:30.7020027Z min=0.0151
2026-02-21T10:04:30.7020199Z mid=0.0153
2026-02-21T10:04:30.7020366Z max=0.0232
2026-02-21T10:04:30.7020542Z best={'block_sizes': [1],
2026-02-21T10:04:30.7020946Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:04:30.7021566Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:04:30.7022135Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:04:30.7022590Z  'load_eviction_policies': ['', '', '', 'last', '', '', 'last', ''],
2026-02-21T10:04:30.7023537Z  'num_stages': 3,
2026-02-21T10:04:30.7023732Z  'num_warps': 4,
2026-02-21T10:04:30.7023920Z  'pid_type': 'flat',
2026-02-21T10:04:30.7024517Z  'range_flattens': [None],
2026-02-21T10:04:30.7024744Z  'range_multi_buffers': [None],
2026-02-21T10:04:30.7024983Z  'range_num_stages': [0],
2026-02-21T10:04:30.7025211Z  'range_unroll_factors': [0],
2026-02-21T10:04:30.7025446Z  'range_warp_specializes': [],
2026-02-21T10:04:30.7025690Z  'reduction_loops': [None]}
2026-02-21T10:04:30.7054900Z [203s] Fitting surrogate: 648 points, 648 targets
2026-02-21T10:04:31.3797849Z [203s] Generation 11 starting: 34 neighbors, 4 active search path(s)
2026-02-21T10:04:33.3726237Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 16.4 configs/s
2026-02-21T10:04:35.4686773Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 17.1 configs/s
2026-02-21T10:04:39.5825917Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 264.7         
2026-02-21T10:04:39.5826514Z                                                                   configs/s     
2026-02-21T10:04:39.9313113Z [212s] Generation 11 complete: 
2026-02-21T10:04:39.9313416Z ok=38
2026-02-21T10:04:39.9313602Z min=0.0151
2026-02-21T10:04:39.9313779Z mid=0.0157
2026-02-21T10:04:39.9313949Z max=0.0280
2026-02-21T10:04:39.9314510Z best={'block_sizes': [1],
2026-02-21T10:04:39.9314979Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:04:39.9315642Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:04:39.9316187Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:04:39.9316638Z  'load_eviction_policies': ['', 'last', '', '', '', 'first', 'last', 'first'],
2026-02-21T10:04:39.9317016Z  'num_stages': 7,
2026-02-21T10:04:39.9317198Z  'num_warps': 4,
2026-02-21T10:04:39.9317371Z  'pid_type': 'flat',
2026-02-21T10:04:39.9317564Z  'range_flattens': [None],
2026-02-21T10:04:39.9317770Z  'range_multi_buffers': [None],
2026-02-21T10:04:39.9318008Z  'range_num_stages': [0],
2026-02-21T10:04:39.9318209Z  'range_unroll_factors': [0],
2026-02-21T10:04:39.9318431Z  'range_warp_specializes': [],
2026-02-21T10:04:39.9318650Z  'reduction_loops': [None]}
2026-02-21T10:04:39.9345983Z [212s] Fitting surrogate: 686 points, 686 targets
2026-02-21T10:04:40.6415898Z [213s] Generation 12 starting: 38 neighbors, 4 active search path(s)
2026-02-21T10:04:42.9732168Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 34.3 configs/s
2026-02-21T10:04:45.3713325Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 17.0 configs/s
2026-02-21T10:04:49.4179747Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 251.7         
2026-02-21T10:04:49.4180309Z                                                                   configs/s     
2026-02-21T10:04:49.7856213Z [222s] Generation 12 complete: 
2026-02-21T10:04:49.7856516Z ok=42
2026-02-21T10:04:49.7856723Z min=0.0152
2026-02-21T10:04:49.7857526Z mid=0.0154
2026-02-21T10:04:49.7857702Z max=0.1563
2026-02-21T10:04:49.7857885Z best={'block_sizes': [1],
2026-02-21T10:04:49.7858343Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:04:49.7858965Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:04:49.7859436Z               'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:04:49.7859823Z  'load_eviction_policies': ['', '', '', 'last', '', '', 'last', ''],
2026-02-21T10:04:49.7860181Z  'num_stages': 3,
2026-02-21T10:04:49.7860381Z  'num_warps': 4,
2026-02-21T10:04:49.7860574Z  'pid_type': 'flat',
2026-02-21T10:04:49.7860801Z  'range_flattens': [None],
2026-02-21T10:04:49.7861041Z  'range_multi_buffers': [None],
2026-02-21T10:04:49.7861613Z  'range_num_stages': [0],
2026-02-21T10:04:49.7861857Z  'range_unroll_factors': [0],
2026-02-21T10:04:49.7862106Z  'range_warp_specializes': [],
2026-02-21T10:04:49.7862352Z  'reduction_loops': [None]}
2026-02-21T10:04:49.7895565Z [222s] Fitting surrogate: 728 points, 728 targets
2026-02-21T10:04:50.5072655Z [222s] Generation 13 starting: 42 neighbors, 4 active search path(s)
2026-02-21T10:04:53.0832195Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 43.1 configs/s
2026-02-21T10:04:55.7927228Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 45/45 16.9 configs/s
2026-02-21T10:05:00.2437506Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 244.2         
2026-02-21T10:05:00.2437991Z                                                                   configs/s     
2026-02-21T10:05:00.6209837Z [232s] Generation 13 complete: 
2026-02-21T10:05:00.6210121Z ok=46
2026-02-21T10:05:00.6210390Z min=0.0150
2026-02-21T10:05:00.6210674Z mid=0.0163
2026-02-21T10:05:00.6210978Z max=0.1566
2026-02-21T10:05:00.6211271Z best={'block_sizes': [1],
2026-02-21T10:05:00.6211985Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:05:00.6213004Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:05:00.6213708Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:05:00.6214780Z  'load_eviction_policies': ['', '', '', 'last', '', '', 'last', ''],
2026-02-21T10:05:00.6215336Z  'num_stages': 3,
2026-02-21T10:05:00.6215646Z  'num_warps': 4,
2026-02-21T10:05:00.6215951Z  'pid_type': 'flat',
2026-02-21T10:05:00.6216295Z  'range_flattens': [None],
2026-02-21T10:05:00.6216670Z  'range_multi_buffers': [None],
2026-02-21T10:05:00.6217059Z  'range_num_stages': [0],
2026-02-21T10:05:00.6217428Z  'range_unroll_factors': [0],
2026-02-21T10:05:00.6217817Z  'range_warp_specializes': [],
2026-02-21T10:05:00.6218210Z  'reduction_loops': [None]}
2026-02-21T10:05:00.6248439Z [232s] Fitting surrogate: 774 points, 774 targets
2026-02-21T10:05:01.1429277Z [233s] Generation 14 starting: 26 neighbors, 3 active search path(s)
2026-02-21T10:05:02.9357280Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 29.1 configs/s
2026-02-21T10:05:04.6036493Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 28/28 17.2 configs/s
2026-02-21T10:05:07.4033181Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 363.3         
2026-02-21T10:05:07.4033712Z                                                                   configs/s     
2026-02-21T10:05:07.6639208Z [240s] Generation 14 complete: 
2026-02-21T10:05:07.6639517Z ok=29
2026-02-21T10:05:07.6639706Z min=0.0151
2026-02-21T10:05:07.6639885Z mid=0.0156
2026-02-21T10:05:07.6640066Z max=0.0299
2026-02-21T10:05:07.6640259Z best={'block_sizes': [1],
2026-02-21T10:05:07.6640710Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:05:07.6641389Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:05:07.6641885Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:05:07.6642268Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', 'last', ''],
2026-02-21T10:05:07.6643154Z  'num_stages': 3,
2026-02-21T10:05:07.6643359Z  'num_warps': 4,
2026-02-21T10:05:07.6643559Z  'pid_type': 'flat',
2026-02-21T10:05:07.6643777Z  'range_flattens': [None],
2026-02-21T10:05:07.6644401Z  'range_multi_buffers': [None],
2026-02-21T10:05:07.6644658Z  'range_num_stages': [0],
2026-02-21T10:05:07.6644885Z  'range_unroll_factors': [0],
2026-02-21T10:05:07.6645143Z  'range_warp_specializes': [],
2026-02-21T10:05:07.6645395Z  'reduction_loops': [None]}
2026-02-21T10:05:07.6680160Z [240s] Fitting surrogate: 803 points, 803 targets
2026-02-21T10:05:08.4365519Z [240s] Generation 15 starting: 42 neighbors, 3 active search path(s)
2026-02-21T10:05:11.2230748Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 25.8 configs/s
2026-02-21T10:05:13.7951920Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 42/42 16.6 configs/s
2026-02-21T10:05:18.2394787Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 245.4         
2026-02-21T10:05:18.2395320Z                                                                   configs/s     
2026-02-21T10:05:18.6176690Z [250s] Generation 15 complete: 
2026-02-21T10:05:18.6177023Z ok=45
2026-02-21T10:05:18.6177219Z min=0.0148
2026-02-21T10:05:18.6177407Z mid=0.0156
2026-02-21T10:05:18.6177573Z max=0.0357
2026-02-21T10:05:18.6177780Z best={'block_sizes': [1],
2026-02-21T10:05:18.6178219Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:05:18.6178840Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:05:18.6179323Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:05:18.6179747Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', 'last', ''],
2026-02-21T10:05:18.6180122Z  'num_stages': 3,
2026-02-21T10:05:18.6180313Z  'num_warps': 4,
2026-02-21T10:05:18.6180513Z  'pid_type': 'flat',
2026-02-21T10:05:18.6180739Z  'range_flattens': [None],
2026-02-21T10:05:18.6180995Z  'range_multi_buffers': [None],
2026-02-21T10:05:18.6181240Z  'range_num_stages': [0],
2026-02-21T10:05:18.6181486Z  'range_unroll_factors': [0],
2026-02-21T10:05:18.6181733Z  'range_warp_specializes': [],
2026-02-21T10:05:18.6181980Z  'reduction_loops': [None]}
2026-02-21T10:05:18.6216682Z [250s] Fitting surrogate: 848 points, 848 targets
2026-02-21T10:05:19.0382360Z [251s] Generation 16 starting: 19 neighbors, 2 active search path(s)
2026-02-21T10:05:20.0853811Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 39.6 configs/s
2026-02-21T10:05:21.2297470Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.3 configs/s
2026-02-21T10:05:23.3859413Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 472.2         
2026-02-21T10:05:23.3871708Z                                                                   configs/s     
2026-02-21T10:05:23.5930480Z [255s] Generation 16 complete: 
2026-02-21T10:05:23.5930779Z ok=21
2026-02-21T10:05:23.5930986Z min=0.0151
2026-02-21T10:05:23.5931179Z mid=0.0151
2026-02-21T10:05:23.5931350Z max=0.0179
2026-02-21T10:05:23.5931547Z best={'block_sizes': [1],
2026-02-21T10:05:23.5932026Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:05:23.5932628Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:05:23.5933028Z               'tensor_descriptor'],
2026-02-21T10:05:23.5933410Z  'load_eviction_policies': ['', '', 'first', 'last', 'last', 'first', 'first', ''],
2026-02-21T10:05:23.5933823Z  'num_stages': 3,
2026-02-21T10:05:23.5934423Z  'num_warps': 4,
2026-02-21T10:05:23.5934652Z  'pid_type': 'flat',
2026-02-21T10:05:23.5934866Z  'range_flattens': [None],
2026-02-21T10:05:23.5935119Z  'range_multi_buffers': [None],
2026-02-21T10:05:23.5935367Z  'range_num_stages': [0],
2026-02-21T10:05:23.5935592Z  'range_unroll_factors': [0],
2026-02-21T10:05:23.5935858Z  'range_warp_specializes': [],
2026-02-21T10:05:23.5936692Z  'reduction_loops': [None]}
2026-02-21T10:05:23.5973607Z [255s] Fitting surrogate: 869 points, 869 targets
2026-02-21T10:05:23.8625341Z [256s] Generation 17 starting: 7 neighbors, 1 active search path(s)
2026-02-21T10:05:24.2912404Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7/7 42.2 configs/s
2026-02-21T10:05:24.7146713Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 7/7 18.7 configs/s
2026-02-21T10:05:25.6319500Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 1106.6        
2026-02-21T10:05:25.6320161Z                                                                   configs/s     
2026-02-21T10:05:25.7335703Z [258s] Generation 17 complete: 
2026-02-21T10:05:25.7335973Z ok=9
2026-02-21T10:05:25.7336146Z min=0.0153
2026-02-21T10:05:25.7336872Z mid=0.0154
2026-02-21T10:05:25.7337064Z max=0.0212
2026-02-21T10:05:25.7337273Z best={'block_sizes': [1],
2026-02-21T10:05:25.7337803Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:05:25.7338521Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:05:25.7338894Z               'tensor_descriptor'],
2026-02-21T10:05:25.7339276Z  'load_eviction_policies': ['', '', 'first', 'last', 'last', 'first', 'first', ''],
2026-02-21T10:05:25.7339675Z  'num_stages': 3,
2026-02-21T10:05:25.7339862Z  'num_warps': 4,
2026-02-21T10:05:25.7340056Z  'pid_type': 'flat',
2026-02-21T10:05:25.7340259Z  'range_flattens': [None],
2026-02-21T10:05:25.7340492Z  'range_multi_buffers': [None],
2026-02-21T10:05:25.7340727Z  'range_num_stages': [0],
2026-02-21T10:05:25.7340950Z  'range_unroll_factors': [0],
2026-02-21T10:05:25.7341184Z  'range_warp_specializes': [],
2026-02-21T10:05:25.7341423Z  'reduction_loops': [None]}
2026-02-21T10:05:25.7377004Z [258s] Fitting surrogate: 878 points, 878 targets
2026-02-21T10:05:25.8989669Z [258s] Autotuning complete in 258.3s after searching 830 configs.
2026-02-21T10:05:25.8990178Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:05:25.8992302Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', '', 'first', 'last', 'last', 'first', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:05:25.8994687Z 
2026-02-21T10:05:25.8995133Z [258s] Code of selected kernel: /tmp/torchinductor_root/zm/czmdwm6fyujotp6bz7x66msqtzddquzsyoujo4tpfzi4rx2mgsv2.py
2026-02-21T10:05:25.9242180Z from __future__ import annotations
2026-02-21T10:05:25.9242388Z 
2026-02-21T10:05:25.9242470Z import torch
2026-02-21T10:05:25.9242671Z import triton
2026-02-21T10:05:25.9242894Z import triton.language as tl
2026-02-21T10:05:25.9243251Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:05:25.9243711Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:05:25.9244182Z 
2026-02-21T10:05:25.9244262Z @triton.jit
2026-02-21T10:05:25.9244658Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:05:25.9245174Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:05:25.9245494Z     pid_0 = tl.program_id(0)
2026-02-21T10:05:25.9245732Z     offset_0 = pid_0
2026-02-21T10:05:25.9246019Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T10:05:25.9246388Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:05:25.9246791Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:05:25.9247255Z     acc = tl.load(x + (indices_0[:, None] * 1024 + indices_1[None, :] * 1), None)
2026-02-21T10:05:25.9247745Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:05:25.9248521Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:05:25.9248781Z     v_0 = 0.0009765625
2026-02-21T10:05:25.9248964Z     v_1 = sum_1 * v_0
2026-02-21T10:05:25.9249232Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:05:25.9249539Z     subscript = v_1[:, None]
2026-02-21T10:05:25.9249892Z     v_2 = acc - subscript
2026-02-21T10:05:25.9250205Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:05:25.9250564Z     v_3 = v_2 * v_2
2026-02-21T10:05:25.9250781Z     sum_2 = tl.cast(tl.sum(v_3, 1), tl.float32)
2026-02-21T10:05:25.9251039Z     v_4 = 0.0009765625
2026-02-21T10:05:25.9251240Z     v_5 = sum_2 * v_4
2026-02-21T10:05:25.9251760Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:05:25.9252102Z     v_6 = v_5 + eps
2026-02-21T10:05:25.9252290Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:05:25.9252612Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:05:25.9252953Z     subscript_1 = v_7[:, None]
2026-02-21T10:05:25.9253165Z     v_8 = v_2 * subscript_1
2026-02-21T10:05:25.9253484Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:05:25.9253871Z     load_1 = tl.load(weight + indices_1 * 1, None)
2026-02-21T10:05:25.9254297Z     v_9 = load_1[None, :]
2026-02-21T10:05:25.9254496Z     v_10 = v_8 * v_9
2026-02-21T10:05:25.9254733Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:05:25.9255120Z     load_2 = tl.load(bias + indices_1 * 1, None, eviction_policy='evict_first')
2026-02-21T10:05:25.9255599Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:05:25.9256018Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:05:25.9256310Z     # src[layer_norm.py:75]: )
2026-02-21T10:05:25.9256530Z     v_11 = load_2[None, :]
2026-02-21T10:05:25.9256722Z     v_12 = v_10 + v_11
2026-02-21T10:05:25.9256974Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:05:25.9257372Z     tl.store(out + (indices_0[:, None] * 1024 + indices_1[None, :] * 1), v_12, None)
2026-02-21T10:05:25.9257773Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:05:25.9258066Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:05:25.9258344Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:05:25.9258631Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:05:25.9258805Z 
2026-02-21T10:05:25.9259253Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:05:25.9259851Z     """
2026-02-21T10:05:25.9260092Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:05:25.9260399Z     Args:
2026-02-21T10:05:25.9260676Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:05:25.9261199Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:05:25.9261699Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:05:25.9262107Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:05:25.9262611Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:05:25.9262984Z     Returns:
2026-02-21T10:05:25.9263188Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:05:25.9263565Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:05:25.9263931Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:05:25.9264437Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:05:25.9264752Z     """
2026-02-21T10:05:25.9264916Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:05:25.9265318Z     m, n = x.size()
2026-02-21T10:05:25.9265647Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:05:25.9266118Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:05:25.9266456Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:05:25.9266839Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:05:25.9267196Z     if bias is not None:
2026-02-21T10:05:25.9267528Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:05:25.9267975Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:05:25.9268489Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:05:25.9268900Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:05:25.9269257Z     # src[layer_norm.py:52]: )
2026-02-21T10:05:25.9269617Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:05:25.9270039Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:05:25.9270415Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:05:25.9270761Z     # src[layer_norm.py:55]: )
2026-02-21T10:05:25.9271081Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:05:25.9271541Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:05:25.9271913Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:05:25.9272293Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:05:25.9272684Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:05:25.9273089Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:05:25.9273479Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:05:25.9273780Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:05:25.9274156Z     _RDIM_SIZE_1 = 1024
2026-02-21T10:05:25.9274369Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:05:25.9274676Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:05:25.9274971Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:05:25.9275219Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:05:25.9275664Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=4, num_stages=3)
2026-02-21T10:05:25.9276136Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:05:25.9276387Z     return (out, mean, rstd)
2026-02-21T10:05:26.8293867Z WARNING:tritonbench.utils.triton_op:Completed input ID 0:
2026-02-21T10:05:26.8294611Z (M, N)
2026-02-21T10:05:26.8294796Z ------------
2026-02-21T10:05:26.8294988Z (4096, 1024)
2026-02-21T10:05:26.8295122Z 
2026-02-21T10:05:26.8314197Z   5%|▌         | 1/20 [04:23<1:23:27, 263.57s/it]WARNING:tritonbench.utils.triton_op:Running input ID 2:
2026-02-21T10:05:26.8314618Z (M, N)
2026-02-21T10:05:26.8314773Z ------------
2026-02-21T10:05:26.8316774Z (4096, 2048)
2026-02-21T10:05:26.8317273Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T10:05:28.5152316Z INFO:tritonbench.utils.triton_op:Took 3.10ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:05:29.6496882Z INFO:tritonbench.utils.triton_op:Took 0.03ms to get benchmark function for liger_layer_norm
2026-02-21T10:05:31.0889442Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:05:31.0890116Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:05:31.0890548Z               'dtype': 'torch.float32',
2026-02-21T10:05:31.0890980Z               'shape': (4096, 2048),
2026-02-21T10:05:31.0892059Z               'stride': (2048, 1)},
2026-02-21T10:05:31.0892451Z             (2048,),
2026-02-21T10:05:31.0892660Z             { 'device': 'cuda:0',
2026-02-21T10:05:31.0892905Z               'dtype': 'torch.float32',
2026-02-21T10:05:31.0893167Z               'shape': (2048,),
2026-02-21T10:05:31.0893398Z               'stride': (1,)},
2026-02-21T10:05:31.0893632Z             { 'device': 'cuda:0',
2026-02-21T10:05:31.0893873Z               'dtype': 'torch.float32',
2026-02-21T10:05:31.0894480Z               'shape': (2048,),
2026-02-21T10:05:31.0894731Z               'stride': (1,)},
2026-02-21T10:05:31.0894957Z             1e-05),
2026-02-21T10:05:31.0895151Z   'kwargs': {}}
2026-02-21T10:05:31.0915058Z INFO:tritonbench.utils.triton_op:Took 2.95ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:05:31.0991655Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:05:31.0992732Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:05:31.0993362Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:05:31.0993721Z While processing:
2026-02-21T10:05:31.0994335Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:05:31.0994772Z     if bias is not None:
2026-02-21T10:05:31.0994992Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:05:31.0995135Z 
2026-02-21T10:05:31.2600500Z [0s] Autotune random seed: 2141537047
2026-02-21T10:05:31.2914658Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:06:05.0119372Z [33s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[None])
2026-02-21T10:06:05.2687986Z [33s] Timeout after 30s compiling Config(block_sizes=[128], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', '', 'last', 'last', 'last', 'first', 'first'], maxnreg=256, num_sm_multiplier=4, num_stages=8, num_warps=1, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[128])
2026-02-21T10:06:05.5379713Z [34s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last', 'first', '', '', '', 'first', ''], maxnreg=64, num_sm_multiplier=4, num_stages=4, num_warps=1, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[0], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[32])
2026-02-21T10:06:05.8077322Z [34s] Timeout after 30s compiling Config(block_sizes=[32], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'first', 'first', 'last', 'last', 'last', 'first', ''], maxnreg=256, num_sm_multiplier=4, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[True], range_num_stages=[0], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:06:07.2185112Z [35s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:06:07.2205144Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T10:06:12.8436252Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.9 configs/s
2026-02-21T10:06:12.8452498Z [41s] Adaptive compile timeout: 30s (90% percentile=5.4s, bounds=[30.0s, 30s])
2026-02-21T10:06:15.3946690Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 458.1 configs/s
2026-02-21T10:06:15.5817618Z [44s] Initial random population of 100, 5 starting points: 
2026-02-21T10:06:15.5818018Z error=5
2026-02-21T10:06:15.5818199Z timeout=5
2026-02-21T10:06:15.5818369Z ok=90
2026-02-21T10:06:15.5818537Z min=0.0268
2026-02-21T10:06:15.5818706Z mid=0.1307
2026-02-21T10:06:15.5818872Z max=6.2996
2026-02-21T10:06:15.5819058Z best={'block_sizes': [1],
2026-02-21T10:06:15.5819473Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:06:15.5820008Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:06:15.5820460Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:06:15.5820774Z  'num_stages': 1,
2026-02-21T10:06:15.5820974Z  'num_warps': 4,
2026-02-21T10:06:15.5821173Z  'pid_type': 'flat',
2026-02-21T10:06:15.5821401Z  'range_flattens': [None],
2026-02-21T10:06:15.5821638Z  'range_multi_buffers': [None],
2026-02-21T10:06:15.5821879Z  'range_num_stages': [0],
2026-02-21T10:06:15.5822117Z  'range_unroll_factors': [0],
2026-02-21T10:06:15.5822408Z  'range_warp_specializes': [],
2026-02-21T10:06:15.5822707Z  'reduction_loops': [None]}
2026-02-21T10:06:15.5838972Z [44s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:06:16.6202551Z [45s] Generation 1 starting: 67 neighbors, 5 active search path(s)
2026-02-21T10:06:21.2702168Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 32.1 configs/s
2026-02-21T10:06:25.6741899Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 16.5 configs/s
2026-02-21T10:06:34.0498591Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.9         
2026-02-21T10:06:34.0499108Z                                                                   configs/s     
2026-02-21T10:06:34.7464137Z [63s] Generation 1 complete: 
2026-02-21T10:06:34.7465087Z ok=73
2026-02-21T10:06:34.7465270Z min=0.0261
2026-02-21T10:06:34.7465457Z mid=0.0303
2026-02-21T10:06:34.7465628Z max=0.0549
2026-02-21T10:06:34.7465828Z best={'block_sizes': [1],
2026-02-21T10:06:34.7466258Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:06:34.7466788Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:06:34.7467194Z  'load_eviction_policies': ['', '', '', '', '', '', 'last', ''],
2026-02-21T10:06:34.7467530Z  'num_stages': 1,
2026-02-21T10:06:34.7467718Z  'num_warps': 8,
2026-02-21T10:06:34.7467908Z  'pid_type': 'flat',
2026-02-21T10:06:34.7468115Z  'range_flattens': [None],
2026-02-21T10:06:34.7468337Z  'range_multi_buffers': [None],
2026-02-21T10:06:34.7468581Z  'range_num_stages': [0],
2026-02-21T10:06:34.7469117Z  'range_unroll_factors': [0],
2026-02-21T10:06:34.7469369Z  'range_warp_specializes': [],
2026-02-21T10:06:34.7469617Z  'reduction_loops': [None]}
2026-02-21T10:06:34.7486165Z [63s] Fitting surrogate: 173 points, 173 targets
2026-02-21T10:06:35.7956504Z [64s] Generation 2 starting: 66 neighbors, 5 active search path(s)
2026-02-21T10:06:40.0386927Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69/69 29.4 configs/s
2026-02-21T10:06:44.2066730Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 69/69 16.7 configs/s
2026-02-21T10:06:51.4505649Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 146.3         
2026-02-21T10:06:51.4506146Z                                                                   configs/s     
2026-02-21T10:06:51.9929389Z [80s] Generation 2 complete: 
2026-02-21T10:06:51.9929934Z ok=72
2026-02-21T10:06:51.9930219Z min=0.0294
2026-02-21T10:06:51.9930505Z mid=0.0310
2026-02-21T10:06:51.9930769Z max=0.5922
2026-02-21T10:06:51.9931105Z best={'block_sizes': [2],
2026-02-21T10:06:51.9931808Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:06:51.9932795Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:06:51.9933676Z  'load_eviction_policies': ['', 'first', '', 'last', 'first', 'last', '', ''],
2026-02-21T10:06:51.9934749Z  'num_sm_multiplier': 16,
2026-02-21T10:06:51.9935115Z  'num_stages': 8,
2026-02-21T10:06:51.9935416Z  'num_warps': 4,
2026-02-21T10:06:51.9935766Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:06:51.9936211Z  'range_flattens': [False],
2026-02-21T10:06:51.9936585Z  'range_multi_buffers': [None],
2026-02-21T10:06:51.9936971Z  'range_num_stages': [2],
2026-02-21T10:06:51.9937326Z  'range_unroll_factors': [1],
2026-02-21T10:06:51.9937760Z  'range_warp_specializes': [],
2026-02-21T10:06:51.9938234Z  'reduction_loops': [None]}
2026-02-21T10:06:51.9953453Z [80s] Fitting surrogate: 245 points, 245 targets
2026-02-21T10:06:52.9222137Z [81s] Generation 3 starting: 56 neighbors, 5 active search path(s)
2026-02-21T10:06:56.7964865Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 22.0 configs/s
2026-02-21T10:07:00.5024854Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.7 configs/s
2026-02-21T10:07:06.3793218Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 172.6         
2026-02-21T10:07:06.3793711Z                                                                   configs/s     
2026-02-21T10:07:06.8511657Z [95s] Generation 3 complete: 
2026-02-21T10:07:06.8511929Z ok=62
2026-02-21T10:07:06.8512114Z min=0.0259
2026-02-21T10:07:06.8512297Z mid=0.0295
2026-02-21T10:07:06.8512469Z max=0.1592
2026-02-21T10:07:06.8512659Z best={'block_sizes': [4],
2026-02-21T10:07:06.8513112Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:07:06.8513842Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:07:06.8515813Z               'pointer'],
2026-02-21T10:07:06.8516189Z  'load_eviction_policies': ['first', '', '', '', 'last', 'first', 'first', 'last'],
2026-02-21T10:07:06.8517028Z  'num_stages': 8,
2026-02-21T10:07:06.8517232Z  'num_warps': 4,
2026-02-21T10:07:06.8517428Z  'pid_type': 'flat',
2026-02-21T10:07:06.8517653Z  'range_flattens': [None],
2026-02-21T10:07:06.8517895Z  'range_multi_buffers': [None],
2026-02-21T10:07:06.8518182Z  'range_num_stages': [0],
2026-02-21T10:07:06.8518443Z  'range_unroll_factors': [0],
2026-02-21T10:07:06.8518723Z  'range_warp_specializes': [],
2026-02-21T10:07:06.8518948Z  'reduction_loops': [None]}
2026-02-21T10:07:06.8543129Z [95s] Fitting surrogate: 307 points, 307 targets
2026-02-21T10:07:07.8066882Z [96s] Generation 4 starting: 58 neighbors, 5 active search path(s)
2026-02-21T10:07:11.8158201Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 12.4 configs/s
2026-02-21T10:07:15.4944298Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.8 configs/s
2026-02-21T10:07:22.4658873Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 153.3         
2026-02-21T10:07:22.4659511Z                                                                   configs/s     
2026-02-21T10:07:23.0054560Z [111s] Generation 4 complete: 
2026-02-21T10:07:23.0054897Z ok=63
2026-02-21T10:07:23.0055078Z min=0.0259
2026-02-21T10:07:23.0055257Z mid=0.0272
2026-02-21T10:07:23.0055424Z max=0.1964
2026-02-21T10:07:23.0055613Z best={'block_sizes': [4],
2026-02-21T10:07:23.0056066Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:07:23.0056724Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:07:23.0057172Z               'pointer'],
2026-02-21T10:07:23.0057543Z  'load_eviction_policies': ['first', '', '', '', 'last', 'first', 'first', 'last'],
2026-02-21T10:07:23.0058003Z  'num_stages': 8,
2026-02-21T10:07:23.0058201Z  'num_warps': 4,
2026-02-21T10:07:23.0058404Z  'pid_type': 'flat',
2026-02-21T10:07:23.0058615Z  'range_flattens': [None],
2026-02-21T10:07:23.0058854Z  'range_multi_buffers': [None],
2026-02-21T10:07:23.0059112Z  'range_num_stages': [0],
2026-02-21T10:07:23.0059367Z  'range_unroll_factors': [0],
2026-02-21T10:07:23.0059637Z  'range_warp_specializes': [],
2026-02-21T10:07:23.0059933Z  'reduction_loops': [None]}
2026-02-21T10:07:23.0081061Z [111s] Fitting surrogate: 370 points, 370 targets
2026-02-21T10:07:23.9966176Z [112s] Generation 5 starting: 59 neighbors, 5 active search path(s)
2026-02-21T10:07:28.7654873Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 2.6 configs/s
2026-02-21T10:07:32.3941396Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.7 configs/s
2026-02-21T10:07:39.7123751Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 145.3         
2026-02-21T10:07:39.7124668Z                                                                   configs/s     
2026-02-21T10:07:40.2698720Z [128s] Generation 5 complete: 
2026-02-21T10:07:40.2698991Z ok=64
2026-02-21T10:07:40.2699165Z min=0.0287
2026-02-21T10:07:40.2699401Z mid=0.0301
2026-02-21T10:07:40.2699569Z max=0.1643
2026-02-21T10:07:40.2699755Z best={'block_sizes': [4],
2026-02-21T10:07:40.2700167Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:07:40.2700717Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:07:40.2701181Z  'load_eviction_policies': ['', '', '', '', '', '', 'last', ''],
2026-02-21T10:07:40.2701512Z  'num_stages': 2,
2026-02-21T10:07:40.2701748Z  'num_warps': 4,
2026-02-21T10:07:40.2701985Z  'pid_type': 'flat',
2026-02-21T10:07:40.2702231Z  'range_flattens': [None],
2026-02-21T10:07:40.2702456Z  'range_multi_buffers': [None],
2026-02-21T10:07:40.2702697Z  'range_num_stages': [0],
2026-02-21T10:07:40.2702923Z  'range_unroll_factors': [0],
2026-02-21T10:07:40.2703172Z  'range_warp_specializes': [],
2026-02-21T10:07:40.2703421Z  'reduction_loops': [None]}
2026-02-21T10:07:40.2727885Z [128s] Fitting surrogate: 434 points, 434 targets
2026-02-21T10:07:41.2026906Z [129s] Generation 6 starting: 56 neighbors, 4 active search path(s)
2026-02-21T10:07:45.0318138Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 30.8 configs/s
2026-02-21T10:07:48.6518857Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.8 configs/s
2026-02-21T10:07:55.7230085Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.3         
2026-02-21T10:07:55.7230592Z                                                                   configs/s     
2026-02-21T10:07:56.2679336Z [144s] Generation 6 complete: 
2026-02-21T10:07:56.2679616Z ok=61
2026-02-21T10:07:56.2679819Z min=0.0257
2026-02-21T10:07:56.2679999Z mid=0.0271
2026-02-21T10:07:56.2680172Z max=0.1646
2026-02-21T10:07:56.2680362Z best={'block_sizes': [4],
2026-02-21T10:07:56.2681284Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:07:56.2681864Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:07:56.2682377Z  'load_eviction_policies': ['', '', '', '', '', '', 'last', ''],
2026-02-21T10:07:56.2682733Z  'num_stages': 2,
2026-02-21T10:07:56.2682968Z  'num_warps': 4,
2026-02-21T10:07:56.2683212Z  'pid_type': 'flat',
2026-02-21T10:07:56.2683416Z  'range_flattens': [None],
2026-02-21T10:07:56.2683642Z  'range_multi_buffers': [None],
2026-02-21T10:07:56.2683875Z  'range_num_stages': [0],
2026-02-21T10:07:56.2684387Z  'range_unroll_factors': [0],
2026-02-21T10:07:56.2684622Z  'range_warp_specializes': [],
2026-02-21T10:07:56.2684871Z  'reduction_loops': [None]}
2026-02-21T10:07:56.2712124Z [144s] Fitting surrogate: 495 points, 495 targets
2026-02-21T10:07:57.1431433Z [145s] Generation 7 starting: 51 neighbors, 4 active search path(s)
2026-02-21T10:08:00.7670735Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 17.5 configs/s
2026-02-21T10:08:03.9016170Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 16.8 configs/s
2026-02-21T10:08:10.4146642Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 155.9         
2026-02-21T10:08:10.4147172Z                                                                   configs/s     
2026-02-21T10:08:10.9574696Z [159s] Generation 7 complete: 
2026-02-21T10:08:10.9575022Z ok=56
2026-02-21T10:08:10.9575209Z min=0.0286
2026-02-21T10:08:10.9575384Z mid=0.0298
2026-02-21T10:08:10.9575558Z max=0.0766
2026-02-21T10:08:10.9575740Z best={'block_sizes': [4],
2026-02-21T10:08:10.9576156Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:08:10.9576765Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:08:10.9577278Z  'load_eviction_policies': ['', '', '', '', '', '', 'last', ''],
2026-02-21T10:08:10.9577624Z  'num_stages': 2,
2026-02-21T10:08:10.9577872Z  'num_warps': 4,
2026-02-21T10:08:10.9578076Z  'pid_type': 'flat',
2026-02-21T10:08:10.9578284Z  'range_flattens': [None],
2026-02-21T10:08:10.9578527Z  'range_multi_buffers': [None],
2026-02-21T10:08:10.9578787Z  'range_num_stages': [0],
2026-02-21T10:08:10.9579022Z  'range_unroll_factors': [0],
2026-02-21T10:08:10.9579263Z  'range_warp_specializes': [],
2026-02-21T10:08:10.9579510Z  'reduction_loops': [None]}
2026-02-21T10:08:10.9614994Z [159s] Fitting surrogate: 551 points, 551 targets
2026-02-21T10:08:11.8249828Z [160s] Generation 8 starting: 50 neighbors, 4 active search path(s)
2026-02-21T10:08:15.2296968Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 40.3 configs/s
2026-02-21T10:08:18.4323611Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 16.8 configs/s
2026-02-21T10:08:24.5148845Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 178.2         
2026-02-21T10:08:24.5149404Z                                                                   configs/s     
2026-02-21T10:08:24.9796439Z [173s] Generation 8 complete: 
2026-02-21T10:08:24.9796772Z ok=54
2026-02-21T10:08:24.9796967Z min=0.0257
2026-02-21T10:08:24.9797914Z mid=0.0272
2026-02-21T10:08:24.9798089Z max=0.0489
2026-02-21T10:08:24.9798270Z best={'block_sizes': [4],
2026-02-21T10:08:24.9798690Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:08:24.9799298Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:08:24.9799828Z  'load_eviction_policies': ['', '', '', '', 'last', '', 'last', ''],
2026-02-21T10:08:24.9800200Z  'num_stages': 2,
2026-02-21T10:08:24.9800407Z  'num_warps': 4,
2026-02-21T10:08:24.9800610Z  'pid_type': 'flat',
2026-02-21T10:08:24.9800845Z  'range_flattens': [None],
2026-02-21T10:08:24.9801089Z  'range_multi_buffers': [None],
2026-02-21T10:08:24.9801334Z  'range_num_stages': [0],
2026-02-21T10:08:24.9801572Z  'range_unroll_factors': [0],
2026-02-21T10:08:24.9802151Z  'range_warp_specializes': [],
2026-02-21T10:08:24.9802412Z  'reduction_loops': [None]}
2026-02-21T10:08:24.9831229Z [173s] Fitting surrogate: 605 points, 605 targets
2026-02-21T10:08:25.8472462Z [174s] Generation 9 starting: 48 neighbors, 4 active search path(s)
2026-02-21T10:08:29.0356548Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 26.9 configs/s
2026-02-21T10:08:31.9786585Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.9 configs/s
2026-02-21T10:08:37.5403409Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 182.6         
2026-02-21T10:08:37.5403931Z                                                                   configs/s     
2026-02-21T10:08:37.9857527Z [186s] Generation 9 complete: 
2026-02-21T10:08:37.9857761Z ok=52
2026-02-21T10:08:37.9857939Z min=0.0286
2026-02-21T10:08:37.9858088Z mid=0.0299
2026-02-21T10:08:37.9858236Z max=0.1524
2026-02-21T10:08:37.9858400Z best={'block_sizes': [4],
2026-02-21T10:08:37.9858775Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:08:37.9859283Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:08:37.9859755Z  'load_eviction_policies': ['', '', '', '', 'first', '', 'last', ''],
2026-02-21T10:08:37.9860066Z  'num_stages': 2,
2026-02-21T10:08:37.9860229Z  'num_warps': 4,
2026-02-21T10:08:37.9860408Z  'pid_type': 'flat',
2026-02-21T10:08:37.9860584Z  'range_flattens': [None],
2026-02-21T10:08:37.9860785Z  'range_multi_buffers': [None],
2026-02-21T10:08:37.9860992Z  'range_num_stages': [0],
2026-02-21T10:08:37.9861180Z  'range_unroll_factors': [0],
2026-02-21T10:08:37.9861403Z  'range_warp_specializes': [],
2026-02-21T10:08:37.9861610Z  'reduction_loops': [None]}
2026-02-21T10:08:37.9899282Z [186s] Fitting surrogate: 657 points, 657 targets
2026-02-21T10:08:38.9052838Z [187s] Generation 10 starting: 53 neighbors, 4 active search path(s)
2026-02-21T10:08:43.5680392Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 11.2 configs/s
2026-02-21T10:08:47.0057759Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 57/57 16.8 configs/s
2026-02-21T10:08:53.0881875Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 167.0         
2026-02-21T10:08:53.0882442Z                                                                   configs/s     
2026-02-21T10:08:53.5876653Z [202s] Generation 10 complete: 
2026-02-21T10:08:53.5876961Z ok=58
2026-02-21T10:08:53.5877151Z min=0.0258
2026-02-21T10:08:53.5877336Z mid=0.0279
2026-02-21T10:08:53.5877515Z max=0.1967
2026-02-21T10:08:53.5877712Z best={'block_sizes': [4],
2026-02-21T10:08:53.5878153Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:08:53.5878782Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:08:53.5879350Z  'load_eviction_policies': ['', '', '', '', 'first', '', 'last', ''],
2026-02-21T10:08:53.5880317Z  'num_stages': 2,
2026-02-21T10:08:53.5880548Z  'num_warps': 4,
2026-02-21T10:08:53.5880762Z  'pid_type': 'flat',
2026-02-21T10:08:53.5881004Z  'range_flattens': [None],
2026-02-21T10:08:53.5881283Z  'range_multi_buffers': [None],
2026-02-21T10:08:53.5881556Z  'range_num_stages': [0],
2026-02-21T10:08:53.5881804Z  'range_unroll_factors': [0],
2026-02-21T10:08:53.5882070Z  'range_warp_specializes': [],
2026-02-21T10:08:53.5882326Z  'reduction_loops': [None]}
2026-02-21T10:08:53.5922646Z [202s] Fitting surrogate: 715 points, 715 targets
2026-02-21T10:08:54.4652686Z [203s] Generation 11 starting: 51 neighbors, 4 active search path(s)
2026-02-21T10:08:57.8955743Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 20.4 configs/s
2026-02-21T10:09:00.9716151Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 51/51 16.8 configs/s
2026-02-21T10:09:07.7384441Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 158.5         
2026-02-21T10:09:07.7384987Z                                                                   configs/s     
2026-02-21T10:09:08.2627495Z [216s] Generation 11 complete: 
2026-02-21T10:09:08.2627785Z ok=56
2026-02-21T10:09:08.2627956Z min=0.0288
2026-02-21T10:09:08.2628169Z mid=0.0301
2026-02-21T10:09:08.2628330Z max=0.1513
2026-02-21T10:09:08.2628510Z best={'block_sizes': [4],
2026-02-21T10:09:08.2628949Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:09:08.2629530Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:09:08.2629913Z               'tensor_descriptor'],
2026-02-21T10:09:08.2630310Z  'load_eviction_policies': ['first', '', '', 'first', 'first', 'last', 'first', 'first'],
2026-02-21T10:09:08.2630723Z  'num_stages': 8,
2026-02-21T10:09:08.2630907Z  'num_warps': 4,
2026-02-21T10:09:08.2631098Z  'pid_type': 'flat',
2026-02-21T10:09:08.2631302Z  'range_flattens': [None],
2026-02-21T10:09:08.2631531Z  'range_multi_buffers': [None],
2026-02-21T10:09:08.2631777Z  'range_num_stages': [0],
2026-02-21T10:09:08.2632003Z  'range_unroll_factors': [0],
2026-02-21T10:09:08.2632240Z  'range_warp_specializes': [],
2026-02-21T10:09:08.2632479Z  'reduction_loops': [None]}
2026-02-21T10:09:08.2673793Z [216s] Fitting surrogate: 771 points, 771 targets
2026-02-21T10:09:09.1357333Z [217s] Generation 12 starting: 50 neighbors, 4 active search path(s)
2026-02-21T10:09:14.3858589Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 4.5 configs/s
2026-02-21T10:09:17.6461475Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 54/54 16.8 configs/s
2026-02-21T10:09:22.8683835Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 194.3         
2026-02-21T10:09:22.8684734Z                                                                   configs/s     
2026-02-21T10:09:23.2985306Z [232s] Generation 12 complete: 
2026-02-21T10:09:23.2985615Z ok=55
2026-02-21T10:09:23.2985801Z min=0.0259
2026-02-21T10:09:23.2985984Z mid=0.0269
2026-02-21T10:09:23.2986194Z max=0.2337
2026-02-21T10:09:23.2986397Z best={'block_sizes': [4],
2026-02-21T10:09:23.2986858Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:09:23.2988267Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:09:23.2988854Z  'load_eviction_policies': ['first', '', '', 'first', 'first', 'last', 'last', 'first'],
2026-02-21T10:09:23.2989282Z  'num_stages': 8,
2026-02-21T10:09:23.2989492Z  'num_warps': 4,
2026-02-21T10:09:23.2989688Z  'pid_type': 'flat',
2026-02-21T10:09:23.2989906Z  'range_flattens': [None],
2026-02-21T10:09:23.2990138Z  'range_multi_buffers': [None],
2026-02-21T10:09:23.2990401Z  'range_num_stages': [0],
2026-02-21T10:09:23.2990633Z  'range_unroll_factors': [0],
2026-02-21T10:09:23.2990880Z  'range_warp_specializes': [],
2026-02-21T10:09:23.2991130Z  'reduction_loops': [None]}
2026-02-21T10:09:23.3033467Z [232s] Fitting surrogate: 826 points, 826 targets
2026-02-21T10:09:24.1485990Z [232s] Generation 13 starting: 47 neighbors, 4 active search path(s)
2026-02-21T10:09:27.6877448Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 24.0 configs/s
2026-02-21T10:09:30.5141857Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 47/47 16.9 configs/s
2026-02-21T10:09:36.2085903Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 178.4         
2026-02-21T10:09:36.2086387Z                                                                   configs/s     
2026-02-21T10:09:36.6758666Z [245s] Generation 13 complete: 
2026-02-21T10:09:36.6759066Z ok=51
2026-02-21T10:09:36.6759324Z min=0.0260
2026-02-21T10:09:36.6759604Z mid=0.0272
2026-02-21T10:09:36.6759849Z max=0.1515
2026-02-21T10:09:36.6760127Z best={'block_sizes': [4],
2026-02-21T10:09:36.6760782Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:09:36.6761754Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:09:36.6762594Z  'load_eviction_policies': ['first', '', '', 'first', 'first', 'last', 'last', 'first'],
2026-02-21T10:09:36.6763315Z  'num_stages': 8,
2026-02-21T10:09:36.6763579Z  'num_warps': 4,
2026-02-21T10:09:36.6763754Z  'pid_type': 'flat',
2026-02-21T10:09:36.6763947Z  'range_flattens': [None],
2026-02-21T10:09:36.6764302Z  'range_multi_buffers': [None],
2026-02-21T10:09:36.6764527Z  'range_num_stages': [0],
2026-02-21T10:09:36.6764732Z  'range_unroll_factors': [0],
2026-02-21T10:09:36.6764964Z  'range_warp_specializes': [],
2026-02-21T10:09:36.6765185Z  'reduction_loops': [None]}
2026-02-21T10:09:36.6809703Z [245s] Fitting surrogate: 877 points, 877 targets
2026-02-21T10:09:37.4822251Z [246s] Generation 14 starting: 46 neighbors, 4 active search path(s)
2026-02-21T10:09:40.7791913Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 18.4 configs/s
2026-02-21T10:09:43.6635105Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 48/48 16.9 configs/s
2026-02-21T10:09:49.3676086Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 190.4         
2026-02-21T10:09:49.3676631Z                                                                   configs/s     
2026-02-21T10:09:49.8063316Z [258s] Generation 14 complete: 
2026-02-21T10:09:49.8063605Z ok=50
2026-02-21T10:09:49.8063785Z min=0.0259
2026-02-21T10:09:49.8063955Z mid=0.0272
2026-02-21T10:09:49.8064381Z max=0.1578
2026-02-21T10:09:49.8064555Z best={'block_sizes': [4],
2026-02-21T10:09:49.8064950Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:09:49.8065515Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:09:49.8066049Z  'load_eviction_policies': ['', '', 'first', '', 'first', 'last', 'last', ''],
2026-02-21T10:09:49.8066427Z  'num_stages': 2,
2026-02-21T10:09:49.8066609Z  'num_warps': 4,
2026-02-21T10:09:49.8066801Z  'pid_type': 'flat',
2026-02-21T10:09:49.8067024Z  'range_flattens': [None],
2026-02-21T10:09:49.8067257Z  'range_multi_buffers': [None],
2026-02-21T10:09:49.8067487Z  'range_num_stages': [0],
2026-02-21T10:09:49.8067713Z  'range_unroll_factors': [0],
2026-02-21T10:09:49.8068269Z  'range_warp_specializes': [],
2026-02-21T10:09:49.8068510Z  'reduction_loops': [None]}
2026-02-21T10:09:49.8113914Z [258s] Fitting surrogate: 927 points, 927 targets
2026-02-21T10:09:50.5171912Z [259s] Generation 15 starting: 38 neighbors, 3 active search path(s)
2026-02-21T10:09:53.2825602Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 17.1 configs/s
2026-02-21T10:09:55.5893696Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 38/38 16.8 configs/s
2026-02-21T10:10:00.1880841Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 221.0         
2026-02-21T10:10:00.1881383Z                                                                   configs/s     
2026-02-21T10:10:00.5614288Z [269s] Generation 15 complete: 
2026-02-21T10:10:00.5615538Z ok=41
2026-02-21T10:10:00.5615836Z min=0.0286
2026-02-21T10:10:00.5616104Z mid=0.0299
2026-02-21T10:10:00.5616377Z max=0.0619
2026-02-21T10:10:00.5616649Z best={'block_sizes': [4],
2026-02-21T10:10:00.5617348Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:10:00.5618305Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:10:00.5619104Z  'load_eviction_policies': ['', '', 'first', '', 'first', 'last', 'last', ''],
2026-02-21T10:10:00.5619802Z  'num_stages': 2,
2026-02-21T10:10:00.5620128Z  'num_warps': 4,
2026-02-21T10:10:00.5620349Z  'pid_type': 'flat',
2026-02-21T10:10:00.5620556Z  'range_flattens': [None],
2026-02-21T10:10:00.5620787Z  'range_multi_buffers': [None],
2026-02-21T10:10:00.5621021Z  'range_num_stages': [0],
2026-02-21T10:10:00.5621249Z  'range_unroll_factors': [0],
2026-02-21T10:10:00.5621485Z  'range_warp_specializes': [],
2026-02-21T10:10:00.5621729Z  'reduction_loops': [None]}
2026-02-21T10:10:00.5672189Z [269s] Fitting surrogate: 968 points, 968 targets
2026-02-21T10:10:01.2634685Z [269s] Generation 16 starting: 37 neighbors, 3 active search path(s)
2026-02-21T10:10:06.8904369Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 2.7 configs/s
2026-02-21T10:10:09.3224966Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 16.7 configs/s
2026-02-21T10:10:13.4379958Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 273.0         
2026-02-21T10:10:13.4380461Z                                                                   configs/s     
2026-02-21T10:10:13.7473843Z [282s] Generation 16 complete: 
2026-02-21T10:10:13.7474243Z ok=41
2026-02-21T10:10:13.7474406Z min=0.0259
2026-02-21T10:10:13.7474575Z mid=0.0276
2026-02-21T10:10:13.7474743Z max=0.3273
2026-02-21T10:10:13.7474913Z best={'block_sizes': [4],
2026-02-21T10:10:13.7475328Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:10:13.7475934Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:10:13.7476433Z  'load_eviction_policies': ['', '', 'last', '', 'first', 'last', 'last', ''],
2026-02-21T10:10:13.7476796Z  'num_stages': 2,
2026-02-21T10:10:13.7476990Z  'num_warps': 4,
2026-02-21T10:10:13.7477173Z  'pid_type': 'flat',
2026-02-21T10:10:13.7477362Z  'range_flattens': [None],
2026-02-21T10:10:13.7477578Z  'range_multi_buffers': [None],
2026-02-21T10:10:13.7477796Z  'range_num_stages': [0],
2026-02-21T10:10:13.7478010Z  'range_unroll_factors': [0],
2026-02-21T10:10:13.7478228Z  'range_warp_specializes': [],
2026-02-21T10:10:13.7478459Z  'reduction_loops': [None]}
2026-02-21T10:10:13.7523344Z [282s] Fitting surrogate: 1009 points, 1009 targets
2026-02-21T10:10:14.5564720Z [283s] Generation 17 starting: 44 neighbors, 3 active search path(s)
2026-02-21T10:10:17.6177849Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 20.5 configs/s
2026-02-21T10:10:20.3215872Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 45/45 16.9 configs/s
2026-02-21T10:10:25.4359185Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 198.5         
2026-02-21T10:10:25.4360162Z                                                                   configs/s     
2026-02-21T10:10:25.8591720Z [294s] Generation 17 complete: 
2026-02-21T10:10:25.8592142Z ok=47
2026-02-21T10:10:25.8592424Z min=0.0259
2026-02-21T10:10:25.8592694Z mid=0.0270
2026-02-21T10:10:25.8592944Z max=0.1646
2026-02-21T10:10:25.8593217Z best={'block_sizes': [4],
2026-02-21T10:10:25.8593880Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:10:25.8595299Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:10:25.8596100Z  'load_eviction_policies': ['', '', 'last', '', 'last', 'last', 'last', ''],
2026-02-21T10:10:25.8596671Z  'num_stages': 2,
2026-02-21T10:10:25.8597553Z  'num_warps': 4,
2026-02-21T10:10:25.8597881Z  'pid_type': 'flat',
2026-02-21T10:10:25.8598077Z  'range_flattens': [None],
2026-02-21T10:10:25.8609600Z  'range_multi_buffers': [None],
2026-02-21T10:10:25.8609855Z  'range_num_stages': [0],
2026-02-21T10:10:25.8610163Z  'range_unroll_factors': [0],
2026-02-21T10:10:25.8610378Z  'range_warp_specializes': [],
2026-02-21T10:10:25.8610597Z  'reduction_loops': [None]}
2026-02-21T10:10:25.8651929Z [294s] Fitting surrogate: 1056 points, 1056 targets
2026-02-21T10:10:26.6128863Z [295s] Generation 18 starting: 43 neighbors, 3 active search path(s)
2026-02-21T10:10:29.6572920Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 19.1 configs/s
2026-02-21T10:10:32.2435053Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 43/43 16.9 configs/s
2026-02-21T10:10:37.5021887Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 208.0         
2026-02-21T10:10:37.5022370Z                                                                   configs/s     
2026-02-21T10:10:37.9024755Z [306s] Generation 18 complete: 
2026-02-21T10:10:37.9025018Z ok=46
2026-02-21T10:10:37.9025193Z min=0.0256
2026-02-21T10:10:37.9025368Z mid=0.0267
2026-02-21T10:10:37.9025598Z max=0.1647
2026-02-21T10:10:37.9025937Z best={'block_sizes': [4],
2026-02-21T10:10:37.9026802Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:10:37.9027842Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:10:37.9028735Z  'load_eviction_policies': ['', '', 'last', '', 'last', 'last', 'last', ''],
2026-02-21T10:10:37.9029343Z  'num_stages': 3,
2026-02-21T10:10:37.9029665Z  'num_warps': 4,
2026-02-21T10:10:37.9029978Z  'pid_type': 'flat',
2026-02-21T10:10:37.9030328Z  'range_flattens': [None],
2026-02-21T10:10:37.9030700Z  'range_multi_buffers': [None],
2026-02-21T10:10:37.9031093Z  'range_num_stages': [0],
2026-02-21T10:10:37.9031452Z  'range_unroll_factors': [0],
2026-02-21T10:10:37.9031852Z  'range_warp_specializes': [],
2026-02-21T10:10:37.9032247Z  'reduction_loops': [None]}
2026-02-21T10:10:37.9078592Z [306s] Fitting surrogate: 1102 points, 1102 targets
2026-02-21T10:10:38.3524699Z [307s] Generation 19 starting: 21 neighbors, 2 active search path(s)
2026-02-21T10:10:40.0157749Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 24.5 configs/s
2026-02-21T10:10:41.3611769Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 16.9 configs/s
2026-02-21T10:10:43.8951547Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 400.0         
2026-02-21T10:10:43.8952213Z                                                                   configs/s     
2026-02-21T10:10:44.1042666Z [312s] Generation 19 complete: 
2026-02-21T10:10:44.1043146Z ok=23
2026-02-21T10:10:44.1043430Z min=0.0257
2026-02-21T10:10:44.1043718Z mid=0.0268
2026-02-21T10:10:44.1044461Z max=0.0439
2026-02-21T10:10:44.1044827Z best={'block_sizes': [4],
2026-02-21T10:10:44.1046328Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:10:44.1047373Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:10:44.1048260Z  'load_eviction_policies': ['', '', 'last', '', 'last', 'last', 'last', ''],
2026-02-21T10:10:44.1048861Z  'num_stages': 3,
2026-02-21T10:10:44.1049185Z  'num_warps': 4,
2026-02-21T10:10:44.1049494Z  'pid_type': 'flat',
2026-02-21T10:10:44.1049849Z  'range_flattens': [None],
2026-02-21T10:10:44.1050393Z  'range_multi_buffers': [None],
2026-02-21T10:10:44.1050678Z  'range_num_stages': [0],
2026-02-21T10:10:44.1050880Z  'range_unroll_factors': [0],
2026-02-21T10:10:44.1051087Z  'range_warp_specializes': [],
2026-02-21T10:10:44.1051298Z  'reduction_loops': [None]}
2026-02-21T10:10:44.1100729Z [312s] Fitting surrogate: 1125 points, 1125 targets
2026-02-21T10:10:44.4014244Z [313s] Generation 20 starting: 11 neighbors, 1 active search path(s)
2026-02-21T10:10:45.6498913Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 7.8 configs/s
2026-02-21T10:10:46.3162395Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.7 configs/s
2026-02-21T10:10:47.6997470Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 727.9         
2026-02-21T10:10:47.6997987Z                                                                   configs/s     
2026-02-21T10:10:47.8308603Z [316s] Generation 20 complete: 
2026-02-21T10:10:47.8308855Z ok=13
2026-02-21T10:10:47.8309029Z min=0.0257
2026-02-21T10:10:47.8309209Z mid=0.0270
2026-02-21T10:10:47.8309377Z max=0.1594
2026-02-21T10:10:47.8309554Z best={'block_sizes': [4],
2026-02-21T10:10:47.8309987Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:10:47.8310608Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:10:47.8311165Z  'load_eviction_policies': ['first', '', 'last', 'last', 'last', '', '', 'last'],
2026-02-21T10:10:47.8311556Z  'num_stages': 2,
2026-02-21T10:10:47.8311741Z  'num_warps': 4,
2026-02-21T10:10:47.8311943Z  'pid_type': 'flat',
2026-02-21T10:10:47.8312147Z  'range_flattens': [None],
2026-02-21T10:10:47.8312386Z  'range_multi_buffers': [None],
2026-02-21T10:10:47.8312626Z  'range_num_stages': [0],
2026-02-21T10:10:47.8312855Z  'range_unroll_factors': [0],
2026-02-21T10:10:47.8313091Z  'range_warp_specializes': [],
2026-02-21T10:10:47.8313334Z  'reduction_loops': [None]}
2026-02-21T10:10:47.8366221Z [316s] Fitting surrogate: 1138 points, 1138 targets
2026-02-21T10:10:48.0032264Z [316s] Autotuning complete in 316.7s after searching 1088 configs.
2026-02-21T10:10:48.0032938Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:10:48.0035337Z     @helion.kernel(config=helion.Config(block_sizes=[4], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', '', 'last', 'last', 'last', '', '', 'last'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:10:48.0037882Z 
2026-02-21T10:10:48.0038333Z [316s] Code of selected kernel: /tmp/torchinductor_root/nl/cnl4oabcmedhk46jew7qt3azluesmzyzyrsjmo7voqnjg36rvsm5.py
2026-02-21T10:10:48.0295194Z from __future__ import annotations
2026-02-21T10:10:48.0295397Z 
2026-02-21T10:10:48.0295471Z import torch
2026-02-21T10:10:48.0295657Z import triton
2026-02-21T10:10:48.0295845Z import triton.language as tl
2026-02-21T10:10:48.0296157Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:10:48.0296590Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:10:48.0296855Z 
2026-02-21T10:10:48.0296940Z _BLOCK_SIZE_0 = tl.constexpr(4)
2026-02-21T10:10:48.0297093Z 
2026-02-21T10:10:48.0297513Z @triton.jit
2026-02-21T10:10:48.0297877Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:10:48.0298346Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:10:48.0298640Z     pid_0 = tl.program_id(0)
2026-02-21T10:10:48.0298862Z     offset_0 = pid_0 * _BLOCK_SIZE_0
2026-02-21T10:10:48.0299192Z     indices_0 = (offset_0 + tl.arange(0, _BLOCK_SIZE_0)).to(tl.int32)
2026-02-21T10:10:48.0299565Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:10:48.0299937Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:10:48.0300454Z     acc = tl.load(x + (indices_0[:, None] * 2048 + indices_1[None, :] * 1), None, eviction_policy='evict_first')
2026-02-21T10:10:48.0300977Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:10:48.0301325Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:10:48.0301583Z     v_0 = 0.00048828125
2026-02-21T10:10:48.0301780Z     v_1 = sum_1 * v_0
2026-02-21T10:10:48.0302037Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:10:48.0302362Z     subscript = v_1[:, None]
2026-02-21T10:10:48.0302596Z     v_2 = acc - subscript
2026-02-21T10:10:48.0302946Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:10:48.0303333Z     v_3 = v_2 * v_2
2026-02-21T10:10:48.0303547Z     sum_2 = tl.cast(tl.sum(v_3, 1), tl.float32)
2026-02-21T10:10:48.0303822Z     v_4 = 0.00048828125
2026-02-21T10:10:48.0304205Z     v_5 = sum_2 * v_4
2026-02-21T10:10:48.0304501Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:10:48.0304831Z     v_6 = v_5 + eps
2026-02-21T10:10:48.0305032Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:10:48.0305350Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:10:48.0305706Z     subscript_1 = v_7[:, None]
2026-02-21T10:10:48.0305943Z     v_8 = v_2 * subscript_1
2026-02-21T10:10:48.0306282Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:10:48.0306702Z     load_1 = tl.load(weight + indices_1 * 1, None)
2026-02-21T10:10:48.0306983Z     v_9 = load_1[None, :]
2026-02-21T10:10:48.0307196Z     v_10 = v_8 * v_9
2026-02-21T10:10:48.0307429Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:10:48.0307839Z     load_2 = tl.load(bias + indices_1 * 1, None, eviction_policy='evict_last')
2026-02-21T10:10:48.0308329Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:10:48.0308760Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:10:48.0309072Z     # src[layer_norm.py:75]: )
2026-02-21T10:10:48.0309299Z     v_11 = load_2[None, :]
2026-02-21T10:10:48.0309510Z     v_12 = v_10 + v_11
2026-02-21T10:10:48.0309762Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:10:48.0310197Z     tl.store(out + (indices_0[:, None] * 2048 + indices_1[None, :] * 1), v_12, None)
2026-02-21T10:10:48.0310608Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:10:48.0310925Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:10:48.0311236Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:10:48.0311729Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:10:48.0311923Z 
2026-02-21T10:10:48.0312486Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:10:48.0313213Z     """
2026-02-21T10:10:48.0313496Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:10:48.0313829Z     Args:
2026-02-21T10:10:48.0314218Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:10:48.0314756Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:10:48.0315394Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:10:48.0315820Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:10:48.0316315Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:10:48.0316700Z     Returns:
2026-02-21T10:10:48.0316899Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:10:48.0317266Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:10:48.0317655Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:10:48.0318002Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:10:48.0318334Z     """
2026-02-21T10:10:48.0318498Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:10:48.0318711Z     m, n = x.size()
2026-02-21T10:10:48.0319043Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:10:48.0319514Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:10:48.0319861Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:10:48.0320234Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:10:48.0320599Z     if bias is not None:
2026-02-21T10:10:48.0320919Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:10:48.0321350Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:10:48.0321715Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:10:48.0322100Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:10:48.0322441Z     # src[layer_norm.py:52]: )
2026-02-21T10:10:48.0322814Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:10:48.0323239Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:10:48.0323641Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:10:48.0324104Z     # src[layer_norm.py:55]: )
2026-02-21T10:10:48.0324438Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:10:48.0324896Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:10:48.0325271Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:10:48.0325652Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:10:48.0326043Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:10:48.0326424Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:10:48.0326808Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:10:48.0327118Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:10:48.0327354Z     _BLOCK_SIZE_0 = 4
2026-02-21T10:10:48.0327524Z     _RDIM_SIZE_1 = 2048
2026-02-21T10:10:48.0327876Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:10:48.0328178Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:10:48.0328481Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:10:48.0328711Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:10:48.0329236Z     _launcher(_helion_layer_norm_fwd, (triton.cdiv(4096, _BLOCK_SIZE_0),), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=4, num_stages=2)
2026-02-21T10:10:48.0329778Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:10:48.0330116Z     return (out, mean, rstd)
2026-02-21T10:10:48.9758320Z WARNING:tritonbench.utils.triton_op:Completed input ID 2:
2026-02-21T10:10:48.9758907Z (M, N)
2026-02-21T10:10:48.9777967Z ------------
2026-02-21T10:10:48.9778391Z (4096, 2048)
2026-02-21T10:10:48.9778508Z 
2026-02-21T10:10:48.9778939Z  10%|█         | 2/20 [09:45<1:29:24, 298.03s/it]WARNING:tritonbench.utils.triton_op:Running input ID 3:
2026-02-21T10:10:48.9779363Z (M, N)
2026-02-21T10:10:48.9779514Z ------------
2026-02-21T10:10:48.9779677Z (4096, 2560)
2026-02-21T10:10:48.9780022Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T10:10:50.6200181Z INFO:tritonbench.utils.triton_op:Took 3.09ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:10:51.7878549Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:10:53.2943121Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:10:53.2943433Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:10:53.2943698Z               'dtype': 'torch.float32',
2026-02-21T10:10:53.2943957Z               'shape': (4096, 2560),
2026-02-21T10:10:53.2944479Z               'stride': (2560, 1)},
2026-02-21T10:10:53.2944730Z             (2560,),
2026-02-21T10:10:53.2944935Z             { 'device': 'cuda:0',
2026-02-21T10:10:53.2945174Z               'dtype': 'torch.float32',
2026-02-21T10:10:53.2945447Z               'shape': (2560,),
2026-02-21T10:10:53.2945680Z               'stride': (1,)},
2026-02-21T10:10:53.2945903Z             { 'device': 'cuda:0',
2026-02-21T10:10:53.2946145Z               'dtype': 'torch.float32',
2026-02-21T10:10:53.2946390Z               'shape': (2560,),
2026-02-21T10:10:53.2946610Z               'stride': (1,)},
2026-02-21T10:10:53.2946818Z             1e-05),
2026-02-21T10:10:53.2947001Z   'kwargs': {}}
2026-02-21T10:10:53.2979212Z INFO:tritonbench.utils.triton_op:Took 4.02ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:10:53.3060212Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:10:53.3061089Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:10:53.3061663Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:10:53.3062001Z While processing:
2026-02-21T10:10:53.3062420Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:10:53.3062832Z     if bias is not None:
2026-02-21T10:10:53.3063043Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:10:53.3063169Z 
2026-02-21T10:10:53.4673378Z [0s] Autotune random seed: 2141537047
2026-02-21T10:10:53.5009227Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:11:27.5582872Z [34s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:11:27.7972751Z [34s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:11:27.7994135Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T10:11:33.4743537Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.8 configs/s
2026-02-21T10:11:33.4756730Z [39s] Adaptive compile timeout: 30s (90% percentile=4.2s, bounds=[30.0s, 30s])
2026-02-21T10:11:34.7668676Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 779.0 configs/s
2026-02-21T10:11:34.8847739Z [41s] Initial random population of 100, 5 starting points: 
2026-02-21T10:11:34.8848351Z error=10
2026-02-21T10:11:34.8848626Z timeout=2
2026-02-21T10:11:34.8848895Z ok=88
2026-02-21T10:11:34.8849157Z min=0.0312
2026-02-21T10:11:34.8849419Z mid=0.1841
2026-02-21T10:11:34.8849673Z max=7.3657
2026-02-21T10:11:34.8850067Z best={'block_sizes': [1],
2026-02-21T10:11:34.8850738Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:11:34.8851587Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:11:34.8852261Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:11:34.8852774Z  'num_stages': 1,
2026-02-21T10:11:34.8853087Z  'num_warps': 4,
2026-02-21T10:11:34.8853424Z  'pid_type': 'flat',
2026-02-21T10:11:34.8853758Z  'range_flattens': [None],
2026-02-21T10:11:34.8854752Z  'range_multi_buffers': [None],
2026-02-21T10:11:34.8855200Z  'range_num_stages': [0],
2026-02-21T10:11:34.8855751Z  'range_unroll_factors': [0],
2026-02-21T10:11:34.8856316Z  'range_warp_specializes': [],
2026-02-21T10:11:34.8856828Z  'reduction_loops': [None]}
2026-02-21T10:11:34.8869306Z [41s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:11:36.0741198Z [42s] Generation 1 starting: 72 neighbors, 5 active search path(s)
2026-02-21T10:11:44.5515371Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77/77 5.1 configs/s
2026-02-21T10:11:49.3239664Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 77/77 16.3 configs/s
2026-02-21T10:11:57.6546275Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.7         
2026-02-21T10:11:57.6546769Z                                                                   configs/s     
2026-02-21T10:11:58.2965781Z [64s] Generation 1 complete: 
2026-02-21T10:11:58.2966072Z ok=78
2026-02-21T10:11:58.2966260Z min=0.0318
2026-02-21T10:11:58.2966437Z mid=0.0391
2026-02-21T10:11:58.2966604Z max=0.7659
2026-02-21T10:11:58.2966829Z best={'block_sizes': [1],
2026-02-21T10:11:58.2967234Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:11:58.2967796Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:11:58.2968238Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:11:58.2968565Z  'num_stages': 1,
2026-02-21T10:11:58.2968760Z  'num_warps': 4,
2026-02-21T10:11:58.2968961Z  'pid_type': 'flat',
2026-02-21T10:11:58.2969175Z  'range_flattens': [None],
2026-02-21T10:11:58.2969415Z  'range_multi_buffers': [None],
2026-02-21T10:11:58.2969676Z  'range_num_stages': [0],
2026-02-21T10:11:58.2969904Z  'range_unroll_factors': [0],
2026-02-21T10:11:58.2970249Z  'range_warp_specializes': [],
2026-02-21T10:11:58.2970494Z  'reduction_loops': [None]}
2026-02-21T10:11:58.2987266Z [64s] Fitting surrogate: 178 points, 178 targets
2026-02-21T10:11:59.4480712Z [65s] Generation 2 starting: 70 neighbors, 5 active search path(s)
2026-02-21T10:12:05.6102838Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 21.9 configs/s
2026-02-21T10:12:10.0214713Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 16.5 configs/s
2026-02-21T10:12:18.1357117Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.0         
2026-02-21T10:12:18.1357655Z                                                                   configs/s     
2026-02-21T10:12:18.7585434Z [85s] Generation 2 complete: 
2026-02-21T10:12:18.7585689Z ok=75
2026-02-21T10:12:18.7585889Z min=0.0323
2026-02-21T10:12:18.7586206Z mid=0.0357
2026-02-21T10:12:18.7586524Z max=0.1774
2026-02-21T10:12:18.7586874Z best={'block_sizes': [2],
2026-02-21T10:12:18.7588385Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:12:18.7589348Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:12:18.7590108Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:12:18.7590634Z  'num_stages': 1,
2026-02-21T10:12:18.7590971Z  'num_warps': 16,
2026-02-21T10:12:18.7591286Z  'pid_type': 'flat',
2026-02-21T10:12:18.7591634Z  'range_flattens': [None],
2026-02-21T10:12:18.7591999Z  'range_multi_buffers': [None],
2026-02-21T10:12:18.7592389Z  'range_num_stages': [0],
2026-02-21T10:12:18.7592756Z  'range_unroll_factors': [0],
2026-02-21T10:12:18.7593135Z  'range_warp_specializes': [],
2026-02-21T10:12:18.7593519Z  'reduction_loops': [None]}
2026-02-21T10:12:18.7615374Z [85s] Fitting surrogate: 253 points, 253 targets
2026-02-21T10:12:19.7178078Z [86s] Generation 3 starting: 59 neighbors, 5 active search path(s)
2026-02-21T10:12:25.0744543Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 15.3 configs/s
2026-02-21T10:12:28.6588240Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 17.2 configs/s
2026-02-21T10:12:34.6988290Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 167.9         
2026-02-21T10:12:34.6988788Z                                                                   configs/s     
2026-02-21T10:12:35.1630704Z [101s] Generation 3 complete: 
2026-02-21T10:12:35.1631105Z error=2
2026-02-21T10:12:35.1631367Z ok=62
2026-02-21T10:12:35.1631641Z min=0.0316
2026-02-21T10:12:35.1631905Z mid=0.0363
2026-02-21T10:12:35.1632149Z max=0.6058
2026-02-21T10:12:35.1632424Z best={'block_sizes': [2],
2026-02-21T10:12:35.1633090Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:12:35.1634437Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:12:35.1635164Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:12:35.1635653Z  'num_stages': 1,
2026-02-21T10:12:35.1635966Z  'num_warps': 16,
2026-02-21T10:12:35.1636257Z  'pid_type': 'flat',
2026-02-21T10:12:35.1636602Z  'range_flattens': [None],
2026-02-21T10:12:35.1636972Z  'range_multi_buffers': [None],
2026-02-21T10:12:35.1637400Z  'range_num_stages': [0],
2026-02-21T10:12:35.1637784Z  'range_unroll_factors': [0],
2026-02-21T10:12:35.1638060Z  'range_warp_specializes': [],
2026-02-21T10:12:35.1638274Z  'reduction_loops': [None]}
2026-02-21T10:12:35.1658394Z [101s] Fitting surrogate: 317 points, 317 targets
2026-02-21T10:12:36.0975566Z [102s] Generation 4 starting: 53 neighbors, 5 active search path(s)
2026-02-21T10:12:40.4024501Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 27.3 configs/s
2026-02-21T10:12:43.7326429Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 17.0 configs/s
2026-02-21T10:12:49.8920299Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 176.1         
2026-02-21T10:12:49.8920853Z                                                                   configs/s     
2026-02-21T10:12:50.3446343Z [116s] Generation 4 complete: 
2026-02-21T10:12:50.3446639Z error=1
2026-02-21T10:12:50.3446826Z ok=58
2026-02-21T10:12:50.3446991Z min=0.0320
2026-02-21T10:12:50.3447754Z mid=0.0349
2026-02-21T10:12:50.3447928Z max=0.1324
2026-02-21T10:12:50.3448139Z best={'block_sizes': [2],
2026-02-21T10:12:50.3448541Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:12:50.3449062Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:12:50.3449446Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:12:50.3449719Z  'num_stages': 1,
2026-02-21T10:12:50.3449990Z  'num_warps': 8,
2026-02-21T10:12:50.3450157Z  'pid_type': 'flat',
2026-02-21T10:12:50.3450343Z  'range_flattens': [None],
2026-02-21T10:12:50.3450538Z  'range_multi_buffers': [None],
2026-02-21T10:12:50.3450750Z  'range_num_stages': [0],
2026-02-21T10:12:50.3450947Z  'range_unroll_factors': [0],
2026-02-21T10:12:50.3451483Z  'range_warp_specializes': [],
2026-02-21T10:12:50.3451702Z  'reduction_loops': [None]}
2026-02-21T10:12:50.3471741Z [116s] Fitting surrogate: 376 points, 376 targets
2026-02-21T10:12:51.4166408Z [117s] Generation 5 starting: 66 neighbors, 5 active search path(s)
2026-02-21T10:12:57.0216859Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 18.3 configs/s
2026-02-21T10:13:01.0395655Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 17.1 configs/s
2026-02-21T10:13:08.2314416Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 149.5         
2026-02-21T10:13:08.2314975Z                                                                   configs/s     
2026-02-21T10:13:08.7739766Z [135s] Generation 5 complete: 
2026-02-21T10:13:08.7740086Z error=2
2026-02-21T10:13:08.7740273Z ok=69
2026-02-21T10:13:08.7740473Z min=0.0318
2026-02-21T10:13:08.7740685Z mid=0.0349
2026-02-21T10:13:08.7740894Z max=0.3067
2026-02-21T10:13:08.7741145Z best={'block_sizes': [2],
2026-02-21T10:13:08.7741603Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:13:08.7742178Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:13:08.7742612Z               'tensor_descriptor'],
2026-02-21T10:13:08.7742957Z  'load_eviction_policies': ['', 'first', '', 'last', 'last', '', '', ''],
2026-02-21T10:13:08.7743327Z  'num_stages': 5,
2026-02-21T10:13:08.7743517Z  'num_warps': 16,
2026-02-21T10:13:08.7743701Z  'pid_type': 'flat',
2026-02-21T10:13:08.7743916Z  'range_flattens': [None],
2026-02-21T10:13:08.7744568Z  'range_multi_buffers': [None],
2026-02-21T10:13:08.7744809Z  'range_num_stages': [0],
2026-02-21T10:13:08.7745027Z  'range_unroll_factors': [0],
2026-02-21T10:13:08.7745270Z  'range_warp_specializes': [],
2026-02-21T10:13:08.7745502Z  'reduction_loops': [None]}
2026-02-21T10:13:08.7771081Z [135s] Fitting surrogate: 447 points, 447 targets
2026-02-21T10:13:09.8014336Z [136s] Generation 6 starting: 62 neighbors, 5 active search path(s)
2026-02-21T10:13:14.9046563Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 26.1 configs/s
2026-02-21T10:13:18.6639535Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 17.2 configs/s
2026-02-21T10:13:26.2594652Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 133.6         
2026-02-21T10:13:26.2595184Z                                                                   configs/s     
2026-02-21T10:13:26.8418683Z [153s] Generation 6 complete: 
2026-02-21T10:13:26.8418955Z error=2
2026-02-21T10:13:26.8419134Z ok=65
2026-02-21T10:13:26.8419303Z min=0.0312
2026-02-21T10:13:26.8419483Z mid=0.0336
2026-02-21T10:13:26.8419648Z max=0.0538
2026-02-21T10:13:26.8419838Z best={'block_sizes': [1],
2026-02-21T10:13:26.8420240Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:13:26.8421427Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:13:26.8421883Z               'tensor_descriptor'],
2026-02-21T10:13:26.8422250Z  'load_eviction_policies': ['', '', '', 'last', 'last', '', 'first', 'first'],
2026-02-21T10:13:26.8422648Z  'num_stages': 7,
2026-02-21T10:13:26.8422858Z  'num_warps': 4,
2026-02-21T10:13:26.8423095Z  'pid_type': 'flat',
2026-02-21T10:13:26.8423356Z  'range_flattens': [None],
2026-02-21T10:13:26.8423602Z  'range_multi_buffers': [None],
2026-02-21T10:13:26.8423836Z  'range_num_stages': [0],
2026-02-21T10:13:26.8424195Z  'range_unroll_factors': [0],
2026-02-21T10:13:26.8424428Z  'range_warp_specializes': [],
2026-02-21T10:13:26.8424671Z  'reduction_loops': [None]}
2026-02-21T10:13:26.8456350Z [153s] Fitting surrogate: 514 points, 514 targets
2026-02-21T10:13:27.8516798Z [154s] Generation 7 starting: 59 neighbors, 5 active search path(s)
2026-02-21T10:13:32.6549845Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 15.1 configs/s
2026-02-21T10:13:36.6829074Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 15.0 configs/s
2026-02-21T10:13:43.8466537Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.6         
2026-02-21T10:13:43.8467079Z                                                                   configs/s     
2026-02-21T10:13:44.4167811Z [170s] Generation 7 complete: 
2026-02-21T10:13:44.4168119Z error=1
2026-02-21T10:13:44.4168294Z ok=63
2026-02-21T10:13:44.4168474Z min=0.0313
2026-02-21T10:13:44.4168661Z mid=0.0323
2026-02-21T10:13:44.4168836Z max=0.0589
2026-02-21T10:13:44.4169032Z best={'block_sizes': [1],
2026-02-21T10:13:44.4169475Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:13:44.4170218Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:13:44.4170749Z  'load_eviction_policies': ['', '', '', 'last', 'last', '', 'first', 'first'],
2026-02-21T10:13:44.4171128Z  'num_stages': 7,
2026-02-21T10:13:44.4171321Z  'num_warps': 4,
2026-02-21T10:13:44.4171560Z  'pid_type': 'flat',
2026-02-21T10:13:44.4171780Z  'range_flattens': [None],
2026-02-21T10:13:44.4172014Z  'range_multi_buffers': [None],
2026-02-21T10:13:44.4172278Z  'range_num_stages': [0],
2026-02-21T10:13:44.4172506Z  'range_unroll_factors': [0],
2026-02-21T10:13:44.4172758Z  'range_warp_specializes': [],
2026-02-21T10:13:44.4172998Z  'reduction_loops': [None]}
2026-02-21T10:13:44.4202209Z [170s] Fitting surrogate: 578 points, 578 targets
2026-02-21T10:13:45.1390252Z [171s] Generation 8 starting: 38 neighbors, 4 active search path(s)
2026-02-21T10:13:48.1075257Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 22.9 configs/s
2026-02-21T10:13:50.3712636Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.1 configs/s
2026-02-21T10:13:55.1841714Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 210.6         
2026-02-21T10:13:55.1842285Z                                                                   configs/s     
2026-02-21T10:13:55.5703513Z [182s] Generation 8 complete: 
2026-02-21T10:13:55.5703804Z ok=42
2026-02-21T10:13:55.5704305Z min=0.0311
2026-02-21T10:13:55.5704476Z mid=0.0319
2026-02-21T10:13:55.5705342Z max=0.0503
2026-02-21T10:13:55.5705517Z best={'block_sizes': [1],
2026-02-21T10:13:55.5705926Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:13:55.5706510Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:13:55.5706927Z               'tensor_descriptor'],
2026-02-21T10:13:55.5707290Z  'load_eviction_policies': ['', '', '', 'last', 'last', '', 'first', 'first'],
2026-02-21T10:13:55.5707656Z  'num_stages': 7,
2026-02-21T10:13:55.5707847Z  'num_warps': 4,
2026-02-21T10:13:55.5708031Z  'pid_type': 'flat',
2026-02-21T10:13:55.5708241Z  'range_flattens': [None],
2026-02-21T10:13:55.5708463Z  'range_multi_buffers': [None],
2026-02-21T10:13:55.5708697Z  'range_num_stages': [0],
2026-02-21T10:13:55.5709226Z  'range_unroll_factors': [0],
2026-02-21T10:13:55.5709478Z  'range_warp_specializes': [],
2026-02-21T10:13:55.5709710Z  'reduction_loops': [None]}
2026-02-21T10:13:55.5741073Z [182s] Fitting surrogate: 620 points, 620 targets
2026-02-21T10:13:56.3018318Z [182s] Generation 9 starting: 40 neighbors, 4 active search path(s)
2026-02-21T10:13:59.9101931Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 33.7 configs/s
2026-02-21T10:14:02.3918259Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 42/42 17.2 configs/s
2026-02-21T10:14:07.5528415Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 196.5         
2026-02-21T10:14:07.5528949Z                                                                   configs/s     
2026-02-21T10:14:07.9637449Z [194s] Generation 9 complete: 
2026-02-21T10:14:07.9637749Z ok=44
2026-02-21T10:14:07.9637930Z min=0.0342
2026-02-21T10:14:07.9638105Z mid=0.0350
2026-02-21T10:14:07.9638298Z max=0.0639
2026-02-21T10:14:07.9638481Z best={'block_sizes': [1],
2026-02-21T10:14:07.9638942Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:14:07.9639581Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:14:07.9640086Z               'tensor_descriptor'],
2026-02-21T10:14:07.9640459Z  'load_eviction_policies': ['', '', '', 'last', 'last', '', 'first', 'first'],
2026-02-21T10:14:07.9640837Z  'num_stages': 7,
2026-02-21T10:14:07.9641037Z  'num_warps': 4,
2026-02-21T10:14:07.9641232Z  'pid_type': 'flat',
2026-02-21T10:14:07.9641449Z  'range_flattens': [None],
2026-02-21T10:14:07.9641695Z  'range_multi_buffers': [None],
2026-02-21T10:14:07.9641974Z  'range_num_stages': [0],
2026-02-21T10:14:07.9642230Z  'range_unroll_factors': [0],
2026-02-21T10:14:07.9642463Z  'range_warp_specializes': [],
2026-02-21T10:14:07.9642682Z  'reduction_loops': [None]}
2026-02-21T10:14:07.9679911Z [194s] Fitting surrogate: 664 points, 664 targets
2026-02-21T10:14:08.6876713Z [195s] Generation 10 starting: 39 neighbors, 4 active search path(s)
2026-02-21T10:14:12.1298438Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 14.4 configs/s
2026-02-21T10:14:14.7116800Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 43/43 16.9 configs/s
2026-02-21T10:14:19.2994397Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 220.8         
2026-02-21T10:14:19.3000795Z                                                                   configs/s     
2026-02-21T10:14:19.6680022Z [206s] Generation 10 complete: 
2026-02-21T10:14:19.6680315Z ok=44
2026-02-21T10:14:19.6680501Z min=0.0310
2026-02-21T10:14:19.6680681Z mid=0.0324
2026-02-21T10:14:19.6680859Z max=0.0806
2026-02-21T10:14:19.6681048Z best={'block_sizes': [1],
2026-02-21T10:14:19.6681506Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:14:19.6682199Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:14:19.6682691Z               'pointer', 'tensor_descriptor'],
2026-02-21T10:14:19.6683087Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', '', 'last'],
2026-02-21T10:14:19.6684619Z  'num_stages': 4,
2026-02-21T10:14:19.6684828Z  'num_warps': 4,
2026-02-21T10:14:19.6685027Z  'pid_type': 'flat',
2026-02-21T10:14:19.6685246Z  'range_flattens': [None],
2026-02-21T10:14:19.6685480Z  'range_multi_buffers': [None],
2026-02-21T10:14:19.6685726Z  'range_num_stages': [0],
2026-02-21T10:14:19.6685954Z  'range_unroll_factors': [0],
2026-02-21T10:14:19.6686211Z  'range_warp_specializes': [],
2026-02-21T10:14:19.6686461Z  'reduction_loops': [None]}
2026-02-21T10:14:19.6726646Z [206s] Fitting surrogate: 708 points, 708 targets
2026-02-21T10:14:20.3897814Z [206s] Generation 11 starting: 39 neighbors, 4 active search path(s)
2026-02-21T10:14:24.2556304Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 4.1 configs/s
2026-02-21T10:14:26.6482689Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 17.0 configs/s
2026-02-21T10:14:31.4893686Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 209.3         
2026-02-21T10:14:31.4894353Z                                                                   configs/s     
2026-02-21T10:14:31.8759723Z [218s] Generation 11 complete: 
2026-02-21T10:14:31.8760024Z ok=43
2026-02-21T10:14:31.8760206Z min=0.0314
2026-02-21T10:14:31.8760387Z mid=0.0322
2026-02-21T10:14:31.8760549Z max=0.2646
2026-02-21T10:14:31.8760739Z best={'block_sizes': [1],
2026-02-21T10:14:31.8761187Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:14:31.8761847Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:14:31.8762323Z               'pointer', 'tensor_descriptor'],
2026-02-21T10:14:31.8762715Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', '', 'last'],
2026-02-21T10:14:31.8763087Z  'num_stages': 4,
2026-02-21T10:14:31.8763332Z  'num_warps': 4,
2026-02-21T10:14:31.8763535Z  'pid_type': 'flat',
2026-02-21T10:14:31.8763747Z  'range_flattens': [None],
2026-02-21T10:14:31.8765171Z  'range_multi_buffers': [None],
2026-02-21T10:14:31.8765453Z  'range_num_stages': [0],
2026-02-21T10:14:31.8765685Z  'range_unroll_factors': [0],
2026-02-21T10:14:31.8765932Z  'range_warp_specializes': [],
2026-02-21T10:14:31.8766182Z  'reduction_loops': [None]}
2026-02-21T10:14:31.8803070Z [218s] Fitting surrogate: 751 points, 751 targets
2026-02-21T10:14:32.4725547Z [218s] Generation 12 starting: 31 neighbors, 3 active search path(s)
2026-02-21T10:14:35.0901053Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 10.7 configs/s
2026-02-21T10:14:36.9219556Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 17.3 configs/s
2026-02-21T10:14:41.0822528Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 243.1         
2026-02-21T10:14:41.0823077Z                                                                   configs/s     
2026-02-21T10:14:41.4140517Z [227s] Generation 12 complete: 
2026-02-21T10:14:41.4140832Z ok=35
2026-02-21T10:14:41.4141021Z min=0.0342
2026-02-21T10:14:41.4141234Z mid=0.0348
2026-02-21T10:14:41.4141421Z max=0.0781
2026-02-21T10:14:41.4141622Z best={'block_sizes': [1],
2026-02-21T10:14:41.4142097Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:14:41.4142809Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:14:41.4143297Z               'pointer'],
2026-02-21T10:14:41.4143648Z  'load_eviction_policies': ['', '', '', '', 'last', 'last', '', 'first'],
2026-02-21T10:14:41.4144484Z  'num_stages': 1,
2026-02-21T10:14:41.4144691Z  'num_warps': 4,
2026-02-21T10:14:41.4144901Z  'pid_type': 'flat',
2026-02-21T10:14:41.4145133Z  'range_flattens': [None],
2026-02-21T10:14:41.4145380Z  'range_multi_buffers': [None],
2026-02-21T10:14:41.4145643Z  'range_num_stages': [0],
2026-02-21T10:14:41.4145883Z  'range_unroll_factors': [0],
2026-02-21T10:14:41.4146118Z  'range_warp_specializes': [],
2026-02-21T10:14:41.4146356Z  'reduction_loops': [None]}
2026-02-21T10:14:41.4186002Z [227s] Fitting surrogate: 786 points, 786 targets
2026-02-21T10:14:41.8600877Z [228s] Generation 13 starting: 20 neighbors, 2 active search path(s)
2026-02-21T10:14:43.6408063Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 21.7 configs/s
2026-02-21T10:14:44.9467002Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.5 configs/s
2026-02-21T10:14:48.1954919Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 356.3         
2026-02-21T10:14:48.1955460Z                                                                   configs/s     
2026-02-21T10:14:48.4276146Z [234s] Generation 13 complete: 
2026-02-21T10:14:48.4276454Z ok=23
2026-02-21T10:14:48.4276628Z min=0.0345
2026-02-21T10:14:48.4276809Z mid=0.0351
2026-02-21T10:14:48.4276978Z max=0.0467
2026-02-21T10:14:48.4277916Z best={'block_sizes': [1],
2026-02-21T10:14:48.4278386Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:14:48.4279090Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:14:48.4279563Z               'pointer'],
2026-02-21T10:14:48.4279914Z  'load_eviction_policies': ['', '', '', '', 'last', 'last', '', 'first'],
2026-02-21T10:14:48.4280327Z  'num_stages': 1,
2026-02-21T10:14:48.4280501Z  'num_warps': 4,
2026-02-21T10:14:48.4280678Z  'pid_type': 'flat',
2026-02-21T10:14:48.4280865Z  'range_flattens': [None],
2026-02-21T10:14:48.4281089Z  'range_multi_buffers': [None],
2026-02-21T10:14:48.4281308Z  'range_num_stages': [0],
2026-02-21T10:14:48.4281511Z  'range_unroll_factors': [0],
2026-02-21T10:14:48.4281737Z  'range_warp_specializes': [],
2026-02-21T10:14:48.4281956Z  'reduction_loops': [None]}
2026-02-21T10:14:48.4314859Z [234s] Fitting surrogate: 809 points, 809 targets
2026-02-21T10:14:48.8685359Z [235s] Generation 14 starting: 20 neighbors, 2 active search path(s)
2026-02-21T10:14:51.1284999Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 6.7 configs/s
2026-02-21T10:14:52.4600581Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.1 configs/s
2026-02-21T10:14:54.6211804Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 467.3         
2026-02-21T10:14:54.6212339Z                                                                   configs/s     
2026-02-21T10:14:54.8085437Z [241s] Generation 14 complete: 
2026-02-21T10:14:54.8085724Z ok=23
2026-02-21T10:14:54.8085912Z min=0.0314
2026-02-21T10:14:54.8086096Z mid=0.0332
2026-02-21T10:14:54.8086267Z max=0.1698
2026-02-21T10:14:54.8086452Z best={'block_sizes': [1],
2026-02-21T10:14:54.8086915Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:14:54.8087638Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:14:54.8088105Z               'tensor_descriptor'],
2026-02-21T10:14:54.8088480Z  'load_eviction_policies': ['', '', 'last', 'last', 'last', '', '', 'first'],
2026-02-21T10:14:54.8089378Z  'num_stages': 6,
2026-02-21T10:14:54.8089584Z  'num_warps': 4,
2026-02-21T10:14:54.8089871Z  'pid_type': 'flat',
2026-02-21T10:14:54.8090089Z  'range_flattens': [None],
2026-02-21T10:14:54.8090320Z  'range_multi_buffers': [None],
2026-02-21T10:14:54.8090566Z  'range_num_stages': [0],
2026-02-21T10:14:54.8090795Z  'range_unroll_factors': [0],
2026-02-21T10:14:54.8091044Z  'range_warp_specializes': [],
2026-02-21T10:14:54.8091285Z  'reduction_loops': [None]}
2026-02-21T10:14:54.8129585Z [241s] Fitting surrogate: 832 points, 832 targets
2026-02-21T10:14:55.2581020Z [241s] Generation 15 starting: 21 neighbors, 2 active search path(s)
2026-02-21T10:14:57.5957993Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 4.5 configs/s
2026-02-21T10:14:58.9194611Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.2 configs/s
2026-02-21T10:15:00.9886749Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 486.9         
2026-02-21T10:15:00.9887276Z                                                                   configs/s     
2026-02-21T10:15:01.1673729Z [247s] Generation 15 complete: 
2026-02-21T10:15:01.1674378Z ok=23
2026-02-21T10:15:01.1674594Z min=0.0343
2026-02-21T10:15:01.1674769Z mid=0.0352
2026-02-21T10:15:01.1674946Z max=0.0783
2026-02-21T10:15:01.1675129Z best={'block_sizes': [1],
2026-02-21T10:15:01.1675597Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:01.1676270Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:01.1676729Z               'tensor_descriptor'],
2026-02-21T10:15:01.1677099Z  'load_eviction_policies': ['', '', 'last', 'last', 'last', '', '', ''],
2026-02-21T10:15:01.1677493Z  'num_stages': 6,
2026-02-21T10:15:01.1677713Z  'num_warps': 4,
2026-02-21T10:15:01.1677915Z  'pid_type': 'flat',
2026-02-21T10:15:01.1678140Z  'range_flattens': [None],
2026-02-21T10:15:01.1678389Z  'range_multi_buffers': [None],
2026-02-21T10:15:01.1678643Z  'range_num_stages': [0],
2026-02-21T10:15:01.1678897Z  'range_unroll_factors': [0],
2026-02-21T10:15:01.1679179Z  'range_warp_specializes': [],
2026-02-21T10:15:01.1679429Z  'reduction_loops': [None]}
2026-02-21T10:15:01.1718811Z [247s] Fitting surrogate: 855 points, 855 targets
2026-02-21T10:15:01.5901930Z [248s] Generation 16 starting: 19 neighbors, 2 active search path(s)
2026-02-21T10:15:03.6799240Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 15.1 configs/s
2026-02-21T10:15:04.9610541Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 17.0 configs/s
2026-02-21T10:15:07.5128746Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 395.1         
2026-02-21T10:15:07.5129312Z                                                                   configs/s     
2026-02-21T10:15:07.7255012Z [254s] Generation 16 complete: 
2026-02-21T10:15:07.7255277Z ok=22
2026-02-21T10:15:07.7266583Z min=0.0310
2026-02-21T10:15:07.7266851Z mid=0.0341
2026-02-21T10:15:07.7267038Z max=0.1709
2026-02-21T10:15:07.7267245Z best={'block_sizes': [1],
2026-02-21T10:15:07.7267728Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:07.7268452Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:07.7268947Z               'tensor_descriptor'],
2026-02-21T10:15:07.7269348Z  'load_eviction_policies': ['', '', 'last', 'last', 'last', '', 'last', ''],
2026-02-21T10:15:07.7269757Z  'num_stages': 6,
2026-02-21T10:15:07.7269963Z  'num_warps': 4,
2026-02-21T10:15:07.7270173Z  'pid_type': 'flat',
2026-02-21T10:15:07.7270404Z  'range_flattens': [None],
2026-02-21T10:15:07.7270663Z  'range_multi_buffers': [None],
2026-02-21T10:15:07.7270924Z  'range_num_stages': [0],
2026-02-21T10:15:07.7271170Z  'range_unroll_factors': [0],
2026-02-21T10:15:07.7271428Z  'range_warp_specializes': [],
2026-02-21T10:15:07.7271991Z  'reduction_loops': [None]}
2026-02-21T10:15:07.7301729Z [254s] Fitting surrogate: 877 points, 877 targets
2026-02-21T10:15:08.1964270Z [254s] Generation 17 starting: 22 neighbors, 2 active search path(s)
2026-02-21T10:15:10.5410991Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 9.2 configs/s
2026-02-21T10:15:11.9242981Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 17.2 configs/s
2026-02-21T10:15:14.5920778Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 378.8         
2026-02-21T10:15:14.5921289Z                                                                   configs/s     
2026-02-21T10:15:14.8162371Z [261s] Generation 17 complete: 
2026-02-21T10:15:14.8162641Z ok=24
2026-02-21T10:15:14.8162798Z min=0.0318
2026-02-21T10:15:14.8162954Z mid=0.0333
2026-02-21T10:15:14.8163677Z max=0.0662
2026-02-21T10:15:14.8163852Z best={'block_sizes': [1],
2026-02-21T10:15:14.8164630Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:14.8165242Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:14.8165645Z               'tensor_descriptor'],
2026-02-21T10:15:14.8165965Z  'load_eviction_policies': ['', '', 'last', 'last', 'last', '', 'last', ''],
2026-02-21T10:15:14.8166293Z  'num_stages': 6,
2026-02-21T10:15:14.8166457Z  'num_warps': 8,
2026-02-21T10:15:14.8166630Z  'pid_type': 'flat',
2026-02-21T10:15:14.8166811Z  'range_flattens': [None],
2026-02-21T10:15:14.8167019Z  'range_multi_buffers': [None],
2026-02-21T10:15:14.8167224Z  'range_num_stages': [0],
2026-02-21T10:15:14.8167424Z  'range_unroll_factors': [0],
2026-02-21T10:15:14.8167633Z  'range_warp_specializes': [],
2026-02-21T10:15:14.8167856Z  'reduction_loops': [None]}
2026-02-21T10:15:14.8210733Z [261s] Fitting surrogate: 901 points, 901 targets
2026-02-21T10:15:15.6622029Z [262s] Generation 18 starting: 18 neighbors, 2 active search path(s)
2026-02-21T10:15:17.9129119Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 7.6 configs/s
2026-02-21T10:15:19.1246386Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.1 configs/s
2026-02-21T10:15:21.5681238Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 413.0         
2026-02-21T10:15:21.5681756Z                                                                   configs/s     
2026-02-21T10:15:21.7733093Z [268s] Generation 18 complete: 
2026-02-21T10:15:21.7733391Z ok=21
2026-02-21T10:15:21.7733573Z min=0.0312
2026-02-21T10:15:21.7733763Z mid=0.0324
2026-02-21T10:15:21.7733930Z max=0.0472
2026-02-21T10:15:21.7734498Z best={'block_sizes': [1],
2026-02-21T10:15:21.7734970Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:21.7735664Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:21.7736135Z               'tensor_descriptor'],
2026-02-21T10:15:21.7736525Z  'load_eviction_policies': ['', '', 'last', 'last', 'last', '', 'last', 'last'],
2026-02-21T10:15:21.7736913Z  'num_stages': 6,
2026-02-21T10:15:21.7737103Z  'num_warps': 4,
2026-02-21T10:15:21.7737304Z  'pid_type': 'flat',
2026-02-21T10:15:21.7737551Z  'range_flattens': [None],
2026-02-21T10:15:21.7737789Z  'range_multi_buffers': [None],
2026-02-21T10:15:21.7738038Z  'range_num_stages': [0],
2026-02-21T10:15:21.7738263Z  'range_unroll_factors': [0],
2026-02-21T10:15:21.7738519Z  'range_warp_specializes': [],
2026-02-21T10:15:21.7738765Z  'reduction_loops': [None]}
2026-02-21T10:15:21.7781888Z [268s] Fitting surrogate: 922 points, 922 targets
2026-02-21T10:15:22.2369397Z [268s] Generation 19 starting: 22 neighbors, 2 active search path(s)
2026-02-21T10:15:23.8241823Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 257.6 configs/s
2026-02-21T10:15:25.1133869Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.7 configs/s
2026-02-21T10:15:27.9787204Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 352.9         
2026-02-21T10:15:27.9788402Z                                                                   configs/s     
2026-02-21T10:15:28.2196439Z [274s] Generation 19 complete: 
2026-02-21T10:15:28.2196727Z ok=24
2026-02-21T10:15:28.2196916Z min=0.0311
2026-02-21T10:15:28.2197091Z mid=0.0317
2026-02-21T10:15:28.2197282Z max=0.0364
2026-02-21T10:15:28.2197472Z best={'block_sizes': [1],
2026-02-21T10:15:28.2197928Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:28.2198591Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:28.2199039Z               'tensor_descriptor'],
2026-02-21T10:15:28.2199936Z  'load_eviction_policies': ['', '', 'last', 'last', 'last', '', 'last', 'last'],
2026-02-21T10:15:28.2200347Z  'num_stages': 6,
2026-02-21T10:15:28.2200554Z  'num_warps': 4,
2026-02-21T10:15:28.2200756Z  'pid_type': 'flat',
2026-02-21T10:15:28.2201001Z  'range_flattens': [None],
2026-02-21T10:15:28.2201232Z  'range_multi_buffers': [None],
2026-02-21T10:15:28.2201484Z  'range_num_stages': [0],
2026-02-21T10:15:28.2201722Z  'range_unroll_factors': [0],
2026-02-21T10:15:28.2201967Z  'range_warp_specializes': [],
2026-02-21T10:15:28.2202217Z  'reduction_loops': [None]}
2026-02-21T10:15:28.2245932Z [274s] Fitting surrogate: 946 points, 946 targets
2026-02-21T10:15:28.5096600Z [275s] Generation 20 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:15:29.1882609Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 - configs/s
2026-02-21T10:15:29.7130855Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.9 configs/s
2026-02-21T10:15:31.0436092Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 750.2         
2026-02-21T10:15:31.0436825Z                                                                   configs/s     
2026-02-21T10:15:31.1688341Z [277s] Generation 20 complete: 
2026-02-21T10:15:31.1688628Z ok=11
2026-02-21T10:15:31.1688799Z min=0.0349
2026-02-21T10:15:31.1688981Z mid=0.0350
2026-02-21T10:15:31.1689144Z max=0.0374
2026-02-21T10:15:31.1689336Z best={'block_sizes': [1],
2026-02-21T10:15:31.1689918Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:31.1690532Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:15:31.1690962Z               'tensor_descriptor'],
2026-02-21T10:15:31.1691302Z  'load_eviction_policies': ['', '', 'last', 'last', 'last', '', 'last', 'last'],
2026-02-21T10:15:31.1691658Z  'num_stages': 6,
2026-02-21T10:15:31.1691831Z  'num_warps': 4,
2026-02-21T10:15:31.1692014Z  'pid_type': 'flat',
2026-02-21T10:15:31.1692214Z  'range_flattens': [None],
2026-02-21T10:15:31.1692432Z  'range_multi_buffers': [None],
2026-02-21T10:15:31.1692656Z  'range_num_stages': [0],
2026-02-21T10:15:31.1692866Z  'range_unroll_factors': [0],
2026-02-21T10:15:31.1693110Z  'range_warp_specializes': [],
2026-02-21T10:15:31.1693334Z  'reduction_loops': [None]}
2026-02-21T10:15:31.1736429Z [277s] Fitting surrogate: 957 points, 957 targets
2026-02-21T10:15:31.3288910Z [277s] Autotuning complete in 277.8s after searching 911 configs.
2026-02-21T10:15:31.3289396Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:15:31.3291614Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', '', 'last', 'last', 'last', '', 'last', 'last'], num_stages=6, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:15:31.3293568Z 
2026-02-21T10:15:31.3294317Z [277s] Code of selected kernel: /tmp/torchinductor_root/2y/c2ykqv4avwjxyski5zmfqu5yxe2mqqldpakwezxqwxaoprdptccn.py
2026-02-21T10:15:31.3565121Z from __future__ import annotations
2026-02-21T10:15:31.3565322Z 
2026-02-21T10:15:31.3565403Z import torch
2026-02-21T10:15:31.3565600Z import triton
2026-02-21T10:15:31.3565811Z import triton.language as tl
2026-02-21T10:15:31.3566152Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:15:31.3566601Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:15:31.3566892Z 
2026-02-21T10:15:31.3566988Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T10:15:31.3567157Z 
2026-02-21T10:15:31.3567241Z @triton.jit
2026-02-21T10:15:31.3567608Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:15:31.3568422Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:15:31.3568750Z     pid_0 = tl.program_id(0)
2026-02-21T10:15:31.3568994Z     offset_0 = pid_0
2026-02-21T10:15:31.3569267Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T10:15:31.3569624Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:15:31.3570094Z     mask_1 = indices_1 < 2560
2026-02-21T10:15:31.3570409Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:15:31.3570908Z     acc = tl.load(x + (indices_0[:, None] * 2560 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T10:15:31.3571382Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:15:31.3571724Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:15:31.3571978Z     v_0 = 0.000390625
2026-02-21T10:15:31.3572155Z     v_1 = sum_1 * v_0
2026-02-21T10:15:31.3572409Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:15:31.3572730Z     subscript = v_1[:, None]
2026-02-21T10:15:31.3572948Z     v_2 = acc - subscript
2026-02-21T10:15:31.3573259Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:15:31.3573615Z     v_3 = v_2 * v_2
2026-02-21T10:15:31.3574184Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T10:15:31.3574724Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T10:15:31.3574994Z     v_4 = 0.000390625
2026-02-21T10:15:31.3575169Z     v_5 = sum_2 * v_4
2026-02-21T10:15:31.3575431Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:15:31.3575735Z     v_6 = v_5 + eps
2026-02-21T10:15:31.3575927Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:15:31.3576226Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:15:31.3576557Z     subscript_1 = v_7[:, None]
2026-02-21T10:15:31.3576773Z     v_8 = v_2 * subscript_1
2026-02-21T10:15:31.3577088Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:15:31.3577512Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0)
2026-02-21T10:15:31.3577806Z     v_9 = load_1[None, :]
2026-02-21T10:15:31.3577999Z     v_10 = v_8 * v_9
2026-02-21T10:15:31.3578216Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:15:31.3578623Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T10:15:31.3579110Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:15:31.3579533Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:15:31.3579826Z     # src[layer_norm.py:75]: )
2026-02-21T10:15:31.3580042Z     v_11 = load_2[None, :]
2026-02-21T10:15:31.3580237Z     v_12 = v_10 + v_11
2026-02-21T10:15:31.3580471Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:15:31.3580864Z     tl.store(out + (indices_0[:, None] * 2560 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T10:15:31.3581237Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:15:31.3581499Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:15:31.3581915Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:15:31.3582164Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:15:31.3582322Z 
2026-02-21T10:15:31.3582772Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:15:31.3583349Z     """
2026-02-21T10:15:31.3583580Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:15:31.3583866Z     Args:
2026-02-21T10:15:31.3584269Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:15:31.3584823Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:15:31.3585460Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:15:31.3585889Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:15:31.3586385Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:15:31.3586764Z     Returns:
2026-02-21T10:15:31.3586970Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:15:31.3587338Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:15:31.3587717Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:15:31.3588063Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:15:31.3588379Z     """
2026-02-21T10:15:31.3588542Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:15:31.3588761Z     m, n = x.size()
2026-02-21T10:15:31.3589083Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:15:31.3589559Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:15:31.3589905Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:15:31.3590282Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:15:31.3590641Z     if bias is not None:
2026-02-21T10:15:31.3590952Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:15:31.3591385Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:15:31.3591750Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:15:31.3592145Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:15:31.3592494Z     # src[layer_norm.py:52]: )
2026-02-21T10:15:31.3592832Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:15:31.3593257Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:15:31.3593632Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:15:31.3594113Z     # src[layer_norm.py:55]: )
2026-02-21T10:15:31.3594469Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:15:31.3594931Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:15:31.3595309Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:15:31.3595683Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:15:31.3596079Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:15:31.3596461Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:15:31.3596847Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:15:31.3597152Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:15:31.3597387Z     _RDIM_SIZE_1 = 4096
2026-02-21T10:15:31.3597751Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:15:31.3598051Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:15:31.3598354Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:15:31.3598588Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:15:31.3599013Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=4, num_stages=6)
2026-02-21T10:15:31.3599483Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:15:31.3599720Z     return (out, mean, rstd)
2026-02-21T10:15:32.3814188Z WARNING:tritonbench.utils.triton_op:Completed input ID 3:
2026-02-21T10:15:32.3814585Z (M, N)
2026-02-21T10:15:32.3814770Z ------------
2026-02-21T10:15:32.3814957Z (4096, 2560)
2026-02-21T10:15:32.3815730Z 
2026-02-21T10:15:32.3834167Z  15%|█▌        | 3/20 [14:29<1:22:32, 291.35s/it]WARNING:tritonbench.utils.triton_op:Running input ID 5:
2026-02-21T10:15:32.3834605Z (M, N)
2026-02-21T10:15:32.3834774Z ------------
2026-02-21T10:15:32.3834938Z (4096, 3584)
2026-02-21T10:15:32.3836891Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T10:15:33.9572655Z INFO:tritonbench.utils.triton_op:Took 3.30ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:15:35.6457408Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:15:37.2793215Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:15:37.2793553Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:15:37.2793840Z               'dtype': 'torch.float32',
2026-02-21T10:15:37.2794581Z               'shape': (4096, 3584),
2026-02-21T10:15:37.2794854Z               'stride': (3584, 1)},
2026-02-21T10:15:37.2795128Z             (3584,),
2026-02-21T10:15:37.2795357Z             { 'device': 'cuda:0',
2026-02-21T10:15:37.2795612Z               'dtype': 'torch.float32',
2026-02-21T10:15:37.2795891Z               'shape': (3584,),
2026-02-21T10:15:37.2796149Z               'stride': (1,)},
2026-02-21T10:15:37.2796378Z             { 'device': 'cuda:0',
2026-02-21T10:15:37.2796635Z               'dtype': 'torch.float32',
2026-02-21T10:15:37.2796898Z               'shape': (3584,),
2026-02-21T10:15:37.2797127Z               'stride': (1,)},
2026-02-21T10:15:37.2797342Z             1e-05),
2026-02-21T10:15:37.2797533Z   'kwargs': {}}
2026-02-21T10:15:37.2831082Z INFO:tritonbench.utils.triton_op:Took 4.17ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:15:37.2951881Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:15:37.2952866Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:15:37.2953506Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:15:37.2953882Z While processing:
2026-02-21T10:15:37.2954520Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:15:37.2954985Z     if bias is not None:
2026-02-21T10:15:37.2955209Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:15:37.2955345Z 
2026-02-21T10:15:37.4497980Z [0s] Autotune random seed: 2141537047
2026-02-21T10:15:37.4841950Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:16:11.6785957Z [34s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:16:11.9617406Z [34s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:16:11.9638205Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T10:16:18.2364642Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.0 configs/s
2026-02-21T10:16:18.2377760Z [40s] Adaptive compile timeout: 30s (90% percentile=4.8s, bounds=[30.0s, 30s])
2026-02-21T10:16:19.2181453Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1002.2 configs/s
2026-02-21T10:16:19.3134741Z [41s] Initial random population of 100, 5 starting points: 
2026-02-21T10:16:19.3137141Z error=10
2026-02-21T10:16:19.3137391Z timeout=2
2026-02-21T10:16:19.3137576Z ok=88
2026-02-21T10:16:19.3137770Z min=0.0423
2026-02-21T10:16:19.3137940Z mid=0.2499
2026-02-21T10:16:19.3138109Z max=10.6429
2026-02-21T10:16:19.3138304Z best={'block_sizes': [1],
2026-02-21T10:16:19.3138753Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:16:19.3139292Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:16:19.3139723Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:16:19.3140058Z  'num_stages': 1,
2026-02-21T10:16:19.3140255Z  'num_warps': 4,
2026-02-21T10:16:19.3140459Z  'pid_type': 'flat',
2026-02-21T10:16:19.3140688Z  'range_flattens': [None],
2026-02-21T10:16:19.3140933Z  'range_multi_buffers': [None],
2026-02-21T10:16:19.3141178Z  'range_num_stages': [0],
2026-02-21T10:16:19.3141413Z  'range_unroll_factors': [0],
2026-02-21T10:16:19.3141669Z  'range_warp_specializes': [],
2026-02-21T10:16:19.3141918Z  'reduction_loops': [None]}
2026-02-21T10:16:19.3157811Z [41s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:16:20.6106184Z [43s] Generation 1 starting: 80 neighbors, 5 active search path(s)
2026-02-21T10:16:39.2936090Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 1.4 configs/s
2026-02-21T10:16:44.3187660Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 16.5 configs/s
2026-02-21T10:16:52.9932736Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.5         
2026-02-21T10:16:52.9936018Z                                                                   configs/s     
2026-02-21T10:16:53.5974317Z [76s] Generation 1 complete: 
2026-02-21T10:16:53.5974695Z error=1
2026-02-21T10:16:53.5974874Z ok=84
2026-02-21T10:16:53.5975047Z min=0.0428
2026-02-21T10:16:53.5975218Z mid=0.0574
2026-02-21T10:16:53.5975392Z max=0.2934
2026-02-21T10:16:53.5975595Z best={'block_sizes': [1],
2026-02-21T10:16:53.5976045Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:16:53.5976613Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:16:53.5977022Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:16:53.5977419Z  'num_stages': 1,
2026-02-21T10:16:53.5977656Z  'num_warps': 16,
2026-02-21T10:16:53.5977891Z  'pid_type': 'flat',
2026-02-21T10:16:53.5978095Z  'range_flattens': [None],
2026-02-21T10:16:53.5978330Z  'range_multi_buffers': [None],
2026-02-21T10:16:53.5978564Z  'range_num_stages': [0],
2026-02-21T10:16:53.5978789Z  'range_unroll_factors': [0],
2026-02-21T10:16:53.5979029Z  'range_warp_specializes': [],
2026-02-21T10:16:53.5979303Z  'reduction_loops': [None]}
2026-02-21T10:16:53.5998700Z [76s] Fitting surrogate: 185 points, 185 targets
2026-02-21T10:16:55.2276849Z [77s] Generation 2 starting: 68 neighbors, 5 active search path(s)
2026-02-21T10:17:02.3294509Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69/69 4.9 configs/s
2026-02-21T10:17:06.5238792Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 69/69 16.6 configs/s
2026-02-21T10:17:15.3524386Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 114.6         
2026-02-21T10:17:15.3524921Z                                                                   configs/s     
2026-02-21T10:17:15.9696886Z [98s] Generation 2 complete: 
2026-02-21T10:17:15.9697120Z ok=73
2026-02-21T10:17:15.9697279Z min=0.0424
2026-02-21T10:17:15.9697436Z mid=0.0497
2026-02-21T10:17:15.9697590Z max=0.3079
2026-02-21T10:17:15.9697752Z best={'block_sizes': [1],
2026-02-21T10:17:15.9698596Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:17:15.9699144Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:17:15.9699559Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T10:17:15.9699890Z  'num_stages': 1,
2026-02-21T10:17:15.9700062Z  'num_warps': 4,
2026-02-21T10:17:15.9700242Z  'pid_type': 'flat',
2026-02-21T10:17:15.9700429Z  'range_flattens': [None],
2026-02-21T10:17:15.9700643Z  'range_multi_buffers': [None],
2026-02-21T10:17:15.9700872Z  'range_num_stages': [0],
2026-02-21T10:17:15.9701083Z  'range_unroll_factors': [0],
2026-02-21T10:17:15.9701304Z  'range_warp_specializes': [],
2026-02-21T10:17:15.9701529Z  'reduction_loops': [None]}
2026-02-21T10:17:15.9728038Z [98s] Fitting surrogate: 258 points, 258 targets
2026-02-21T10:17:16.7901930Z [99s] Generation 3 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:17:21.1688728Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 12.4 configs/s
2026-02-21T10:17:24.1471515Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 17.0 configs/s
2026-02-21T10:17:31.9240425Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 138.4         
2026-02-21T10:17:31.9240911Z                                                                   configs/s     
2026-02-21T10:17:32.4414929Z [114s] Generation 3 complete: 
2026-02-21T10:17:32.4415466Z ok=54
2026-02-21T10:17:32.4415731Z min=0.0425
2026-02-21T10:17:32.4415910Z mid=0.0456
2026-02-21T10:17:32.4416077Z max=0.0611
2026-02-21T10:17:32.4416253Z best={'block_sizes': [1],
2026-02-21T10:17:32.4416698Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:17:32.4417266Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:17:32.4417715Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'last'],
2026-02-21T10:17:32.4418048Z  'num_stages': 1,
2026-02-21T10:17:32.4418242Z  'num_warps': 16,
2026-02-21T10:17:32.4418451Z  'pid_type': 'flat',
2026-02-21T10:17:32.4420718Z  'range_flattens': [None],
2026-02-21T10:17:32.4420964Z  'range_multi_buffers': [None],
2026-02-21T10:17:32.4421198Z  'range_num_stages': [0],
2026-02-21T10:17:32.4421790Z  'range_unroll_factors': [0],
2026-02-21T10:17:32.4422036Z  'range_warp_specializes': [],
2026-02-21T10:17:32.4422277Z  'reduction_loops': [None]}
2026-02-21T10:17:32.4438900Z [114s] Fitting surrogate: 312 points, 312 targets
2026-02-21T10:17:33.2067145Z [115s] Generation 4 starting: 45 neighbors, 5 active search path(s)
2026-02-21T10:17:37.3879856Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 7.2 configs/s
2026-02-21T10:17:40.2715285Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.9 configs/s
2026-02-21T10:17:46.6041768Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 159.6         
2026-02-21T10:17:46.6042294Z                                                                   configs/s     
2026-02-21T10:17:47.0582163Z [129s] Generation 4 complete: 
2026-02-21T10:17:47.0582445Z ok=50
2026-02-21T10:17:47.0582616Z min=0.0426
2026-02-21T10:17:47.0582781Z mid=0.0442
2026-02-21T10:17:47.0582946Z max=0.0732
2026-02-21T10:17:47.0583143Z best={'block_sizes': [2],
2026-02-21T10:17:47.0583583Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:17:47.0584488Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:17:47.0585056Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'last'],
2026-02-21T10:17:47.0585470Z  'num_stages': 2,
2026-02-21T10:17:47.0585698Z  'num_warps': 8,
2026-02-21T10:17:47.0585903Z  'pid_type': 'flat',
2026-02-21T10:17:47.0586121Z  'range_flattens': [None],
2026-02-21T10:17:47.0586378Z  'range_multi_buffers': [None],
2026-02-21T10:17:47.0586632Z  'range_num_stages': [0],
2026-02-21T10:17:47.0586872Z  'range_unroll_factors': [0],
2026-02-21T10:17:47.0587120Z  'range_warp_specializes': [],
2026-02-21T10:17:47.0587384Z  'reduction_loops': [None]}
2026-02-21T10:17:47.0610454Z [129s] Fitting surrogate: 362 points, 362 targets
2026-02-21T10:17:47.8618673Z [130s] Generation 5 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:17:52.3262751Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 40.4 configs/s
2026-02-21T10:17:55.3013657Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 17.1 configs/s
2026-02-21T10:18:02.6189134Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 138.2         
2026-02-21T10:18:02.6189639Z                                                                   configs/s     
2026-02-21T10:18:03.1390417Z [145s] Generation 5 complete: 
2026-02-21T10:18:03.1390656Z ok=55
2026-02-21T10:18:03.1390817Z min=0.0459
2026-02-21T10:18:03.1390983Z mid=0.0467
2026-02-21T10:18:03.1391140Z max=0.0689
2026-02-21T10:18:03.1391304Z best={'block_sizes': [2],
2026-02-21T10:18:03.1391734Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:18:03.1392266Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:18:03.1392674Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:18:03.1392986Z  'num_stages': 2,
2026-02-21T10:18:03.1393168Z  'num_warps': 16,
2026-02-21T10:18:03.1393349Z  'pid_type': 'flat',
2026-02-21T10:18:03.1393541Z  'range_flattens': [None],
2026-02-21T10:18:03.1393753Z  'range_multi_buffers': [None],
2026-02-21T10:18:03.1394305Z  'range_num_stages': [0],
2026-02-21T10:18:03.1394526Z  'range_unroll_factors': [0],
2026-02-21T10:18:03.1394742Z  'range_warp_specializes': [],
2026-02-21T10:18:03.1394964Z  'reduction_loops': [None]}
2026-02-21T10:18:03.1422144Z [145s] Fitting surrogate: 417 points, 417 targets
2026-02-21T10:18:03.9401964Z [146s] Generation 6 starting: 46 neighbors, 5 active search path(s)
2026-02-21T10:18:08.6720260Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 9.8 configs/s
2026-02-21T10:18:11.7351581Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 16.9 configs/s
2026-02-21T10:18:18.9372474Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.2         
2026-02-21T10:18:18.9373705Z                                                                   configs/s     
2026-02-21T10:18:19.4276222Z [161s] Generation 6 complete: 
2026-02-21T10:18:19.4276705Z ok=52
2026-02-21T10:18:19.4276991Z min=0.0427
2026-02-21T10:18:19.4277295Z mid=0.0448
2026-02-21T10:18:19.4277558Z max=0.2178
2026-02-21T10:18:19.4277858Z best={'block_sizes': [2],
2026-02-21T10:18:19.4278565Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:18:19.4279506Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:18:19.4280214Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:18:19.4280757Z  'num_stages': 2,
2026-02-21T10:18:19.4281094Z  'num_warps': 16,
2026-02-21T10:18:19.4281972Z  'pid_type': 'flat',
2026-02-21T10:18:19.4282356Z  'range_flattens': [None],
2026-02-21T10:18:19.4282725Z  'range_multi_buffers': [None],
2026-02-21T10:18:19.4283123Z  'range_num_stages': [0],
2026-02-21T10:18:19.4283525Z  'range_unroll_factors': [0],
2026-02-21T10:18:19.4283927Z  'range_warp_specializes': [],
2026-02-21T10:18:19.4284809Z  'reduction_loops': [None]}
2026-02-21T10:18:19.4306522Z [161s] Fitting surrogate: 469 points, 469 targets
2026-02-21T10:18:20.2965510Z [162s] Generation 7 starting: 52 neighbors, 5 active search path(s)
2026-02-21T10:18:24.8058891Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 16.0 configs/s
2026-02-21T10:18:27.9798734Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 16.9 configs/s
2026-02-21T10:18:35.0038247Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 144.0         
2026-02-21T10:18:35.0038785Z                                                                   configs/s     
2026-02-21T10:18:35.5142534Z [178s] Generation 7 complete: 
2026-02-21T10:18:35.5142793Z ok=58
2026-02-21T10:18:35.5142974Z min=0.0425
2026-02-21T10:18:35.5143147Z mid=0.0433
2026-02-21T10:18:35.5143309Z max=0.1074
2026-02-21T10:18:35.5143506Z best={'block_sizes': [2],
2026-02-21T10:18:35.5143947Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:18:35.5144694Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:18:35.5145077Z               'tensor_descriptor'],
2026-02-21T10:18:35.5145419Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', ''],
2026-02-21T10:18:35.5145767Z  'num_stages': 6,
2026-02-21T10:18:35.5145955Z  'num_warps': 8,
2026-02-21T10:18:35.5146149Z  'pid_type': 'flat',
2026-02-21T10:18:35.5146353Z  'range_flattens': [None],
2026-02-21T10:18:35.5146583Z  'range_multi_buffers': [None],
2026-02-21T10:18:35.5146826Z  'range_num_stages': [0],
2026-02-21T10:18:35.5147062Z  'range_unroll_factors': [0],
2026-02-21T10:18:35.5147312Z  'range_warp_specializes': [],
2026-02-21T10:18:35.5147561Z  'reduction_loops': [None]}
2026-02-21T10:18:35.5184156Z [178s] Fitting surrogate: 527 points, 527 targets
2026-02-21T10:18:36.3444301Z [178s] Generation 8 starting: 47 neighbors, 5 active search path(s)
2026-02-21T10:18:40.4920077Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 15.3 configs/s
2026-02-21T10:18:43.3130651Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 17.3 configs/s
2026-02-21T10:18:50.5642742Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.4         
2026-02-21T10:18:50.5643293Z                                                                   configs/s     
2026-02-21T10:18:51.0454544Z [193s] Generation 8 complete: 
2026-02-21T10:18:51.0455008Z ok=52
2026-02-21T10:18:51.0455313Z min=0.0448
2026-02-21T10:18:51.0455591Z mid=0.0455
2026-02-21T10:18:51.0455855Z max=0.2933
2026-02-21T10:18:51.0456136Z best={'block_sizes': [1],
2026-02-21T10:18:51.0456907Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:18:51.0457945Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:18:51.0459452Z  'load_eviction_policies': ['', '', '', 'last', '', 'last', 'first', ''],
2026-02-21T10:18:51.0460180Z  'num_stages': 1,
2026-02-21T10:18:51.0460436Z  'num_warps': 4,
2026-02-21T10:18:51.0460629Z  'pid_type': 'flat',
2026-02-21T10:18:51.0460829Z  'range_flattens': [None],
2026-02-21T10:18:51.0461059Z  'range_multi_buffers': [None],
2026-02-21T10:18:51.0461303Z  'range_num_stages': [0],
2026-02-21T10:18:51.0461527Z  'range_unroll_factors': [0],
2026-02-21T10:18:51.0461762Z  'range_warp_specializes': [],
2026-02-21T10:18:51.0462000Z  'reduction_loops': [None]}
2026-02-21T10:18:51.0488044Z [193s] Fitting surrogate: 579 points, 579 targets
2026-02-21T10:18:51.8611212Z [194s] Generation 9 starting: 47 neighbors, 5 active search path(s)
2026-02-21T10:18:56.4735875Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 11.0 configs/s
2026-02-21T10:18:59.5952369Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 16.9 configs/s
2026-02-21T10:19:06.3132870Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.6         
2026-02-21T10:19:06.3133379Z                                                                   configs/s     
2026-02-21T10:19:06.7923606Z [209s] Generation 9 complete: 
2026-02-21T10:19:06.7923871Z ok=53
2026-02-21T10:19:06.7924183Z min=0.0426
2026-02-21T10:19:06.7924361Z mid=0.0446
2026-02-21T10:19:06.7924527Z max=0.2934
2026-02-21T10:19:06.7924713Z best={'block_sizes': [1],
2026-02-21T10:19:06.7925115Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:19:06.7925727Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:19:06.7926200Z               'pointer', 'tensor_descriptor'],
2026-02-21T10:19:06.7926609Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', '', ''],
2026-02-21T10:19:06.7926986Z  'num_stages': 2,
2026-02-21T10:19:06.7927171Z  'num_warps': 8,
2026-02-21T10:19:06.7927362Z  'pid_type': 'flat',
2026-02-21T10:19:06.7927580Z  'range_flattens': [None],
2026-02-21T10:19:06.7927810Z  'range_multi_buffers': [None],
2026-02-21T10:19:06.7928048Z  'range_num_stages': [0],
2026-02-21T10:19:06.7928277Z  'range_unroll_factors': [0],
2026-02-21T10:19:06.7928514Z  'range_warp_specializes': [],
2026-02-21T10:19:06.7928743Z  'reduction_loops': [None]}
2026-02-21T10:19:06.7964576Z [209s] Fitting surrogate: 632 points, 632 targets
2026-02-21T10:19:07.6687707Z [210s] Generation 10 starting: 51 neighbors, 5 active search path(s)
2026-02-21T10:19:12.0627784Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 17.5 configs/s
2026-02-21T10:19:15.1900184Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 53/53 17.2 configs/s
2026-02-21T10:19:22.8665742Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 140.6         
2026-02-21T10:19:22.8666220Z                                                                   configs/s     
2026-02-21T10:19:23.3817242Z [225s] Generation 10 complete: 
2026-02-21T10:19:23.3818228Z ok=56
2026-02-21T10:19:23.3818530Z min=0.0424
2026-02-21T10:19:23.3818808Z mid=0.0435
2026-02-21T10:19:23.3819099Z max=0.1036
2026-02-21T10:19:23.3819395Z best={'block_sizes': [1],
2026-02-21T10:19:23.3820103Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:19:23.3821036Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:19:23.3821847Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'last'],
2026-02-21T10:19:23.3822504Z  'num_stages': 3,
2026-02-21T10:19:23.3822719Z  'num_warps': 4,
2026-02-21T10:19:23.3822910Z  'pid_type': 'flat',
2026-02-21T10:19:23.3823112Z  'range_flattens': [None],
2026-02-21T10:19:23.3823343Z  'range_multi_buffers': [None],
2026-02-21T10:19:23.3823584Z  'range_num_stages': [0],
2026-02-21T10:19:23.3823811Z  'range_unroll_factors': [0],
2026-02-21T10:19:23.3824341Z  'range_warp_specializes': [],
2026-02-21T10:19:23.3824592Z  'reduction_loops': [None]}
2026-02-21T10:19:23.3858933Z [225s] Fitting surrogate: 688 points, 688 targets
2026-02-21T10:19:24.2345660Z [226s] Generation 11 starting: 47 neighbors, 5 active search path(s)
2026-02-21T10:19:28.1341880Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 43.6 configs/s
2026-02-21T10:19:30.9436288Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 48/48 17.4 configs/s
2026-02-21T10:19:37.8465414Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 146.5         
2026-02-21T10:19:37.8465932Z                                                                   configs/s     
2026-02-21T10:19:38.3346412Z [240s] Generation 11 complete: 
2026-02-21T10:19:38.3346673Z ok=52
2026-02-21T10:19:38.3346838Z min=0.0460
2026-02-21T10:19:38.3347008Z mid=0.0464
2026-02-21T10:19:38.3347595Z max=0.0691
2026-02-21T10:19:38.3347788Z best={'block_sizes': [2],
2026-02-21T10:19:38.3348197Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:19:38.3348826Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:19:38.3349298Z               'pointer', 'tensor_descriptor'],
2026-02-21T10:19:38.3349646Z  'load_eviction_policies': ['', '', '', '', '', 'last', '', ''],
2026-02-21T10:19:38.3349982Z  'num_stages': 6,
2026-02-21T10:19:38.3350171Z  'num_warps': 8,
2026-02-21T10:19:38.3350356Z  'pid_type': 'flat',
2026-02-21T10:19:38.3350562Z  'range_flattens': [None],
2026-02-21T10:19:38.3350785Z  'range_multi_buffers': [None],
2026-02-21T10:19:38.3351025Z  'range_num_stages': [0],
2026-02-21T10:19:38.3351244Z  'range_unroll_factors': [0],
2026-02-21T10:19:38.3351485Z  'range_warp_specializes': [],
2026-02-21T10:19:38.3351717Z  'reduction_loops': [None]}
2026-02-21T10:19:38.3393954Z [240s] Fitting surrogate: 740 points, 740 targets
2026-02-21T10:19:39.1865993Z [241s] Generation 12 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:19:44.0101193Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 7.0 configs/s
2026-02-21T10:19:47.1630301Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 53/53 17.0 configs/s
2026-02-21T10:19:54.3839722Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 151.7         
2026-02-21T10:19:54.3840258Z                                                                   configs/s     
2026-02-21T10:19:54.8638375Z [257s] Generation 12 complete: 
2026-02-21T10:19:54.8638838Z ok=54
2026-02-21T10:19:54.8639127Z min=0.0422
2026-02-21T10:19:54.8639429Z mid=0.0429
2026-02-21T10:19:54.8639712Z max=0.2932
2026-02-21T10:19:54.8640015Z best={'block_sizes': [1],
2026-02-21T10:19:54.8640785Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:19:54.8641861Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:19:54.8642744Z  'load_eviction_policies': ['', '', '', 'first', '', 'last', 'last', ''],
2026-02-21T10:19:54.8643968Z  'num_stages': 5,
2026-02-21T10:19:54.8644474Z  'num_warps': 16,
2026-02-21T10:19:54.8644659Z  'pid_type': 'flat',
2026-02-21T10:19:54.8644844Z  'range_flattens': [None],
2026-02-21T10:19:54.8645058Z  'range_multi_buffers': [None],
2026-02-21T10:19:54.8645267Z  'range_num_stages': [0],
2026-02-21T10:19:54.8645463Z  'range_unroll_factors': [0],
2026-02-21T10:19:54.8645672Z  'range_warp_specializes': [],
2026-02-21T10:19:54.8645879Z  'reduction_loops': [None]}
2026-02-21T10:19:54.8680654Z [257s] Fitting surrogate: 794 points, 794 targets
2026-02-21T10:19:55.7040566Z [258s] Generation 13 starting: 46 neighbors, 5 active search path(s)
2026-02-21T10:19:59.5078851Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 26.3 configs/s
2026-02-21T10:20:02.2039650Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 46/46 17.4 configs/s
2026-02-21T10:20:09.0942994Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 146.8         
2026-02-21T10:20:09.0943458Z                                                                   configs/s     
2026-02-21T10:20:09.6061799Z [272s] Generation 13 complete: 
2026-02-21T10:20:09.6062056Z ok=51
2026-02-21T10:20:09.6062219Z min=0.0457
2026-02-21T10:20:09.6062392Z mid=0.0461
2026-02-21T10:20:09.6062551Z max=0.0534
2026-02-21T10:20:09.6062730Z best={'block_sizes': [1],
2026-02-21T10:20:09.6063113Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:20:09.6063707Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:20:09.6064875Z               'tensor_descriptor'],
2026-02-21T10:20:09.6065428Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', 'last'],
2026-02-21T10:20:09.6066006Z  'num_stages': 2,
2026-02-21T10:20:09.6066334Z  'num_warps': 4,
2026-02-21T10:20:09.6066648Z  'pid_type': 'flat',
2026-02-21T10:20:09.6066993Z  'range_flattens': [None],
2026-02-21T10:20:09.6067391Z  'range_multi_buffers': [None],
2026-02-21T10:20:09.6067787Z  'range_num_stages': [0],
2026-02-21T10:20:09.6068174Z  'range_unroll_factors': [0],
2026-02-21T10:20:09.6068572Z  'range_warp_specializes': [],
2026-02-21T10:20:09.6068945Z  'reduction_loops': [None]}
2026-02-21T10:20:09.6112222Z [272s] Fitting surrogate: 845 points, 845 targets
2026-02-21T10:20:10.4665685Z [272s] Generation 14 starting: 47 neighbors, 5 active search path(s)
2026-02-21T10:20:15.8989517Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 11.9 configs/s
2026-02-21T10:20:19.6552037Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 52/52 14.0 configs/s
2026-02-21T10:20:26.9836495Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 148.8         
2026-02-21T10:20:26.9836983Z                                                                   configs/s     
2026-02-21T10:20:27.4717263Z [289s] Generation 14 complete: 
2026-02-21T10:20:27.4717706Z ok=53
2026-02-21T10:20:27.4717973Z min=0.0423
2026-02-21T10:20:27.4718228Z mid=0.0434
2026-02-21T10:20:27.4718501Z max=0.0718
2026-02-21T10:20:27.4718773Z best={'block_sizes': [1],
2026-02-21T10:20:27.4719464Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:20:27.4720457Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:20:27.4721155Z               'tensor_descriptor'],
2026-02-21T10:20:27.4734874Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', '', ''],
2026-02-21T10:20:27.4735275Z  'num_stages': 2,
2026-02-21T10:20:27.4735465Z  'num_warps': 4,
2026-02-21T10:20:27.4735669Z  'pid_type': 'flat',
2026-02-21T10:20:27.4735883Z  'range_flattens': [None],
2026-02-21T10:20:27.4736108Z  'range_multi_buffers': [None],
2026-02-21T10:20:27.4736329Z  'range_num_stages': [0],
2026-02-21T10:20:27.4736559Z  'range_unroll_factors': [0],
2026-02-21T10:20:27.4736788Z  'range_warp_specializes': [],
2026-02-21T10:20:27.4737039Z  'reduction_loops': [None]}
2026-02-21T10:20:27.4766994Z [289s] Fitting surrogate: 898 points, 898 targets
2026-02-21T10:20:28.3782965Z [290s] Generation 15 starting: 53 neighbors, 5 active search path(s)
2026-02-21T10:20:33.1979806Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 9.7 configs/s
2026-02-21T10:20:36.3001829Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 53/53 17.3 configs/s
2026-02-21T10:20:43.8541673Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 133.8         
2026-02-21T10:20:43.8542181Z                                                                   configs/s     
2026-02-21T10:20:44.3868653Z [306s] Generation 15 complete: 
2026-02-21T10:20:44.3868984Z ok=58
2026-02-21T10:20:44.3869204Z min=0.0459
2026-02-21T10:20:44.3869404Z mid=0.0464
2026-02-21T10:20:44.3869570Z max=0.0898
2026-02-21T10:20:44.3870276Z best={'block_sizes': [1],
2026-02-21T10:20:44.3870742Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:20:44.3871412Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:20:44.3871931Z               'tensor_descriptor'],
2026-02-21T10:20:44.3872308Z  'load_eviction_policies': ['', '', '', 'first', '', 'last', '', 'last'],
2026-02-21T10:20:44.3872687Z  'num_stages': 2,
2026-02-21T10:20:44.3872890Z  'num_warps': 4,
2026-02-21T10:20:44.3873094Z  'pid_type': 'flat',
2026-02-21T10:20:44.3873322Z  'range_flattens': [None],
2026-02-21T10:20:44.3873578Z  'range_multi_buffers': [None],
2026-02-21T10:20:44.3873824Z  'range_num_stages': [0],
2026-02-21T10:20:44.3874428Z  'range_unroll_factors': [0],
2026-02-21T10:20:44.3874697Z  'range_warp_specializes': [],
2026-02-21T10:20:44.3874957Z  'reduction_loops': [None]}
2026-02-21T10:20:44.3922637Z [306s] Fitting surrogate: 956 points, 956 targets
2026-02-21T10:20:45.0979368Z [307s] Generation 16 starting: 36 neighbors, 4 active search path(s)
2026-02-21T10:20:48.5611778Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 43.6 configs/s
2026-02-21T10:20:50.9360987Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 17.2 configs/s
2026-02-21T10:20:56.3386028Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 207.0         
2026-02-21T10:20:56.3386533Z                                                                   configs/s     
2026-02-21T10:20:56.7036062Z [319s] Generation 16 complete: 
2026-02-21T10:20:56.7036352Z ok=41
2026-02-21T10:20:56.7036552Z min=0.0425
2026-02-21T10:20:56.7036743Z mid=0.0428
2026-02-21T10:20:56.7036927Z max=0.0717
2026-02-21T10:20:56.7037115Z best={'block_sizes': [1],
2026-02-21T10:20:56.7037545Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:20:56.7038217Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:20:56.7038714Z               'tensor_descriptor'],
2026-02-21T10:20:56.7039105Z  'load_eviction_policies': ['', '', '', 'first', '', 'last', '', 'last'],
2026-02-21T10:20:56.7039486Z  'num_stages': 2,
2026-02-21T10:20:56.7039692Z  'num_warps': 4,
2026-02-21T10:20:56.7039891Z  'pid_type': 'flat',
2026-02-21T10:20:56.7040112Z  'range_flattens': [None],
2026-02-21T10:20:56.7040343Z  'range_multi_buffers': [None],
2026-02-21T10:20:56.7040588Z  'range_num_stages': [0],
2026-02-21T10:20:56.7040815Z  'range_unroll_factors': [0],
2026-02-21T10:20:56.7041086Z  'range_warp_specializes': [],
2026-02-21T10:20:56.7041331Z  'reduction_loops': [None]}
2026-02-21T10:20:56.7084418Z [319s] Fitting surrogate: 997 points, 997 targets
2026-02-21T10:20:57.4516194Z [319s] Generation 17 starting: 41 neighbors, 4 active search path(s)
2026-02-21T10:21:01.6600872Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 34.3 configs/s
2026-02-21T10:21:04.2750288Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 42/42 16.3 configs/s
2026-02-21T10:21:10.4666561Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 163.4         
2026-02-21T10:21:10.4667785Z                                                                   configs/s     
2026-02-21T10:21:10.9275086Z [333s] Generation 17 complete: 
2026-02-21T10:21:10.9278941Z ok=46
2026-02-21T10:21:10.9279381Z min=0.0459
2026-02-21T10:21:10.9279726Z mid=0.0463
2026-02-21T10:21:10.9280013Z max=0.0538
2026-02-21T10:21:10.9280333Z best={'block_sizes': [1],
2026-02-21T10:21:10.9281135Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:21:10.9282159Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:21:10.9283005Z  'load_eviction_policies': ['', 'first', '', '', '', 'last', 'last', ''],
2026-02-21T10:21:10.9283601Z  'num_stages': 8,
2026-02-21T10:21:10.9283934Z  'num_warps': 16,
2026-02-21T10:21:10.9285670Z  'pid_type': 'flat',
2026-02-21T10:21:10.9286085Z  'range_flattens': [None],
2026-02-21T10:21:10.9286480Z  'range_multi_buffers': [None],
2026-02-21T10:21:10.9286913Z  'range_num_stages': [0],
2026-02-21T10:21:10.9287270Z  'range_unroll_factors': [0],
2026-02-21T10:21:10.9287483Z  'range_warp_specializes': [],
2026-02-21T10:21:10.9287698Z  'reduction_loops': [None]}
2026-02-21T10:21:10.9336074Z [333s] Fitting surrogate: 1043 points, 1043 targets
2026-02-21T10:21:11.5270060Z [334s] Generation 18 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:21:14.7039338Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 4.4 configs/s
2026-02-21T10:21:16.6792472Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 17.1 configs/s
2026-02-21T10:21:20.8320975Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 243.3         
2026-02-21T10:21:20.8321744Z                                                                   configs/s     
2026-02-21T10:21:21.1396242Z [343s] Generation 18 complete: 
2026-02-21T10:21:21.1396713Z ok=34
2026-02-21T10:21:21.1397011Z min=0.0429
2026-02-21T10:21:21.1397295Z mid=0.0455
2026-02-21T10:21:21.1397570Z max=0.0761
2026-02-21T10:21:21.1397884Z best={'block_sizes': [1],
2026-02-21T10:21:21.1398534Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:21:21.1399516Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:21:21.1400253Z               'tensor_descriptor'],
2026-02-21T10:21:21.1400876Z  'load_eviction_policies': ['', 'last', '', '', 'first', '', 'first', ''],
2026-02-21T10:21:21.1401466Z  'num_stages': 2,
2026-02-21T10:21:21.1401785Z  'num_warps': 16,
2026-02-21T10:21:21.1402093Z  'pid_type': 'flat',
2026-02-21T10:21:21.1402442Z  'range_flattens': [None],
2026-02-21T10:21:21.1402816Z  'range_multi_buffers': [None],
2026-02-21T10:21:21.1403208Z  'range_num_stages': [0],
2026-02-21T10:21:21.1403597Z  'range_unroll_factors': [0],
2026-02-21T10:21:21.1404418Z  'range_warp_specializes': [],
2026-02-21T10:21:21.1404639Z  'reduction_loops': [None]}
2026-02-21T10:21:21.1454737Z [343s] Fitting surrogate: 1077 points, 1077 targets
2026-02-21T10:21:21.7295719Z [344s] Generation 19 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:21:25.3092966Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 15.6 configs/s
2026-02-21T10:21:27.2654177Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 17.3 configs/s
2026-02-21T10:21:31.8523202Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 252.4         
2026-02-21T10:21:31.8523730Z                                                                   configs/s     
2026-02-21T10:21:32.1513270Z [354s] Generation 19 complete: 
2026-02-21T10:21:32.1513601Z ok=34
2026-02-21T10:21:32.1513784Z min=0.0425
2026-02-21T10:21:32.1514364Z mid=0.0459
2026-02-21T10:21:32.1514558Z max=0.0880
2026-02-21T10:21:32.1514752Z best={'block_sizes': [1],
2026-02-21T10:21:32.1516043Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:21:32.1516681Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:21:32.1517470Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:21:32.1517961Z  'load_eviction_policies': ['', '', '', '', '', 'last', '', ''],
2026-02-21T10:21:32.1518298Z  'num_stages': 5,
2026-02-21T10:21:32.1518497Z  'num_warps': 16,
2026-02-21T10:21:32.1518699Z  'pid_type': 'flat',
2026-02-21T10:21:32.1518910Z  'range_flattens': [None],
2026-02-21T10:21:32.1519151Z  'range_multi_buffers': [None],
2026-02-21T10:21:32.1519391Z  'range_num_stages': [0],
2026-02-21T10:21:32.1519623Z  'range_unroll_factors': [0],
2026-02-21T10:21:32.1519863Z  'range_warp_specializes': [],
2026-02-21T10:21:32.1520109Z  'reduction_loops': [None]}
2026-02-21T10:21:32.1565193Z [354s] Fitting surrogate: 1111 points, 1111 targets
2026-02-21T10:21:32.7157390Z [355s] Generation 20 starting: 27 neighbors, 3 active search path(s)
2026-02-21T10:21:35.1751175Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 29.4 configs/s
2026-02-21T10:21:36.8260895Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 28/28 17.4 configs/s
2026-02-21T10:21:40.8198480Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 253.1         
2026-02-21T10:21:40.8199012Z                                                                   configs/s     
2026-02-21T10:21:41.1165073Z [363s] Generation 20 complete: 
2026-02-21T10:21:41.1165301Z ok=30
2026-02-21T10:21:41.1165458Z min=0.0426
2026-02-21T10:21:41.1165605Z mid=0.0438
2026-02-21T10:21:41.1165776Z max=0.0565
2026-02-21T10:21:41.1165934Z best={'block_sizes': [2],
2026-02-21T10:21:41.1166292Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:21:41.1166845Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:21:41.1167242Z               'tensor_descriptor'],
2026-02-21T10:21:41.1167573Z  'load_eviction_policies': ['', 'last', '', '', 'last', '', 'first', ''],
2026-02-21T10:21:41.1167977Z  'num_stages': 2,
2026-02-21T10:21:41.1168244Z  'num_warps': 8,
2026-02-21T10:21:41.1168438Z  'pid_type': 'flat',
2026-02-21T10:21:41.1168649Z  'range_flattens': [None],
2026-02-21T10:21:41.1168877Z  'range_multi_buffers': [None],
2026-02-21T10:21:41.1169122Z  'range_num_stages': [0],
2026-02-21T10:21:41.1169347Z  'range_unroll_factors': [0],
2026-02-21T10:21:41.1169597Z  'range_warp_specializes': [],
2026-02-21T10:21:41.1169902Z  'reduction_loops': [None]}
2026-02-21T10:21:41.1223704Z [363s] Fitting surrogate: 1141 points, 1141 targets
2026-02-21T10:21:41.2896470Z [363s] Autotuning complete in 363.8s after searching 1082 configs.
2026-02-21T10:21:41.2896887Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:21:41.2898966Z     @helion.kernel(config=helion.Config(block_sizes=[2], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', '', 'last', '', 'first', ''], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:21:41.2901594Z 
2026-02-21T10:21:41.2902001Z [363s] Code of selected kernel: /tmp/torchinductor_root/re/cre6y4opwvwcwbdd5vhn5i5g77nrvykr2wh3kf2kwjgyxfxgccgl.py
2026-02-21T10:21:41.3176492Z from __future__ import annotations
2026-02-21T10:21:41.3176854Z 
2026-02-21T10:21:41.3176981Z import torch
2026-02-21T10:21:41.3177273Z import triton
2026-02-21T10:21:41.3177646Z import triton.language as tl
2026-02-21T10:21:41.3178267Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:21:41.3179083Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:21:41.3179377Z 
2026-02-21T10:21:41.3179465Z _BLOCK_SIZE_0 = tl.constexpr(2)
2026-02-21T10:21:41.3179633Z 
2026-02-21T10:21:41.3179714Z @triton.jit
2026-02-21T10:21:41.3180072Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:21:41.3180584Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:21:41.3180897Z     pid_0 = tl.program_id(0)
2026-02-21T10:21:41.3181141Z     offset_0 = pid_0 * _BLOCK_SIZE_0
2026-02-21T10:21:41.3181487Z     indices_0 = (offset_0 + tl.arange(0, _BLOCK_SIZE_0)).to(tl.int32)
2026-02-21T10:21:41.3181879Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:21:41.3182182Z     mask_1 = indices_1 < 3584
2026-02-21T10:21:41.3182484Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:21:41.3182982Z     acc = tl.load(x + (indices_0[:, None] * 3584 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T10:21:41.3183505Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:21:41.3183865Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:21:41.3184453Z     v_0 = 0.00027901785714285713
2026-02-21T10:21:41.3184686Z     v_1 = sum_1 * v_0
2026-02-21T10:21:41.3184976Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:21:41.3185312Z     subscript = v_1[:, None]
2026-02-21T10:21:41.3185546Z     v_2 = acc - subscript
2026-02-21T10:21:41.3185877Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:21:41.3186257Z     v_3 = v_2 * v_2
2026-02-21T10:21:41.3186716Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T10:21:41.3187273Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T10:21:41.3187584Z     v_4 = 0.00027901785714285713
2026-02-21T10:21:41.3187802Z     v_5 = sum_2 * v_4
2026-02-21T10:21:41.3188082Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:21:41.3188353Z     v_6 = v_5 + eps
2026-02-21T10:21:41.3188524Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:21:41.3188811Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:21:41.3189106Z     subscript_1 = v_7[:, None]
2026-02-21T10:21:41.3189298Z     v_8 = v_2 * subscript_1
2026-02-21T10:21:41.3189578Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:21:41.3190040Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T10:21:41.3190389Z     v_9 = load_1[None, :]
2026-02-21T10:21:41.3190565Z     v_10 = v_8 * v_9
2026-02-21T10:21:41.3190764Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:21:41.3191054Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T10:21:41.3191408Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:21:41.3191765Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:21:41.3192028Z     # src[layer_norm.py:75]: )
2026-02-21T10:21:41.3192216Z     v_11 = load_2[None, :]
2026-02-21T10:21:41.3192558Z     v_12 = v_10 + v_11
2026-02-21T10:21:41.3192777Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:21:41.3193179Z     tl.store(out + (indices_0[:, None] * 3584 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T10:21:41.3193567Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:21:41.3193839Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:21:41.3194239Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:21:41.3194490Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:21:41.3194669Z 
2026-02-21T10:21:41.3195127Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:21:41.3195862Z     """
2026-02-21T10:21:41.3196109Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:21:41.3196420Z     Args:
2026-02-21T10:21:41.3196686Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:21:41.3197239Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:21:41.3197751Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:21:41.3198186Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:21:41.3198709Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:21:41.3199094Z     Returns:
2026-02-21T10:21:41.3199304Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:21:41.3199679Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:21:41.3200060Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:21:41.3200411Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:21:41.3200742Z     """
2026-02-21T10:21:41.3200905Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:21:41.3201123Z     m, n = x.size()
2026-02-21T10:21:41.3201455Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:21:41.3201931Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:21:41.3202282Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:21:41.3202658Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:21:41.3203032Z     if bias is not None:
2026-02-21T10:21:41.3203355Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:21:41.3203803Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:21:41.3204313Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:21:41.3204712Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:21:41.3205061Z     # src[layer_norm.py:52]: )
2026-02-21T10:21:41.3205398Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:21:41.3205853Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:21:41.3206246Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:21:41.3206575Z     # src[layer_norm.py:55]: )
2026-02-21T10:21:41.3206904Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:21:41.3207375Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:21:41.3207783Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:21:41.3208175Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:21:41.3208579Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:21:41.3209131Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:21:41.3209518Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:21:41.3209942Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:21:41.3210184Z     _BLOCK_SIZE_0 = 2
2026-02-21T10:21:41.3210357Z     _RDIM_SIZE_1 = 4096
2026-02-21T10:21:41.3210557Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:21:41.3210864Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:21:41.3211163Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:21:41.3211395Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:21:41.3212045Z     _launcher(_helion_layer_norm_fwd, (triton.cdiv(4096, _BLOCK_SIZE_0),), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=8, num_stages=2)
2026-02-21T10:21:41.3212590Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:21:41.3212842Z     return (out, mean, rstd)
2026-02-21T10:21:42.3432969Z WARNING:tritonbench.utils.triton_op:Completed input ID 5:
2026-02-21T10:21:42.3433577Z (M, N)
2026-02-21T10:21:42.3433851Z ------------
2026-02-21T10:21:42.3434459Z (4096, 3584)
2026-02-21T10:21:42.3434621Z 
2026-02-21T10:21:42.3447279Z  20%|██        | 4/20 [20:39<1:25:58, 322.39s/it]WARNING:tritonbench.utils.triton_op:Running input ID 6:
2026-02-21T10:21:42.3447670Z (M, N)
2026-02-21T10:21:42.3447818Z ------------
2026-02-21T10:21:42.3447967Z (4096, 4096)
2026-02-21T10:21:42.3449991Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T10:21:43.8832570Z INFO:tritonbench.utils.triton_op:Took 3.12ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:21:45.2171268Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:21:46.7407824Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:21:46.7408407Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:21:46.7408845Z               'dtype': 'torch.float32',
2026-02-21T10:21:46.7409296Z               'shape': (4096, 4096),
2026-02-21T10:21:46.7409735Z               'stride': (4096, 1)},
2026-02-21T10:21:46.7410257Z             (4096,),
2026-02-21T10:21:46.7410594Z             { 'device': 'cuda:0',
2026-02-21T10:21:46.7410989Z               'dtype': 'torch.float32',
2026-02-21T10:21:46.7411423Z               'shape': (4096,),
2026-02-21T10:21:46.7411809Z               'stride': (1,)},
2026-02-21T10:21:46.7412196Z             { 'device': 'cuda:0',
2026-02-21T10:21:46.7412512Z               'dtype': 'torch.float32',
2026-02-21T10:21:46.7412732Z               'shape': (4096,),
2026-02-21T10:21:46.7412925Z               'stride': (1,)},
2026-02-21T10:21:46.7413127Z             1e-05),
2026-02-21T10:21:46.7413305Z   'kwargs': {}}
2026-02-21T10:21:46.7448795Z INFO:tritonbench.utils.triton_op:Took 4.46ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:21:46.7528732Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:21:46.7530279Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:21:46.7531253Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:21:46.7531850Z While processing:
2026-02-21T10:21:46.7532411Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:21:46.7532785Z     if bias is not None:
2026-02-21T10:21:46.7532966Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:21:46.7533081Z 
2026-02-21T10:21:46.9141082Z [0s] Autotune random seed: 2141537047
2026-02-21T10:21:46.9459791Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:22:21.3023575Z [34s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:22:21.5953263Z [34s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:22:21.5975380Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T10:22:27.4819108Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.1 configs/s
2026-02-21T10:22:27.4831904Z [40s] Adaptive compile timeout: 30s (90% percentile=5.7s, bounds=[30.0s, 30s])
2026-02-21T10:22:28.3597122Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1111.1 configs/s
2026-02-21T10:22:28.4494993Z [41s] Initial random population of 100, 5 starting points: 
2026-02-21T10:22:28.4495589Z error=10
2026-02-21T10:22:28.4495873Z timeout=2
2026-02-21T10:22:28.4496133Z ok=88
2026-02-21T10:22:28.4496405Z min=0.0474
2026-02-21T10:22:28.4496857Z mid=0.2661
2026-02-21T10:22:28.4497229Z max=12.1476
2026-02-21T10:22:28.4497658Z best={'block_sizes': [1],
2026-02-21T10:22:28.4498383Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:22:28.4499244Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:22:28.4499937Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:22:28.4500558Z  'num_stages': 1,
2026-02-21T10:22:28.4500995Z  'num_warps': 4,
2026-02-21T10:22:28.4501458Z  'pid_type': 'flat',
2026-02-21T10:22:28.4501917Z  'range_flattens': [None],
2026-02-21T10:22:28.4502197Z  'range_multi_buffers': [None],
2026-02-21T10:22:28.4502476Z  'range_num_stages': [0],
2026-02-21T10:22:28.4502695Z  'range_unroll_factors': [0],
2026-02-21T10:22:28.4502938Z  'range_warp_specializes': [],
2026-02-21T10:22:28.4503170Z  'reduction_loops': [None]}
2026-02-21T10:22:28.4516737Z [41s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:22:29.7565179Z [42s] Generation 1 starting: 79 neighbors, 5 active search path(s)
2026-02-21T10:22:38.1161135Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 6.1 configs/s
2026-02-21T10:22:43.6589926Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 14.9 configs/s
2026-02-21T10:22:52.0450697Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 120.5         
2026-02-21T10:22:52.0457880Z                                                                   configs/s     
2026-02-21T10:22:52.5971915Z [65s] Generation 1 complete: 
2026-02-21T10:22:52.5972224Z ok=84
2026-02-21T10:22:52.5972403Z min=0.0482
2026-02-21T10:22:52.5972588Z mid=0.0641
2026-02-21T10:22:52.5972774Z max=0.1497
2026-02-21T10:22:52.5972966Z best={'block_sizes': [1],
2026-02-21T10:22:52.5973422Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:22:52.5974356Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:22:52.5974785Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:22:52.5975157Z  'num_stages': 1,
2026-02-21T10:22:52.5975364Z  'num_warps': 4,
2026-02-21T10:22:52.5975559Z  'pid_type': 'flat',
2026-02-21T10:22:52.5975781Z  'range_flattens': [None],
2026-02-21T10:22:52.5976652Z  'range_multi_buffers': [None],
2026-02-21T10:22:52.5976902Z  'range_num_stages': [0],
2026-02-21T10:22:52.5977125Z  'range_unroll_factors': [0],
2026-02-21T10:22:52.5977405Z  'range_warp_specializes': [],
2026-02-21T10:22:52.5977698Z  'reduction_loops': [None]}
2026-02-21T10:22:52.5993933Z [65s] Fitting surrogate: 184 points, 184 targets
2026-02-21T10:22:53.7293888Z [66s] Generation 2 starting: 69 neighbors, 5 active search path(s)
2026-02-21T10:23:00.1916488Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69/69 5.9 configs/s
2026-02-21T10:23:04.3334495Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 69/69 16.8 configs/s
2026-02-21T10:23:14.6407530Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 103.9         
2026-02-21T10:23:14.6408813Z                                                                   configs/s     
2026-02-21T10:23:15.2908409Z [88s] Generation 2 complete: 
2026-02-21T10:23:15.2908707Z ok=74
2026-02-21T10:23:15.2908877Z min=0.0482
2026-02-21T10:23:15.2909082Z mid=0.0549
2026-02-21T10:23:15.2909246Z max=0.3712
2026-02-21T10:23:15.2909440Z best={'block_sizes': [1],
2026-02-21T10:23:15.2909882Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:23:15.2910439Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:23:15.2910829Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:23:15.2911151Z  'num_stages': 1,
2026-02-21T10:23:15.2911343Z  'num_warps': 4,
2026-02-21T10:23:15.2911528Z  'pid_type': 'flat',
2026-02-21T10:23:15.2911747Z  'range_flattens': [None],
2026-02-21T10:23:15.2911972Z  'range_multi_buffers': [None],
2026-02-21T10:23:15.2912212Z  'range_num_stages': [0],
2026-02-21T10:23:15.2912445Z  'range_unroll_factors': [0],
2026-02-21T10:23:15.2912687Z  'range_warp_specializes': [],
2026-02-21T10:23:15.2912921Z  'reduction_loops': [None]}
2026-02-21T10:23:15.2934284Z [88s] Fitting surrogate: 258 points, 258 targets
2026-02-21T10:23:15.9252847Z [88s] Generation 3 starting: 36 neighbors, 4 active search path(s)
2026-02-21T10:23:19.1465717Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 17.1 configs/s
2026-02-21T10:23:21.2760720Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 17.3 configs/s
2026-02-21T10:23:27.0570689Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 174.5         
2026-02-21T10:23:27.0571255Z                                                                   configs/s     
2026-02-21T10:23:27.4546048Z [100s] Generation 3 complete: 
2026-02-21T10:23:27.4546353Z ok=41
2026-02-21T10:23:27.4546530Z min=0.0490
2026-02-21T10:23:27.4546698Z mid=0.0514
2026-02-21T10:23:27.4546866Z max=0.0612
2026-02-21T10:23:27.4547045Z best={'block_sizes': [1],
2026-02-21T10:23:27.4547545Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:23:27.4548112Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:23:27.4548526Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:23:27.4548836Z  'num_stages': 1,
2026-02-21T10:23:27.4549026Z  'num_warps': 4,
2026-02-21T10:23:27.4549220Z  'pid_type': 'flat',
2026-02-21T10:23:27.4549447Z  'range_flattens': [None],
2026-02-21T10:23:27.4549677Z  'range_multi_buffers': [None],
2026-02-21T10:23:27.4549917Z  'range_num_stages': [0],
2026-02-21T10:23:27.4550158Z  'range_unroll_factors': [0],
2026-02-21T10:23:27.4550413Z  'range_warp_specializes': [],
2026-02-21T10:23:27.4550662Z  'reduction_loops': [None]}
2026-02-21T10:23:27.4569946Z [100s] Fitting surrogate: 299 points, 299 targets
2026-02-21T10:23:28.0802474Z [101s] Generation 4 starting: 35 neighbors, 4 active search path(s)
2026-02-21T10:23:31.6914836Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 7.1 configs/s
2026-02-21T10:23:33.9597926Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.1 configs/s
2026-02-21T10:23:39.3481168Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 187.0         
2026-02-21T10:23:39.3482367Z                                                                   configs/s     
2026-02-21T10:23:39.7200821Z [112s] Generation 4 complete: 
2026-02-21T10:23:39.7201315Z ok=40
2026-02-21T10:23:39.7201597Z min=0.0490
2026-02-21T10:23:39.7201900Z mid=0.0525
2026-02-21T10:23:39.7202163Z max=0.0724
2026-02-21T10:23:39.7202456Z best={'block_sizes': [1],
2026-02-21T10:23:39.7203220Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:23:39.7204684Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:23:39.7205351Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:23:39.7205865Z  'num_stages': 1,
2026-02-21T10:23:39.7206689Z  'num_warps': 4,
2026-02-21T10:23:39.7207067Z  'pid_type': 'flat',
2026-02-21T10:23:39.7207416Z  'range_flattens': [None],
2026-02-21T10:23:39.7207810Z  'range_multi_buffers': [None],
2026-02-21T10:23:39.7208239Z  'range_num_stages': [0],
2026-02-21T10:23:39.7208615Z  'range_unroll_factors': [0],
2026-02-21T10:23:39.7209014Z  'range_warp_specializes': [],
2026-02-21T10:23:39.7209391Z  'reduction_loops': [None]}
2026-02-21T10:23:39.7226911Z [112s] Fitting surrogate: 339 points, 339 targets
2026-02-21T10:23:40.3744113Z [113s] Generation 5 starting: 37 neighbors, 4 active search path(s)
2026-02-21T10:23:43.8916065Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 7.5 configs/s
2026-02-21T10:23:46.1401907Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.2 configs/s
2026-02-21T10:23:52.2307052Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 180.1         
2026-02-21T10:23:52.2307573Z                                                                   configs/s     
2026-02-21T10:23:52.6224510Z [125s] Generation 5 complete: 
2026-02-21T10:23:52.6224784Z ok=42
2026-02-21T10:23:52.6224960Z min=0.0479
2026-02-21T10:23:52.6225167Z mid=0.0501
2026-02-21T10:23:52.6225339Z max=0.0925
2026-02-21T10:23:52.6225524Z best={'block_sizes': [1],
2026-02-21T10:23:52.6225967Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:23:52.6226545Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:23:52.6226944Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:23:52.6227268Z  'num_stages': 1,
2026-02-21T10:23:52.6227456Z  'num_warps': 4,
2026-02-21T10:23:52.6227653Z  'pid_type': 'flat',
2026-02-21T10:23:52.6227859Z  'range_flattens': [None],
2026-02-21T10:23:52.6228092Z  'range_multi_buffers': [None],
2026-02-21T10:23:52.6228331Z  'range_num_stages': [0],
2026-02-21T10:23:52.6228548Z  'range_unroll_factors': [0],
2026-02-21T10:23:52.6228795Z  'range_warp_specializes': [],
2026-02-21T10:23:52.6229032Z  'reduction_loops': [None]}
2026-02-21T10:23:52.6249843Z [125s] Fitting surrogate: 381 points, 381 targets
2026-02-21T10:23:53.2497248Z [126s] Generation 6 starting: 31 neighbors, 4 active search path(s)
2026-02-21T10:23:56.0978132Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 31.9 configs/s
2026-02-21T10:23:58.0091363Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 32/32 17.1 configs/s
2026-02-21T10:24:03.0334707Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 200.7         
2026-02-21T10:24:03.0335225Z                                                                   configs/s     
2026-02-21T10:24:03.3877688Z [136s] Generation 6 complete: 
2026-02-21T10:24:03.3878115Z ok=36
2026-02-21T10:24:03.3878399Z min=0.0484
2026-02-21T10:24:03.3878683Z mid=0.0498
2026-02-21T10:24:03.3878943Z max=0.0704
2026-02-21T10:24:03.3879239Z best={'block_sizes': [1],
2026-02-21T10:24:03.3880009Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:24:03.3880909Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:24:03.3882305Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:24:03.3882809Z  'num_stages': 1,
2026-02-21T10:24:03.3883120Z  'num_warps': 4,
2026-02-21T10:24:03.3883426Z  'pid_type': 'flat',
2026-02-21T10:24:03.3883763Z  'range_flattens': [None],
2026-02-21T10:24:03.3884673Z  'range_multi_buffers': [None],
2026-02-21T10:24:03.3885070Z  'range_num_stages': [0],
2026-02-21T10:24:03.3885421Z  'range_unroll_factors': [0],
2026-02-21T10:24:03.3885813Z  'range_warp_specializes': [],
2026-02-21T10:24:03.3886191Z  'reduction_loops': [None]}
2026-02-21T10:24:03.3907247Z [136s] Fitting surrogate: 417 points, 417 targets
2026-02-21T10:24:04.1085787Z [137s] Generation 7 starting: 41 neighbors, 4 active search path(s)
2026-02-21T10:24:07.7990560Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 12.7 configs/s
2026-02-21T10:24:10.2241375Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 41/41 17.2 configs/s
2026-02-21T10:24:16.8367473Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 165.7         
2026-02-21T10:24:16.8368296Z                                                                   configs/s     
2026-02-21T10:24:17.2671050Z [150s] Generation 7 complete: 
2026-02-21T10:24:17.2671483Z ok=46
2026-02-21T10:24:17.2671771Z min=0.0476
2026-02-21T10:24:17.2672042Z mid=0.0488
2026-02-21T10:24:17.2672308Z max=0.0828
2026-02-21T10:24:17.2672594Z best={'block_sizes': [2],
2026-02-21T10:24:17.2673350Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:24:17.2674873Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:24:17.2675613Z               'pointer'],
2026-02-21T10:24:17.2676230Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'first', '', 'first'],
2026-02-21T10:24:17.2676943Z  'num_stages': 3,
2026-02-21T10:24:17.2677241Z  'num_warps': 4,
2026-02-21T10:24:17.2677419Z  'pid_type': 'flat',
2026-02-21T10:24:17.2677615Z  'range_flattens': [None],
2026-02-21T10:24:17.2677836Z  'range_multi_buffers': [None],
2026-02-21T10:24:17.2678066Z  'range_num_stages': [0],
2026-02-21T10:24:17.2678269Z  'range_unroll_factors': [0],
2026-02-21T10:24:17.2678507Z  'range_warp_specializes': [],
2026-02-21T10:24:17.2678732Z  'reduction_loops': [None]}
2026-02-21T10:24:17.2701272Z [150s] Fitting surrogate: 463 points, 463 targets
2026-02-21T10:24:17.9536355Z [151s] Generation 8 starting: 37 neighbors, 4 active search path(s)
2026-02-21T10:24:21.2711553Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 - configs/s
2026-02-21T10:24:23.5725341Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 39/39 17.3 configs/s
2026-02-21T10:24:29.2039546Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 179.2         
2026-02-21T10:24:29.2040130Z                                                                   configs/s     
2026-02-21T10:24:29.5951059Z [162s] Generation 8 complete: 
2026-02-21T10:24:29.5951520Z ok=42
2026-02-21T10:24:29.5952422Z min=0.0516
2026-02-21T10:24:29.5952725Z mid=0.0529
2026-02-21T10:24:29.5952999Z max=0.2650
2026-02-21T10:24:29.5953294Z best={'block_sizes': [1],
2026-02-21T10:24:29.5954636Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:24:29.5955813Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:24:29.5956210Z               'tensor_descriptor'],
2026-02-21T10:24:29.5956575Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', 'last', ''],
2026-02-21T10:24:29.5956937Z  'num_stages': 2,
2026-02-21T10:24:29.5957127Z  'num_warps': 4,
2026-02-21T10:24:29.5957314Z  'pid_type': 'flat',
2026-02-21T10:24:29.5957521Z  'range_flattens': [None],
2026-02-21T10:24:29.5958011Z  'range_multi_buffers': [None],
2026-02-21T10:24:29.5958289Z  'range_num_stages': [0],
2026-02-21T10:24:29.5958518Z  'range_unroll_factors': [0],
2026-02-21T10:24:29.5958756Z  'range_warp_specializes': [],
2026-02-21T10:24:29.5959004Z  'reduction_loops': [None]}
2026-02-21T10:24:29.5986477Z [162s] Fitting surrogate: 505 points, 505 targets
2026-02-21T10:24:30.2881930Z [163s] Generation 9 starting: 38 neighbors, 4 active search path(s)
2026-02-21T10:24:34.0335136Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 23.9 configs/s
2026-02-21T10:24:36.5300567Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 42/42 17.1 configs/s
2026-02-21T10:24:41.8246941Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 190.4         
2026-02-21T10:24:41.8247472Z                                                                   configs/s     
2026-02-21T10:24:42.1997287Z [175s] Generation 9 complete: 
2026-02-21T10:24:42.1997757Z ok=43
2026-02-21T10:24:42.1998039Z min=0.0483
2026-02-21T10:24:42.1998365Z mid=0.0506
2026-02-21T10:24:42.1998630Z max=0.3506
2026-02-21T10:24:42.1998923Z best={'block_sizes': [1],
2026-02-21T10:24:42.1999634Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:24:42.2000604Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:24:42.2001221Z               'tensor_descriptor'],
2026-02-21T10:24:42.2001813Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', 'last', ''],
2026-02-21T10:24:42.2002400Z  'num_stages': 2,
2026-02-21T10:24:42.2002701Z  'num_warps': 4,
2026-02-21T10:24:42.2003013Z  'pid_type': 'flat',
2026-02-21T10:24:42.2003360Z  'range_flattens': [None],
2026-02-21T10:24:42.2003759Z  'range_multi_buffers': [None],
2026-02-21T10:24:42.2004360Z  'range_num_stages': [0],
2026-02-21T10:24:42.2004560Z  'range_unroll_factors': [0],
2026-02-21T10:24:42.2004773Z  'range_warp_specializes': [],
2026-02-21T10:24:42.2004977Z  'reduction_loops': [None]}
2026-02-21T10:24:42.2033421Z [175s] Fitting surrogate: 548 points, 548 targets
2026-02-21T10:24:42.9869413Z [176s] Generation 10 starting: 45 neighbors, 4 active search path(s)
2026-02-21T10:24:47.0584616Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 49.2 configs/s
2026-02-21T10:24:49.7623042Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 47/47 17.7 configs/s
2026-02-21T10:24:56.6021140Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 160.8         
2026-02-21T10:24:56.6021647Z                                                                   configs/s     
2026-02-21T10:24:57.0448261Z [190s] Generation 10 complete: 
2026-02-21T10:24:57.0448734Z error=1
2026-02-21T10:24:57.0449003Z ok=49
2026-02-21T10:24:57.0449298Z min=0.0485
2026-02-21T10:24:57.0449568Z mid=0.0505
2026-02-21T10:24:57.0449997Z max=0.3509
2026-02-21T10:24:57.0450297Z best={'block_sizes': [2],
2026-02-21T10:24:57.0450956Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:24:57.0451989Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:24:57.0452869Z  'load_eviction_policies': ['', 'last', '', 'last', '', '', 'first', ''],
2026-02-21T10:24:57.0454378Z  'num_stages': 5,
2026-02-21T10:24:57.0454764Z  'num_warps': 4,
2026-02-21T10:24:57.0455003Z  'pid_type': 'flat',
2026-02-21T10:24:57.0455204Z  'range_flattens': [None],
2026-02-21T10:24:57.0455458Z  'range_multi_buffers': [None],
2026-02-21T10:24:57.0455711Z  'range_num_stages': [0],
2026-02-21T10:24:57.0455947Z  'range_unroll_factors': [0],
2026-02-21T10:24:57.0456199Z  'range_warp_specializes': [],
2026-02-21T10:24:57.0456443Z  'reduction_loops': [None]}
2026-02-21T10:24:57.0483294Z [190s] Fitting surrogate: 598 points, 598 targets
2026-02-21T10:24:57.5945244Z [190s] Generation 11 starting: 28 neighbors, 3 active search path(s)
2026-02-21T10:25:00.7386930Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 7.9 configs/s
2026-02-21T10:25:02.5350225Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 17.1 configs/s
2026-02-21T10:25:06.0052925Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 290.1         
2026-02-21T10:25:06.0053475Z                                                                   configs/s     
2026-02-21T10:25:06.2587265Z [199s] Generation 11 complete: 
2026-02-21T10:25:06.2587528Z ok=32
2026-02-21T10:25:06.2587693Z min=0.0485
2026-02-21T10:25:06.2587877Z mid=0.0501
2026-02-21T10:25:06.2588052Z max=0.3580
2026-02-21T10:25:06.2588228Z best={'block_sizes': [1],
2026-02-21T10:25:06.2588680Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:25:06.2589353Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:25:06.2589832Z               'tensor_descriptor'],
2026-02-21T10:25:06.2590202Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', 'last', ''],
2026-02-21T10:25:06.2590686Z  'num_stages': 3,
2026-02-21T10:25:06.2590915Z  'num_warps': 4,
2026-02-21T10:25:06.2591153Z  'pid_type': 'flat',
2026-02-21T10:25:06.2591413Z  'range_flattens': [None],
2026-02-21T10:25:06.2591657Z  'range_multi_buffers': [None],
2026-02-21T10:25:06.2591926Z  'range_num_stages': [0],
2026-02-21T10:25:06.2592157Z  'range_unroll_factors': [0],
2026-02-21T10:25:06.2592407Z  'range_warp_specializes': [],
2026-02-21T10:25:06.2592650Z  'reduction_loops': [None]}
2026-02-21T10:25:06.2625602Z [199s] Fitting surrogate: 630 points, 630 targets
2026-02-21T10:25:06.8194871Z [199s] Generation 12 starting: 28 neighbors, 3 active search path(s)
2026-02-21T10:25:09.4157777Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 23.2 configs/s
2026-02-21T10:25:11.0797411Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 17.9 configs/s
2026-02-21T10:25:14.8335182Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 267.8         
2026-02-21T10:25:14.8335708Z                                                                   configs/s     
2026-02-21T10:25:15.1057568Z [208s] Generation 12 complete: 
2026-02-21T10:25:15.1057832Z error=1
2026-02-21T10:25:15.1058025Z ok=30
2026-02-21T10:25:15.1058187Z min=0.0483
2026-02-21T10:25:15.1058358Z mid=0.0500
2026-02-21T10:25:15.1058520Z max=0.2650
2026-02-21T10:25:15.1058702Z best={'block_sizes': [1],
2026-02-21T10:25:15.1059139Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:25:15.1059822Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:25:15.1060284Z               'tensor_descriptor'],
2026-02-21T10:25:15.1060641Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', 'last', ''],
2026-02-21T10:25:15.1061003Z  'num_stages': 3,
2026-02-21T10:25:15.1061189Z  'num_warps': 4,
2026-02-21T10:25:15.1061387Z  'pid_type': 'flat',
2026-02-21T10:25:15.1061591Z  'range_flattens': [None],
2026-02-21T10:25:15.1061831Z  'range_multi_buffers': [None],
2026-02-21T10:25:15.1062064Z  'range_num_stages': [0],
2026-02-21T10:25:15.1062287Z  'range_unroll_factors': [0],
2026-02-21T10:25:15.1062522Z  'range_warp_specializes': [],
2026-02-21T10:25:15.1063254Z  'reduction_loops': [None]}
2026-02-21T10:25:15.1099691Z [208s] Fitting surrogate: 661 points, 661 targets
2026-02-21T10:25:15.6364959Z [208s] Generation 13 starting: 23 neighbors, 3 active search path(s)
2026-02-21T10:25:18.3222031Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 3.2 configs/s
2026-02-21T10:25:19.7468526Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 17.4 configs/s
2026-02-21T10:25:23.3827440Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 276.4         
2026-02-21T10:25:23.3827943Z                                                                   configs/s     
2026-02-21T10:25:23.6460950Z [216s] Generation 13 complete: 
2026-02-21T10:25:23.6461398Z ok=26
2026-02-21T10:25:23.6461694Z min=0.0482
2026-02-21T10:25:23.6462582Z mid=0.0496
2026-02-21T10:25:23.6462936Z max=0.0688
2026-02-21T10:25:23.6463287Z best={'block_sizes': [2],
2026-02-21T10:25:23.6463829Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:25:23.6464787Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:25:23.6465184Z               'pointer'],
2026-02-21T10:25:23.6465538Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'first', 'last', 'first'],
2026-02-21T10:25:23.6465932Z  'num_stages': 4,
2026-02-21T10:25:23.6466134Z  'num_warps': 4,
2026-02-21T10:25:23.6466322Z  'pid_type': 'flat',
2026-02-21T10:25:23.6466531Z  'range_flattens': [None],
2026-02-21T10:25:23.6466754Z  'range_multi_buffers': [None],
2026-02-21T10:25:23.6466994Z  'range_num_stages': [0],
2026-02-21T10:25:23.6467224Z  'range_unroll_factors': [0],
2026-02-21T10:25:23.6467461Z  'range_warp_specializes': [],
2026-02-21T10:25:23.6467705Z  'reduction_loops': [None]}
2026-02-21T10:25:23.6506489Z [216s] Fitting surrogate: 687 points, 687 targets
2026-02-21T10:25:24.0949368Z [217s] Generation 14 starting: 22 neighbors, 2 active search path(s)
2026-02-21T10:25:26.7472971Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 3.2 configs/s
2026-02-21T10:25:28.0517291Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 18.3 configs/s
2026-02-21T10:25:31.0040133Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 419.1         
2026-02-21T10:25:31.0041008Z                                                                   configs/s     
2026-02-21T10:25:31.1864304Z [224s] Generation 14 complete: 
2026-02-21T10:25:31.1864578Z error=1
2026-02-21T10:25:31.1864752Z ok=23
2026-02-21T10:25:31.1864914Z min=0.0517
2026-02-21T10:25:31.1865091Z mid=0.0544
2026-02-21T10:25:31.1865257Z max=0.3798
2026-02-21T10:25:31.1865442Z best={'block_sizes': [2],
2026-02-21T10:25:31.1865901Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:25:31.1866525Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:25:31.1866940Z               'pointer'],
2026-02-21T10:25:31.1867294Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'first', 'last', 'first'],
2026-02-21T10:25:31.1867699Z  'num_stages': 4,
2026-02-21T10:25:31.1867908Z  'num_warps': 4,
2026-02-21T10:25:31.1868120Z  'pid_type': 'flat',
2026-02-21T10:25:31.1868329Z  'range_flattens': [None],
2026-02-21T10:25:31.1868566Z  'range_multi_buffers': [None],
2026-02-21T10:25:31.1868805Z  'range_num_stages': [0],
2026-02-21T10:25:31.1869020Z  'range_unroll_factors': [0],
2026-02-21T10:25:31.1869246Z  'range_warp_specializes': [],
2026-02-21T10:25:31.1869473Z  'reduction_loops': [None]}
2026-02-21T10:25:31.1898648Z [224s] Fitting surrogate: 711 points, 711 targets
2026-02-21T10:25:31.5681188Z [224s] Generation 15 starting: 16 neighbors, 2 active search path(s)
2026-02-21T10:25:33.2813007Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 18.9 configs/s
2026-02-21T10:25:34.2388804Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 18.7 configs/s
2026-02-21T10:25:35.7681943Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 650.1         
2026-02-21T10:25:35.7682424Z                                                                   configs/s     
2026-02-21T10:25:35.8981727Z [228s] Generation 15 complete: 
2026-02-21T10:25:35.8982081Z error=1
2026-02-21T10:25:35.8982244Z ok=17
2026-02-21T10:25:35.8982407Z min=0.0514
2026-02-21T10:25:35.8982571Z mid=0.0563
2026-02-21T10:25:35.8982738Z max=0.2650
2026-02-21T10:25:35.8982915Z best={'block_sizes': [2],
2026-02-21T10:25:35.8983358Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:25:35.8984312Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:25:35.8985196Z               'pointer'],
2026-02-21T10:25:35.8985568Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'first', 'last', 'first'],
2026-02-21T10:25:35.8985977Z  'num_stages': 4,
2026-02-21T10:25:35.8986189Z  'num_warps': 4,
2026-02-21T10:25:35.8986379Z  'pid_type': 'flat',
2026-02-21T10:25:35.8986589Z  'range_flattens': [None],
2026-02-21T10:25:35.8986814Z  'range_multi_buffers': [None],
2026-02-21T10:25:35.8987054Z  'range_num_stages': [0],
2026-02-21T10:25:35.8987273Z  'range_unroll_factors': [0],
2026-02-21T10:25:35.8987517Z  'range_warp_specializes': [],
2026-02-21T10:25:35.8987755Z  'reduction_loops': [None]}
2026-02-21T10:25:35.9022632Z [228s] Fitting surrogate: 729 points, 729 targets
2026-02-21T10:25:36.3463419Z [229s] Generation 16 starting: 21 neighbors, 2 active search path(s)
2026-02-21T10:25:43.6712014Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 0.8 configs/s
2026-02-21T10:25:45.0496735Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 17.2 configs/s
2026-02-21T10:25:47.8547373Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 358.1         
2026-02-21T10:25:47.8547883Z                                                                   configs/s     
2026-02-21T10:25:48.0648341Z [241s] Generation 16 complete: 
2026-02-21T10:25:48.0648631Z ok=24
2026-02-21T10:25:48.0648824Z min=0.0486
2026-02-21T10:25:48.0649016Z mid=0.0520
2026-02-21T10:25:48.0649188Z max=0.6882
2026-02-21T10:25:48.0649396Z best={'block_sizes': [2],
2026-02-21T10:25:48.0649936Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:25:48.0650604Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:25:48.0651042Z               'pointer'],
2026-02-21T10:25:48.0651407Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'first', 'last', 'first'],
2026-02-21T10:25:48.0651816Z  'num_stages': 4,
2026-02-21T10:25:48.0652010Z  'num_warps': 4,
2026-02-21T10:25:48.0652235Z  'pid_type': 'flat',
2026-02-21T10:25:48.0652452Z  'range_flattens': [None],
2026-02-21T10:25:48.0652692Z  'range_multi_buffers': [None],
2026-02-21T10:25:48.0652940Z  'range_num_stages': [0],
2026-02-21T10:25:48.0653676Z  'range_unroll_factors': [0],
2026-02-21T10:25:48.0653923Z  'range_warp_specializes': [],
2026-02-21T10:25:48.0654617Z  'reduction_loops': [None]}
2026-02-21T10:25:48.0690970Z [241s] Fitting surrogate: 753 points, 753 targets
2026-02-21T10:25:48.4750993Z [241s] Generation 17 starting: 19 neighbors, 2 active search path(s)
2026-02-21T10:25:50.5041063Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 5.6 configs/s
2026-02-21T10:25:51.6408159Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 18.4 configs/s
2026-02-21T10:25:54.2750020Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 380.7         
2026-02-21T10:25:54.2750546Z                                                                   configs/s     
2026-02-21T10:25:54.4763721Z [247s] Generation 17 complete: 
2026-02-21T10:25:54.4764498Z error=1
2026-02-21T10:25:54.4764685Z ok=21
2026-02-21T10:25:54.4764853Z min=0.0483
2026-02-21T10:25:54.4765032Z mid=0.0496
2026-02-21T10:25:54.4765218Z max=0.0906
2026-02-21T10:25:54.4765407Z best={'block_sizes': [4],
2026-02-21T10:25:54.4765819Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:25:54.4766405Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:25:54.4766840Z               'tensor_descriptor'],
2026-02-21T10:25:54.4767205Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'last', '', 'first'],
2026-02-21T10:25:54.4767613Z  'num_stages': 4,
2026-02-21T10:25:54.4767805Z  'num_warps': 8,
2026-02-21T10:25:54.4768007Z  'pid_type': 'flat',
2026-02-21T10:25:54.4768222Z  'range_flattens': [None],
2026-02-21T10:25:54.4768466Z  'range_multi_buffers': [None],
2026-02-21T10:25:54.4768710Z  'range_num_stages': [0],
2026-02-21T10:25:54.4768953Z  'range_unroll_factors': [0],
2026-02-21T10:25:54.4769204Z  'range_warp_specializes': [],
2026-02-21T10:25:54.4769445Z  'reduction_loops': [None]}
2026-02-21T10:25:54.4807050Z [247s] Fitting surrogate: 775 points, 775 targets
2026-02-21T10:25:54.9266089Z [247s] Generation 18 starting: 20 neighbors, 2 active search path(s)
2026-02-21T10:25:57.7111275Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 4.1 configs/s
2026-02-21T10:25:58.8866553Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.7 configs/s
2026-02-21T10:26:01.4037442Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 398.7         
2026-02-21T10:26:01.4037966Z                                                                   configs/s     
2026-02-21T10:26:01.5963070Z [254s] Generation 18 complete: 
2026-02-21T10:26:01.5963359Z ok=22
2026-02-21T10:26:01.5963541Z min=0.0515
2026-02-21T10:26:01.5963726Z mid=0.0522
2026-02-21T10:26:01.5963895Z max=0.3375
2026-02-21T10:26:01.5964502Z best={'block_sizes': [1],
2026-02-21T10:26:01.5964924Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:26:01.5965526Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:26:01.5965988Z               'tensor_descriptor'],
2026-02-21T10:26:01.5966358Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'last', '', 'first'],
2026-02-21T10:26:01.5966744Z  'num_stages': 4,
2026-02-21T10:26:01.5966955Z  'num_warps': 4,
2026-02-21T10:26:01.5967168Z  'pid_type': 'flat',
2026-02-21T10:26:01.5967394Z  'range_flattens': [None],
2026-02-21T10:26:01.5967641Z  'range_multi_buffers': [None],
2026-02-21T10:26:01.5967895Z  'range_num_stages': [0],
2026-02-21T10:26:01.5968137Z  'range_unroll_factors': [0],
2026-02-21T10:26:01.5968394Z  'range_warp_specializes': [],
2026-02-21T10:26:01.5968658Z  'reduction_loops': [None]}
2026-02-21T10:26:01.6008256Z [254s] Fitting surrogate: 797 points, 797 targets
2026-02-21T10:26:02.0410448Z [255s] Generation 19 starting: 20 neighbors, 2 active search path(s)
2026-02-21T10:26:04.2949738Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 16.3 configs/s
2026-02-21T10:26:05.5985431Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.5 configs/s
2026-02-21T10:26:08.8190232Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 312.9         
2026-02-21T10:26:08.8190779Z                                                                   configs/s     
2026-02-21T10:26:09.0557967Z [262s] Generation 19 complete: 
2026-02-21T10:26:09.0558270Z ok=23
2026-02-21T10:26:09.0558460Z min=0.0478
2026-02-21T10:26:09.0558641Z mid=0.0508
2026-02-21T10:26:09.0558811Z max=0.0706
2026-02-21T10:26:09.0558991Z best={'block_sizes': [2],
2026-02-21T10:26:09.0559402Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:26:09.0559990Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:26:09.0561104Z               'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:26:09.0561606Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'first', 'first', 'first'],
2026-02-21T10:26:09.0562017Z  'num_stages': 4,
2026-02-21T10:26:09.0562212Z  'num_warps': 4,
2026-02-21T10:26:09.0562401Z  'pid_type': 'flat',
2026-02-21T10:26:09.0562618Z  'range_flattens': [None],
2026-02-21T10:26:09.0562860Z  'range_multi_buffers': [None],
2026-02-21T10:26:09.0563100Z  'range_num_stages': [0],
2026-02-21T10:26:09.0563323Z  'range_unroll_factors': [0],
2026-02-21T10:26:09.0563570Z  'range_warp_specializes': [],
2026-02-21T10:26:09.0563805Z  'reduction_loops': [None]}
2026-02-21T10:26:09.0603062Z [262s] Fitting surrogate: 820 points, 820 targets
2026-02-21T10:26:09.5183670Z [262s] Generation 20 starting: 22 neighbors, 2 active search path(s)
2026-02-21T10:26:11.4482146Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 - configs/s
2026-02-21T10:26:12.7225572Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.9 configs/s
2026-02-21T10:26:16.6057146Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 300.4         
2026-02-21T10:26:16.6057711Z                                                                   configs/s     
2026-02-21T10:26:16.8511420Z [269s] Generation 20 complete: 
2026-02-21T10:26:16.8511706Z ok=24
2026-02-21T10:26:16.8511886Z min=0.0516
2026-02-21T10:26:16.8512059Z mid=0.0519
2026-02-21T10:26:16.8512231Z max=0.0607
2026-02-21T10:26:16.8512419Z best={'block_sizes': [1],
2026-02-21T10:26:16.8512831Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:26:16.8513430Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:26:16.8513852Z               'tensor_descriptor'],
2026-02-21T10:26:16.8515694Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'last', '', 'first'],
2026-02-21T10:26:16.8516100Z  'num_stages': 4,
2026-02-21T10:26:16.8516312Z  'num_warps': 4,
2026-02-21T10:26:16.8516528Z  'pid_type': 'flat',
2026-02-21T10:26:16.8516745Z  'range_flattens': [None],
2026-02-21T10:26:16.8517007Z  'range_multi_buffers': [None],
2026-02-21T10:26:16.8517274Z  'range_num_stages': [0],
2026-02-21T10:26:16.8517518Z  'range_unroll_factors': [0],
2026-02-21T10:26:16.8517776Z  'range_warp_specializes': [],
2026-02-21T10:26:16.8518031Z  'reduction_loops': [None]}
2026-02-21T10:26:16.8552483Z [269s] Fitting surrogate: 844 points, 844 targets
2026-02-21T10:26:17.0095683Z [270s] Autotuning complete in 270.1s after searching 792 configs.
2026-02-21T10:26:17.0096108Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:26:17.0097905Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', 'last', '', 'last', '', 'first'], num_stages=4, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:26:17.0100151Z 
2026-02-21T10:26:17.0100549Z [270s] Code of selected kernel: /tmp/torchinductor_root/cn/ccns3iuj7c4kksju5irtbqsvg42fla52lfo3q7knkb3dtawry4ox.py
2026-02-21T10:26:17.0344641Z from __future__ import annotations
2026-02-21T10:26:17.0344851Z 
2026-02-21T10:26:17.0344927Z import torch
2026-02-21T10:26:17.0345125Z import triton
2026-02-21T10:26:17.0345328Z import triton.language as tl
2026-02-21T10:26:17.0345663Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:26:17.0346104Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:26:17.0346385Z 
2026-02-21T10:26:17.0346473Z @triton.jit
2026-02-21T10:26:17.0347202Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:26:17.0347725Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:26:17.0348032Z     pid_0 = tl.program_id(0)
2026-02-21T10:26:17.0348265Z     offset_0 = pid_0
2026-02-21T10:26:17.0348514Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T10:26:17.0348848Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:26:17.0349227Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:26:17.0349665Z     acc = tl.load(x + (indices_0[:, None] * 4096 + indices_1[None, :] * 1), None)
2026-02-21T10:26:17.0350127Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:26:17.0350494Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:26:17.0350768Z     v_0 = 0.000244140625
2026-02-21T10:26:17.0350962Z     v_1 = sum_1 * v_0
2026-02-21T10:26:17.0351228Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:26:17.0351547Z     subscript = v_1[:, None]
2026-02-21T10:26:17.0351768Z     v_2 = acc - subscript
2026-02-21T10:26:17.0352085Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:26:17.0352439Z     v_3 = v_2 * v_2
2026-02-21T10:26:17.0352647Z     sum_2 = tl.cast(tl.sum(v_3, 1), tl.float32)
2026-02-21T10:26:17.0352924Z     v_4 = 0.000244140625
2026-02-21T10:26:17.0353109Z     v_5 = sum_2 * v_4
2026-02-21T10:26:17.0353368Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:26:17.0353671Z     v_6 = v_5 + eps
2026-02-21T10:26:17.0353858Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:26:17.0354510Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:26:17.0354850Z     subscript_1 = v_7[:, None]
2026-02-21T10:26:17.0355066Z     v_8 = v_2 * subscript_1
2026-02-21T10:26:17.0355378Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:26:17.0355852Z     load_1 = tl.load(weight + indices_1 * 1, None, eviction_policy='evict_last')
2026-02-21T10:26:17.0356212Z     v_9 = load_1[None, :]
2026-02-21T10:26:17.0356424Z     v_10 = v_8 * v_9
2026-02-21T10:26:17.0356645Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:26:17.0356957Z     load_2 = tl.load(bias + indices_1 * 1, None)
2026-02-21T10:26:17.0357327Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:26:17.0357725Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:26:17.0358018Z     # src[layer_norm.py:75]: )
2026-02-21T10:26:17.0358232Z     v_11 = load_2[None, :]
2026-02-21T10:26:17.0358427Z     v_12 = v_10 + v_11
2026-02-21T10:26:17.0358666Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:26:17.0359072Z     tl.store(out + (indices_0[:, None] * 4096 + indices_1[None, :] * 1), v_12, None)
2026-02-21T10:26:17.0359457Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:26:17.0359747Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:26:17.0360052Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:26:17.0360332Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:26:17.0360513Z 
2026-02-21T10:26:17.0361013Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:26:17.0361822Z     """
2026-02-21T10:26:17.0362053Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:26:17.0362353Z     Args:
2026-02-21T10:26:17.0362612Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:26:17.0363138Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:26:17.0363625Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:26:17.0364184Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:26:17.0364867Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:26:17.0365268Z     Returns:
2026-02-21T10:26:17.0365469Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:26:17.0365835Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:26:17.0366211Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:26:17.0366557Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:26:17.0366869Z     """
2026-02-21T10:26:17.0367026Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:26:17.0367243Z     m, n = x.size()
2026-02-21T10:26:17.0367567Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:26:17.0368034Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:26:17.0368381Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:26:17.0368759Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:26:17.0369123Z     if bias is not None:
2026-02-21T10:26:17.0369439Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:26:17.0369987Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:26:17.0370356Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:26:17.0370742Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:26:17.0371080Z     # src[layer_norm.py:52]: )
2026-02-21T10:26:17.0371417Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:26:17.0371836Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:26:17.0372214Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:26:17.0372551Z     # src[layer_norm.py:55]: )
2026-02-21T10:26:17.0372890Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:26:17.0373354Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:26:17.0373743Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:26:17.0374246Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:26:17.0374647Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:26:17.0375022Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:26:17.0375416Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:26:17.0375723Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:26:17.0375966Z     _RDIM_SIZE_1 = 4096
2026-02-21T10:26:17.0376178Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:26:17.0376483Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:26:17.0376787Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:26:17.0377189Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:26:17.0377634Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=4, num_stages=4)
2026-02-21T10:26:17.0378100Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:26:17.0378338Z     return (out, mean, rstd)
2026-02-21T10:26:18.1609416Z WARNING:tritonbench.utils.triton_op:Completed input ID 6:
2026-02-21T10:26:18.1609795Z (M, N)
2026-02-21T10:26:18.1610092Z ------------
2026-02-21T10:26:18.1610289Z (4096, 4096)
2026-02-21T10:26:18.1610399Z 
2026-02-21T10:26:18.1625886Z  25%|██▌       | 5/20 [25:14<1:16:23, 305.59s/it]WARNING:tritonbench.utils.triton_op:Running input ID 8:
2026-02-21T10:26:18.1626345Z (M, N)
2026-02-21T10:26:18.1626509Z ------------
2026-02-21T10:26:18.1626993Z (4096, 5120)
2026-02-21T10:26:18.1627895Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T10:26:19.6533285Z INFO:tritonbench.utils.triton_op:Took 3.12ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:26:21.0397823Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:26:22.5474707Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:26:22.5475044Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:26:22.5475318Z               'dtype': 'torch.float32',
2026-02-21T10:26:22.5475608Z               'shape': (4096, 5120),
2026-02-21T10:26:22.5475867Z               'stride': (5120, 1)},
2026-02-21T10:26:22.5476102Z             (5120,),
2026-02-21T10:26:22.5476317Z             { 'device': 'cuda:0',
2026-02-21T10:26:22.5476606Z               'dtype': 'torch.float32',
2026-02-21T10:26:22.5476873Z               'shape': (5120,),
2026-02-21T10:26:22.5477139Z               'stride': (1,)},
2026-02-21T10:26:22.5477372Z             { 'device': 'cuda:0',
2026-02-21T10:26:22.5477624Z               'dtype': 'torch.float32',
2026-02-21T10:26:22.5477877Z               'shape': (5120,),
2026-02-21T10:26:22.5478133Z               'stride': (1,)},
2026-02-21T10:26:22.5478353Z             1e-05),
2026-02-21T10:26:22.5478549Z   'kwargs': {}}
2026-02-21T10:26:22.5502458Z INFO:tritonbench.utils.triton_op:Took 3.21ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:26:22.5581952Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:26:22.5582843Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:26:22.5583454Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:26:22.5583893Z While processing:
2026-02-21T10:26:22.5584588Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:26:22.5585085Z     if bias is not None:
2026-02-21T10:26:22.5585315Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:26:22.5585449Z 
2026-02-21T10:26:22.7260919Z [0s] Autotune random seed: 2141537047
2026-02-21T10:26:22.7722129Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:26:57.3072311Z [34s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:26:57.6904464Z [34s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:26:58.8136882Z [36s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:26:58.8162501Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T10:27:04.7640700Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.9 configs/s
2026-02-21T10:27:04.7653906Z [41s] Adaptive compile timeout: 30s (90% percentile=6.6s, bounds=[30.0s, 30s])
2026-02-21T10:27:06.1189794Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 725.4 configs/s
2026-02-21T10:27:06.2317882Z [43s] Initial random population of 100, 5 starting points: 
2026-02-21T10:27:06.2321425Z error=11
2026-02-21T10:27:06.2322145Z timeout=3
2026-02-21T10:27:06.2322505Z ok=86
2026-02-21T10:27:06.2322797Z min=0.0729
2026-02-21T10:27:06.2323087Z mid=0.3344
2026-02-21T10:27:06.2323349Z max=15.7356
2026-02-21T10:27:06.2323662Z best={'block_sizes': [1],
2026-02-21T10:27:06.2324662Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:27:06.2325256Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:27:06.2325659Z               'tensor_descriptor'],
2026-02-21T10:27:06.2326012Z  'load_eviction_policies': ['last', 'first', '', 'first', 'last', 'last', '', ''],
2026-02-21T10:27:06.2326372Z  'num_sm_multiplier': 8,
2026-02-21T10:27:06.2326564Z  'num_stages': 5,
2026-02-21T10:27:06.2326732Z  'num_warps': 8,
2026-02-21T10:27:06.2326909Z  'pid_type': 'persistent_blocked',
2026-02-21T10:27:06.2327137Z  'range_flattens': [False],
2026-02-21T10:27:06.2327333Z  'range_multi_buffers': [True],
2026-02-21T10:27:06.2327549Z  'range_num_stages': [0],
2026-02-21T10:27:06.2327739Z  'range_unroll_factors': [4],
2026-02-21T10:27:06.2327947Z  'range_warp_specializes': [],
2026-02-21T10:27:06.2328159Z  'reduction_loops': [1024]}
2026-02-21T10:27:06.2340471Z [43s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:27:07.5537457Z [44s] Generation 1 starting: 83 neighbors, 5 active search path(s)
2026-02-21T10:27:25.7238779Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 1.3 configs/s
2026-02-21T10:27:31.0323434Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.3 configs/s
2026-02-21T10:27:42.0117837Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 97.2 configs/s
2026-02-21T10:27:42.6170054Z [79s] Generation 1 complete: 
2026-02-21T10:27:42.6170471Z ok=89
2026-02-21T10:27:42.6170736Z min=0.0604
2026-02-21T10:27:42.6171000Z mid=0.0806
2026-02-21T10:27:42.6171265Z max=0.9244
2026-02-21T10:27:42.6171569Z best={'block_sizes': [1],
2026-02-21T10:27:42.6172187Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:27:42.6172968Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:27:42.6173571Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:27:42.6174503Z  'num_stages': 1,
2026-02-21T10:27:42.6174823Z  'num_warps': 8,
2026-02-21T10:27:42.6175157Z  'pid_type': 'flat',
2026-02-21T10:27:42.6175483Z  'range_flattens': [None],
2026-02-21T10:27:42.6175827Z  'range_multi_buffers': [None],
2026-02-21T10:27:42.6176192Z  'range_num_stages': [0],
2026-02-21T10:27:42.6177088Z  'range_unroll_factors': [0],
2026-02-21T10:27:42.6177485Z  'range_warp_specializes': [],
2026-02-21T10:27:42.6177839Z  'reduction_loops': [None]}
2026-02-21T10:27:42.6192883Z [79s] Fitting surrogate: 189 points, 189 targets
2026-02-21T10:27:43.5793046Z [80s] Generation 2 starting: 59 neighbors, 5 active search path(s)
2026-02-21T10:27:51.2742680Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 7.1 configs/s
2026-02-21T10:27:54.8876671Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 17.4 configs/s
2026-02-21T10:28:03.2166796Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.1         
2026-02-21T10:28:03.2169245Z                                                                   configs/s     
2026-02-21T10:28:03.7368697Z [100s] Generation 2 complete: 
2026-02-21T10:28:03.7369136Z error=3
2026-02-21T10:28:03.7369398Z ok=62
2026-02-21T10:28:03.7369791Z min=0.0598
2026-02-21T10:28:03.7370063Z mid=0.0700
2026-02-21T10:28:03.7370339Z max=0.8974
2026-02-21T10:28:03.7370619Z best={'block_sizes': [1],
2026-02-21T10:28:03.7371235Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:28:03.7372012Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:28:03.7372642Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:28:03.7373136Z  'num_stages': 1,
2026-02-21T10:28:03.7373423Z  'num_warps': 8,
2026-02-21T10:28:03.7373729Z  'pid_type': 'flat',
2026-02-21T10:28:03.7374503Z  'range_flattens': [None],
2026-02-21T10:28:03.7374769Z  'range_multi_buffers': [None],
2026-02-21T10:28:03.7375010Z  'range_num_stages': [0],
2026-02-21T10:28:03.7375233Z  'range_unroll_factors': [0],
2026-02-21T10:28:03.7375477Z  'range_warp_specializes': [],
2026-02-21T10:28:03.7375716Z  'reduction_loops': [None]}
2026-02-21T10:28:03.7395659Z [100s] Fitting surrogate: 254 points, 254 targets
2026-02-21T10:28:04.5584408Z [101s] Generation 3 starting: 45 neighbors, 5 active search path(s)
2026-02-21T10:28:10.0402586Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 2.4 configs/s
2026-02-21T10:28:13.4550340Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 13.9 configs/s
2026-02-21T10:28:20.9270936Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 135.0         
2026-02-21T10:28:20.9271454Z                                                                   configs/s     
2026-02-21T10:28:21.4124703Z [118s] Generation 3 complete: 
2026-02-21T10:28:21.4125164Z ok=51
2026-02-21T10:28:21.4125446Z min=0.0599
2026-02-21T10:28:21.4125719Z mid=0.0672
2026-02-21T10:28:21.4126017Z max=0.2269
2026-02-21T10:28:21.4126306Z best={'block_sizes': [1],
2026-02-21T10:28:21.4126940Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:28:21.4127469Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:28:21.4127882Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:28:21.4128536Z  'num_stages': 1,
2026-02-21T10:28:21.4128744Z  'num_warps': 8,
2026-02-21T10:28:21.4128948Z  'pid_type': 'flat',
2026-02-21T10:28:21.4129157Z  'range_flattens': [None],
2026-02-21T10:28:21.4129395Z  'range_multi_buffers': [None],
2026-02-21T10:28:21.4129636Z  'range_num_stages': [0],
2026-02-21T10:28:21.4129973Z  'range_unroll_factors': [0],
2026-02-21T10:28:21.4130226Z  'range_warp_specializes': [],
2026-02-21T10:28:21.4130469Z  'reduction_loops': [None]}
2026-02-21T10:28:21.4149802Z [118s] Fitting surrogate: 305 points, 305 targets
2026-02-21T10:28:22.1616746Z [119s] Generation 4 starting: 42 neighbors, 5 active search path(s)
2026-02-21T10:28:26.9673848Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 17.0 configs/s
2026-02-21T10:28:29.7424656Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 16.8 configs/s
2026-02-21T10:28:36.4303441Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.7         
2026-02-21T10:28:36.4304277Z                                                                   configs/s     
2026-02-21T10:28:36.8531618Z [134s] Generation 4 complete: 
2026-02-21T10:28:36.8532029Z ok=48
2026-02-21T10:28:36.8532296Z min=0.0598
2026-02-21T10:28:36.8532556Z mid=0.0674
2026-02-21T10:28:36.8532812Z max=0.1002
2026-02-21T10:28:36.8533084Z best={'block_sizes': [1],
2026-02-21T10:28:36.8533718Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:28:36.8535019Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:28:36.8535692Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:28:36.8536190Z  'num_stages': 1,
2026-02-21T10:28:36.8536482Z  'num_warps': 8,
2026-02-21T10:28:36.8536808Z  'pid_type': 'flat',
2026-02-21T10:28:36.8537182Z  'range_flattens': [None],
2026-02-21T10:28:36.8537609Z  'range_multi_buffers': [None],
2026-02-21T10:28:36.8538040Z  'range_num_stages': [0],
2026-02-21T10:28:36.8538292Z  'range_unroll_factors': [0],
2026-02-21T10:28:36.8538533Z  'range_warp_specializes': [],
2026-02-21T10:28:36.8538764Z  'reduction_loops': [None]}
2026-02-21T10:28:36.8562914Z [134s] Fitting surrogate: 353 points, 353 targets
2026-02-21T10:28:37.5131735Z [134s] Generation 5 starting: 39 neighbors, 4 active search path(s)
2026-02-21T10:28:41.6714321Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 7.1 configs/s
2026-02-21T10:28:44.0451280Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 40/40 17.2 configs/s
2026-02-21T10:28:50.8036132Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 162.6         
2026-02-21T10:28:50.8037615Z                                                                   configs/s     
2026-02-21T10:28:51.2095960Z [148s] Generation 5 complete: 
2026-02-21T10:28:51.2096267Z ok=44
2026-02-21T10:28:51.2096447Z min=0.0602
2026-02-21T10:28:51.2096622Z mid=0.0624
2026-02-21T10:28:51.2096792Z max=0.2295
2026-02-21T10:28:51.2097008Z best={'block_sizes': [1],
2026-02-21T10:28:51.2097584Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:28:51.2098130Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:28:51.2098557Z  'load_eviction_policies': ['', '', '', 'first', 'last', '', '', ''],
2026-02-21T10:28:51.2098908Z  'num_stages': 1,
2026-02-21T10:28:51.2099174Z  'num_warps': 8,
2026-02-21T10:28:51.2099368Z  'pid_type': 'flat',
2026-02-21T10:28:51.2099570Z  'range_flattens': [None],
2026-02-21T10:28:51.2099803Z  'range_multi_buffers': [None],
2026-02-21T10:28:51.2100034Z  'range_num_stages': [0],
2026-02-21T10:28:51.2100259Z  'range_unroll_factors': [0],
2026-02-21T10:28:51.2100495Z  'range_warp_specializes': [],
2026-02-21T10:28:51.2100737Z  'reduction_loops': [None]}
2026-02-21T10:28:51.2123443Z [148s] Fitting surrogate: 397 points, 397 targets
2026-02-21T10:28:51.8694865Z [149s] Generation 6 starting: 37 neighbors, 4 active search path(s)
2026-02-21T10:28:55.9006526Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 7.8 configs/s
2026-02-21T10:28:58.0989720Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.7 configs/s
2026-02-21T10:29:03.9639859Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 171.8         
2026-02-21T10:29:03.9640407Z                                                                   configs/s     
2026-02-21T10:29:04.3546007Z [161s] Generation 6 complete: 
2026-02-21T10:29:04.3546363Z error=1
2026-02-21T10:29:04.3546625Z ok=40
2026-02-21T10:29:04.3546858Z min=0.0594
2026-02-21T10:29:04.3547121Z mid=0.0606
2026-02-21T10:29:04.3547354Z max=0.0927
2026-02-21T10:29:04.3547621Z best={'block_sizes': [1],
2026-02-21T10:29:04.3548951Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:29:04.3549603Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:29:04.3550011Z               'tensor_descriptor'],
2026-02-21T10:29:04.3550415Z  'load_eviction_policies': ['', '', 'last', 'first', 'first', '', 'first', 'first'],
2026-02-21T10:29:04.3550811Z  'num_stages': 8,
2026-02-21T10:29:04.3551005Z  'num_warps': 8,
2026-02-21T10:29:04.3551204Z  'pid_type': 'flat',
2026-02-21T10:29:04.3551416Z  'range_flattens': [None],
2026-02-21T10:29:04.3551653Z  'range_multi_buffers': [None],
2026-02-21T10:29:04.3551890Z  'range_num_stages': [0],
2026-02-21T10:29:04.3552122Z  'range_unroll_factors': [0],
2026-02-21T10:29:04.3552383Z  'range_warp_specializes': [],
2026-02-21T10:29:04.3552623Z  'reduction_loops': [None]}
2026-02-21T10:29:04.3577617Z [161s] Fitting surrogate: 438 points, 438 targets
2026-02-21T10:29:05.0299933Z [162s] Generation 7 starting: 37 neighbors, 4 active search path(s)
2026-02-21T10:29:09.2112043Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 9.2 configs/s
2026-02-21T10:29:11.4717350Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.2 configs/s
2026-02-21T10:29:17.1394677Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 177.7         
2026-02-21T10:29:17.1395272Z                                                                   configs/s     
2026-02-21T10:29:17.5188093Z [174s] Generation 7 complete: 
2026-02-21T10:29:17.5188362Z ok=41
2026-02-21T10:29:17.5188519Z min=0.0594
2026-02-21T10:29:17.5188664Z mid=0.0604
2026-02-21T10:29:17.5188819Z max=0.2065
2026-02-21T10:29:17.5188979Z best={'block_sizes': [1],
2026-02-21T10:29:17.5189341Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:29:17.5189904Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:29:17.5190310Z               'tensor_descriptor'],
2026-02-21T10:29:17.5190677Z  'load_eviction_policies': ['', '', 'last', 'first', 'first', '', 'first', 'first'],
2026-02-21T10:29:17.5191030Z  'num_stages': 8,
2026-02-21T10:29:17.5191206Z  'num_warps': 8,
2026-02-21T10:29:17.5191386Z  'pid_type': 'flat',
2026-02-21T10:29:17.5191570Z  'range_flattens': [None],
2026-02-21T10:29:17.5191769Z  'range_multi_buffers': [None],
2026-02-21T10:29:17.5191980Z  'range_num_stages': [0],
2026-02-21T10:29:17.5192177Z  'range_unroll_factors': [0],
2026-02-21T10:29:17.5192384Z  'range_warp_specializes': [],
2026-02-21T10:29:17.5192598Z  'reduction_loops': [None]}
2026-02-21T10:29:17.5224343Z [174s] Fitting surrogate: 479 points, 479 targets
2026-02-21T10:29:18.2317708Z [175s] Generation 8 starting: 40 neighbors, 4 active search path(s)
2026-02-21T10:29:22.4088201Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 13.0 configs/s
2026-02-21T10:29:24.7633135Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 40/40 17.3 configs/s
2026-02-21T10:29:31.8994889Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 154.9         
2026-02-21T10:29:31.8995413Z                                                                   configs/s     
2026-02-21T10:29:32.3222026Z [189s] Generation 8 complete: 
2026-02-21T10:29:32.3222940Z ok=44
2026-02-21T10:29:32.3223117Z min=0.0631
2026-02-21T10:29:32.3223288Z mid=0.0633
2026-02-21T10:29:32.3223457Z max=0.1443
2026-02-21T10:29:32.3223633Z best={'block_sizes': [1],
2026-02-21T10:29:32.3224411Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:29:32.3225014Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:29:32.3225429Z               'pointer'],
2026-02-21T10:29:32.3225767Z  'load_eviction_policies': ['', '', '', 'first', 'last', '', '', 'first'],
2026-02-21T10:29:32.3226124Z  'num_stages': 1,
2026-02-21T10:29:32.3226313Z  'num_warps': 8,
2026-02-21T10:29:32.3226499Z  'pid_type': 'flat',
2026-02-21T10:29:32.3227012Z  'range_flattens': [None],
2026-02-21T10:29:32.3227246Z  'range_multi_buffers': [None],
2026-02-21T10:29:32.3227469Z  'range_num_stages': [0],
2026-02-21T10:29:32.3227673Z  'range_unroll_factors': [0],
2026-02-21T10:29:32.3227905Z  'range_warp_specializes': [],
2026-02-21T10:29:32.3228122Z  'reduction_loops': [None]}
2026-02-21T10:29:32.3254125Z [189s] Fitting surrogate: 523 points, 523 targets
2026-02-21T10:29:33.0168720Z [190s] Generation 9 starting: 39 neighbors, 4 active search path(s)
2026-02-21T10:29:37.9838935Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 4.3 configs/s
2026-02-21T10:29:40.5307208Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 17.2 configs/s
2026-02-21T10:29:46.4108499Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 171.3         
2026-02-21T10:29:46.4109040Z                                                                   configs/s     
2026-02-21T10:29:46.8006830Z [204s] Generation 9 complete: 
2026-02-21T10:29:46.8007129Z ok=44
2026-02-21T10:29:46.8007351Z min=0.0599
2026-02-21T10:29:46.8007523Z mid=0.0610
2026-02-21T10:29:46.8007716Z max=0.2807
2026-02-21T10:29:46.8007901Z best={'block_sizes': [1],
2026-02-21T10:29:46.8008324Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:29:46.8008943Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:29:46.8009358Z               'pointer'],
2026-02-21T10:29:46.8009807Z  'load_eviction_policies': ['', '', '', 'first', 'last', '', '', ''],
2026-02-21T10:29:46.8010176Z  'num_stages': 1,
2026-02-21T10:29:46.8010384Z  'num_warps': 4,
2026-02-21T10:29:46.8010586Z  'pid_type': 'flat',
2026-02-21T10:29:46.8010806Z  'range_flattens': [None],
2026-02-21T10:29:46.8011038Z  'range_multi_buffers': [None],
2026-02-21T10:29:46.8011289Z  'range_num_stages': [0],
2026-02-21T10:29:46.8011522Z  'range_unroll_factors': [0],
2026-02-21T10:29:46.8011765Z  'range_warp_specializes': [],
2026-02-21T10:29:46.8012021Z  'reduction_loops': [None]}
2026-02-21T10:29:46.8044684Z [204s] Fitting surrogate: 567 points, 567 targets
2026-02-21T10:29:47.4814566Z [204s] Generation 10 starting: 36 neighbors, 4 active search path(s)
2026-02-21T10:29:51.2321937Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 3.1 configs/s
2026-02-21T10:29:53.3296142Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 36/36 17.5 configs/s
2026-02-21T10:29:59.2261837Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 170.8         
2026-02-21T10:29:59.2263110Z                                                                   configs/s     
2026-02-21T10:29:59.6137120Z [216s] Generation 10 complete: 
2026-02-21T10:29:59.6137382Z ok=40
2026-02-21T10:29:59.6137550Z min=0.0630
2026-02-21T10:29:59.6137725Z mid=0.0632
2026-02-21T10:29:59.6137889Z max=0.0898
2026-02-21T10:29:59.6138074Z best={'block_sizes': [1],
2026-02-21T10:29:59.6138568Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:29:59.6139148Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:29:59.6139615Z  'load_eviction_policies': ['', '', '', 'first', 'last', '', '', ''],
2026-02-21T10:29:59.6140316Z  'num_stages': 1,
2026-02-21T10:29:59.6140509Z  'num_warps': 8,
2026-02-21T10:29:59.6140784Z  'pid_type': 'flat',
2026-02-21T10:29:59.6141314Z  'range_flattens': [None],
2026-02-21T10:29:59.6141604Z  'range_multi_buffers': [None],
2026-02-21T10:29:59.6141958Z  'range_num_stages': [0],
2026-02-21T10:29:59.6142331Z  'range_unroll_factors': [0],
2026-02-21T10:29:59.6142689Z  'range_warp_specializes': [],
2026-02-21T10:29:59.6142986Z  'reduction_loops': [None]}
2026-02-21T10:29:59.6176870Z [216s] Fitting surrogate: 607 points, 607 targets
2026-02-21T10:30:00.1903251Z [217s] Generation 11 starting: 29 neighbors, 3 active search path(s)
2026-02-21T10:30:04.1043271Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 13.0 configs/s
2026-02-21T10:30:05.9893153Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 17.4 configs/s
2026-02-21T10:30:10.5060198Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 222.7         
2026-02-21T10:30:10.5060748Z                                                                   configs/s     
2026-02-21T10:30:10.8105202Z [228s] Generation 11 complete: 
2026-02-21T10:30:10.8105527Z ok=33
2026-02-21T10:30:10.8105793Z min=0.0595
2026-02-21T10:30:10.8106322Z mid=0.0620
2026-02-21T10:30:10.8121054Z max=0.6469
2026-02-21T10:30:10.8121248Z best={'block_sizes': [1],
2026-02-21T10:30:10.8121659Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:30:10.8122224Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:30:10.8122627Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:30:10.8122989Z  'load_eviction_policies': ['', '', '', 'last', 'last', 'first', '', 'first'],
2026-02-21T10:30:10.8123339Z  'num_stages': 1,
2026-02-21T10:30:10.8123512Z  'num_warps': 8,
2026-02-21T10:30:10.8123676Z  'pid_type': 'flat',
2026-02-21T10:30:10.8123854Z  'range_flattens': [None],
2026-02-21T10:30:10.8124228Z  'range_multi_buffers': [None],
2026-02-21T10:30:10.8124422Z  'range_num_stages': [0],
2026-02-21T10:30:10.8124607Z  'range_unroll_factors': [0],
2026-02-21T10:30:10.8124814Z  'range_warp_specializes': [],
2026-02-21T10:30:10.8125012Z  'reduction_loops': [None]}
2026-02-21T10:30:10.8144802Z [228s] Fitting surrogate: 640 points, 640 targets
2026-02-21T10:30:11.3917393Z [228s] Generation 12 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:30:14.6415588Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 4.2 configs/s
2026-02-21T10:30:16.4555356Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 17.5 configs/s
2026-02-21T10:30:21.1510045Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 214.1         
2026-02-21T10:30:21.1510683Z                                                                   configs/s     
2026-02-21T10:30:21.4692155Z [238s] Generation 12 complete: 
2026-02-21T10:30:21.4692597Z ok=33
2026-02-21T10:30:21.4692879Z min=0.0636
2026-02-21T10:30:21.4694469Z mid=0.0640
2026-02-21T10:30:21.4694768Z max=0.1299
2026-02-21T10:30:21.4695069Z best={'block_sizes': [1],
2026-02-21T10:30:21.4695787Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:30:21.4696740Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:30:21.4697503Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'first', ''],
2026-02-21T10:30:21.4698142Z  'num_stages': 6,
2026-02-21T10:30:21.4698469Z  'num_warps': 8,
2026-02-21T10:30:21.4698790Z  'pid_type': 'flat',
2026-02-21T10:30:21.4699146Z  'range_flattens': [None],
2026-02-21T10:30:21.4699517Z  'range_multi_buffers': [None],
2026-02-21T10:30:21.4699933Z  'range_num_stages': [0],
2026-02-21T10:30:21.4700744Z  'range_unroll_factors': [0],
2026-02-21T10:30:21.4701001Z  'range_warp_specializes': [],
2026-02-21T10:30:21.4701239Z  'reduction_loops': [None]}
2026-02-21T10:30:21.4733260Z [238s] Fitting surrogate: 673 points, 673 targets
2026-02-21T10:30:22.0353629Z [239s] Generation 13 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:30:25.4267590Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 5.2 configs/s
2026-02-21T10:30:27.3620704Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 17.5 configs/s
2026-02-21T10:30:32.1546819Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 210.0         
2026-02-21T10:30:32.1547314Z                                                                   configs/s     
2026-02-21T10:30:32.4737915Z [249s] Generation 13 complete: 
2026-02-21T10:30:32.4738334Z ok=34
2026-02-21T10:30:32.4738512Z min=0.0599
2026-02-21T10:30:32.4738680Z mid=0.0610
2026-02-21T10:30:32.4738851Z max=0.0979
2026-02-21T10:30:32.4739071Z best={'block_sizes': [1],
2026-02-21T10:30:32.4739505Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:30:32.4740161Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:30:32.4740623Z               'pointer'],
2026-02-21T10:30:32.4740966Z  'load_eviction_policies': ['', '', '', 'last', 'last', 'first', 'last', 'first'],
2026-02-21T10:30:32.4741354Z  'num_stages': 1,
2026-02-21T10:30:32.4741549Z  'num_warps': 8,
2026-02-21T10:30:32.4741739Z  'pid_type': 'flat',
2026-02-21T10:30:32.4741949Z  'range_flattens': [None],
2026-02-21T10:30:32.4742184Z  'range_multi_buffers': [None],
2026-02-21T10:30:32.4742425Z  'range_num_stages': [0],
2026-02-21T10:30:32.4742655Z  'range_unroll_factors': [0],
2026-02-21T10:30:32.4742897Z  'range_warp_specializes': [],
2026-02-21T10:30:32.4743148Z  'reduction_loops': [None]}
2026-02-21T10:30:32.4781278Z [249s] Fitting surrogate: 707 points, 707 targets
2026-02-21T10:30:33.0091428Z [250s] Generation 14 starting: 27 neighbors, 3 active search path(s)
2026-02-21T10:30:35.8406733Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 - configs/s
2026-02-21T10:30:37.5490525Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 17.4 configs/s
2026-02-21T10:30:42.6610420Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 223.2         
2026-02-21T10:30:42.6611563Z                                                                   configs/s     
2026-02-21T10:30:42.9636033Z [260s] Generation 14 complete: 
2026-02-21T10:30:42.9636475Z ok=30
2026-02-21T10:30:42.9636749Z min=0.0597
2026-02-21T10:30:42.9637009Z mid=0.0610
2026-02-21T10:30:42.9637268Z max=0.0772
2026-02-21T10:30:42.9637545Z best={'block_sizes': [1],
2026-02-21T10:30:42.9638253Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:30:42.9639288Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:30:42.9640005Z               'pointer'],
2026-02-21T10:30:42.9640530Z  'load_eviction_policies': ['', '', '', 'last', 'last', 'first', 'last', 'first'],
2026-02-21T10:30:42.9641694Z  'num_stages': 1,
2026-02-21T10:30:42.9642004Z  'num_warps': 8,
2026-02-21T10:30:42.9642298Z  'pid_type': 'flat',
2026-02-21T10:30:42.9642623Z  'range_flattens': [None],
2026-02-21T10:30:42.9642978Z  'range_multi_buffers': [None],
2026-02-21T10:30:42.9643336Z  'range_num_stages': [0],
2026-02-21T10:30:42.9643681Z  'range_unroll_factors': [0],
2026-02-21T10:30:42.9644341Z  'range_warp_specializes': [],
2026-02-21T10:30:42.9644722Z  'reduction_loops': [None]}
2026-02-21T10:30:42.9673745Z [260s] Fitting surrogate: 737 points, 737 targets
2026-02-21T10:30:43.4119066Z [260s] Generation 15 starting: 21 neighbors, 2 active search path(s)
2026-02-21T10:30:47.5590801Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 2.0 configs/s
2026-02-21T10:30:48.8658054Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.4 configs/s
2026-02-21T10:30:51.8989270Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 330.1         
2026-02-21T10:30:51.8989758Z                                                                   configs/s     
2026-02-21T10:30:52.1114659Z [269s] Generation 15 complete: 
2026-02-21T10:30:52.1114993Z ok=24
2026-02-21T10:30:52.1115228Z min=0.0635
2026-02-21T10:30:52.1115443Z mid=0.0653
2026-02-21T10:30:52.1115651Z max=0.3722
2026-02-21T10:30:52.1115889Z best={'block_sizes': [1],
2026-02-21T10:30:52.1116431Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:30:52.1117119Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:30:52.1117616Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:30:52.1118036Z  'num_stages': 1,
2026-02-21T10:30:52.1118288Z  'num_warps': 8,
2026-02-21T10:30:52.1118682Z  'pid_type': 'flat',
2026-02-21T10:30:52.1118977Z  'range_flattens': [None],
2026-02-21T10:30:52.1119282Z  'range_multi_buffers': [None],
2026-02-21T10:30:52.1119584Z  'range_num_stages': [0],
2026-02-21T10:30:52.1119858Z  'range_unroll_factors': [0],
2026-02-21T10:30:52.1120169Z  'range_warp_specializes': [],
2026-02-21T10:30:52.1120464Z  'reduction_loops': [None]}
2026-02-21T10:30:52.1157131Z [269s] Fitting surrogate: 761 points, 761 targets
2026-02-21T10:30:52.5069734Z [269s] Generation 16 starting: 17 neighbors, 2 active search path(s)
2026-02-21T10:30:54.8474826Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 10.3 configs/s
2026-02-21T10:30:55.9826468Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.4 configs/s
2026-02-21T10:30:58.6671929Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 372.4         
2026-02-21T10:30:58.6676970Z                                                                   configs/s     
2026-02-21T10:30:58.8618374Z [276s] Generation 16 complete: 
2026-02-21T10:30:58.8618679Z ok=20
2026-02-21T10:30:58.8618851Z min=0.0600
2026-02-21T10:30:58.8619037Z mid=0.0609
2026-02-21T10:30:58.8619203Z max=0.0958
2026-02-21T10:30:58.8619389Z best={'block_sizes': [1],
2026-02-21T10:30:58.8619839Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:30:58.8620458Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:30:58.8620990Z  'load_eviction_policies': ['', '', '', 'first', 'last', 'first', 'first', ''],
2026-02-21T10:30:58.8621364Z  'num_stages': 8,
2026-02-21T10:30:58.8621557Z  'num_warps': 16,
2026-02-21T10:30:58.8621754Z  'pid_type': 'flat',
2026-02-21T10:30:58.8621985Z  'range_flattens': [None],
2026-02-21T10:30:58.8622213Z  'range_multi_buffers': [None],
2026-02-21T10:30:58.8622458Z  'range_num_stages': [0],
2026-02-21T10:30:58.8622680Z  'range_unroll_factors': [0],
2026-02-21T10:30:58.8622930Z  'range_warp_specializes': [],
2026-02-21T10:30:58.8623176Z  'reduction_loops': [None]}
2026-02-21T10:30:58.8660852Z [276s] Fitting surrogate: 781 points, 781 targets
2026-02-21T10:30:59.2719413Z [276s] Generation 17 starting: 16 neighbors, 2 active search path(s)
2026-02-21T10:31:00.8610524Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 - configs/s
2026-02-21T10:31:01.7882933Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 16/16 18.2 configs/s
2026-02-21T10:31:04.4819480Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 371.1         
2026-02-21T10:31:04.4819981Z                                                                   configs/s     
2026-02-21T10:31:04.6752392Z [281s] Generation 17 complete: 
2026-02-21T10:31:04.6752675Z ok=18
2026-02-21T10:31:04.6752856Z min=0.0604
2026-02-21T10:31:04.6753038Z mid=0.0612
2026-02-21T10:31:04.6753234Z max=0.0733
2026-02-21T10:31:04.6753420Z best={'block_sizes': [1],
2026-02-21T10:31:04.6754666Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:31:04.6755309Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:31:04.6755798Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:31:04.6756141Z  'num_stages': 2,
2026-02-21T10:31:04.6756341Z  'num_warps': 16,
2026-02-21T10:31:04.6756542Z  'pid_type': 'flat',
2026-02-21T10:31:04.6756754Z  'range_flattens': [None],
2026-02-21T10:31:04.6756995Z  'range_multi_buffers': [None],
2026-02-21T10:31:04.6757261Z  'range_num_stages': [0],
2026-02-21T10:31:04.6757505Z  'range_unroll_factors': [0],
2026-02-21T10:31:04.6757763Z  'range_warp_specializes': [],
2026-02-21T10:31:04.6758008Z  'reduction_loops': [None]}
2026-02-21T10:31:04.6797503Z [281s] Fitting surrogate: 799 points, 799 targets
2026-02-21T10:31:04.9795662Z [282s] Generation 18 starting: 10 neighbors, 1 active search path(s)
2026-02-21T10:31:06.3647600Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 10.0 configs/s
2026-02-21T10:31:07.0293519Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.8 configs/s
2026-02-21T10:31:08.8671107Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 540.0         
2026-02-21T10:31:08.8671671Z                                                                   configs/s     
2026-02-21T10:31:09.0094859Z [286s] Generation 18 complete: 
2026-02-21T10:31:09.0095107Z ok=12
2026-02-21T10:31:09.0095277Z min=0.0636
2026-02-21T10:31:09.0095447Z mid=0.0677
2026-02-21T10:31:09.0095613Z max=0.0777
2026-02-21T10:31:09.0095806Z best={'block_sizes': [1],
2026-02-21T10:31:09.0096233Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:31:09.0096835Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:31:09.0097370Z  'load_eviction_policies': ['', '', '', 'first', 'last', 'first', 'first', ''],
2026-02-21T10:31:09.0097743Z  'num_stages': 8,
2026-02-21T10:31:09.0097935Z  'num_warps': 8,
2026-02-21T10:31:09.0098142Z  'pid_type': 'flat',
2026-02-21T10:31:09.0098348Z  'range_flattens': [None],
2026-02-21T10:31:09.0098580Z  'range_multi_buffers': [None],
2026-02-21T10:31:09.0098824Z  'range_num_stages': [0],
2026-02-21T10:31:09.0099050Z  'range_unroll_factors': [0],
2026-02-21T10:31:09.0099296Z  'range_warp_specializes': [],
2026-02-21T10:31:09.0099538Z  'reduction_loops': [None]}
2026-02-21T10:31:09.0138371Z [286s] Fitting surrogate: 811 points, 811 targets
2026-02-21T10:31:09.3014528Z [286s] Generation 19 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:31:10.8063956Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 10.1 configs/s
2026-02-21T10:31:11.4108814Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.9 configs/s
2026-02-21T10:31:13.0560618Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 602.4         
2026-02-21T10:31:13.0561062Z                                                                   configs/s     
2026-02-21T10:31:13.1888478Z [290s] Generation 19 complete: 
2026-02-21T10:31:13.1888752Z ok=11
2026-02-21T10:31:13.1888929Z min=0.0632
2026-02-21T10:31:13.1889118Z mid=0.0637
2026-02-21T10:31:13.1889694Z max=0.0700
2026-02-21T10:31:13.1889966Z best={'block_sizes': [1],
2026-02-21T10:31:13.1890416Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:31:13.1891017Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:31:13.1891547Z  'load_eviction_policies': ['', '', '', 'first', 'last', 'first', 'first', ''],
2026-02-21T10:31:13.1891926Z  'num_stages': 8,
2026-02-21T10:31:13.1892129Z  'num_warps': 8,
2026-02-21T10:31:13.1892325Z  'pid_type': 'flat',
2026-02-21T10:31:13.1892545Z  'range_flattens': [None],
2026-02-21T10:31:13.1892776Z  'range_multi_buffers': [None],
2026-02-21T10:31:13.1893026Z  'range_num_stages': [0],
2026-02-21T10:31:13.1893259Z  'range_unroll_factors': [0],
2026-02-21T10:31:13.1893811Z  'range_warp_specializes': [],
2026-02-21T10:31:13.1894407Z  'reduction_loops': [None]}
2026-02-21T10:31:13.1933907Z [290s] Fitting surrogate: 822 points, 822 targets
2026-02-21T10:31:13.4834978Z [290s] Generation 20 starting: 10 neighbors, 1 active search path(s)
2026-02-21T10:31:16.7880453Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 1.9 configs/s
2026-02-21T10:31:17.4588855Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.6 configs/s
2026-02-21T10:31:18.9259827Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 674.8         
2026-02-21T10:31:18.9260433Z                                                                   configs/s     
2026-02-21T10:31:19.0495227Z [296s] Generation 20 complete: 
2026-02-21T10:31:19.0495486Z ok=12
2026-02-21T10:31:19.0495659Z min=0.0593
2026-02-21T10:31:19.0495837Z mid=0.0628
2026-02-21T10:31:19.0496002Z max=0.3721
2026-02-21T10:31:19.0496189Z best={'block_sizes': [1],
2026-02-21T10:31:19.0496655Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:31:19.0497260Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:31:19.0497814Z  'load_eviction_policies': ['', '', '', 'first', 'last', 'first', 'first', ''],
2026-02-21T10:31:19.0498191Z  'num_stages': 8,
2026-02-21T10:31:19.0498390Z  'num_warps': 8,
2026-02-21T10:31:19.0498585Z  'pid_type': 'flat',
2026-02-21T10:31:19.0498805Z  'range_flattens': [None],
2026-02-21T10:31:19.0499037Z  'range_multi_buffers': [None],
2026-02-21T10:31:19.0499283Z  'range_num_stages': [0],
2026-02-21T10:31:19.0499534Z  'range_unroll_factors': [0],
2026-02-21T10:31:19.0499783Z  'range_warp_specializes': [],
2026-02-21T10:31:19.0500031Z  'reduction_loops': [None]}
2026-02-21T10:31:19.0542586Z [296s] Fitting surrogate: 834 points, 834 targets
2026-02-21T10:31:19.2136016Z [296s] Autotuning complete in 296.4s after searching 787 configs.
2026-02-21T10:31:19.2136466Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:31:19.2138301Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', '', '', 'first', 'last', 'first', 'first', ''], num_stages=8, num_warps=8, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:31:19.2140442Z 
2026-02-21T10:31:19.2140861Z [296s] Code of selected kernel: /tmp/torchinductor_root/lk/clkyfppznnotxvayhysrhf5i5ar5hptoqjq6mdwgd2o7l3sx7bfa.py
2026-02-21T10:31:19.2441167Z from __future__ import annotations
2026-02-21T10:31:19.2441424Z 
2026-02-21T10:31:19.2441516Z import torch
2026-02-21T10:31:19.2441710Z import triton
2026-02-21T10:31:19.2441943Z import triton.language as tl
2026-02-21T10:31:19.2442691Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:31:19.2443189Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:31:19.2443478Z 
2026-02-21T10:31:19.2443581Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T10:31:19.2443754Z 
2026-02-21T10:31:19.2443829Z @triton.jit
2026-02-21T10:31:19.2444447Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:31:19.2444969Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:31:19.2445293Z     pid_0 = tl.program_id(0)
2026-02-21T10:31:19.2445531Z     offset_0 = pid_0
2026-02-21T10:31:19.2445780Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T10:31:19.2446125Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:31:19.2446437Z     mask_1 = indices_1 < 5120
2026-02-21T10:31:19.2446753Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:31:19.2447295Z     acc = tl.load(x + (indices_0[:, None] * 5120 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T10:31:19.2447826Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:31:19.2448198Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:31:19.2448486Z     v_0 = 0.0001953125
2026-02-21T10:31:19.2448688Z     v_1 = sum_1 * v_0
2026-02-21T10:31:19.2448980Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:31:19.2449317Z     subscript = v_1[:, None]
2026-02-21T10:31:19.2449554Z     v_2 = acc - subscript
2026-02-21T10:31:19.2450007Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:31:19.2450455Z     v_3 = v_2 * v_2
2026-02-21T10:31:19.2451020Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T10:31:19.2451584Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T10:31:19.2451880Z     v_4 = 0.0001953125
2026-02-21T10:31:19.2452075Z     v_5 = sum_2 * v_4
2026-02-21T10:31:19.2452361Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:31:19.2452690Z     v_6 = v_5 + eps
2026-02-21T10:31:19.2452896Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:31:19.2453232Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:31:19.2453587Z     subscript_1 = v_7[:, None]
2026-02-21T10:31:19.2453825Z     v_8 = v_2 * subscript_1
2026-02-21T10:31:19.2454307Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:31:19.2454762Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0)
2026-02-21T10:31:19.2455079Z     v_9 = load_1[None, :]
2026-02-21T10:31:19.2455286Z     v_10 = v_8 * v_9
2026-02-21T10:31:19.2455521Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:31:19.2455869Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T10:31:19.2456299Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:31:19.2456728Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:31:19.2457044Z     # src[layer_norm.py:75]: )
2026-02-21T10:31:19.2457268Z     v_11 = load_2[None, :]
2026-02-21T10:31:19.2457678Z     v_12 = v_10 + v_11
2026-02-21T10:31:19.2457939Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:31:19.2458418Z     tl.store(out + (indices_0[:, None] * 5120 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T10:31:19.2458876Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:31:19.2459184Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:31:19.2459489Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:31:19.2459792Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:31:19.2459991Z 
2026-02-21T10:31:19.2460549Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:31:19.2461356Z     """
2026-02-21T10:31:19.2461593Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:31:19.2461884Z     Args:
2026-02-21T10:31:19.2462146Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:31:19.2462668Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:31:19.2463152Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:31:19.2463560Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:31:19.2464174Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:31:19.2464557Z     Returns:
2026-02-21T10:31:19.2464764Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:31:19.2465124Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:31:19.2465500Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:31:19.2465854Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:31:19.2466173Z     """
2026-02-21T10:31:19.2466338Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:31:19.2466562Z     m, n = x.size()
2026-02-21T10:31:19.2466885Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:31:19.2467367Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:31:19.2467709Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:31:19.2468081Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:31:19.2468443Z     if bias is not None:
2026-02-21T10:31:19.2468754Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:31:19.2469191Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:31:19.2469548Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:31:19.2469938Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:31:19.2470280Z     # src[layer_norm.py:52]: )
2026-02-21T10:31:19.2470625Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:31:19.2471044Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:31:19.2471421Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:31:19.2471756Z     # src[layer_norm.py:55]: )
2026-02-21T10:31:19.2472085Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:31:19.2472539Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:31:19.2472922Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:31:19.2473292Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:31:19.2473862Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:31:19.2474364Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:31:19.2474747Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:31:19.2475059Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:31:19.2475298Z     _RDIM_SIZE_1 = 8192
2026-02-21T10:31:19.2475512Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:31:19.2475831Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:31:19.2476139Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:31:19.2476377Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:31:19.2476950Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=8, num_stages=8)
2026-02-21T10:31:19.2477426Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:31:19.2477669Z     return (out, mean, rstd)
2026-02-21T10:31:20.3042271Z WARNING:tritonbench.utils.triton_op:Completed input ID 8:
2026-02-21T10:31:20.3042668Z (M, N)
2026-02-21T10:31:20.3042854Z ------------
2026-02-21T10:31:20.3043053Z (4096, 5120)
2026-02-21T10:31:20.3043169Z 
2026-02-21T10:31:20.3060403Z  30%|███       | 6/20 [30:17<1:11:01, 304.42s/it]WARNING:tritonbench.utils.triton_op:Running input ID 9:
2026-02-21T10:31:20.3060785Z (M, N)
2026-02-21T10:31:20.3060927Z ------------
2026-02-21T10:31:20.3061102Z (4096, 5632)
2026-02-21T10:31:20.3064136Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T10:31:21.7732045Z INFO:tritonbench.utils.triton_op:Took 3.44ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:31:23.1591618Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:31:24.7088436Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:31:24.7088776Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:31:24.7089084Z               'dtype': 'torch.float32',
2026-02-21T10:31:24.7089360Z               'shape': (4096, 5632),
2026-02-21T10:31:24.7089624Z               'stride': (5632, 1)},
2026-02-21T10:31:24.7089964Z             (5632,),
2026-02-21T10:31:24.7090178Z             { 'device': 'cuda:0',
2026-02-21T10:31:24.7090430Z               'dtype': 'torch.float32',
2026-02-21T10:31:24.7090692Z               'shape': (5632,),
2026-02-21T10:31:24.7090925Z               'stride': (1,)},
2026-02-21T10:31:24.7091161Z             { 'device': 'cuda:0',
2026-02-21T10:31:24.7091406Z               'dtype': 'torch.float32',
2026-02-21T10:31:24.7091655Z               'shape': (5632,),
2026-02-21T10:31:24.7091887Z               'stride': (1,)},
2026-02-21T10:31:24.7092102Z             1e-05),
2026-02-21T10:31:24.7092308Z   'kwargs': {}}
2026-02-21T10:31:24.7133870Z INFO:tritonbench.utils.triton_op:Took 5.03ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:31:24.7223349Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:31:24.7224414Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:31:24.7225153Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:31:24.7225567Z While processing:
2026-02-21T10:31:24.7226003Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:31:24.7226456Z     if bias is not None:
2026-02-21T10:31:24.7226693Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:31:24.7226831Z 
2026-02-21T10:31:24.8886475Z [0s] Autotune random seed: 2141537047
2026-02-21T10:31:24.9349189Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:32:00.1608279Z [35s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:32:00.6257262Z [35s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:32:01.9024456Z [36s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:32:01.9041971Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T10:32:07.9789747Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.6 configs/s
2026-02-21T10:32:07.9803440Z [43s] Adaptive compile timeout: 30s (90% percentile=7.4s, bounds=[30.0s, 30s])
2026-02-21T10:32:08.9876147Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 965.8 configs/s
2026-02-21T10:32:09.0832221Z [44s] Initial random population of 100, 5 starting points: 
2026-02-21T10:32:09.0832592Z error=10
2026-02-21T10:32:09.0832777Z timeout=3
2026-02-21T10:32:09.0832951Z ok=87
2026-02-21T10:32:09.0833120Z min=0.0771
2026-02-21T10:32:09.0833288Z mid=0.3450
2026-02-21T10:32:09.0833454Z max=16.8695
2026-02-21T10:32:09.0833637Z best={'block_sizes': [1],
2026-02-21T10:32:09.0834431Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:32:09.0834997Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:32:09.0835433Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:32:09.0835788Z  'num_stages': 1,
2026-02-21T10:32:09.0835979Z  'num_warps': 4,
2026-02-21T10:32:09.0836150Z  'pid_type': 'flat',
2026-02-21T10:32:09.0836343Z  'range_flattens': [None],
2026-02-21T10:32:09.0836547Z  'range_multi_buffers': [None],
2026-02-21T10:32:09.0836750Z  'range_num_stages': [0],
2026-02-21T10:32:09.0836946Z  'range_unroll_factors': [0],
2026-02-21T10:32:09.0837163Z  'range_warp_specializes': [],
2026-02-21T10:32:09.0837372Z  'reduction_loops': [4096]}
2026-02-21T10:32:09.0853744Z [44s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:32:10.5686439Z [45s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T10:32:30.8458534Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 1.9 configs/s
2026-02-21T10:32:36.6104330Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 16.2 configs/s
2026-02-21T10:32:48.2238598Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 86.8 configs/s
2026-02-21T10:32:48.8614773Z [83s] Generation 1 complete: 
2026-02-21T10:32:48.8620211Z ok=96
2026-02-21T10:32:48.8620400Z min=0.0670
2026-02-21T10:32:48.8620727Z mid=0.0939
2026-02-21T10:32:48.8620937Z max=0.6100
2026-02-21T10:32:48.8621132Z best={'block_sizes': [1],
2026-02-21T10:32:48.8621610Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:32:48.8622718Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:32:48.8623269Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T10:32:48.8623631Z  'num_stages': 1,
2026-02-21T10:32:48.8623818Z  'num_warps': 4,
2026-02-21T10:32:48.8624176Z  'pid_type': 'flat',
2026-02-21T10:32:48.8624391Z  'range_flattens': [None],
2026-02-21T10:32:48.8624618Z  'range_multi_buffers': [None],
2026-02-21T10:32:48.8624860Z  'range_num_stages': [0],
2026-02-21T10:32:48.8625081Z  'range_unroll_factors': [0],
2026-02-21T10:32:48.8625323Z  'range_warp_specializes': [],
2026-02-21T10:32:48.8625560Z  'reduction_loops': [None]}
2026-02-21T10:32:48.8644155Z [83s] Fitting surrogate: 196 points, 196 targets
2026-02-21T10:32:50.7992017Z [85s] Generation 2 starting: 76 neighbors, 5 active search path(s)
2026-02-21T10:33:27.4535275Z [122s] Timeout after 30s compiling Config(block_sizes=[4], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', '', 'first', '', 'last', '', 'first', ''], maxnreg=256, num_sm_multiplier=4, num_stages=2, num_warps=1, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[4], range_warp_specializes=[], reduction_loops=[4096])
2026-02-21T10:33:27.4555692Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81/81 0.5 configs/s
2026-02-21T10:33:32.3669378Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 81/81 16.6 configs/s
2026-02-21T10:33:42.1916059Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.6         
2026-02-21T10:33:42.1916642Z                                                                   configs/s     
2026-02-21T10:33:42.7620586Z [137s] Generation 2 complete: 
2026-02-21T10:33:42.7620911Z timeout=1
2026-02-21T10:33:42.7621145Z ok=81
2026-02-21T10:33:42.7621337Z min=0.0652
2026-02-21T10:33:42.7621533Z mid=0.0820
2026-02-21T10:33:42.7621700Z max=0.7546
2026-02-21T10:33:42.7621886Z best={'block_sizes': [1],
2026-02-21T10:33:42.7622276Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:33:42.7622788Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:33:42.7623216Z  'load_eviction_policies': ['', '', '', 'first', 'last', '', '', ''],
2026-02-21T10:33:42.7623571Z  'num_stages': 1,
2026-02-21T10:33:42.7623756Z  'num_warps': 16,
2026-02-21T10:33:42.7623956Z  'pid_type': 'flat',
2026-02-21T10:33:42.7624461Z  'range_flattens': [None],
2026-02-21T10:33:42.7624688Z  'range_multi_buffers': [None],
2026-02-21T10:33:42.7624927Z  'range_num_stages': [0],
2026-02-21T10:33:42.7625151Z  'range_unroll_factors': [0],
2026-02-21T10:33:42.7625391Z  'range_warp_specializes': [],
2026-02-21T10:33:42.7625625Z  'reduction_loops': [None]}
2026-02-21T10:33:42.7649761Z [137s] Fitting surrogate: 278 points, 278 targets
2026-02-21T10:33:43.7144645Z [138s] Generation 3 starting: 59 neighbors, 5 active search path(s)
2026-02-21T10:33:50.6904592Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 2.8 configs/s
2026-02-21T10:33:53.8620766Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 19.9 configs/s
2026-02-21T10:34:03.0341171Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.0         
2026-02-21T10:34:03.0341818Z                                                                   configs/s     
2026-02-21T10:34:03.5336089Z [158s] Generation 3 complete: 
2026-02-21T10:34:03.5339056Z error=10
2026-02-21T10:34:03.5339269Z ok=55
2026-02-21T10:34:03.5339444Z min=0.0655
2026-02-21T10:34:03.5339613Z mid=0.0730
2026-02-21T10:34:03.5339789Z max=0.1043
2026-02-21T10:34:03.5339999Z best={'block_sizes': [1],
2026-02-21T10:34:03.5340402Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:34:03.5340926Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:34:03.5341874Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:34:03.5342218Z  'num_stages': 1,
2026-02-21T10:34:03.5342425Z  'num_warps': 4,
2026-02-21T10:34:03.5342624Z  'pid_type': 'flat',
2026-02-21T10:34:03.5342836Z  'range_flattens': [None],
2026-02-21T10:34:03.5343063Z  'range_multi_buffers': [None],
2026-02-21T10:34:03.5343304Z  'range_num_stages': [0],
2026-02-21T10:34:03.5343525Z  'range_unroll_factors': [0],
2026-02-21T10:34:03.5343770Z  'range_warp_specializes': [],
2026-02-21T10:34:03.5344298Z  'reduction_loops': [None]}
2026-02-21T10:34:03.5365116Z [158s] Fitting surrogate: 343 points, 343 targets
2026-02-21T10:34:04.3488327Z [159s] Generation 4 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:34:12.5080694Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 1.6 configs/s
2026-02-21T10:34:15.5713253Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 16.9 configs/s
2026-02-21T10:34:23.4779696Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 127.5         
2026-02-21T10:34:23.4780185Z                                                                   configs/s     
2026-02-21T10:34:23.9641111Z [179s] Generation 4 complete: 
2026-02-21T10:34:23.9641514Z ok=55
2026-02-21T10:34:23.9641786Z min=0.0657
2026-02-21T10:34:23.9642059Z mid=0.0700
2026-02-21T10:34:23.9642319Z max=0.7899
2026-02-21T10:34:23.9642596Z best={'block_sizes': [1],
2026-02-21T10:34:23.9643217Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:34:23.9644445Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:34:23.9645165Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:34:23.9645726Z  'num_stages': 1,
2026-02-21T10:34:23.9646028Z  'num_warps': 8,
2026-02-21T10:34:23.9646332Z  'pid_type': 'flat',
2026-02-21T10:34:23.9646648Z  'range_flattens': [None],
2026-02-21T10:34:23.9647027Z  'range_multi_buffers': [None],
2026-02-21T10:34:23.9647395Z  'range_num_stages': [0],
2026-02-21T10:34:23.9647738Z  'range_unroll_factors': [0],
2026-02-21T10:34:23.9648109Z  'range_warp_specializes': [],
2026-02-21T10:34:23.9648469Z  'reduction_loops': [None]}
2026-02-21T10:34:23.9672618Z [179s] Fitting surrogate: 398 points, 398 targets
2026-02-21T10:34:24.7751581Z [179s] Generation 5 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:34:31.2571196Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 7.7 configs/s
2026-02-21T10:34:34.4660370Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 16.4 configs/s
2026-02-21T10:34:43.2677902Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 124.4         
2026-02-21T10:34:43.2678462Z                                                                   configs/s     
2026-02-21T10:34:43.7616808Z [198s] Generation 5 complete: 
2026-02-21T10:34:43.7617051Z ok=55
2026-02-21T10:34:43.7617245Z min=0.0655
2026-02-21T10:34:43.7617405Z mid=0.0685
2026-02-21T10:34:43.7617567Z max=0.6000
2026-02-21T10:34:43.7617735Z best={'block_sizes': [2],
2026-02-21T10:34:43.7618151Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:34:43.7618742Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:34:43.7619222Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', 'first', ''],
2026-02-21T10:34:43.7619568Z  'num_stages': 8,
2026-02-21T10:34:43.7619746Z  'num_warps': 16,
2026-02-21T10:34:43.7619933Z  'pid_type': 'flat',
2026-02-21T10:34:43.7620124Z  'range_flattens': [None],
2026-02-21T10:34:43.7620351Z  'range_multi_buffers': [None],
2026-02-21T10:34:43.7620573Z  'range_num_stages': [0],
2026-02-21T10:34:43.7620798Z  'range_unroll_factors': [0],
2026-02-21T10:34:43.7621022Z  'range_warp_specializes': [],
2026-02-21T10:34:43.7621251Z  'reduction_loops': [None]}
2026-02-21T10:34:43.7647204Z [198s] Fitting surrogate: 453 points, 453 targets
2026-02-21T10:34:44.5801890Z [199s] Generation 6 starting: 48 neighbors, 5 active search path(s)
2026-02-21T10:34:54.2992373Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 2.9 configs/s
2026-02-21T10:34:57.2478203Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 17.2 configs/s
2026-02-21T10:35:05.0721797Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.9         
2026-02-21T10:35:05.0722305Z                                                                   configs/s     
2026-02-21T10:35:05.5527769Z [220s] Generation 6 complete: 
2026-02-21T10:35:05.5528174Z error=1
2026-02-21T10:35:05.5528436Z ok=52
2026-02-21T10:35:05.5528701Z min=0.0652
2026-02-21T10:35:05.5528922Z mid=0.0696
2026-02-21T10:35:05.5529621Z max=0.4167
2026-02-21T10:35:05.5529925Z best={'block_sizes': [2],
2026-02-21T10:35:05.5530351Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:35:05.5530945Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:35:05.5531424Z  'load_eviction_policies': ['', '', '', 'first', 'last', '', '', ''],
2026-02-21T10:35:05.5531785Z  'num_stages': 1,
2026-02-21T10:35:05.5531980Z  'num_warps': 4,
2026-02-21T10:35:05.5532184Z  'pid_type': 'flat',
2026-02-21T10:35:05.5532400Z  'range_flattens': [None],
2026-02-21T10:35:05.5532647Z  'range_multi_buffers': [None],
2026-02-21T10:35:05.5532896Z  'range_num_stages': [0],
2026-02-21T10:35:05.5533135Z  'range_unroll_factors': [0],
2026-02-21T10:35:05.5533388Z  'range_warp_specializes': [],
2026-02-21T10:35:05.5533642Z  'reduction_loops': [None]}
2026-02-21T10:35:05.5565700Z [220s] Fitting surrogate: 506 points, 506 targets
2026-02-21T10:35:06.1282917Z [221s] Generation 7 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:35:12.6135416Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 1.8 configs/s
2026-02-21T10:35:14.5749027Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 32/32 16.7 configs/s
2026-02-21T10:35:18.9701063Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 228.6         
2026-02-21T10:35:18.9701688Z                                                                   configs/s     
2026-02-21T10:35:19.2550886Z [234s] Generation 7 complete: 
2026-02-21T10:35:19.2551155Z ok=33
2026-02-21T10:35:19.2551334Z min=0.0651
2026-02-21T10:35:19.2551515Z mid=0.0688
2026-02-21T10:35:19.2551680Z max=0.9154
2026-02-21T10:35:19.2551870Z best={'block_sizes': [2],
2026-02-21T10:35:19.2552274Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:35:19.2552822Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:35:19.2553337Z  'load_eviction_policies': ['', '', '', 'first', 'last', 'last', '', ''],
2026-02-21T10:35:19.2553693Z  'num_stages': 1,
2026-02-21T10:35:19.2553896Z  'num_warps': 4,
2026-02-21T10:35:19.2554402Z  'pid_type': 'flat',
2026-02-21T10:35:19.2558778Z  'range_flattens': [None],
2026-02-21T10:35:19.2558996Z  'range_multi_buffers': [None],
2026-02-21T10:35:19.2559223Z  'range_num_stages': [0],
2026-02-21T10:35:19.2559429Z  'range_unroll_factors': [0],
2026-02-21T10:35:19.2559657Z  'range_warp_specializes': [],
2026-02-21T10:35:19.2559882Z  'reduction_loops': [None]}
2026-02-21T10:35:19.2584745Z [234s] Fitting surrogate: 539 points, 539 targets
2026-02-21T10:35:19.8339374Z [234s] Generation 8 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:35:28.3481913Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 0.8 configs/s
2026-02-21T10:35:30.1948318Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 31/31 17.2 configs/s
2026-02-21T10:35:35.6654798Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 211.4         
2026-02-21T10:35:35.6655287Z                                                                   configs/s     
2026-02-21T10:35:35.9718661Z [251s] Generation 8 complete: 
2026-02-21T10:35:35.9718996Z ok=33
2026-02-21T10:35:35.9719175Z min=0.0648
2026-02-21T10:35:35.9719364Z mid=0.0665
2026-02-21T10:35:35.9719533Z max=1.2730
2026-02-21T10:35:35.9719724Z best={'block_sizes': [2],
2026-02-21T10:35:35.9720128Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:35:35.9720683Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:35:35.9721166Z  'load_eviction_policies': ['', '', '', 'first', 'last', 'last', '', ''],
2026-02-21T10:35:35.9721546Z  'num_stages': 1,
2026-02-21T10:35:35.9721746Z  'num_warps': 4,
2026-02-21T10:35:35.9721957Z  'pid_type': 'flat',
2026-02-21T10:35:35.9722176Z  'range_flattens': [None],
2026-02-21T10:35:35.9722409Z  'range_multi_buffers': [None],
2026-02-21T10:35:35.9722669Z  'range_num_stages': [0],
2026-02-21T10:35:35.9722898Z  'range_unroll_factors': [0],
2026-02-21T10:35:35.9723150Z  'range_warp_specializes': [],
2026-02-21T10:35:35.9723394Z  'reduction_loops': [None]}
2026-02-21T10:35:35.9749814Z [251s] Fitting surrogate: 572 points, 572 targets
2026-02-21T10:35:36.5185973Z [251s] Generation 9 starting: 27 neighbors, 3 active search path(s)
2026-02-21T10:35:40.8764501Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 12.0 configs/s
2026-02-21T10:35:42.7936048Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 27/27 14.3 configs/s
2026-02-21T10:35:47.0121003Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 237.9         
2026-02-21T10:35:47.0121509Z                                                                   configs/s     
2026-02-21T10:35:47.2944584Z [262s] Generation 9 complete: 
2026-02-21T10:35:47.2944839Z ok=30
2026-02-21T10:35:47.2945013Z min=0.0683
2026-02-21T10:35:47.2945201Z mid=0.0690
2026-02-21T10:35:47.2945396Z max=0.3144
2026-02-21T10:35:47.2945582Z best={'block_sizes': [1],
2026-02-21T10:35:47.2946027Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:35:47.2946711Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:35:47.2947164Z               'tensor_descriptor'],
2026-02-21T10:35:47.2947509Z  'load_eviction_policies': ['', '', '', 'last', '', 'last', '', ''],
2026-02-21T10:35:47.2947939Z  'num_stages': 5,
2026-02-21T10:35:47.2958528Z  'num_warps': 16,
2026-02-21T10:35:47.2958780Z  'pid_type': 'flat',
2026-02-21T10:35:47.2958991Z  'range_flattens': [None],
2026-02-21T10:35:47.2959209Z  'range_multi_buffers': [None],
2026-02-21T10:35:47.2959422Z  'range_num_stages': [0],
2026-02-21T10:35:47.2959629Z  'range_unroll_factors': [0],
2026-02-21T10:35:47.2959840Z  'range_warp_specializes': [],
2026-02-21T10:35:47.2960062Z  'reduction_loops': [4096]}
2026-02-21T10:35:47.2981262Z [262s] Fitting surrogate: 602 points, 602 targets
2026-02-21T10:35:47.7654301Z [262s] Generation 10 starting: 22 neighbors, 2 active search path(s)
2026-02-21T10:35:51.0237611Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 5.7 configs/s
2026-02-21T10:35:52.4049656Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 18.0 configs/s
2026-02-21T10:35:55.8165810Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 293.3         
2026-02-21T10:35:55.8166266Z                                                                   configs/s     
2026-02-21T10:35:56.0409297Z [271s] Generation 10 complete: 
2026-02-21T10:35:56.0409579Z error=1
2026-02-21T10:35:56.0409838Z ok=24
2026-02-21T10:35:56.0410025Z min=0.0652
2026-02-21T10:35:56.0410200Z mid=0.0743
2026-02-21T10:35:56.0410379Z max=0.2862
2026-02-21T10:35:56.0410568Z best={'block_sizes': [2],
2026-02-21T10:35:56.0411033Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:35:56.0412111Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:35:56.0412592Z               'pointer'],
2026-02-21T10:35:56.0412953Z  'load_eviction_policies': ['', 'last', 'last', 'first', 'last', '', '', ''],
2026-02-21T10:35:56.0413338Z  'num_stages': 1,
2026-02-21T10:35:56.0413564Z  'num_warps': 16,
2026-02-21T10:35:56.0413799Z  'pid_type': 'flat',
2026-02-21T10:35:56.0414348Z  'range_flattens': [None],
2026-02-21T10:35:56.0414589Z  'range_multi_buffers': [None],
2026-02-21T10:35:56.0414832Z  'range_num_stages': [0],
2026-02-21T10:35:56.0415055Z  'range_unroll_factors': [0],
2026-02-21T10:35:56.0415299Z  'range_warp_specializes': [],
2026-02-21T10:35:56.0415544Z  'reduction_loops': [None]}
2026-02-21T10:35:56.0446879Z [271s] Fitting surrogate: 627 points, 627 targets
2026-02-21T10:35:56.4602882Z [271s] Generation 11 starting: 19 neighbors, 2 active search path(s)
2026-02-21T10:35:59.6823309Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 6.3 configs/s
2026-02-21T10:36:00.8107804Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.6 configs/s
2026-02-21T10:36:03.7438496Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 341.0         
2026-02-21T10:36:03.7439000Z                                                                   configs/s     
2026-02-21T10:36:03.9487176Z [279s] Generation 11 complete: 
2026-02-21T10:36:03.9487660Z ok=21
2026-02-21T10:36:03.9487955Z min=0.0656
2026-02-21T10:36:03.9488241Z mid=0.0661
2026-02-21T10:36:03.9488513Z max=0.3383
2026-02-21T10:36:03.9488806Z best={'block_sizes': [2],
2026-02-21T10:36:03.9489570Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:36:03.9490559Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:36:03.9491040Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:36:03.9491437Z  'load_eviction_policies': ['', 'last', 'last', 'first', 'last', '', '', ''],
2026-02-21T10:36:03.9491830Z  'num_stages': 1,
2026-02-21T10:36:03.9492024Z  'num_warps': 16,
2026-02-21T10:36:03.9492212Z  'pid_type': 'flat',
2026-02-21T10:36:03.9492433Z  'range_flattens': [None],
2026-02-21T10:36:03.9492661Z  'range_multi_buffers': [None],
2026-02-21T10:36:03.9492903Z  'range_num_stages': [0],
2026-02-21T10:36:03.9493130Z  'range_unroll_factors': [0],
2026-02-21T10:36:03.9493376Z  'range_warp_specializes': [],
2026-02-21T10:36:03.9493615Z  'reduction_loops': [None]}
2026-02-21T10:36:03.9523335Z [279s] Fitting surrogate: 648 points, 648 targets
2026-02-21T10:36:04.3741116Z [279s] Generation 12 starting: 19 neighbors, 2 active search path(s)
2026-02-21T10:36:06.8372520Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 10.6 configs/s
2026-02-21T10:36:08.0180966Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.6 configs/s
2026-02-21T10:36:11.2833909Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 306.8         
2026-02-21T10:36:11.2834615Z                                                                   configs/s     
2026-02-21T10:36:11.4974977Z [286s] Generation 12 complete: 
2026-02-21T10:36:11.4975668Z ok=22
2026-02-21T10:36:11.4975852Z min=0.0682
2026-02-21T10:36:11.4976024Z mid=0.0689
2026-02-21T10:36:11.4976197Z max=0.1066
2026-02-21T10:36:11.4976382Z best={'block_sizes': [2],
2026-02-21T10:36:11.4976787Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:36:11.4977409Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:36:11.4977889Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:36:11.4978284Z  'load_eviction_policies': ['', 'last', 'last', 'first', 'last', '', '', ''],
2026-02-21T10:36:11.4978660Z  'num_stages': 1,
2026-02-21T10:36:11.4978856Z  'num_warps': 4,
2026-02-21T10:36:11.4979046Z  'pid_type': 'flat',
2026-02-21T10:36:11.4979255Z  'range_flattens': [None],
2026-02-21T10:36:11.4979746Z  'range_multi_buffers': [None],
2026-02-21T10:36:11.4979998Z  'range_num_stages': [0],
2026-02-21T10:36:11.4980220Z  'range_unroll_factors': [0],
2026-02-21T10:36:11.4980471Z  'range_warp_specializes': [],
2026-02-21T10:36:11.4980708Z  'reduction_loops': [None]}
2026-02-21T10:36:11.5012754Z [286s] Fitting surrogate: 670 points, 670 targets
2026-02-21T10:36:11.9376060Z [287s] Generation 13 starting: 20 neighbors, 2 active search path(s)
2026-02-21T10:36:14.7355459Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 9.9 configs/s
2026-02-21T10:36:15.8716318Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 20.3 configs/s
2026-02-21T10:36:19.0102731Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 318.9         
2026-02-21T10:36:19.0103224Z                                                                   configs/s     
2026-02-21T10:36:19.2246097Z [294s] Generation 13 complete: 
2026-02-21T10:36:19.2246535Z error=3
2026-02-21T10:36:19.2246857Z ok=20
2026-02-21T10:36:19.2247134Z min=0.0651
2026-02-21T10:36:19.2247408Z mid=0.0670
2026-02-21T10:36:19.2247702Z max=0.0890
2026-02-21T10:36:19.2248010Z best={'block_sizes': [2],
2026-02-21T10:36:19.2248699Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:36:19.2249839Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:36:19.2250680Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:36:19.2251269Z  'load_eviction_policies': ['', 'last', 'last', 'first', 'last', '', '', ''],
2026-02-21T10:36:19.2251604Z  'num_stages': 1,
2026-02-21T10:36:19.2251778Z  'num_warps': 4,
2026-02-21T10:36:19.2251947Z  'pid_type': 'flat',
2026-02-21T10:36:19.2252135Z  'range_flattens': [None],
2026-02-21T10:36:19.2252339Z  'range_multi_buffers': [None],
2026-02-21T10:36:19.2252546Z  'range_num_stages': [0],
2026-02-21T10:36:19.2252746Z  'range_unroll_factors': [0],
2026-02-21T10:36:19.2252968Z  'range_warp_specializes': [],
2026-02-21T10:36:19.2253199Z  'reduction_loops': [None]}
2026-02-21T10:36:19.2284502Z [294s] Fitting surrogate: 693 points, 693 targets
2026-02-21T10:36:19.5057005Z [294s] Generation 14 starting: 10 neighbors, 1 active search path(s)
2026-02-21T10:36:21.3723145Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 3.8 configs/s
2026-02-21T10:36:21.9590766Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.6 configs/s
2026-02-21T10:36:24.2570497Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 595.5         
2026-02-21T10:36:24.2572109Z                                                                   configs/s     
2026-02-21T10:36:24.3901762Z [299s] Generation 14 complete: 
2026-02-21T10:36:24.3902037Z ok=12
2026-02-21T10:36:24.3902234Z min=0.0655
2026-02-21T10:36:24.3902404Z mid=0.0658
2026-02-21T10:36:24.3902576Z max=0.6356
2026-02-21T10:36:24.3902755Z best={'block_sizes': [1],
2026-02-21T10:36:24.3903223Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:36:24.3904545Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:36:24.3905819Z               'tensor_descriptor'],
2026-02-21T10:36:24.3906355Z  'load_eviction_policies': ['', '', '', '', 'first', 'last', 'last', ''],
2026-02-21T10:36:24.3906914Z  'num_stages': 5,
2026-02-21T10:36:24.3907211Z  'num_warps': 16,
2026-02-21T10:36:24.3907505Z  'pid_type': 'flat',
2026-02-21T10:36:24.3907846Z  'range_flattens': [None],
2026-02-21T10:36:24.3908200Z  'range_multi_buffers': [None],
2026-02-21T10:36:24.3908574Z  'range_num_stages': [0],
2026-02-21T10:36:24.3908911Z  'range_unroll_factors': [0],
2026-02-21T10:36:24.3909283Z  'range_warp_specializes': [],
2026-02-21T10:36:24.3909640Z  'reduction_loops': [None]}
2026-02-21T10:36:24.3933917Z [299s] Fitting surrogate: 705 points, 705 targets
2026-02-21T10:36:24.5403851Z [299s] Autotuning complete in 299.6s after searching 670 configs.
2026-02-21T10:36:24.5404641Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:36:24.5406557Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', '', '', '', 'first', 'last', 'last', ''], num_stages=5, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:36:24.5408340Z 
2026-02-21T10:36:24.5408725Z [299s] Code of selected kernel: /tmp/torchinductor_root/pe/cpe2fomw66mlwz3cfp5ca6k247idkyv7bbjjdr467kqcl6xo3znx.py
2026-02-21T10:36:24.5674191Z from __future__ import annotations
2026-02-21T10:36:24.5674408Z 
2026-02-21T10:36:24.5674491Z import torch
2026-02-21T10:36:24.5674678Z import triton
2026-02-21T10:36:24.5674874Z import triton.language as tl
2026-02-21T10:36:24.5675188Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:36:24.5675607Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:36:24.5675877Z 
2026-02-21T10:36:24.5675985Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T10:36:24.5676138Z 
2026-02-21T10:36:24.5676228Z @triton.jit
2026-02-21T10:36:24.5676567Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:36:24.5677047Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:36:24.5677333Z     pid_0 = tl.program_id(0)
2026-02-21T10:36:24.5677547Z     offset_0 = pid_0
2026-02-21T10:36:24.5677787Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T10:36:24.5678099Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:36:24.5678382Z     mask_1 = indices_1 < 5632
2026-02-21T10:36:24.5678669Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:36:24.5679148Z     acc = tl.load(x + (indices_0[:, None] * 5632 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T10:36:24.5679630Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:36:24.5679980Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:36:24.5680244Z     v_0 = 0.0001775568181818182
2026-02-21T10:36:24.5680449Z     v_1 = sum_1 * v_0
2026-02-21T10:36:24.5680707Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:36:24.5681017Z     subscript = v_1[:, None]
2026-02-21T10:36:24.5681244Z     v_2 = acc - subscript
2026-02-21T10:36:24.5681569Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:36:24.5681931Z     v_3 = v_2 * v_2
2026-02-21T10:36:24.5682357Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T10:36:24.5682883Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T10:36:24.5683159Z     v_4 = 0.0001775568181818182
2026-02-21T10:36:24.5683356Z     v_5 = sum_2 * v_4
2026-02-21T10:36:24.5683617Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:36:24.5684302Z     v_6 = v_5 + eps
2026-02-21T10:36:24.5684476Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:36:24.5684753Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:36:24.5685050Z     subscript_1 = v_7[:, None]
2026-02-21T10:36:24.5685241Z     v_8 = v_2 * subscript_1
2026-02-21T10:36:24.5685513Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:36:24.5685880Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0)
2026-02-21T10:36:24.5686136Z     v_9 = load_1[None, :]
2026-02-21T10:36:24.5686313Z     v_10 = v_8 * v_9
2026-02-21T10:36:24.5686514Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:36:24.5686808Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T10:36:24.5687312Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:36:24.5687682Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:36:24.5687950Z     # src[layer_norm.py:75]: )
2026-02-21T10:36:24.5688145Z     v_11 = load_2[None, :]
2026-02-21T10:36:24.5688325Z     v_12 = v_10 + v_11
2026-02-21T10:36:24.5688542Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:36:24.5688927Z     tl.store(out + (indices_0[:, None] * 5632 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T10:36:24.5689295Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:36:24.5689558Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:36:24.5689901Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:36:24.5690225Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:36:24.5690430Z 
2026-02-21T10:36:24.5690886Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:36:24.5691461Z     """
2026-02-21T10:36:24.5691695Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:36:24.5691991Z     Args:
2026-02-21T10:36:24.5692256Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:36:24.5692780Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:36:24.5693264Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:36:24.5693680Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:36:24.5694366Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:36:24.5694752Z     Returns:
2026-02-21T10:36:24.5694949Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:36:24.5695323Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:36:24.5695706Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:36:24.5696063Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:36:24.5696383Z     """
2026-02-21T10:36:24.5696545Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:36:24.5696769Z     m, n = x.size()
2026-02-21T10:36:24.5697093Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:36:24.5697569Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:36:24.5697910Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:36:24.5698281Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:36:24.5698658Z     if bias is not None:
2026-02-21T10:36:24.5698976Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:36:24.5699433Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:36:24.5699968Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:36:24.5700356Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:36:24.5700715Z     # src[layer_norm.py:52]: )
2026-02-21T10:36:24.5701053Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:36:24.5701475Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:36:24.5701853Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:36:24.5702183Z     # src[layer_norm.py:55]: )
2026-02-21T10:36:24.5702513Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:36:24.5703106Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:36:24.5703492Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:36:24.5703884Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:36:24.5704425Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:36:24.5704812Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:36:24.5705203Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:36:24.5705525Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:36:24.5705767Z     _RDIM_SIZE_1 = 8192
2026-02-21T10:36:24.5705977Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:36:24.5706281Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:36:24.5706580Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:36:24.5706823Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:36:24.5707252Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=5)
2026-02-21T10:36:24.5707739Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:36:24.5707991Z     return (out, mean, rstd)
2026-02-21T10:36:25.7275066Z WARNING:tritonbench.utils.triton_op:Completed input ID 9:
2026-02-21T10:36:25.7275617Z (M, N)
2026-02-21T10:36:25.7275902Z ------------
2026-02-21T10:36:25.7276183Z (4096, 5632)
2026-02-21T10:36:25.7276363Z 
2026-02-21T10:36:25.7291589Z  35%|███▌      | 7/20 [35:22<1:06:01, 304.75s/it]WARNING:tritonbench.utils.triton_op:Running input ID 11:
2026-02-21T10:36:25.7292016Z (M, N)
2026-02-21T10:36:25.7292170Z ------------
2026-02-21T10:36:25.7292335Z (4096, 6656)
2026-02-21T10:36:25.7293775Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T10:36:27.1507827Z INFO:tritonbench.utils.triton_op:Took 2.97ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:36:29.0588475Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:36:30.5728921Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:36:30.5729417Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:36:30.5729971Z               'dtype': 'torch.float32',
2026-02-21T10:36:30.5730409Z               'shape': (4096, 6656),
2026-02-21T10:36:30.5730802Z               'stride': (6656, 1)},
2026-02-21T10:36:30.5731163Z             (6656,),
2026-02-21T10:36:30.5731473Z             { 'device': 'cuda:0',
2026-02-21T10:36:30.5731854Z               'dtype': 'torch.float32',
2026-02-21T10:36:30.5732243Z               'shape': (6656,),
2026-02-21T10:36:30.5732600Z               'stride': (1,)},
2026-02-21T10:36:30.5732940Z             { 'device': 'cuda:0',
2026-02-21T10:36:30.5733311Z               'dtype': 'torch.float32',
2026-02-21T10:36:30.5733692Z               'shape': (6656,),
2026-02-21T10:36:30.5734449Z               'stride': (1,)},
2026-02-21T10:36:30.5734788Z             1e-05),
2026-02-21T10:36:30.5735092Z   'kwargs': {}}
2026-02-21T10:36:30.5755314Z INFO:tritonbench.utils.triton_op:Took 3.01ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:36:30.5874672Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:36:30.5876066Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:36:30.5876982Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:36:30.5877505Z While processing:
2026-02-21T10:36:30.5878221Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:36:30.5878694Z     if bias is not None:
2026-02-21T10:36:30.5878893Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:36:30.5879013Z 
2026-02-21T10:36:30.7486931Z [0s] Autotune random seed: 2141537047
2026-02-21T10:36:30.7961913Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:37:05.6371746Z [34s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:37:06.1360384Z [35s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:37:07.6003467Z [36s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:37:07.6023334Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T10:37:13.8097562Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.2 configs/s
2026-02-21T10:37:13.8107328Z [43s] Adaptive compile timeout: 30s (90% percentile=8.4s, bounds=[30.0s, 30s])
2026-02-21T10:37:14.9452363Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 855.5 configs/s
2026-02-21T10:37:15.0442643Z [44s] Initial random population of 100, 5 starting points: 
2026-02-21T10:37:15.0443229Z error=10
2026-02-21T10:37:15.0443674Z timeout=3
2026-02-21T10:37:15.0443954Z ok=87
2026-02-21T10:37:15.0444649Z min=0.0938
2026-02-21T10:37:15.0445002Z mid=0.3923
2026-02-21T10:37:15.0445346Z max=19.7495
2026-02-21T10:37:15.0445717Z best={'block_sizes': [1],
2026-02-21T10:37:15.0446430Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:37:15.0447328Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:37:15.0448043Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:37:15.0448625Z  'num_stages': 1,
2026-02-21T10:37:15.0449113Z  'num_warps': 4,
2026-02-21T10:37:15.0449613Z  'pid_type': 'flat',
2026-02-21T10:37:15.0450227Z  'range_flattens': [None],
2026-02-21T10:37:15.0450599Z  'range_multi_buffers': [None],
2026-02-21T10:37:15.0451196Z  'range_num_stages': [0],
2026-02-21T10:37:15.0451392Z  'range_unroll_factors': [0],
2026-02-21T10:37:15.0451613Z  'range_warp_specializes': [],
2026-02-21T10:37:15.0451820Z  'reduction_loops': [4096]}
2026-02-21T10:37:15.0465165Z [44s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:37:16.3885631Z [45s] Generation 1 starting: 82 neighbors, 5 active search path(s)
2026-02-21T10:37:32.5732447Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 1.0 configs/s
2026-02-21T10:37:37.7698702Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 16.5 configs/s
2026-02-21T10:37:47.3230785Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 105.3         
2026-02-21T10:37:47.3231304Z                                                                   configs/s     
2026-02-21T10:37:47.8179662Z [77s] Generation 1 complete: 
2026-02-21T10:37:47.8180176Z error=1
2026-02-21T10:37:47.8180467Z ok=87
2026-02-21T10:37:47.8180729Z min=0.0764
2026-02-21T10:37:47.8181050Z mid=0.1100
2026-02-21T10:37:47.8181319Z max=0.8678
2026-02-21T10:37:47.8181633Z best={'block_sizes': [1],
2026-02-21T10:37:47.8182559Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:37:47.8183538Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:37:47.8184270Z  'load_eviction_policies': ['', '', '', '', '', '', 'last', ''],
2026-02-21T10:37:47.8184628Z  'num_stages': 1,
2026-02-21T10:37:47.8184831Z  'num_warps': 8,
2026-02-21T10:37:47.8185017Z  'pid_type': 'flat',
2026-02-21T10:37:47.8185259Z  'range_flattens': [None],
2026-02-21T10:37:47.8185488Z  'range_multi_buffers': [None],
2026-02-21T10:37:47.8185741Z  'range_num_stages': [0],
2026-02-21T10:37:47.8185966Z  'range_unroll_factors': [0],
2026-02-21T10:37:47.8186225Z  'range_warp_specializes': [],
2026-02-21T10:37:47.8186471Z  'reduction_loops': [None]}
2026-02-21T10:37:47.8205575Z [77s] Fitting surrogate: 188 points, 188 targets
2026-02-21T10:37:49.2655653Z [78s] Generation 2 starting: 88 neighbors, 5 active search path(s)
2026-02-21T10:38:05.3057627Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 1.4 configs/s
2026-02-21T10:38:10.5346559Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 17.4 configs/s
2026-02-21T10:38:23.2230687Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 79.5 configs/s
2026-02-21T10:38:23.9204570Z [113s] Generation 2 complete: 
2026-02-21T10:38:23.9208327Z error=5
2026-02-21T10:38:23.9208915Z ok=88
2026-02-21T10:38:23.9209220Z min=0.0773
2026-02-21T10:38:23.9209513Z mid=0.0891
2026-02-21T10:38:23.9209777Z max=0.6220
2026-02-21T10:38:23.9210245Z best={'block_sizes': [1],
2026-02-21T10:38:23.9210912Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:38:23.9211802Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:38:23.9212468Z  'load_eviction_policies': ['', '', '', '', '', '', 'last', ''],
2026-02-21T10:38:23.9213643Z  'num_stages': 1,
2026-02-21T10:38:23.9213959Z  'num_warps': 8,
2026-02-21T10:38:23.9214629Z  'pid_type': 'flat',
2026-02-21T10:38:23.9214974Z  'range_flattens': [None],
2026-02-21T10:38:23.9215344Z  'range_multi_buffers': [None],
2026-02-21T10:38:23.9215736Z  'range_num_stages': [0],
2026-02-21T10:38:23.9216104Z  'range_unroll_factors': [0],
2026-02-21T10:38:23.9216499Z  'range_warp_specializes': [],
2026-02-21T10:38:23.9216901Z  'reduction_loops': [None]}
2026-02-21T10:38:23.9232292Z [113s] Fitting surrogate: 281 points, 281 targets
2026-02-21T10:38:24.7392836Z [113s] Generation 3 starting: 47 neighbors, 5 active search path(s)
2026-02-21T10:38:30.8354607Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 3.4 configs/s
2026-02-21T10:38:33.7138352Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 17.3 configs/s
2026-02-21T10:38:42.9055659Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.3         
2026-02-21T10:38:42.9056202Z                                                                   configs/s     
2026-02-21T10:38:43.3976045Z [132s] Generation 3 complete: 
2026-02-21T10:38:43.3976512Z error=1
2026-02-21T10:38:43.3976793Z ok=52
2026-02-21T10:38:43.3977065Z min=0.0763
2026-02-21T10:38:43.3977338Z mid=0.0808
2026-02-21T10:38:43.3977606Z max=0.5271
2026-02-21T10:38:43.3977895Z best={'block_sizes': [1],
2026-02-21T10:38:43.3978641Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:38:43.3979678Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:38:43.3980619Z  'load_eviction_policies': ['', '', 'last', 'first', 'first', '', 'first', 'first'],
2026-02-21T10:38:43.3981317Z  'num_stages': 8,
2026-02-21T10:38:43.3981524Z  'num_warps': 8,
2026-02-21T10:38:43.3981715Z  'pid_type': 'flat',
2026-02-21T10:38:43.3981916Z  'range_flattens': [None],
2026-02-21T10:38:43.3982147Z  'range_multi_buffers': [None],
2026-02-21T10:38:43.3982387Z  'range_num_stages': [0],
2026-02-21T10:38:43.3982613Z  'range_unroll_factors': [0],
2026-02-21T10:38:43.3982848Z  'range_warp_specializes': [],
2026-02-21T10:38:43.3983087Z  'reduction_loops': [None]}
2026-02-21T10:38:43.4000279Z [132s] Fitting surrogate: 334 points, 334 targets
2026-02-21T10:38:44.1636153Z [133s] Generation 4 starting: 44 neighbors, 5 active search path(s)
2026-02-21T10:38:52.9661026Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 13.2 configs/s
2026-02-21T10:38:56.8590072Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 12.1 configs/s
2026-02-21T10:39:05.1683611Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.2         
2026-02-21T10:39:05.1684630Z                                                                   configs/s     
2026-02-21T10:39:05.6343363Z [154s] Generation 4 complete: 
2026-02-21T10:39:05.6343618Z ok=50
2026-02-21T10:39:05.6343789Z min=0.0764
2026-02-21T10:39:05.6344247Z mid=0.0790
2026-02-21T10:39:05.6344447Z max=0.1244
2026-02-21T10:39:05.6344627Z best={'block_sizes': [1],
2026-02-21T10:39:05.6345026Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:39:05.6345658Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:39:05.6346113Z               'tensor_descriptor'],
2026-02-21T10:39:05.6346483Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', '', 'first', ''],
2026-02-21T10:39:05.6346867Z  'num_stages': 7,
2026-02-21T10:39:05.6347061Z  'num_warps': 16,
2026-02-21T10:39:05.6347252Z  'pid_type': 'flat',
2026-02-21T10:39:05.6347466Z  'range_flattens': [None],
2026-02-21T10:39:05.6347691Z  'range_multi_buffers': [None],
2026-02-21T10:39:05.6347943Z  'range_num_stages': [0],
2026-02-21T10:39:05.6348174Z  'range_unroll_factors': [0],
2026-02-21T10:39:05.6348413Z  'range_warp_specializes': [],
2026-02-21T10:39:05.6348655Z  'reduction_loops': [None]}
2026-02-21T10:39:05.6375663Z [154s] Fitting surrogate: 384 points, 384 targets
2026-02-21T10:39:06.4116397Z [155s] Generation 5 starting: 46 neighbors, 5 active search path(s)
2026-02-21T10:39:13.6064726Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 10.7 configs/s
2026-02-21T10:39:16.9879349Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 14.6 configs/s
2026-02-21T10:39:24.2461305Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 138.7         
2026-02-21T10:39:24.2461810Z                                                                   configs/s     
2026-02-21T10:39:24.6552785Z [173s] Generation 5 complete: 
2026-02-21T10:39:24.6553102Z error=4
2026-02-21T10:39:24.6553285Z ok=47
2026-02-21T10:39:24.6553466Z min=0.0764
2026-02-21T10:39:24.6553650Z mid=0.0779
2026-02-21T10:39:24.6553834Z max=0.1391
2026-02-21T10:39:24.6555067Z best={'block_sizes': [1],
2026-02-21T10:39:24.6555547Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:39:24.6556238Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:39:24.6556733Z               'tensor_descriptor'],
2026-02-21T10:39:24.6557118Z  'load_eviction_policies': ['', '', '', 'last', 'last', '', 'first', ''],
2026-02-21T10:39:24.6557530Z  'num_stages': 7,
2026-02-21T10:39:24.6557736Z  'num_warps': 8,
2026-02-21T10:39:24.6557948Z  'pid_type': 'flat',
2026-02-21T10:39:24.6558171Z  'range_flattens': [None],
2026-02-21T10:39:24.6558441Z  'range_multi_buffers': [None],
2026-02-21T10:39:24.6558699Z  'range_num_stages': [0],
2026-02-21T10:39:24.6558948Z  'range_unroll_factors': [0],
2026-02-21T10:39:24.6559227Z  'range_warp_specializes': [],
2026-02-21T10:39:24.6559515Z  'reduction_loops': [None]}
2026-02-21T10:39:24.6585422Z [173s] Fitting surrogate: 435 points, 435 targets
2026-02-21T10:39:25.4648899Z [174s] Generation 6 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:39:42.1495638Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 2.7 configs/s
2026-02-21T10:39:45.8462132Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 13.9 configs/s
2026-02-21T10:39:54.3401114Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.6         
2026-02-21T10:39:54.3401627Z                                                                   configs/s     
2026-02-21T10:39:54.8364712Z [204s] Generation 6 complete: 
2026-02-21T10:39:54.8364982Z error=1
2026-02-21T10:39:54.8365148Z ok=53
2026-02-21T10:39:54.8365308Z min=0.0762
2026-02-21T10:39:54.8365457Z mid=0.0773
2026-02-21T10:39:54.8365604Z max=0.6142
2026-02-21T10:39:54.8365757Z best={'block_sizes': [1],
2026-02-21T10:39:54.8366104Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:39:54.8366678Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:39:54.8367080Z               'tensor_descriptor'],
2026-02-21T10:39:54.8367384Z  'load_eviction_policies': ['', '', '', 'last', 'last', '', 'first', ''],
2026-02-21T10:39:54.8367724Z  'num_stages': 7,
2026-02-21T10:39:54.8367893Z  'num_warps': 8,
2026-02-21T10:39:54.8368061Z  'pid_type': 'flat',
2026-02-21T10:39:54.8368245Z  'range_flattens': [None],
2026-02-21T10:39:54.8368441Z  'range_multi_buffers': [None],
2026-02-21T10:39:54.8368653Z  'range_num_stages': [0],
2026-02-21T10:39:54.8368845Z  'range_unroll_factors': [0],
2026-02-21T10:39:54.8369058Z  'range_warp_specializes': [],
2026-02-21T10:39:54.8369263Z  'reduction_loops': [None]}
2026-02-21T10:39:54.8399956Z [204s] Fitting surrogate: 489 points, 489 targets
2026-02-21T10:39:55.4734789Z [204s] Generation 7 starting: 34 neighbors, 4 active search path(s)
2026-02-21T10:40:00.8256790Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 16.0 configs/s
2026-02-21T10:40:03.0275727Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 17.2 configs/s
2026-02-21T10:40:09.1187961Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 165.0         
2026-02-21T10:40:09.1189255Z                                                                   configs/s     
2026-02-21T10:40:09.4659539Z [218s] Generation 7 complete: 
2026-02-21T10:40:09.4659871Z ok=38
2026-02-21T10:40:09.4660064Z min=0.0764
2026-02-21T10:40:09.4660242Z mid=0.0787
2026-02-21T10:40:09.4660419Z max=0.1548
2026-02-21T10:40:09.4660642Z best={'block_sizes': [1],
2026-02-21T10:40:09.4661179Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:40:09.4661774Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:40:09.4662252Z  'load_eviction_policies': ['', '', '', 'first', '', '', 'first', 'first'],
2026-02-21T10:40:09.4662619Z  'num_stages': 8,
2026-02-21T10:40:09.4663562Z  'num_warps': 16,
2026-02-21T10:40:09.4663786Z  'pid_type': 'flat',
2026-02-21T10:40:09.4664395Z  'range_flattens': [None],
2026-02-21T10:40:09.4664643Z  'range_multi_buffers': [None],
2026-02-21T10:40:09.4664905Z  'range_num_stages': [0],
2026-02-21T10:40:09.4665126Z  'range_unroll_factors': [0],
2026-02-21T10:40:09.4665367Z  'range_warp_specializes': [],
2026-02-21T10:40:09.4665602Z  'reduction_loops': [None]}
2026-02-21T10:40:09.4694857Z [218s] Fitting surrogate: 527 points, 527 targets
2026-02-21T10:40:10.1293698Z [219s] Generation 8 starting: 36 neighbors, 4 active search path(s)
2026-02-21T10:40:15.2230413Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 16.6 configs/s
2026-02-21T10:40:17.5553958Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 16.1 configs/s
2026-02-21T10:40:23.8739435Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 159.2         
2026-02-21T10:40:23.8739985Z                                                                   configs/s     
2026-02-21T10:40:24.2576195Z [233s] Generation 8 complete: 
2026-02-21T10:40:24.2576533Z error=1
2026-02-21T10:40:24.2576710Z ok=39
2026-02-21T10:40:24.2576888Z min=0.0764
2026-02-21T10:40:24.2577102Z mid=0.0770
2026-02-21T10:40:24.2577280Z max=0.1191
2026-02-21T10:40:24.2577460Z best={'block_sizes': [1],
2026-02-21T10:40:24.2577912Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:40:24.2578535Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:40:24.2579074Z  'load_eviction_policies': ['', '', '', 'first', '', '', 'first', 'first'],
2026-02-21T10:40:24.2579454Z  'num_stages': 8,
2026-02-21T10:40:24.2579648Z  'num_warps': 16,
2026-02-21T10:40:24.2579846Z  'pid_type': 'flat',
2026-02-21T10:40:24.2580073Z  'range_flattens': [None],
2026-02-21T10:40:24.2580316Z  'range_multi_buffers': [None],
2026-02-21T10:40:24.2580559Z  'range_num_stages': [0],
2026-02-21T10:40:24.2580821Z  'range_unroll_factors': [0],
2026-02-21T10:40:24.2581118Z  'range_warp_specializes': [],
2026-02-21T10:40:24.2581421Z  'reduction_loops': [None]}
2026-02-21T10:40:24.2611189Z [233s] Fitting surrogate: 567 points, 567 targets
2026-02-21T10:40:24.9205604Z [234s] Generation 9 starting: 36 neighbors, 4 active search path(s)
2026-02-21T10:40:32.4187630Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 4.6 configs/s
2026-02-21T10:40:35.3635623Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 12.7 configs/s
2026-02-21T10:40:41.3907595Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 166.8         
2026-02-21T10:40:41.3908100Z                                                                   configs/s     
2026-02-21T10:40:41.7538750Z [250s] Generation 9 complete: 
2026-02-21T10:40:41.7538975Z ok=40
2026-02-21T10:40:41.7539151Z min=0.0761
2026-02-21T10:40:41.7539306Z mid=0.0773
2026-02-21T10:40:41.7539465Z max=0.5254
2026-02-21T10:40:41.7539631Z best={'block_sizes': [2],
2026-02-21T10:40:41.7540480Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:40:41.7541064Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:40:41.9436431Z  'load_eviction_policies': ['', '', '', 'first', '', '', 'first', 'first'],
2026-02-21T10:40:41.9436831Z  'num_stages': 8,
2026-02-21T10:40:41.9437038Z  'num_warps': 16,
2026-02-21T10:40:41.9437253Z  'pid_type': 'flat',
2026-02-21T10:40:41.9437479Z  'range_flattens': [None],
2026-02-21T10:40:41.9437722Z  'range_multi_buffers': [None],
2026-02-21T10:40:41.9437964Z  'range_num_stages': [0],
2026-02-21T10:40:41.9438202Z  'range_unroll_factors': [0],
2026-02-21T10:40:41.9438457Z  'range_warp_specializes': [],
2026-02-21T10:40:41.9438700Z  'reduction_loops': [None]}
2026-02-21T10:40:41.9438991Z [250s] Fitting surrogate: 607 points, 607 targets
2026-02-21T10:40:42.4140300Z [251s] Generation 10 starting: 30 neighbors, 4 active search path(s)
2026-02-21T10:40:46.7467223Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 2.0 configs/s
2026-02-21T10:40:48.5757032Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 17.4 configs/s
2026-02-21T10:40:53.7937590Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 192.5         
2026-02-21T10:40:53.7938134Z                                                                   configs/s     
2026-02-21T10:40:54.1117597Z [263s] Generation 10 complete: 
2026-02-21T10:40:54.1118074Z ok=34
2026-02-21T10:40:54.1118359Z min=0.0766
2026-02-21T10:40:54.1118663Z mid=0.0778
2026-02-21T10:40:54.1118935Z max=0.5257
2026-02-21T10:40:54.1119237Z best={'block_sizes': [2],
2026-02-21T10:40:54.1119887Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:40:54.1120832Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:40:54.1121602Z               'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:40:54.1122290Z  'load_eviction_policies': ['', '', '', 'last', 'last', '', 'first', ''],
2026-02-21T10:40:54.1122929Z  'num_stages': 8,
2026-02-21T10:40:54.1123159Z  'num_warps': 16,
2026-02-21T10:40:54.1123343Z  'pid_type': 'flat',
2026-02-21T10:40:54.1123526Z  'range_flattens': [None],
2026-02-21T10:40:54.1123734Z  'range_multi_buffers': [None],
2026-02-21T10:40:54.1123938Z  'range_num_stages': [0],
2026-02-21T10:40:54.1124459Z  'range_unroll_factors': [0],
2026-02-21T10:40:54.1124677Z  'range_warp_specializes': [],
2026-02-21T10:40:54.1124882Z  'reduction_loops': [None]}
2026-02-21T10:40:54.1155697Z [263s] Fitting surrogate: 641 points, 641 targets
2026-02-21T10:40:54.6796342Z [263s] Generation 11 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:41:01.6860128Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 0.9 configs/s
2026-02-21T10:41:03.5357108Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 17.8 configs/s
2026-02-21T10:41:08.5758351Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 199.2         
2026-02-21T10:41:08.5758916Z                                                                   configs/s     
2026-02-21T10:41:08.8843149Z [278s] Generation 11 complete: 
2026-02-21T10:41:08.8843431Z error=1
2026-02-21T10:41:08.8843606Z ok=32
2026-02-21T10:41:08.8843793Z min=0.0764
2026-02-21T10:41:08.8844274Z mid=0.0786
2026-02-21T10:41:08.8844468Z max=0.5696
2026-02-21T10:41:08.8844663Z best={'block_sizes': [2],
2026-02-21T10:41:08.8845100Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:41:08.8845728Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:41:08.8846232Z               'pointer', 'tensor_descriptor'],
2026-02-21T10:41:08.8846638Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', '', 'first', ''],
2026-02-21T10:41:08.8847023Z  'num_stages': 6,
2026-02-21T10:41:08.8847228Z  'num_warps': 16,
2026-02-21T10:41:08.8847775Z  'pid_type': 'flat',
2026-02-21T10:41:08.8848013Z  'range_flattens': [None],
2026-02-21T10:41:08.8848250Z  'range_multi_buffers': [None],
2026-02-21T10:41:08.8848517Z  'range_num_stages': [0],
2026-02-21T10:41:08.8848746Z  'range_unroll_factors': [0],
2026-02-21T10:41:08.8849001Z  'range_warp_specializes': [],
2026-02-21T10:41:08.8849255Z  'reduction_loops': [None]}
2026-02-21T10:41:08.8881979Z [278s] Fitting surrogate: 674 points, 674 targets
2026-02-21T10:41:09.4534480Z [278s] Generation 12 starting: 29 neighbors, 3 active search path(s)
2026-02-21T10:41:13.8885934Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 4.0 configs/s
2026-02-21T10:41:15.4756086Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 19.5 configs/s
2026-02-21T10:41:19.9497476Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 224.3         
2026-02-21T10:41:19.9497994Z                                                                   configs/s     
2026-02-21T10:41:20.2287411Z [289s] Generation 12 complete: 
2026-02-21T10:41:20.2287712Z error=3
2026-02-21T10:41:20.2287897Z ok=29
2026-02-21T10:41:20.2288067Z min=0.0763
2026-02-21T10:41:20.2288268Z mid=0.0769
2026-02-21T10:41:20.2288434Z max=0.5254
2026-02-21T10:41:20.2288619Z best={'block_sizes': [1],
2026-02-21T10:41:20.2289070Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:41:20.2289711Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:41:20.2290272Z               'tensor_descriptor'],
2026-02-21T10:41:20.2290651Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'last', 'first'],
2026-02-21T10:41:20.2290999Z  'num_stages': 2,
2026-02-21T10:41:20.2291172Z  'num_warps': 16,
2026-02-21T10:41:20.2291351Z  'pid_type': 'flat',
2026-02-21T10:41:20.2291538Z  'range_flattens': [None],
2026-02-21T10:41:20.2291752Z  'range_multi_buffers': [None],
2026-02-21T10:41:20.2291975Z  'range_num_stages': [0],
2026-02-21T10:41:20.2292187Z  'range_unroll_factors': [0],
2026-02-21T10:41:20.2292410Z  'range_warp_specializes': [],
2026-02-21T10:41:20.2292638Z  'reduction_loops': [None]}
2026-02-21T10:41:20.2326443Z [289s] Fitting surrogate: 706 points, 706 targets
2026-02-21T10:41:20.7964398Z [290s] Generation 13 starting: 30 neighbors, 3 active search path(s)
2026-02-21T10:41:25.5009062Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 4.7 configs/s
2026-02-21T10:41:27.3739028Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.9 configs/s
2026-02-21T10:41:32.4443121Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 197.9         
2026-02-21T10:41:32.4443634Z                                                                   configs/s     
2026-02-21T10:41:32.7535739Z [301s] Generation 13 complete: 
2026-02-21T10:41:32.7536052Z error=1
2026-02-21T10:41:32.7536242Z ok=32
2026-02-21T10:41:32.7536414Z min=0.0766
2026-02-21T10:41:32.7536614Z mid=0.0780
2026-02-21T10:41:32.7536817Z max=0.1966
2026-02-21T10:41:32.7537009Z best={'block_sizes': [2],
2026-02-21T10:41:32.7537459Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:41:32.7538722Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:41:32.7539237Z               'tensor_descriptor'],
2026-02-21T10:41:32.7539595Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'last', 'first'],
2026-02-21T10:41:32.7539970Z  'num_stages': 2,
2026-02-21T10:41:32.7540159Z  'num_warps': 16,
2026-02-21T10:41:32.7540354Z  'pid_type': 'flat',
2026-02-21T10:41:32.7540561Z  'range_flattens': [None],
2026-02-21T10:41:32.7540793Z  'range_multi_buffers': [None],
2026-02-21T10:41:32.7541032Z  'range_num_stages': [0],
2026-02-21T10:41:32.7541264Z  'range_unroll_factors': [0],
2026-02-21T10:41:32.7541513Z  'range_warp_specializes': [],
2026-02-21T10:41:32.7541763Z  'reduction_loops': [None]}
2026-02-21T10:41:32.7575660Z [301s] Fitting surrogate: 739 points, 739 targets
2026-02-21T10:41:33.3327758Z [302s] Generation 14 starting: 29 neighbors, 3 active search path(s)
2026-02-21T10:41:40.3492036Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 2.8 configs/s
2026-02-21T10:41:42.0204473Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 19.1 configs/s
2026-02-21T10:41:46.3875438Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 229.6         
2026-02-21T10:41:46.3876676Z                                                                   configs/s     
2026-02-21T10:41:46.6596553Z [315s] Generation 14 complete: 
2026-02-21T10:41:46.6596871Z error=3
2026-02-21T10:41:46.6597068Z ok=29
2026-02-21T10:41:46.6597243Z min=0.0764
2026-02-21T10:41:46.6597439Z mid=0.0777
2026-02-21T10:41:46.6597618Z max=0.1992
2026-02-21T10:41:46.6597818Z best={'block_sizes': [2],
2026-02-21T10:41:46.6598318Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:41:46.6599102Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:41:46.6599548Z               'pointer', 'tensor_descriptor'],
2026-02-21T10:41:46.6599927Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', '', '', ''],
2026-02-21T10:41:46.6600274Z  'num_stages': 5,
2026-02-21T10:41:46.6600451Z  'num_warps': 16,
2026-02-21T10:41:46.6600642Z  'pid_type': 'flat',
2026-02-21T10:41:46.6600839Z  'range_flattens': [None],
2026-02-21T10:41:46.6601060Z  'range_multi_buffers': [None],
2026-02-21T10:41:46.6601281Z  'range_num_stages': [0],
2026-02-21T10:41:46.6601508Z  'range_unroll_factors': [0],
2026-02-21T10:41:46.6601728Z  'range_warp_specializes': [],
2026-02-21T10:41:46.6601957Z  'reduction_loops': [None]}
2026-02-21T10:41:46.6637060Z [315s] Fitting surrogate: 771 points, 771 targets
2026-02-21T10:41:47.0693914Z [316s] Generation 15 starting: 17 neighbors, 2 active search path(s)
2026-02-21T10:41:50.1701201Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 3.4 configs/s
2026-02-21T10:41:51.1224772Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 18.8 configs/s
2026-02-21T10:41:53.9566769Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 352.0         
2026-02-21T10:41:53.9567299Z                                                                   configs/s     
2026-02-21T10:41:54.1474335Z [323s] Generation 15 complete: 
2026-02-21T10:41:54.1474628Z error=1
2026-02-21T10:41:54.1474787Z ok=18
2026-02-21T10:41:54.1474952Z min=0.0763
2026-02-21T10:41:54.1475115Z mid=0.0771
2026-02-21T10:41:54.1475297Z max=0.1966
2026-02-21T10:41:54.1475482Z best={'block_sizes': [2],
2026-02-21T10:41:54.1475934Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:41:54.1476545Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:41:54.1476947Z               'tensor_descriptor'],
2026-02-21T10:41:54.1477320Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'last', 'last'],
2026-02-21T10:41:54.1477672Z  'num_stages': 1,
2026-02-21T10:41:54.1477863Z  'num_warps': 16,
2026-02-21T10:41:54.1478504Z  'pid_type': 'flat',
2026-02-21T10:41:54.1478714Z  'range_flattens': [None],
2026-02-21T10:41:54.1478936Z  'range_multi_buffers': [None],
2026-02-21T10:41:54.1479167Z  'range_num_stages': [0],
2026-02-21T10:41:54.1479382Z  'range_unroll_factors': [0],
2026-02-21T10:41:54.1479614Z  'range_warp_specializes': [],
2026-02-21T10:41:54.1479840Z  'reduction_loops': [None]}
2026-02-21T10:41:54.1516562Z [323s] Fitting surrogate: 790 points, 790 targets
2026-02-21T10:41:54.5795546Z [323s] Generation 16 starting: 18 neighbors, 2 active search path(s)
2026-02-21T10:41:57.0598827Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 5.6 configs/s
2026-02-21T10:41:58.1176416Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.8 configs/s
2026-02-21T10:42:01.4395105Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 302.5         
2026-02-21T10:42:01.4395676Z                                                                   configs/s     
2026-02-21T10:42:01.6421371Z [330s] Generation 16 complete: 
2026-02-21T10:42:01.6421662Z ok=20
2026-02-21T10:42:01.6421846Z min=0.0763
2026-02-21T10:42:01.6422017Z mid=0.0769
2026-02-21T10:42:01.6422196Z max=0.0982
2026-02-21T10:42:01.6422379Z best={'block_sizes': [1],
2026-02-21T10:42:01.6422826Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:42:01.6423432Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:42:01.6423909Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:42:01.6424719Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', '', 'last', ''],
2026-02-21T10:42:01.6425097Z  'num_stages': 4,
2026-02-21T10:42:01.6425292Z  'num_warps': 16,
2026-02-21T10:42:01.6425507Z  'pid_type': 'flat',
2026-02-21T10:42:01.6425719Z  'range_flattens': [None],
2026-02-21T10:42:01.6425951Z  'range_multi_buffers': [None],
2026-02-21T10:42:01.6426197Z  'range_num_stages': [0],
2026-02-21T10:42:01.6426431Z  'range_unroll_factors': [0],
2026-02-21T10:42:01.6426676Z  'range_warp_specializes': [],
2026-02-21T10:42:01.6426923Z  'reduction_loops': [None]}
2026-02-21T10:42:01.6464477Z [330s] Fitting surrogate: 810 points, 810 targets
2026-02-21T10:42:02.0841951Z [331s] Generation 17 starting: 20 neighbors, 2 active search path(s)
2026-02-21T10:42:05.6664458Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 3.6 configs/s
2026-02-21T10:42:07.5541897Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 10.6 configs/s
2026-02-21T10:42:11.2687551Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 269.4         
2026-02-21T10:42:11.2688077Z                                                                   configs/s     
2026-02-21T10:42:11.5042702Z [340s] Generation 17 complete: 
2026-02-21T10:42:11.5043031Z ok=22
2026-02-21T10:42:11.5043221Z min=0.0796
2026-02-21T10:42:11.5043409Z mid=0.0804
2026-02-21T10:42:11.5043580Z max=0.1028
2026-02-21T10:42:11.5044892Z best={'block_sizes': [2],
2026-02-21T10:42:11.5045362Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:42:11.5046048Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:42:11.5046542Z               'tensor_descriptor'],
2026-02-21T10:42:11.5046872Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'last', 'last'],
2026-02-21T10:42:11.5047196Z  'num_stages': 1,
2026-02-21T10:42:11.5047370Z  'num_warps': 16,
2026-02-21T10:42:11.5047542Z  'pid_type': 'flat',
2026-02-21T10:42:11.5047723Z  'range_flattens': [None],
2026-02-21T10:42:11.5047927Z  'range_multi_buffers': [None],
2026-02-21T10:42:11.5048132Z  'range_num_stages': [0],
2026-02-21T10:42:11.5048343Z  'range_unroll_factors': [0],
2026-02-21T10:42:11.5048551Z  'range_warp_specializes': [],
2026-02-21T10:42:11.5048763Z  'reduction_loops': [None]}
2026-02-21T10:42:11.5090356Z [340s] Fitting surrogate: 832 points, 832 targets
2026-02-21T10:42:11.8199696Z [341s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T10:42:14.5293231Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 9.0 configs/s
2026-02-21T10:42:15.3860516Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 14.6 configs/s
2026-02-21T10:42:17.3941185Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 493.9         
2026-02-21T10:42:17.3941680Z                                                                   configs/s     
2026-02-21T10:42:17.5440068Z [346s] Generation 18 complete: 
2026-02-21T10:42:17.5440359Z ok=13
2026-02-21T10:42:17.5440553Z min=0.0763
2026-02-21T10:42:17.5440730Z mid=0.0789
2026-02-21T10:42:17.5440915Z max=0.1437
2026-02-21T10:42:17.5441105Z best={'block_sizes': [2],
2026-02-21T10:42:17.5442240Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:42:17.5442939Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:42:17.5443445Z               'tensor_descriptor'],
2026-02-21T10:42:17.5443820Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', 'last', 'last'],
2026-02-21T10:42:17.5444589Z  'num_stages': 1,
2026-02-21T10:42:17.5444795Z  'num_warps': 16,
2026-02-21T10:42:17.5444994Z  'pid_type': 'flat',
2026-02-21T10:42:17.5445224Z  'range_flattens': [None],
2026-02-21T10:42:17.5445458Z  'range_multi_buffers': [None],
2026-02-21T10:42:17.5445727Z  'range_num_stages': [0],
2026-02-21T10:42:17.5445960Z  'range_unroll_factors': [0],
2026-02-21T10:42:17.5446213Z  'range_warp_specializes': [],
2026-02-21T10:42:17.5446466Z  'reduction_loops': [None]}
2026-02-21T10:42:17.5483877Z [346s] Fitting surrogate: 845 points, 845 targets
2026-02-21T10:42:17.8310404Z [347s] Generation 19 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:42:20.0775550Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 8.4 configs/s
2026-02-21T10:42:20.6172320Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.3 configs/s
2026-02-21T10:42:22.4256515Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 547.7         
2026-02-21T10:42:22.4257023Z                                                                   configs/s     
2026-02-21T10:42:22.5626025Z [351s] Generation 19 complete: 
2026-02-21T10:42:22.5626331Z ok=11
2026-02-21T10:42:22.5626526Z min=0.0795
2026-02-21T10:42:22.5626716Z mid=0.0796
2026-02-21T10:42:22.5626905Z max=0.0817
2026-02-21T10:42:22.5627098Z best={'block_sizes': [1],
2026-02-21T10:42:22.5627584Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:42:22.5628283Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:42:22.5628804Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:42:22.5629322Z  'load_eviction_policies': ['', 'last', 'last', 'first', 'last', '', 'last', 'first'],
2026-02-21T10:42:22.5630260Z  'num_stages': 5,
2026-02-21T10:42:22.5630471Z  'num_warps': 16,
2026-02-21T10:42:22.5630676Z  'pid_type': 'flat',
2026-02-21T10:42:22.5630914Z  'range_flattens': [None],
2026-02-21T10:42:22.5631164Z  'range_multi_buffers': [None],
2026-02-21T10:42:22.5631423Z  'range_num_stages': [0],
2026-02-21T10:42:22.5631662Z  'range_unroll_factors': [0],
2026-02-21T10:42:22.5631926Z  'range_warp_specializes': [],
2026-02-21T10:42:22.5632187Z  'reduction_loops': [None]}
2026-02-21T10:42:22.5669530Z [351s] Fitting surrogate: 856 points, 856 targets
2026-02-21T10:42:22.8563454Z [352s] Generation 20 starting: 10 neighbors, 1 active search path(s)
2026-02-21T10:42:24.7838566Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 8.1 configs/s
2026-02-21T10:42:25.4452724Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.9 configs/s
2026-02-21T10:42:28.2298923Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 499.0         
2026-02-21T10:42:28.2299496Z                                                                   configs/s     
2026-02-21T10:42:28.3775509Z [357s] Generation 20 complete: 
2026-02-21T10:42:28.3775795Z ok=12
2026-02-21T10:42:28.3775980Z min=0.0764
2026-02-21T10:42:28.3776153Z mid=0.0772
2026-02-21T10:42:28.3776324Z max=0.0924
2026-02-21T10:42:28.3776504Z best={'block_sizes': [2],
2026-02-21T10:42:28.3776970Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:42:28.3777631Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:42:28.3778237Z               'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:42:28.3778711Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', '', 'last', 'first'],
2026-02-21T10:42:28.3779098Z  'num_stages': 5,
2026-02-21T10:42:28.3779292Z  'num_warps': 16,
2026-02-21T10:42:28.3779479Z  'pid_type': 'flat',
2026-02-21T10:42:28.3779694Z  'range_flattens': [None],
2026-02-21T10:42:28.3779942Z  'range_multi_buffers': [None],
2026-02-21T10:42:28.3780185Z  'range_num_stages': [0],
2026-02-21T10:42:28.3780407Z  'range_unroll_factors': [0],
2026-02-21T10:42:28.3780665Z  'range_warp_specializes': [],
2026-02-21T10:42:28.3780911Z  'reduction_loops': [None]}
2026-02-21T10:42:28.3816376Z [357s] Fitting surrogate: 868 points, 868 targets
2026-02-21T10:42:28.5398154Z [357s] Autotuning complete in 357.7s after searching 821 configs.
2026-02-21T10:42:28.5398639Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:42:28.5400862Z     @helion.kernel(config=helion.Config(block_sizes=[2], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', 'first', 'last', '', 'last', 'first'], num_stages=5, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:42:28.5402953Z 
2026-02-21T10:42:28.5403360Z [357s] Code of selected kernel: /tmp/torchinductor_root/ur/curi3i6j7h74jd5uw337mkivql3zbtmo6x4ezsd5q5qpbvpgizae.py
2026-02-21T10:42:28.5665116Z from __future__ import annotations
2026-02-21T10:42:28.5665307Z 
2026-02-21T10:42:28.5665387Z import torch
2026-02-21T10:42:28.5665571Z import triton
2026-02-21T10:42:28.5665781Z import triton.language as tl
2026-02-21T10:42:28.5666119Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:42:28.5666570Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:42:28.5666852Z 
2026-02-21T10:42:28.5666938Z _BLOCK_SIZE_0 = tl.constexpr(2)
2026-02-21T10:42:28.5667114Z 
2026-02-21T10:42:28.5667188Z @triton.jit
2026-02-21T10:42:28.5667550Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:42:28.5668722Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:42:28.5669080Z     pid_0 = tl.program_id(0)
2026-02-21T10:42:28.5669353Z     offset_0 = pid_0 * _BLOCK_SIZE_0
2026-02-21T10:42:28.5669727Z     indices_0 = (offset_0 + tl.arange(0, _BLOCK_SIZE_0)).to(tl.int32)
2026-02-21T10:42:28.5670164Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:42:28.5670508Z     mask_1 = indices_1 < 6656
2026-02-21T10:42:28.5670871Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:42:28.5671414Z     acc = tl.load(x + (indices_0[:, None] * 6656 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T10:42:28.5671974Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:42:28.5672628Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:42:28.5672960Z     v_0 = 0.00015024038461538462
2026-02-21T10:42:28.5673222Z     v_1 = sum_1 * v_0
2026-02-21T10:42:28.5673529Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:42:28.5673894Z     subscript = v_1[:, None]
2026-02-21T10:42:28.5674340Z     v_2 = acc - subscript
2026-02-21T10:42:28.5674712Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:42:28.5675119Z     v_3 = v_2 * v_2
2026-02-21T10:42:28.5675612Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T10:42:28.5676220Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T10:42:28.5676540Z     v_4 = 0.00015024038461538462
2026-02-21T10:42:28.5676796Z     v_5 = sum_2 * v_4
2026-02-21T10:42:28.5677109Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:42:28.5677480Z     v_6 = v_5 + eps
2026-02-21T10:42:28.5677696Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:42:28.5678046Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:42:28.5678351Z     subscript_1 = v_7[:, None]
2026-02-21T10:42:28.5678561Z     v_8 = v_2 * subscript_1
2026-02-21T10:42:28.5678837Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:42:28.5679287Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T10:42:28.5679654Z     v_9 = load_1[None, :]
2026-02-21T10:42:28.5679837Z     v_10 = v_8 * v_9
2026-02-21T10:42:28.5680056Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:42:28.5680357Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T10:42:28.5680732Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:42:28.5681109Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:42:28.5681392Z     # src[layer_norm.py:75]: )
2026-02-21T10:42:28.5681612Z     v_11 = load_2[None, :]
2026-02-21T10:42:28.5681788Z     v_12 = v_10 + v_11
2026-02-21T10:42:28.5682016Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:42:28.5682409Z     tl.store(out + (indices_0[:, None] * 6656 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T10:42:28.5682794Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:42:28.5683057Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:42:28.5683320Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:42:28.5683580Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:42:28.5683739Z 
2026-02-21T10:42:28.5684386Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:42:28.5684992Z     """
2026-02-21T10:42:28.5685223Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:42:28.5685534Z     Args:
2026-02-21T10:42:28.5685808Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:42:28.5686359Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:42:28.5687045Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:42:28.5687467Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:42:28.5688005Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:42:28.5688388Z     Returns:
2026-02-21T10:42:28.5688590Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:42:28.5688947Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:42:28.5689317Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:42:28.5689803Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:42:28.5690220Z     """
2026-02-21T10:42:28.5690386Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:42:28.5690596Z     m, n = x.size()
2026-02-21T10:42:28.5690923Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:42:28.5691384Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:42:28.5691725Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:42:28.5692096Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:42:28.5692451Z     if bias is not None:
2026-02-21T10:42:28.5692788Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:42:28.5693221Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:42:28.5693583Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:42:28.5694113Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:42:28.5694461Z     # src[layer_norm.py:52]: )
2026-02-21T10:42:28.5694823Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:42:28.5695243Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:42:28.5695629Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:42:28.5695960Z     # src[layer_norm.py:55]: )
2026-02-21T10:42:28.5696293Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:42:28.5696781Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:42:28.5697168Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:42:28.5697551Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:42:28.5697953Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:42:28.5698371Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:42:28.5698772Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:42:28.5699099Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:42:28.5699361Z     _BLOCK_SIZE_0 = 2
2026-02-21T10:42:28.5699544Z     _RDIM_SIZE_1 = 8192
2026-02-21T10:42:28.5699752Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:42:28.5700054Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:42:28.5700367Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:42:28.5700611Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:42:28.5701138Z     _launcher(_helion_layer_norm_fwd, (triton.cdiv(4096, _BLOCK_SIZE_0),), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=5)
2026-02-21T10:42:28.5701688Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:42:28.5701939Z     return (out, mean, rstd)
2026-02-21T10:42:29.7587175Z WARNING:tritonbench.utils.triton_op:Completed input ID 11:
2026-02-21T10:42:29.7587975Z (M, N)
2026-02-21T10:42:29.7588142Z ------------
2026-02-21T10:42:29.7588324Z (4096, 6656)
2026-02-21T10:42:29.7588437Z 
2026-02-21T10:42:29.7598967Z  40%|████      | 8/20 [41:26<1:04:43, 323.62s/it]WARNING:tritonbench.utils.triton_op:Running input ID 12:
2026-02-21T10:42:29.7599443Z (M, N)
2026-02-21T10:42:29.7599600Z ------------
2026-02-21T10:42:29.7599763Z (4096, 7168)
2026-02-21T10:42:29.7600668Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T10:42:31.1594464Z INFO:tritonbench.utils.triton_op:Took 2.87ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:42:32.6454736Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:42:34.1709663Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:42:34.1710002Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:42:34.1710264Z               'dtype': 'torch.float32',
2026-02-21T10:42:34.1710558Z               'shape': (4096, 7168),
2026-02-21T10:42:34.1710826Z               'stride': (7168, 1)},
2026-02-21T10:42:34.1711069Z             (7168,),
2026-02-21T10:42:34.1711286Z             { 'device': 'cuda:0',
2026-02-21T10:42:34.1711530Z               'dtype': 'torch.float32',
2026-02-21T10:42:34.1711797Z               'shape': (7168,),
2026-02-21T10:42:34.1712032Z               'stride': (1,)},
2026-02-21T10:42:34.1712271Z             { 'device': 'cuda:0',
2026-02-21T10:42:34.1712508Z               'dtype': 'torch.float32',
2026-02-21T10:42:34.1712770Z               'shape': (7168,),
2026-02-21T10:42:34.1712990Z               'stride': (1,)},
2026-02-21T10:42:34.1713207Z             1e-05),
2026-02-21T10:42:34.1713386Z   'kwargs': {}}
2026-02-21T10:42:34.1738772Z INFO:tritonbench.utils.triton_op:Took 3.31ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:42:34.1815538Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:42:34.1816471Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:42:34.1817085Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:42:34.1817442Z While processing:
2026-02-21T10:42:34.1817880Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:42:34.1818323Z     if bias is not None:
2026-02-21T10:42:34.1818545Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:42:34.1818700Z 
2026-02-21T10:42:34.3408614Z [0s] Autotune random seed: 2141537047
2026-02-21T10:42:34.3863820Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:43:09.2102124Z [34s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:43:09.7799097Z [35s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:43:11.4089567Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:43:11.4107653Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T10:43:17.9328778Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.4 configs/s
2026-02-21T10:43:17.9341543Z [43s] Adaptive compile timeout: 30s (90% percentile=9.1s, bounds=[30.0s, 30s])
2026-02-21T10:43:19.1122635Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 822.9 configs/s
2026-02-21T10:43:19.2171145Z [44s] Initial random population of 100, 5 starting points: 
2026-02-21T10:43:19.2171554Z error=10
2026-02-21T10:43:19.2171751Z timeout=3
2026-02-21T10:43:19.2171922Z ok=87
2026-02-21T10:43:19.2172093Z min=0.1016
2026-02-21T10:43:19.2172265Z mid=0.4163
2026-02-21T10:43:19.2172442Z max=21.5676
2026-02-21T10:43:19.2172633Z best={'block_sizes': [1],
2026-02-21T10:43:19.2173051Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:43:19.2173606Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:43:19.2174251Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:43:19.2174600Z  'num_stages': 1,
2026-02-21T10:43:19.2174807Z  'num_warps': 4,
2026-02-21T10:43:19.2175021Z  'pid_type': 'flat',
2026-02-21T10:43:19.2175240Z  'range_flattens': [None],
2026-02-21T10:43:19.2175501Z  'range_multi_buffers': [None],
2026-02-21T10:43:19.2175758Z  'range_num_stages': [0],
2026-02-21T10:43:19.2176028Z  'range_unroll_factors': [0],
2026-02-21T10:43:19.2176293Z  'range_warp_specializes': [],
2026-02-21T10:43:19.2176558Z  'reduction_loops': [4096]}
2026-02-21T10:43:19.2192598Z [44s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:43:20.7000701Z [46s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T10:43:45.6869481Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 1.4 configs/s
2026-02-21T10:43:51.4419956Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.1 configs/s
2026-02-21T10:44:04.9879673Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 78.9 configs/s
2026-02-21T10:44:05.6260487Z [91s] Generation 1 complete: 
2026-02-21T10:44:05.6260749Z error=1
2026-02-21T10:44:05.6260913Z ok=93
2026-02-21T10:44:05.6261078Z min=0.0855
2026-02-21T10:44:05.6261245Z mid=0.1195
2026-02-21T10:44:05.6261412Z max=0.4161
2026-02-21T10:44:05.6261608Z best={'block_sizes': [1],
2026-02-21T10:44:05.6262011Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:44:05.6262529Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:44:05.6262968Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:44:05.6263312Z  'num_stages': 1,
2026-02-21T10:44:05.6263500Z  'num_warps': 2,
2026-02-21T10:44:05.6263703Z  'pid_type': 'flat',
2026-02-21T10:44:05.6263909Z  'range_flattens': [None],
2026-02-21T10:44:05.6264484Z  'range_multi_buffers': [None],
2026-02-21T10:44:05.6264729Z  'range_num_stages': [0],
2026-02-21T10:44:05.6264972Z  'range_unroll_factors': [0],
2026-02-21T10:44:05.6265221Z  'range_warp_specializes': [],
2026-02-21T10:44:05.6265457Z  'reduction_loops': [None]}
2026-02-21T10:44:05.6284403Z [91s] Fitting surrogate: 194 points, 194 targets
2026-02-21T10:44:06.8238759Z [92s] Generation 2 starting: 73 neighbors, 5 active search path(s)
2026-02-21T10:44:21.7622634Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77/77 7.1 configs/s
2026-02-21T10:44:26.4776918Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 77/77 16.5 configs/s
2026-02-21T10:44:39.7538604Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 75.9 configs/s
2026-02-21T10:44:40.4867559Z [126s] Generation 2 complete: 
2026-02-21T10:44:40.4867811Z ok=79
2026-02-21T10:44:40.4867983Z min=0.0834
2026-02-21T10:44:40.4868159Z mid=0.0953
2026-02-21T10:44:40.4868324Z max=0.6885
2026-02-21T10:44:40.4868507Z best={'block_sizes': [1],
2026-02-21T10:44:40.4868948Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:44:40.4869502Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:44:40.4869930Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:44:40.4870347Z  'num_stages': 1,
2026-02-21T10:44:40.4870586Z  'num_warps': 8,
2026-02-21T10:44:40.4871325Z  'pid_type': 'flat',
2026-02-21T10:44:40.4871565Z  'range_flattens': [None],
2026-02-21T10:44:40.4871803Z  'range_multi_buffers': [None],
2026-02-21T10:44:40.4872054Z  'range_num_stages': [0],
2026-02-21T10:44:40.4872305Z  'range_unroll_factors': [0],
2026-02-21T10:44:40.4872552Z  'range_warp_specializes': [],
2026-02-21T10:44:40.4872802Z  'reduction_loops': [None]}
2026-02-21T10:44:40.4898261Z [126s] Fitting surrogate: 273 points, 273 targets
2026-02-21T10:44:41.5444592Z [127s] Generation 3 starting: 63 neighbors, 5 active search path(s)
2026-02-21T10:44:51.1207783Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 9.3 configs/s
2026-02-21T10:44:55.0680607Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 16.6 configs/s
2026-02-21T10:45:07.6265457Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 85.6 configs/s
2026-02-21T10:45:08.2659384Z [153s] Generation 3 complete: 
2026-02-21T10:45:08.2659706Z ok=69
2026-02-21T10:45:08.2659895Z min=0.0829
2026-02-21T10:45:08.2660093Z mid=0.0876
2026-02-21T10:45:08.2660262Z max=0.1677
2026-02-21T10:45:08.2660437Z best={'block_sizes': [2],
2026-02-21T10:45:08.2660883Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:45:08.2661464Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:45:08.2661878Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:45:08.2662221Z  'num_stages': 2,
2026-02-21T10:45:08.2662404Z  'num_warps': 16,
2026-02-21T10:45:08.2662594Z  'pid_type': 'flat',
2026-02-21T10:45:08.2662796Z  'range_flattens': [None],
2026-02-21T10:45:08.2663025Z  'range_multi_buffers': [None],
2026-02-21T10:45:08.2663259Z  'range_num_stages': [0],
2026-02-21T10:45:08.2663484Z  'range_unroll_factors': [0],
2026-02-21T10:45:08.2663721Z  'range_warp_specializes': [],
2026-02-21T10:45:08.2663961Z  'reduction_loops': [None]}
2026-02-21T10:45:08.2687241Z [153s] Fitting surrogate: 342 points, 342 targets
2026-02-21T10:45:09.1609604Z [154s] Generation 4 starting: 52 neighbors, 5 active search path(s)
2026-02-21T10:45:18.8188818Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 1.1 configs/s
2026-02-21T10:45:22.0200319Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 17.1 configs/s
2026-02-21T10:45:30.5928233Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 117.3         
2026-02-21T10:45:30.5931984Z                                                                   configs/s     
2026-02-21T10:45:31.0676726Z [176s] Generation 4 complete: 
2026-02-21T10:45:31.0677149Z error=1
2026-02-21T10:45:31.0677413Z ok=57
2026-02-21T10:45:31.0677662Z min=0.0828
2026-02-21T10:45:31.0677925Z mid=0.0883
2026-02-21T10:45:31.0678173Z max=0.6124
2026-02-21T10:45:31.0678481Z best={'block_sizes': [2],
2026-02-21T10:45:31.0679187Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:45:31.0680083Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:45:31.0680720Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', ''],
2026-02-21T10:45:31.0681234Z  'num_stages': 2,
2026-02-21T10:45:31.0700848Z  'num_warps': 16,
2026-02-21T10:45:31.0701047Z  'pid_type': 'flat',
2026-02-21T10:45:31.0701268Z  'range_flattens': [None],
2026-02-21T10:45:31.0701502Z  'range_multi_buffers': [None],
2026-02-21T10:45:31.0701745Z  'range_num_stages': [0],
2026-02-21T10:45:31.0701969Z  'range_unroll_factors': [0],
2026-02-21T10:45:31.0702223Z  'range_warp_specializes': [],
2026-02-21T10:45:31.0702462Z  'reduction_loops': [None]}
2026-02-21T10:45:31.0709148Z [176s] Fitting surrogate: 400 points, 400 targets
2026-02-21T10:45:31.9411993Z [177s] Generation 5 starting: 53 neighbors, 5 active search path(s)
2026-02-21T10:45:44.0434928Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 12.2 configs/s
2026-02-21T10:45:47.4843639Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.2 configs/s
2026-02-21T10:45:56.9467579Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.4         
2026-02-21T10:45:56.9468123Z                                                                   configs/s     
2026-02-21T10:45:57.4833409Z [203s] Generation 5 complete: 
2026-02-21T10:45:57.4833827Z error=2
2026-02-21T10:45:57.4834318Z ok=57
2026-02-21T10:45:57.4834599Z min=0.0824
2026-02-21T10:45:57.4834859Z mid=0.0866
2026-02-21T10:45:57.4835111Z max=0.5131
2026-02-21T10:45:57.4835381Z best={'block_sizes': [1],
2026-02-21T10:45:57.4836020Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:45:57.4836959Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:45:57.4837718Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:45:57.4838335Z  'load_eviction_policies': ['', 'last', 'last', '', 'last', 'first', '', 'first'],
2026-02-21T10:45:57.4838927Z  'num_stages': 1,
2026-02-21T10:45:57.4839254Z  'num_warps': 32,
2026-02-21T10:45:57.4839551Z  'pid_type': 'flat',
2026-02-21T10:45:57.4839892Z  'range_flattens': [None],
2026-02-21T10:45:57.4840242Z  'range_multi_buffers': [None],
2026-02-21T10:45:57.4840622Z  'range_num_stages': [0],
2026-02-21T10:45:57.4840965Z  'range_unroll_factors': [0],
2026-02-21T10:45:57.4841353Z  'range_warp_specializes': [],
2026-02-21T10:45:57.4841729Z  'reduction_loops': [None]}
2026-02-21T10:45:57.4874300Z [203s] Fitting surrogate: 459 points, 459 targets
2026-02-21T10:45:58.2794570Z [203s] Generation 6 starting: 45 neighbors, 5 active search path(s)
2026-02-21T10:46:05.9638231Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 2.7 configs/s
2026-02-21T10:46:08.7756746Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 17.0 configs/s
2026-02-21T10:46:16.6027500Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.6         
2026-02-21T10:46:16.6028053Z                                                                   configs/s     
2026-02-21T10:46:17.0526039Z [222s] Generation 6 complete: 
2026-02-21T10:46:17.0526464Z ok=51
2026-02-21T10:46:17.0526754Z min=0.0822
2026-02-21T10:46:17.0527056Z mid=0.0850
2026-02-21T10:46:17.0527931Z max=0.5762
2026-02-21T10:46:17.0528119Z best={'block_sizes': [1],
2026-02-21T10:46:17.0528577Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:46:17.0529198Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:46:17.0529700Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:46:17.0530137Z  'num_stages': 2,
2026-02-21T10:46:17.0530341Z  'num_warps': 8,
2026-02-21T10:46:17.0530547Z  'pid_type': 'flat',
2026-02-21T10:46:17.0530761Z  'range_flattens': [None],
2026-02-21T10:46:17.0530999Z  'range_multi_buffers': [None],
2026-02-21T10:46:17.0531241Z  'range_num_stages': [0],
2026-02-21T10:46:17.0531474Z  'range_unroll_factors': [0],
2026-02-21T10:46:17.0532027Z  'range_warp_specializes': [],
2026-02-21T10:46:17.0532290Z  'reduction_loops': [None]}
2026-02-21T10:46:17.0561463Z [222s] Fitting surrogate: 510 points, 510 targets
2026-02-21T10:46:17.6909860Z [223s] Generation 7 starting: 33 neighbors, 4 active search path(s)
2026-02-21T10:46:22.1990870Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 47.0 configs/s
2026-02-21T10:46:24.2282046Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 35/35 17.7 configs/s
2026-02-21T10:46:30.5069248Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 160.0         
2026-02-21T10:46:30.5069786Z                                                                   configs/s     
2026-02-21T10:46:30.8745046Z [236s] Generation 7 complete: 
2026-02-21T10:46:30.8745299Z error=1
2026-02-21T10:46:30.8745467Z ok=36
2026-02-21T10:46:30.8745643Z min=0.0828
2026-02-21T10:46:30.8745817Z mid=0.0844
2026-02-21T10:46:30.8745978Z max=0.1140
2026-02-21T10:46:30.8746158Z best={'block_sizes': [1],
2026-02-21T10:46:30.8746610Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:46:30.8748238Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:46:30.8749078Z  'load_eviction_policies': ['', '', '', '', 'first', '', '', ''],
2026-02-21T10:46:30.8749641Z  'num_stages': 2,
2026-02-21T10:46:30.8749962Z  'num_warps': 32,
2026-02-21T10:46:30.8750267Z  'pid_type': 'flat',
2026-02-21T10:46:30.8750613Z  'range_flattens': [None],
2026-02-21T10:46:30.8750985Z  'range_multi_buffers': [None],
2026-02-21T10:46:30.8751379Z  'range_num_stages': [0],
2026-02-21T10:46:30.8751745Z  'range_unroll_factors': [0],
2026-02-21T10:46:30.8752132Z  'range_warp_specializes': [],
2026-02-21T10:46:30.8752552Z  'reduction_loops': [None]}
2026-02-21T10:46:30.8780347Z [236s] Fitting surrogate: 547 points, 547 targets
2026-02-21T10:46:31.5215872Z [237s] Generation 8 starting: 37 neighbors, 4 active search path(s)
2026-02-21T10:46:37.8082026Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 6.8 configs/s
2026-02-21T10:46:40.3721923Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 39/39 15.4 configs/s
2026-02-21T10:46:47.1079494Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 149.3         
2026-02-21T10:46:47.1079955Z                                                                   configs/s     
2026-02-21T10:46:47.5054962Z [253s] Generation 8 complete: 
2026-02-21T10:46:47.5055388Z error=1
2026-02-21T10:46:47.5055654Z ok=40
2026-02-21T10:46:47.5055905Z min=0.0822
2026-02-21T10:46:47.5056170Z mid=0.0836
2026-02-21T10:46:47.5056420Z max=0.1243
2026-02-21T10:46:47.5056691Z best={'block_sizes': [1],
2026-02-21T10:46:47.5057302Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:46:47.5058246Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:46:47.5059180Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:46:47.5059580Z  'load_eviction_policies': ['', 'last', '', '', '', 'first', '', 'first'],
2026-02-21T10:46:47.5059946Z  'num_stages': 2,
2026-02-21T10:46:47.5060516Z  'num_warps': 16,
2026-02-21T10:46:47.5060705Z  'pid_type': 'flat',
2026-02-21T10:46:47.5060914Z  'range_flattens': [None],
2026-02-21T10:46:47.5061140Z  'range_multi_buffers': [None],
2026-02-21T10:46:47.5061382Z  'range_num_stages': [0],
2026-02-21T10:46:47.5061607Z  'range_unroll_factors': [0],
2026-02-21T10:46:47.5061853Z  'range_warp_specializes': [],
2026-02-21T10:46:47.5062092Z  'reduction_loops': [None]}
2026-02-21T10:46:47.5096619Z [253s] Fitting surrogate: 588 points, 588 targets
2026-02-21T10:46:48.1473849Z [253s] Generation 9 starting: 36 neighbors, 4 active search path(s)
2026-02-21T10:46:53.1972551Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 4.4 configs/s
2026-02-21T10:46:55.4108838Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.5 configs/s
2026-02-21T10:47:03.0401525Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 147.5         
2026-02-21T10:47:03.0403315Z                                                                   configs/s     
2026-02-21T10:47:03.4342179Z [269s] Generation 9 complete: 
2026-02-21T10:47:03.4342448Z ok=41
2026-02-21T10:47:03.4342617Z min=0.0854
2026-02-21T10:47:03.4342791Z mid=0.0858
2026-02-21T10:47:03.4342954Z max=0.1827
2026-02-21T10:47:03.4343141Z best={'block_sizes': [1],
2026-02-21T10:47:03.4343536Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:47:03.4344506Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:47:03.4344991Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:47:03.4345374Z  'load_eviction_policies': ['', 'last', '', '', '', 'first', '', 'first'],
2026-02-21T10:47:03.4345748Z  'num_stages': 2,
2026-02-21T10:47:03.4345941Z  'num_warps': 16,
2026-02-21T10:47:03.4346147Z  'pid_type': 'flat',
2026-02-21T10:47:03.4346375Z  'range_flattens': [None],
2026-02-21T10:47:03.4346608Z  'range_multi_buffers': [None],
2026-02-21T10:47:03.4346841Z  'range_num_stages': [0],
2026-02-21T10:47:03.4347076Z  'range_unroll_factors': [0],
2026-02-21T10:47:03.4347313Z  'range_warp_specializes': [],
2026-02-21T10:47:03.4347554Z  'reduction_loops': [None]}
2026-02-21T10:47:03.4377261Z [269s] Fitting surrogate: 629 points, 629 targets
2026-02-21T10:47:04.0478839Z [269s] Generation 10 starting: 31 neighbors, 4 active search path(s)
2026-02-21T10:47:10.2627805Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 4.7 configs/s
2026-02-21T10:47:12.4119868Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.6 configs/s
2026-02-21T10:47:18.5450210Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 163.8         
2026-02-21T10:47:18.5450739Z                                                                   configs/s     
2026-02-21T10:47:18.9026375Z [284s] Generation 10 complete: 
2026-02-21T10:47:18.9026638Z ok=36
2026-02-21T10:47:18.9026808Z min=0.0820
2026-02-21T10:47:18.9026985Z mid=0.0848
2026-02-21T10:47:18.9027148Z max=0.1468
2026-02-21T10:47:18.9027351Z best={'block_sizes': [1],
2026-02-21T10:47:18.9027750Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:47:18.9028370Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:47:18.9028852Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:47:18.9029232Z  'load_eviction_policies': ['', 'last', '', '', '', 'first', '', 'first'],
2026-02-21T10:47:18.9029611Z  'num_stages': 2,
2026-02-21T10:47:18.9029800Z  'num_warps': 16,
2026-02-21T10:47:18.9030000Z  'pid_type': 'flat',
2026-02-21T10:47:18.9030210Z  'range_flattens': [None],
2026-02-21T10:47:18.9030433Z  'range_multi_buffers': [None],
2026-02-21T10:47:18.9030679Z  'range_num_stages': [0],
2026-02-21T10:47:18.9030907Z  'range_unroll_factors': [0],
2026-02-21T10:47:18.9031151Z  'range_warp_specializes': [],
2026-02-21T10:47:18.9031411Z  'reduction_loops': [None]}
2026-02-21T10:47:18.9066051Z [284s] Fitting surrogate: 665 points, 665 targets
2026-02-21T10:47:19.5858108Z [285s] Generation 11 starting: 37 neighbors, 4 active search path(s)
2026-02-21T10:47:24.6772787Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 53.0 configs/s
2026-02-21T10:47:26.9629508Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 39/39 17.4 configs/s
2026-02-21T10:47:34.0838290Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 141.2         
2026-02-21T10:47:34.0838842Z                                                                   configs/s     
2026-02-21T10:47:34.4947789Z [300s] Generation 11 complete: 
2026-02-21T10:47:34.4948072Z ok=42
2026-02-21T10:47:34.4948259Z min=0.0852
2026-02-21T10:47:34.4948437Z mid=0.0857
2026-02-21T10:47:34.4948615Z max=0.1826
2026-02-21T10:47:34.4949442Z best={'block_sizes': [1],
2026-02-21T10:47:34.4949938Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:47:34.4950537Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:47:34.4950943Z               'tensor_descriptor'],
2026-02-21T10:47:34.4951320Z  'load_eviction_policies': ['', 'last', 'last', '', '', '', 'first', 'first'],
2026-02-21T10:47:34.4951707Z  'num_stages': 8,
2026-02-21T10:47:34.4951920Z  'num_warps': 16,
2026-02-21T10:47:34.4952112Z  'pid_type': 'flat',
2026-02-21T10:47:34.4952336Z  'range_flattens': [None],
2026-02-21T10:47:34.4952568Z  'range_multi_buffers': [None],
2026-02-21T10:47:34.4952826Z  'range_num_stages': [0],
2026-02-21T10:47:34.4953050Z  'range_unroll_factors': [0],
2026-02-21T10:47:34.4953300Z  'range_warp_specializes': [],
2026-02-21T10:47:34.4953542Z  'reduction_loops': [None]}
2026-02-21T10:47:34.4991397Z [300s] Fitting surrogate: 707 points, 707 targets
2026-02-21T10:47:35.1411662Z [300s] Generation 12 starting: 34 neighbors, 4 active search path(s)
2026-02-21T10:47:40.1624723Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 11.2 configs/s
2026-02-21T10:47:42.5399812Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 38/38 16.3 configs/s
2026-02-21T10:47:49.1352556Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 152.5         
2026-02-21T10:47:49.1353110Z                                                                   configs/s     
2026-02-21T10:47:49.5185791Z [315s] Generation 12 complete: 
2026-02-21T10:47:49.5186054Z ok=39
2026-02-21T10:47:49.5186244Z min=0.0820
2026-02-21T10:47:49.5186431Z mid=0.0841
2026-02-21T10:47:49.5186597Z max=0.1283
2026-02-21T10:47:49.5186794Z best={'block_sizes': [1],
2026-02-21T10:47:49.5187240Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:47:49.5187869Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:47:49.5188310Z               'tensor_descriptor'],
2026-02-21T10:47:49.5188672Z  'load_eviction_policies': ['', 'last', 'last', '', '', '', 'first', 'first'],
2026-02-21T10:47:49.5189065Z  'num_stages': 8,
2026-02-21T10:47:49.5189253Z  'num_warps': 16,
2026-02-21T10:47:49.5189447Z  'pid_type': 'flat',
2026-02-21T10:47:49.5189651Z  'range_flattens': [None],
2026-02-21T10:47:49.5189886Z  'range_multi_buffers': [None],
2026-02-21T10:47:49.5190132Z  'range_num_stages': [0],
2026-02-21T10:47:49.5190353Z  'range_unroll_factors': [0],
2026-02-21T10:47:49.5190603Z  'range_warp_specializes': [],
2026-02-21T10:47:49.5190838Z  'reduction_loops': [None]}
2026-02-21T10:47:49.5229367Z [315s] Fitting surrogate: 746 points, 746 targets
2026-02-21T10:47:50.0661514Z [315s] Generation 13 starting: 28 neighbors, 3 active search path(s)
2026-02-21T10:47:54.7145508Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 3.4 configs/s
2026-02-21T10:47:57.1943246Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 11.8 configs/s
2026-02-21T10:48:02.5820403Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 186.4         
2026-02-21T10:48:02.5820994Z                                                                   configs/s     
2026-02-21T10:48:02.8886767Z [328s] Generation 13 complete: 
2026-02-21T10:48:02.8887302Z ok=32
2026-02-21T10:48:02.8887589Z min=0.0854
2026-02-21T10:48:02.8887882Z mid=0.0861
2026-02-21T10:48:02.8888159Z max=0.3914
2026-02-21T10:48:02.8888464Z best={'block_sizes': [1],
2026-02-21T10:48:02.8889178Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:02.8890307Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:48:02.8891114Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', ''],
2026-02-21T10:48:02.8891722Z  'num_stages': 2,
2026-02-21T10:48:02.8891906Z  'num_warps': 16,
2026-02-21T10:48:02.8892091Z  'pid_type': 'flat',
2026-02-21T10:48:02.8892663Z  'range_flattens': [None],
2026-02-21T10:48:02.8892901Z  'range_multi_buffers': [None],
2026-02-21T10:48:02.8893127Z  'range_num_stages': [0],
2026-02-21T10:48:02.8893335Z  'range_unroll_factors': [0],
2026-02-21T10:48:02.8893586Z  'range_warp_specializes': [],
2026-02-21T10:48:02.8893822Z  'reduction_loops': [None]}
2026-02-21T10:48:02.8927804Z [328s] Fitting surrogate: 778 points, 778 targets
2026-02-21T10:48:03.3146335Z [328s] Generation 14 starting: 17 neighbors, 2 active search path(s)
2026-02-21T10:48:06.1725592Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 9.3 configs/s
2026-02-21T10:48:07.2889212Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.8 configs/s
2026-02-21T10:48:10.6177415Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 300.7         
2026-02-21T10:48:10.6177918Z                                                                   configs/s     
2026-02-21T10:48:10.8216888Z [336s] Generation 14 complete: 
2026-02-21T10:48:10.8217177Z ok=20
2026-02-21T10:48:10.8217345Z min=0.0854
2026-02-21T10:48:10.8217531Z mid=0.0880
2026-02-21T10:48:10.8217702Z max=0.1395
2026-02-21T10:48:10.8217891Z best={'block_sizes': [1],
2026-02-21T10:48:10.8218306Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:10.8218920Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:48:10.8219413Z               'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:48:10.8219814Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', 'first'],
2026-02-21T10:48:10.8220183Z  'num_stages': 2,
2026-02-21T10:48:10.8220373Z  'num_warps': 32,
2026-02-21T10:48:10.8220573Z  'pid_type': 'flat',
2026-02-21T10:48:10.8220795Z  'range_flattens': [None],
2026-02-21T10:48:10.8221019Z  'range_multi_buffers': [None],
2026-02-21T10:48:10.8221271Z  'range_num_stages': [0],
2026-02-21T10:48:10.8221493Z  'range_unroll_factors': [0],
2026-02-21T10:48:10.8221745Z  'range_warp_specializes': [],
2026-02-21T10:48:10.8221982Z  'reduction_loops': [None]}
2026-02-21T10:48:10.8263921Z [336s] Fitting surrogate: 798 points, 798 targets
2026-02-21T10:48:11.1006344Z [336s] Generation 15 starting: 8 neighbors, 1 active search path(s)
2026-02-21T10:48:12.7921160Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 4.8 configs/s
2026-02-21T10:48:13.3343017Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.2 configs/s
2026-02-21T10:48:14.9536908Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 608.1         
2026-02-21T10:48:14.9537390Z                                                                   configs/s     
2026-02-21T10:48:15.0749099Z [340s] Generation 15 complete: 
2026-02-21T10:48:15.0749350Z ok=10
2026-02-21T10:48:15.0749522Z min=0.0856
2026-02-21T10:48:15.0749691Z mid=0.1074
2026-02-21T10:48:15.0749863Z max=0.1335
2026-02-21T10:48:15.0750044Z best={'block_sizes': [1],
2026-02-21T10:48:15.0750955Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:15.0751576Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:48:15.0752093Z               'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:48:15.0752507Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', 'first'],
2026-02-21T10:48:15.0752885Z  'num_stages': 2,
2026-02-21T10:48:15.0753083Z  'num_warps': 32,
2026-02-21T10:48:15.0753273Z  'pid_type': 'flat',
2026-02-21T10:48:15.0753484Z  'range_flattens': [None],
2026-02-21T10:48:15.0753712Z  'range_multi_buffers': [None],
2026-02-21T10:48:15.0753955Z  'range_num_stages': [0],
2026-02-21T10:48:15.0754520Z  'range_unroll_factors': [0],
2026-02-21T10:48:15.0754770Z  'range_warp_specializes': [],
2026-02-21T10:48:15.0755014Z  'reduction_loops': [None]}
2026-02-21T10:48:15.0791113Z [340s] Fitting surrogate: 808 points, 808 targets
2026-02-21T10:48:15.3455800Z [340s] Generation 16 starting: 8 neighbors, 1 active search path(s)
2026-02-21T10:48:16.8522229Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 16.8 configs/s
2026-02-21T10:48:17.3903266Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.4 configs/s
2026-02-21T10:48:18.7661705Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 713.7         
2026-02-21T10:48:18.7662205Z                                                                   configs/s     
2026-02-21T10:48:18.8753261Z [344s] Generation 16 complete: 
2026-02-21T10:48:18.8753724Z ok=10
2026-02-21T10:48:18.8754552Z min=0.0825
2026-02-21T10:48:18.8754865Z mid=0.0874
2026-02-21T10:48:18.8755136Z max=0.1534
2026-02-21T10:48:18.8755438Z best={'block_sizes': [1],
2026-02-21T10:48:18.8756094Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:18.8757106Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T10:48:18.8757954Z               'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:48:18.8758688Z  'load_eviction_policies': ['', 'last', '', 'first', '', 'first', '', 'first'],
2026-02-21T10:48:18.8759334Z  'num_stages': 2,
2026-02-21T10:48:18.8759673Z  'num_warps': 32,
2026-02-21T10:48:18.8759986Z  'pid_type': 'flat',
2026-02-21T10:48:18.8760356Z  'range_flattens': [None],
2026-02-21T10:48:18.8760739Z  'range_multi_buffers': [None],
2026-02-21T10:48:18.8761129Z  'range_num_stages': [0],
2026-02-21T10:48:18.8761503Z  'range_unroll_factors': [0],
2026-02-21T10:48:18.8761893Z  'range_warp_specializes': [],
2026-02-21T10:48:18.8762323Z  'reduction_loops': [None]}
2026-02-21T10:48:18.8800818Z [344s] Fitting surrogate: 818 points, 818 targets
2026-02-21T10:48:19.1319592Z [344s] Generation 17 starting: 7 neighbors, 1 active search path(s)
2026-02-21T10:48:20.2509288Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 55.4 configs/s
2026-02-21T10:48:20.7150719Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 19.4 configs/s
2026-02-21T10:48:22.2362451Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 647.9         
2026-02-21T10:48:22.2362962Z                                                                   configs/s     
2026-02-21T10:48:22.3573340Z [347s] Generation 17 complete: 
2026-02-21T10:48:22.3573591Z ok=9
2026-02-21T10:48:22.3573764Z min=0.0854
2026-02-21T10:48:22.3573937Z mid=0.0856
2026-02-21T10:48:22.3574499Z max=0.0862
2026-02-21T10:48:22.3574720Z best={'block_sizes': [1],
2026-02-21T10:48:22.3575173Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:22.3575779Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:48:22.3576324Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:48:22.3576806Z  'load_eviction_policies': ['', 'last', '', 'first', '', 'first', '', 'first'],
2026-02-21T10:48:22.3577530Z  'num_stages': 2,
2026-02-21T10:48:22.3577733Z  'num_warps': 32,
2026-02-21T10:48:22.3577921Z  'pid_type': 'flat',
2026-02-21T10:48:22.3578142Z  'range_flattens': [None],
2026-02-21T10:48:22.3578374Z  'range_multi_buffers': [None],
2026-02-21T10:48:22.3578621Z  'range_num_stages': [0],
2026-02-21T10:48:22.3578844Z  'range_unroll_factors': [0],
2026-02-21T10:48:22.3579090Z  'range_warp_specializes': [],
2026-02-21T10:48:22.3579336Z  'reduction_loops': [None]}
2026-02-21T10:48:22.3615867Z [347s] Fitting surrogate: 827 points, 827 targets
2026-02-21T10:48:22.6439781Z [348s] Generation 18 starting: 10 neighbors, 1 active search path(s)
2026-02-21T10:48:25.1578272Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 6.9 configs/s
2026-02-21T10:48:25.8137472Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 18.1 configs/s
2026-02-21T10:48:27.6973615Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 525.6         
2026-02-21T10:48:27.6974309Z                                                                   configs/s     
2026-02-21T10:48:27.8318627Z [353s] Generation 18 complete: 
2026-02-21T10:48:27.8319042Z ok=12
2026-02-21T10:48:27.8319337Z min=0.0821
2026-02-21T10:48:27.8319645Z mid=0.0862
2026-02-21T10:48:27.8319914Z max=0.1274
2026-02-21T10:48:27.8320217Z best={'block_sizes': [1],
2026-02-21T10:48:27.8320856Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:27.8321850Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:48:27.8322753Z               'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:48:27.8323528Z  'load_eviction_policies': ['', 'last', '', 'first', '', 'first', '', 'first'],
2026-02-21T10:48:27.8324665Z  'num_stages': 2,
2026-02-21T10:48:27.8324994Z  'num_warps': 32,
2026-02-21T10:48:27.8325305Z  'pid_type': 'flat',
2026-02-21T10:48:27.8325646Z  'range_flattens': [None],
2026-02-21T10:48:27.8326032Z  'range_multi_buffers': [None],
2026-02-21T10:48:27.8326421Z  'range_num_stages': [0],
2026-02-21T10:48:27.8326799Z  'range_unroll_factors': [0],
2026-02-21T10:48:27.8327197Z  'range_warp_specializes': [],
2026-02-21T10:48:27.8327604Z  'reduction_loops': [None]}
2026-02-21T10:48:27.8363092Z [353s] Fitting surrogate: 839 points, 839 targets
2026-02-21T10:48:28.1042561Z [353s] Generation 19 starting: 8 neighbors, 1 active search path(s)
2026-02-21T10:48:29.3984588Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 5.6 configs/s
2026-02-21T10:48:29.8612578Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 19.4 configs/s
2026-02-21T10:48:31.5642532Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 579.9         
2026-02-21T10:48:31.5643051Z                                                                   configs/s     
2026-02-21T10:48:31.6948430Z [357s] Generation 19 complete: 
2026-02-21T10:48:31.6948670Z ok=10
2026-02-21T10:48:31.6948874Z min=0.0854
2026-02-21T10:48:31.6949067Z mid=0.0857
2026-02-21T10:48:31.6949252Z max=0.0924
2026-02-21T10:48:31.6949436Z best={'block_sizes': [1],
2026-02-21T10:48:31.6949848Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:31.6951019Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:48:31.6951837Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:48:31.6952674Z  'load_eviction_policies': ['', '', '', 'first', '', 'first', '', 'first'],
2026-02-21T10:48:31.6953226Z  'num_stages': 2,
2026-02-21T10:48:31.6953515Z  'num_warps': 32,
2026-02-21T10:48:31.6953817Z  'pid_type': 'flat',
2026-02-21T10:48:31.6954572Z  'range_flattens': [None],
2026-02-21T10:48:31.6954951Z  'range_multi_buffers': [None],
2026-02-21T10:48:31.6955315Z  'range_num_stages': [0],
2026-02-21T10:48:31.6955660Z  'range_unroll_factors': [0],
2026-02-21T10:48:31.6956024Z  'range_warp_specializes': [],
2026-02-21T10:48:31.6956755Z  'reduction_loops': [None]}
2026-02-21T10:48:31.6992240Z [357s] Fitting surrogate: 849 points, 849 targets
2026-02-21T10:48:31.9755495Z [357s] Generation 20 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:48:34.1689134Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 16.6 configs/s
2026-02-21T10:48:34.7597995Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.4 configs/s
2026-02-21T10:48:36.4857278Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 572.2         
2026-02-21T10:48:36.4857790Z                                                                   configs/s     
2026-02-21T10:48:36.6118004Z [362s] Generation 20 complete: 
2026-02-21T10:48:36.6118238Z ok=11
2026-02-21T10:48:36.6118403Z min=0.0856
2026-02-21T10:48:36.6118564Z mid=0.0859
2026-02-21T10:48:36.6118723Z max=0.1520
2026-02-21T10:48:36.6118891Z best={'block_sizes': [1],
2026-02-21T10:48:36.6119309Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T10:48:36.6119891Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:48:36.6120399Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:48:36.6120868Z  'load_eviction_policies': ['', '', '', 'first', 'last', 'first', '', 'first'],
2026-02-21T10:48:36.6121208Z  'num_stages': 2,
2026-02-21T10:48:36.6121386Z  'num_warps': 32,
2026-02-21T10:48:36.6121559Z  'pid_type': 'flat',
2026-02-21T10:48:36.6121765Z  'range_flattens': [None],
2026-02-21T10:48:36.6121974Z  'range_multi_buffers': [None],
2026-02-21T10:48:36.6122194Z  'range_num_stages': [0],
2026-02-21T10:48:36.6122403Z  'range_unroll_factors': [0],
2026-02-21T10:48:36.6122623Z  'range_warp_specializes': [],
2026-02-21T10:48:36.6122845Z  'reduction_loops': [None]}
2026-02-21T10:48:36.6170688Z [362s] Fitting surrogate: 860 points, 860 targets
2026-02-21T10:48:36.7818298Z [362s] Autotuning complete in 362.4s after searching 814 configs.
2026-02-21T10:48:36.7818776Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:48:36.7821037Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', '', '', 'first', 'last', 'first', '', 'first'], num_stages=2, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:48:36.7823168Z 
2026-02-21T10:48:36.7823574Z [362s] Code of selected kernel: /tmp/torchinductor_root/rv/crvqn7pjnbjw6xpvaw5psgrcjg2hgg3q3wl5bs5prlq7dqopcf7w.py
2026-02-21T10:48:36.8105964Z from __future__ import annotations
2026-02-21T10:48:36.8106154Z 
2026-02-21T10:48:36.8106227Z import torch
2026-02-21T10:48:36.8106415Z import triton
2026-02-21T10:48:36.8106638Z import triton.language as tl
2026-02-21T10:48:36.8106936Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:48:36.8107782Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:48:36.8108043Z 
2026-02-21T10:48:36.8108130Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T10:48:36.8108281Z 
2026-02-21T10:48:36.8108348Z @triton.jit
2026-02-21T10:48:36.8108695Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:48:36.8109158Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:48:36.8109458Z     pid_0 = tl.program_id(0)
2026-02-21T10:48:36.8109670Z     offset_0 = pid_0
2026-02-21T10:48:36.8109891Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T10:48:36.8110206Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:48:36.8110485Z     mask_1 = indices_1 < 7168
2026-02-21T10:48:36.8111065Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:48:36.8111543Z     acc = tl.load(x + (indices_0[:, None] * 7168 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T10:48:36.8112040Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:48:36.8112379Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:48:36.8112643Z     v_0 = 0.00013950892857142856
2026-02-21T10:48:36.8112893Z     v_1 = sum_1 * v_0
2026-02-21T10:48:36.8113152Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:48:36.8113463Z     subscript = v_1[:, None]
2026-02-21T10:48:36.8113674Z     v_2 = acc - subscript
2026-02-21T10:48:36.8114135Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:48:36.8114488Z     v_3 = v_2 * v_2
2026-02-21T10:48:36.8114913Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T10:48:36.8115451Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T10:48:36.8115727Z     v_4 = 0.00013950892857142856
2026-02-21T10:48:36.8115936Z     v_5 = sum_2 * v_4
2026-02-21T10:48:36.8116191Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:48:36.8116509Z     v_6 = v_5 + eps
2026-02-21T10:48:36.8116696Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:48:36.8117006Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:48:36.8117334Z     subscript_1 = v_7[:, None]
2026-02-21T10:48:36.8117555Z     v_8 = v_2 * subscript_1
2026-02-21T10:48:36.8117864Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:48:36.8118287Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0)
2026-02-21T10:48:36.8118581Z     v_9 = load_1[None, :]
2026-02-21T10:48:36.8118768Z     v_10 = v_8 * v_9
2026-02-21T10:48:36.8118990Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:48:36.8119309Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T10:48:36.8119724Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:48:36.8120148Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:48:36.8120441Z     # src[layer_norm.py:75]: )
2026-02-21T10:48:36.8120657Z     v_11 = load_2[None, :]
2026-02-21T10:48:36.8120847Z     v_12 = v_10 + v_11
2026-02-21T10:48:36.8121089Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:48:36.8121525Z     tl.store(out + (indices_0[:, None] * 7168 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T10:48:36.8121946Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:48:36.8122238Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:48:36.8122518Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:48:36.8122803Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:48:36.8122983Z 
2026-02-21T10:48:36.8123501Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:48:36.8124306Z     """
2026-02-21T10:48:36.8124725Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:48:36.8125062Z     Args:
2026-02-21T10:48:36.8125359Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:48:36.8125923Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:48:36.8126410Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:48:36.8126815Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:48:36.8127306Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:48:36.8127679Z     Returns:
2026-02-21T10:48:36.8128010Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:48:36.8128387Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:48:36.8128748Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:48:36.8129099Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:48:36.8129405Z     """
2026-02-21T10:48:36.8129569Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:48:36.8129787Z     m, n = x.size()
2026-02-21T10:48:36.8130198Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:48:36.8130675Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:48:36.8131009Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:48:36.8131385Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:48:36.8131741Z     if bias is not None:
2026-02-21T10:48:36.8132067Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:48:36.8132507Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:48:36.8132872Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:48:36.8133264Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:48:36.8133605Z     # src[layer_norm.py:52]: )
2026-02-21T10:48:36.8133949Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:48:36.8134538Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:48:36.8134926Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:48:36.8135267Z     # src[layer_norm.py:55]: )
2026-02-21T10:48:36.8135611Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:48:36.8136079Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:48:36.8136479Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:48:36.8136887Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:48:36.8137287Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:48:36.8137677Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:48:36.8138069Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:48:36.8138399Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:48:36.8138648Z     _RDIM_SIZE_1 = 8192
2026-02-21T10:48:36.8138855Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:48:36.8139167Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:48:36.8139469Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:48:36.8139706Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:48:36.8140134Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=32, num_stages=2)
2026-02-21T10:48:36.8140774Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:48:36.8141026Z     return (out, mean, rstd)
2026-02-21T10:48:37.8991832Z WARNING:tritonbench.utils.triton_op:Completed input ID 12:
2026-02-21T10:48:37.8992173Z (M, N)
2026-02-21T10:48:37.8992343Z ------------
2026-02-21T10:48:37.8992508Z (4096, 7168)
2026-02-21T10:48:37.8992638Z 
2026-02-21T10:48:37.9015921Z  45%|████▌     | 9/20 [47:34<1:01:52, 337.54s/it]WARNING:tritonbench.utils.triton_op:Running input ID 14:
2026-02-21T10:48:37.9016381Z (M, N)
2026-02-21T10:48:37.9016545Z ------------
2026-02-21T10:48:37.9016727Z (4096, 8192)
2026-02-21T10:48:37.9019756Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T10:48:39.2753583Z INFO:tritonbench.utils.triton_op:Took 3.59ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:48:40.7911139Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:48:42.2779327Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:48:42.2779632Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:48:42.2779904Z               'dtype': 'torch.float32',
2026-02-21T10:48:42.2780185Z               'shape': (4096, 8192),
2026-02-21T10:48:42.2780431Z               'stride': (8192, 1)},
2026-02-21T10:48:42.2780668Z             (8192,),
2026-02-21T10:48:42.2780863Z             { 'device': 'cuda:0',
2026-02-21T10:48:42.2781117Z               'dtype': 'torch.float32',
2026-02-21T10:48:42.2781397Z               'shape': (8192,),
2026-02-21T10:48:42.2781632Z               'stride': (1,)},
2026-02-21T10:48:42.2781857Z             { 'device': 'cuda:0',
2026-02-21T10:48:42.2782100Z               'dtype': 'torch.float32',
2026-02-21T10:48:42.2782354Z               'shape': (8192,),
2026-02-21T10:48:42.2782581Z               'stride': (1,)},
2026-02-21T10:48:42.2782795Z             1e-05),
2026-02-21T10:48:42.2783006Z   'kwargs': {}}
2026-02-21T10:48:42.2825580Z INFO:tritonbench.utils.triton_op:Took 5.01ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:48:42.2910483Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:48:42.2911308Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:48:42.2911860Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:48:42.2912189Z While processing:
2026-02-21T10:48:42.2912616Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:48:42.2913022Z     if bias is not None:
2026-02-21T10:48:42.2913224Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:48:42.2913344Z 
2026-02-21T10:48:42.4610996Z [0s] Autotune random seed: 2141537047
2026-02-21T10:48:42.5051414Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:49:17.6368119Z [35s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:49:18.2706110Z [35s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:49:20.0897062Z [37s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:49:20.0914961Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 1.0 configs/s
2026-02-21T10:49:26.7874378Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.0 configs/s
2026-02-21T10:49:26.7887063Z [44s] Adaptive compile timeout: 30s (90% percentile=10.5s, bounds=[30.0s, 30s])
2026-02-21T10:49:28.0671273Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 757.7 configs/s
2026-02-21T10:49:28.1732417Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T10:49:28.1736710Z error=11
2026-02-21T10:49:28.1737089Z timeout=3
2026-02-21T10:49:28.1737364Z ok=86
2026-02-21T10:49:28.1737641Z min=0.1165
2026-02-21T10:49:28.1737904Z mid=0.5180
2026-02-21T10:49:28.1738173Z max=23.9726
2026-02-21T10:49:28.1738485Z best={'block_sizes': [1],
2026-02-21T10:49:28.1739161Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T10:49:28.1740177Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:49:28.1741066Z               'tensor_descriptor'],
2026-02-21T10:49:28.1741649Z  'load_eviction_policies': ['last', 'first', '', 'first', 'last', 'last', '', ''],
2026-02-21T10:49:28.1742051Z  'num_sm_multiplier': 8,
2026-02-21T10:49:28.1742272Z  'num_stages': 5,
2026-02-21T10:49:28.1742474Z  'num_warps': 8,
2026-02-21T10:49:28.1742688Z  'pid_type': 'persistent_blocked',
2026-02-21T10:49:28.1742950Z  'range_flattens': [False],
2026-02-21T10:49:28.1743180Z  'range_multi_buffers': [True],
2026-02-21T10:49:28.1743420Z  'range_num_stages': [0],
2026-02-21T10:49:28.1743645Z  'range_unroll_factors': [4],
2026-02-21T10:49:28.1743889Z  'range_warp_specializes': [],
2026-02-21T10:49:28.1744289Z  'reduction_loops': [1024]}
2026-02-21T10:49:28.1753404Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:49:30.4912431Z [47s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T10:49:45.3599768Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 5.8 configs/s
2026-02-21T10:49:51.0673010Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.6 configs/s
2026-02-21T10:50:04.8957881Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 72.7 configs/s
2026-02-21T10:50:05.5405378Z [83s] Generation 1 complete: 
2026-02-21T10:50:05.5406289Z error=1
2026-02-21T10:50:05.5406550Z ok=94
2026-02-21T10:50:05.5406804Z min=0.0950
2026-02-21T10:50:05.5407077Z mid=0.1331
2026-02-21T10:50:05.5407286Z max=0.2898
2026-02-21T10:50:05.5407479Z best={'block_sizes': [1],
2026-02-21T10:50:05.5407885Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:50:05.5408406Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:50:05.5408828Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:50:05.5409159Z  'num_stages': 2,
2026-02-21T10:50:05.5409366Z  'num_warps': 8,
2026-02-21T10:50:05.5409561Z  'pid_type': 'flat',
2026-02-21T10:50:05.5409791Z  'range_flattens': [None],
2026-02-21T10:50:05.5410121Z  'range_multi_buffers': [None],
2026-02-21T10:50:05.5410696Z  'range_num_stages': [0],
2026-02-21T10:50:05.5410946Z  'range_unroll_factors': [0],
2026-02-21T10:50:05.5411203Z  'range_warp_specializes': [],
2026-02-21T10:50:05.5411456Z  'reduction_loops': [None]}
2026-02-21T10:50:05.5432023Z [83s] Fitting surrogate: 195 points, 195 targets
2026-02-21T10:50:06.9071646Z [84s] Generation 2 starting: 83 neighbors, 5 active search path(s)
2026-02-21T10:50:19.9881861Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 6.8 configs/s
2026-02-21T10:50:24.5507694Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 19.3 configs/s
2026-02-21T10:50:36.7861093Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.2 configs/s
2026-02-21T10:50:37.3300663Z [114s] Generation 2 complete: 
2026-02-21T10:50:37.3300954Z error=12
2026-02-21T10:50:37.3301122Z ok=76
2026-02-21T10:50:37.3301290Z min=0.0936
2026-02-21T10:50:37.3301456Z mid=0.1216
2026-02-21T10:50:37.3301633Z max=0.4210
2026-02-21T10:50:37.3301815Z best={'block_sizes': [1],
2026-02-21T10:50:37.3302239Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:50:37.3302759Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:50:37.3303170Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:50:37.3303485Z  'num_stages': 1,
2026-02-21T10:50:37.3303672Z  'num_warps': 32,
2026-02-21T10:50:37.3303867Z  'pid_type': 'flat',
2026-02-21T10:50:37.3304456Z  'range_flattens': [None],
2026-02-21T10:50:37.3304706Z  'range_multi_buffers': [None],
2026-02-21T10:50:37.3304941Z  'range_num_stages': [0],
2026-02-21T10:50:37.3305171Z  'range_unroll_factors': [0],
2026-02-21T10:50:37.3305415Z  'range_warp_specializes': [],
2026-02-21T10:50:37.3305649Z  'reduction_loops': [None]}
2026-02-21T10:50:37.3330739Z [114s] Fitting surrogate: 283 points, 283 targets
2026-02-21T10:50:38.3627945Z [115s] Generation 3 starting: 61 neighbors, 5 active search path(s)
2026-02-21T10:50:50.7556645Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 3.1 configs/s
2026-02-21T10:50:55.5222438Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 13.3 configs/s
2026-02-21T10:51:05.9743639Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 96.2 configs/s
2026-02-21T10:51:06.4969949Z [143s] Generation 3 complete: 
2026-02-21T10:51:06.4970472Z ok=67
2026-02-21T10:51:06.4970748Z min=0.0934
2026-02-21T10:51:06.4971022Z mid=0.1031
2026-02-21T10:51:06.4971272Z max=0.5376
2026-02-21T10:51:06.4971550Z best={'block_sizes': [1],
2026-02-21T10:51:06.4972245Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:51:06.4973109Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:51:06.4973727Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:51:06.4974665Z  'num_stages': 1,
2026-02-21T10:51:06.4974955Z  'num_warps': 8,
2026-02-21T10:51:06.4975250Z  'pid_type': 'flat',
2026-02-21T10:51:06.4975593Z  'range_flattens': [None],
2026-02-21T10:51:06.4975947Z  'range_multi_buffers': [None],
2026-02-21T10:51:06.4976314Z  'range_num_stages': [0],
2026-02-21T10:51:06.4976655Z  'range_unroll_factors': [0],
2026-02-21T10:51:06.5973524Z  'range_warp_specializes': [],
2026-02-21T10:51:06.5973769Z  'reduction_loops': [None]}
2026-02-21T10:51:06.5974403Z [143s] Fitting surrogate: 350 points, 350 targets
2026-02-21T10:51:07.5282005Z [145s] Generation 4 starting: 62 neighbors, 5 active search path(s)
2026-02-21T10:51:21.0346313Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 2.4 configs/s
2026-02-21T10:51:24.8104359Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 16.9 configs/s
2026-02-21T10:51:36.4202995Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.9 configs/s
2026-02-21T10:51:36.9691871Z [174s] Generation 4 complete: 
2026-02-21T10:51:36.9692149Z ok=67
2026-02-21T10:51:36.9692337Z min=0.0936
2026-02-21T10:51:36.9692510Z mid=0.1014
2026-02-21T10:51:36.9693245Z max=1.1638
2026-02-21T10:51:36.9693451Z best={'block_sizes': [2],
2026-02-21T10:51:36.9693902Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:51:36.9694693Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:51:36.9695110Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:51:36.9695435Z  'num_stages': 2,
2026-02-21T10:51:36.9695631Z  'num_warps': 8,
2026-02-21T10:51:36.9695835Z  'pid_type': 'flat',
2026-02-21T10:51:36.9696050Z  'range_flattens': [None],
2026-02-21T10:51:36.9696291Z  'range_multi_buffers': [None],
2026-02-21T10:51:36.9696542Z  'range_num_stages': [0],
2026-02-21T10:51:36.9696776Z  'range_unroll_factors': [0],
2026-02-21T10:51:36.9697060Z  'range_warp_specializes': [],
2026-02-21T10:51:36.9697312Z  'reduction_loops': [None]}
2026-02-21T10:51:36.9727744Z [174s] Fitting surrogate: 417 points, 417 targets
2026-02-21T10:51:37.8866482Z [175s] Generation 5 starting: 55 neighbors, 5 active search path(s)
2026-02-21T10:51:47.2091422Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 8.9 configs/s
2026-02-21T10:51:51.1193565Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 14.4 configs/s
2026-02-21T10:52:01.9008803Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.4 configs/s
2026-02-21T10:52:02.4421078Z [199s] Generation 5 complete: 
2026-02-21T10:52:02.4423839Z ok=60
2026-02-21T10:52:02.4424340Z min=0.0943
2026-02-21T10:52:02.4424571Z mid=0.0979
2026-02-21T10:52:02.4424756Z max=1.1943
2026-02-21T10:52:02.4424958Z best={'block_sizes': [1],
2026-02-21T10:52:02.4425441Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:52:02.4426126Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:52:02.4426697Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', 'first', 'first'],
2026-02-21T10:52:02.4427142Z  'num_stages': 8,
2026-02-21T10:52:02.4427349Z  'num_warps': 8,
2026-02-21T10:52:02.4427570Z  'pid_type': 'flat',
2026-02-21T10:52:02.4427805Z  'range_flattens': [None],
2026-02-21T10:52:02.4428065Z  'range_multi_buffers': [None],
2026-02-21T10:52:02.4428334Z  'range_num_stages': [0],
2026-02-21T10:52:02.4428573Z  'range_unroll_factors': [0],
2026-02-21T10:52:02.4428816Z  'range_warp_specializes': [],
2026-02-21T10:52:02.4429049Z  'reduction_loops': [None]}
2026-02-21T10:52:02.4457471Z [199s] Fitting surrogate: 477 points, 477 targets
2026-02-21T10:52:03.2048461Z [200s] Generation 6 starting: 43 neighbors, 5 active search path(s)
2026-02-21T10:52:11.5490758Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 8.7 configs/s
2026-02-21T10:52:14.2914769Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 17.0 configs/s
2026-02-21T10:52:23.0902405Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 114.3         
2026-02-21T10:52:23.0904681Z                                                                   configs/s     
2026-02-21T10:52:23.5362527Z [221s] Generation 6 complete: 
2026-02-21T10:52:23.5362961Z error=2
2026-02-21T10:52:23.5363871Z ok=47
2026-02-21T10:52:23.5364705Z min=0.0938
2026-02-21T10:52:23.5364994Z mid=0.0961
2026-02-21T10:52:23.5365264Z max=0.1300
2026-02-21T10:52:23.5365586Z best={'block_sizes': [1],
2026-02-21T10:52:23.5366321Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:52:23.5367331Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:52:23.5368191Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', 'first', 'first'],
2026-02-21T10:52:23.5368804Z  'num_stages': 8,
2026-02-21T10:52:23.5369127Z  'num_warps': 32,
2026-02-21T10:52:23.5369440Z  'pid_type': 'flat',
2026-02-21T10:52:23.5369784Z  'range_flattens': [None],
2026-02-21T10:52:23.5370272Z  'range_multi_buffers': [None],
2026-02-21T10:52:23.5371119Z  'range_num_stages': [0],
2026-02-21T10:52:23.5371496Z  'range_unroll_factors': [0],
2026-02-21T10:52:23.5371917Z  'range_warp_specializes': [],
2026-02-21T10:52:23.5372308Z  'reduction_loops': [None]}
2026-02-21T10:52:23.5405648Z [221s] Fitting surrogate: 526 points, 526 targets
2026-02-21T10:52:24.3259482Z [221s] Generation 7 starting: 44 neighbors, 5 active search path(s)
2026-02-21T10:52:31.9191817Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 8.3 configs/s
2026-02-21T10:52:34.7389855Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.9 configs/s
2026-02-21T10:52:43.8465108Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 122.4         
2026-02-21T10:52:43.8465629Z                                                                   configs/s     
2026-02-21T10:52:44.2875861Z [241s] Generation 7 complete: 
2026-02-21T10:52:44.2876164Z error=1
2026-02-21T10:52:44.2876339Z ok=48
2026-02-21T10:52:44.2876525Z min=0.0936
2026-02-21T10:52:44.2876729Z mid=0.0957
2026-02-21T10:52:44.2876917Z max=0.5959
2026-02-21T10:52:44.2877111Z best={'block_sizes': [2],
2026-02-21T10:52:44.2877586Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:52:44.2878223Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:52:44.2878686Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', ''],
2026-02-21T10:52:44.2879028Z  'num_stages': 3,
2026-02-21T10:52:44.2879221Z  'num_warps': 8,
2026-02-21T10:52:44.2879430Z  'pid_type': 'flat',
2026-02-21T10:52:44.2879659Z  'range_flattens': [None],
2026-02-21T10:52:44.2879908Z  'range_multi_buffers': [None],
2026-02-21T10:52:44.2880170Z  'range_num_stages': [0],
2026-02-21T10:52:44.2880401Z  'range_unroll_factors': [0],
2026-02-21T10:52:44.2880655Z  'range_warp_specializes': [],
2026-02-21T10:52:44.2880894Z  'reduction_loops': [None]}
2026-02-21T10:52:44.2909458Z [241s] Fitting surrogate: 575 points, 575 targets
2026-02-21T10:52:45.1032645Z [242s] Generation 8 starting: 48 neighbors, 5 active search path(s)
2026-02-21T10:52:54.7877004Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 2.8 configs/s
2026-02-21T10:52:58.5461330Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 13.4 configs/s
2026-02-21T10:53:08.0977226Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 105.3         
2026-02-21T10:53:08.0980022Z                                                                   configs/s     
2026-02-21T10:53:08.6110510Z [266s] Generation 8 complete: 
2026-02-21T10:53:08.6110819Z error=1
2026-02-21T10:53:08.6111001Z ok=52
2026-02-21T10:53:08.6111177Z min=0.0939
2026-02-21T10:53:08.6111377Z mid=0.0959
2026-02-21T10:53:08.6111553Z max=0.5955
2026-02-21T10:53:08.6111748Z best={'block_sizes': [1],
2026-02-21T10:53:08.6112207Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:53:08.6112851Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:53:08.6113251Z               'tensor_descriptor'],
2026-02-21T10:53:08.6113631Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', '', 'first'],
2026-02-21T10:53:08.6114965Z  'num_stages': 7,
2026-02-21T10:53:08.6115142Z  'num_warps': 32,
2026-02-21T10:53:08.6115326Z  'pid_type': 'flat',
2026-02-21T10:53:08.6115522Z  'range_flattens': [None],
2026-02-21T10:53:08.6115739Z  'range_multi_buffers': [None],
2026-02-21T10:53:08.6116053Z  'range_num_stages': [0],
2026-02-21T10:53:08.6123317Z  'range_unroll_factors': [0],
2026-02-21T10:53:08.6123574Z  'range_warp_specializes': [],
2026-02-21T10:53:08.6123812Z  'reduction_loops': [None]}
2026-02-21T10:53:08.6158072Z [266s] Fitting surrogate: 628 points, 628 targets
2026-02-21T10:53:09.3712067Z [266s] Generation 9 starting: 41 neighbors, 5 active search path(s)
2026-02-21T10:53:17.6481787Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 6.4 configs/s
2026-02-21T10:53:20.3076036Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 17.2 configs/s
2026-02-21T10:53:28.3331430Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.2         
2026-02-21T10:53:28.3331980Z                                                                   configs/s     
2026-02-21T10:53:28.7429589Z [286s] Generation 9 complete: 
2026-02-21T10:53:28.7429831Z ok=47
2026-02-21T10:53:28.7429989Z min=0.0938
2026-02-21T10:53:28.7430158Z mid=0.0968
2026-02-21T10:53:28.7430312Z max=0.1559
2026-02-21T10:53:28.7430486Z best={'block_sizes': [1],
2026-02-21T10:53:28.7430890Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T10:53:28.7431421Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T10:53:28.7431774Z               'tensor_descriptor'],
2026-02-21T10:53:28.7432109Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', 'first', 'first'],
2026-02-21T10:53:28.7432459Z  'num_stages': 7,
2026-02-21T10:53:28.7432673Z  'num_warps': 32,
2026-02-21T10:53:28.7432859Z  'pid_type': 'flat',
2026-02-21T10:53:28.7433057Z  'range_flattens': [None],
2026-02-21T10:53:28.7433264Z  'range_multi_buffers': [None],
2026-02-21T10:53:28.7433495Z  'range_num_stages': [0],
2026-02-21T10:53:28.7433701Z  'range_unroll_factors': [0],
2026-02-21T10:53:28.7433931Z  'range_warp_specializes': [],
2026-02-21T10:53:28.7434415Z  'reduction_loops': [None]}
2026-02-21T10:53:28.7476528Z [286s] Fitting surrogate: 675 points, 675 targets
2026-02-21T10:53:29.3760302Z [286s] Generation 10 starting: 34 neighbors, 4 active search path(s)
2026-02-21T10:53:34.5923135Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 25.1 configs/s
2026-02-21T10:53:36.7188251Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 36/36 17.3 configs/s
2026-02-21T10:53:43.7181586Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 143.4         
2026-02-21T10:53:43.7182141Z                                                                   configs/s     
2026-02-21T10:53:44.0947942Z [301s] Generation 10 complete: 
2026-02-21T10:53:44.0948191Z ok=38
2026-02-21T10:53:44.0948368Z min=0.0931
2026-02-21T10:53:44.0948970Z mid=0.0972
2026-02-21T10:53:44.0949293Z max=0.1405
2026-02-21T10:53:44.0949633Z best={'block_sizes': [1],
2026-02-21T10:53:44.0950270Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:53:44.0951138Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:53:44.0951873Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'last'],
2026-02-21T10:53:44.0952428Z  'num_stages': 2,
2026-02-21T10:53:44.0952734Z  'num_warps': 32,
2026-02-21T10:53:44.0953040Z  'pid_type': 'flat',
2026-02-21T10:53:44.0953362Z  'range_flattens': [None],
2026-02-21T10:53:44.0953721Z  'range_multi_buffers': [None],
2026-02-21T10:53:44.0954582Z  'range_num_stages': [0],
2026-02-21T10:53:44.0954945Z  'range_unroll_factors': [0],
2026-02-21T10:53:44.0955743Z  'range_warp_specializes': [],
2026-02-21T10:53:44.0956124Z  'reduction_loops': [None]}
2026-02-21T10:53:44.0989600Z [301s] Fitting surrogate: 713 points, 713 targets
2026-02-21T10:53:44.4749882Z [301s] Generation 11 starting: 17 neighbors, 2 active search path(s)
2026-02-21T10:53:47.0587073Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 37.3 configs/s
2026-02-21T10:53:48.1230860Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.7 configs/s
2026-02-21T10:53:52.6941308Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 270.8         
2026-02-21T10:53:52.6941811Z                                                                   configs/s     
2026-02-21T10:53:52.9119606Z [310s] Generation 11 complete: 
2026-02-21T10:53:52.9119883Z ok=20
2026-02-21T10:53:52.9120064Z min=0.0966
2026-02-21T10:53:52.9120249Z mid=0.0970
2026-02-21T10:53:52.9120432Z max=0.1168
2026-02-21T10:53:52.9120622Z best={'block_sizes': [1],
2026-02-21T10:53:52.9121102Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:53:52.9121784Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:53:52.9122346Z  'load_eviction_policies': ['', '', '', '', 'last', 'last', '', ''],
2026-02-21T10:53:52.9122723Z  'num_stages': 5,
2026-02-21T10:53:52.9122923Z  'num_warps': 32,
2026-02-21T10:53:52.9123118Z  'pid_type': 'flat',
2026-02-21T10:53:52.9123339Z  'range_flattens': [None],
2026-02-21T10:53:52.9123574Z  'range_multi_buffers': [None],
2026-02-21T10:53:52.9123823Z  'range_num_stages': [0],
2026-02-21T10:53:52.9124434Z  'range_unroll_factors': [0],
2026-02-21T10:53:52.9124711Z  'range_warp_specializes': [],
2026-02-21T10:53:52.9125007Z  'reduction_loops': [None]}
2026-02-21T10:53:52.9154799Z [310s] Fitting surrogate: 733 points, 733 targets
2026-02-21T10:53:53.1929879Z [310s] Generation 12 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:53:54.8792004Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 10.5 configs/s
2026-02-21T10:53:55.4806996Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.0 configs/s
2026-02-21T10:53:57.5592112Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 475.7         
2026-02-21T10:53:57.5592830Z                                                                   configs/s     
2026-02-21T10:53:57.7053025Z [315s] Generation 12 complete: 
2026-02-21T10:53:57.7053295Z ok=11
2026-02-21T10:53:57.7053481Z min=0.0969
2026-02-21T10:53:57.7053665Z mid=0.0971
2026-02-21T10:53:57.7053850Z max=0.1383
2026-02-21T10:53:57.7054233Z best={'block_sizes': [1],
2026-02-21T10:53:57.7054726Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:53:57.7055437Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:53:57.7056066Z  'load_eviction_policies': ['', '', '', '', 'last', 'last', '', ''],
2026-02-21T10:53:57.7056455Z  'num_stages': 5,
2026-02-21T10:53:57.7056665Z  'num_warps': 32,
2026-02-21T10:53:57.7056881Z  'pid_type': 'flat',
2026-02-21T10:53:57.7057117Z  'range_flattens': [None],
2026-02-21T10:53:57.7057759Z  'range_multi_buffers': [None],
2026-02-21T10:53:57.7058037Z  'range_num_stages': [0],
2026-02-21T10:53:57.7058357Z  'range_unroll_factors': [0],
2026-02-21T10:53:57.7058650Z  'range_warp_specializes': [],
2026-02-21T10:53:57.7058921Z  'reduction_loops': [2048]}
2026-02-21T10:53:57.7092828Z [315s] Fitting surrogate: 744 points, 744 targets
2026-02-21T10:53:57.9728666Z [315s] Generation 13 starting: 8 neighbors, 1 active search path(s)
2026-02-21T10:53:59.8140327Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 8.6 configs/s
2026-02-21T10:54:00.3706589Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 17.6 configs/s
2026-02-21T10:54:01.8424616Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 665.9         
2026-02-21T10:54:01.8425603Z                                                                   configs/s     
2026-02-21T10:54:01.9592325Z [319s] Generation 13 complete: 
2026-02-21T10:54:01.9592565Z ok=10
2026-02-21T10:54:01.9592753Z min=0.0952
2026-02-21T10:54:01.9592910Z mid=0.0978
2026-02-21T10:54:01.9593085Z max=0.1667
2026-02-21T10:54:01.9593258Z best={'block_sizes': [1],
2026-02-21T10:54:01.9593657Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:54:01.9594406Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:54:01.9594912Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T10:54:01.9595226Z  'num_stages': 6,
2026-02-21T10:54:01.9595404Z  'num_warps': 32,
2026-02-21T10:54:01.9595587Z  'pid_type': 'flat',
2026-02-21T10:54:01.9595782Z  'range_flattens': [None],
2026-02-21T10:54:01.9596001Z  'range_multi_buffers': [None],
2026-02-21T10:54:01.9596242Z  'range_num_stages': [0],
2026-02-21T10:54:01.9596455Z  'range_unroll_factors': [0],
2026-02-21T10:54:01.9596687Z  'range_warp_specializes': [],
2026-02-21T10:54:01.9596905Z  'reduction_loops': [2048]}
2026-02-21T10:54:01.9637607Z [319s] Fitting surrogate: 754 points, 754 targets
2026-02-21T10:54:02.2274763Z [319s] Generation 14 starting: 10 neighbors, 1 active search path(s)
2026-02-21T10:54:04.0861852Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 13.7 configs/s
2026-02-21T10:54:04.7510917Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.8 configs/s
2026-02-21T10:54:06.7772541Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 488.2         
2026-02-21T10:54:06.7772999Z                                                                   configs/s     
2026-02-21T10:54:06.9202275Z [324s] Generation 14 complete: 
2026-02-21T10:54:06.9202529Z ok=12
2026-02-21T10:54:06.9202729Z min=0.0933
2026-02-21T10:54:06.9202926Z mid=0.0973
2026-02-21T10:54:06.9203102Z max=0.1632
2026-02-21T10:54:06.9203318Z best={'block_sizes': [1],
2026-02-21T10:54:06.9203756Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:54:06.9204713Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:54:06.9205304Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T10:54:06.9205650Z  'num_stages': 6,
2026-02-21T10:54:06.9205856Z  'num_warps': 32,
2026-02-21T10:54:06.9206075Z  'pid_type': 'flat',
2026-02-21T10:54:06.9206287Z  'range_flattens': [None],
2026-02-21T10:54:06.9206525Z  'range_multi_buffers': [None],
2026-02-21T10:54:06.9206774Z  'range_num_stages': [0],
2026-02-21T10:54:06.9207002Z  'range_unroll_factors': [0],
2026-02-21T10:54:06.9207253Z  'range_warp_specializes': [],
2026-02-21T10:54:06.9207494Z  'reduction_loops': [None]}
2026-02-21T10:54:06.9243582Z [324s] Fitting surrogate: 766 points, 766 targets
2026-02-21T10:54:07.1853051Z [324s] Generation 15 starting: 8 neighbors, 1 active search path(s)
2026-02-21T10:54:09.7120783Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 6.1 configs/s
2026-02-21T10:54:10.1940762Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 18.4 configs/s
2026-02-21T10:54:11.8424916Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 597.2         
2026-02-21T10:54:11.8426503Z                                                                   configs/s     
2026-02-21T10:54:11.9689938Z [329s] Generation 15 complete: 
2026-02-21T10:54:11.9690215Z ok=9
2026-02-21T10:54:11.9690398Z min=0.0971
2026-02-21T10:54:11.9690577Z mid=0.0976
2026-02-21T10:54:11.9690751Z max=0.1180
2026-02-21T10:54:11.9690942Z best={'block_sizes': [1],
2026-02-21T10:54:11.9691388Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:54:11.9692015Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:54:11.9692936Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T10:54:11.9693295Z  'num_stages': 6,
2026-02-21T10:54:11.9693490Z  'num_warps': 32,
2026-02-21T10:54:11.9693691Z  'pid_type': 'flat',
2026-02-21T10:54:11.9693919Z  'range_flattens': [None],
2026-02-21T10:54:11.9694508Z  'range_multi_buffers': [None],
2026-02-21T10:54:11.9694761Z  'range_num_stages': [0],
2026-02-21T10:54:11.9694993Z  'range_unroll_factors': [0],
2026-02-21T10:54:11.9695244Z  'range_warp_specializes': [],
2026-02-21T10:54:11.9695484Z  'reduction_loops': [None]}
2026-02-21T10:54:11.9730302Z [329s] Fitting surrogate: 775 points, 775 targets
2026-02-21T10:54:12.2347044Z [329s] Generation 16 starting: 5 neighbors, 1 active search path(s)
2026-02-21T10:54:13.6281227Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5/5 10.8 configs/s
2026-02-21T10:54:13.9211248Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 5/5 21.0 configs/s
2026-02-21T10:54:15.0100971Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 891.6         
2026-02-21T10:54:15.0101452Z                                                                   configs/s     
2026-02-21T10:54:15.1094558Z [332s] Generation 16 complete: 
2026-02-21T10:54:15.1094871Z ok=6
2026-02-21T10:54:15.1095052Z min=0.0970
2026-02-21T10:54:15.1095238Z mid=0.0975
2026-02-21T10:54:15.1095405Z max=0.1180
2026-02-21T10:54:15.1095597Z best={'block_sizes': [1],
2026-02-21T10:54:15.1096039Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:54:15.1096631Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:54:15.1097098Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T10:54:15.1097450Z  'num_stages': 5,
2026-02-21T10:54:15.1097651Z  'num_warps': 32,
2026-02-21T10:54:15.1097855Z  'pid_type': 'flat',
2026-02-21T10:54:15.1098077Z  'range_flattens': [None],
2026-02-21T10:54:15.1098315Z  'range_multi_buffers': [None],
2026-02-21T10:54:15.1098573Z  'range_num_stages': [0],
2026-02-21T10:54:15.1098805Z  'range_unroll_factors': [0],
2026-02-21T10:54:15.1099061Z  'range_warp_specializes': [],
2026-02-21T10:54:15.1099305Z  'reduction_loops': [None]}
2026-02-21T10:54:15.1134167Z [332s] Fitting surrogate: 781 points, 781 targets
2026-02-21T10:54:15.3949751Z [332s] Generation 17 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:54:17.8428130Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 7.8 configs/s
2026-02-21T10:54:18.3788069Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 20.8 configs/s
2026-02-21T10:54:20.1857690Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 546.3         
2026-02-21T10:54:20.1858196Z                                                                   configs/s     
2026-02-21T10:54:20.3211876Z [337s] Generation 17 complete: 
2026-02-21T10:54:20.3212176Z error=1
2026-02-21T10:54:20.3212354Z ok=10
2026-02-21T10:54:20.3212521Z min=0.0937
2026-02-21T10:54:20.3212739Z mid=0.0947
2026-02-21T10:54:20.3212905Z max=0.1178
2026-02-21T10:54:20.3213109Z best={'block_sizes': [1],
2026-02-21T10:54:20.3213522Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:54:20.4609686Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:54:20.4610251Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T10:54:20.4610592Z  'num_stages': 5,
2026-02-21T10:54:20.4610795Z  'num_warps': 32,
2026-02-21T10:54:20.4610987Z  'pid_type': 'flat',
2026-02-21T10:54:20.4611208Z  'range_flattens': [None],
2026-02-21T10:54:20.4611444Z  'range_multi_buffers': [None],
2026-02-21T10:54:20.4611692Z  'range_num_stages': [0],
2026-02-21T10:54:20.4611920Z  'range_unroll_factors': [0],
2026-02-21T10:54:20.4612170Z  'range_warp_specializes': [],
2026-02-21T10:54:20.4612412Z  'reduction_loops': [None]}
2026-02-21T10:54:20.4612698Z [337s] Fitting surrogate: 792 points, 792 targets
2026-02-21T10:54:20.6080462Z [338s] Generation 18 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:54:23.0992793Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 7.4 configs/s
2026-02-21T10:54:23.8607663Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 13.7 configs/s
2026-02-21T10:54:25.8551365Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 495.8         
2026-02-21T10:54:25.8551902Z                                                                   configs/s     
2026-02-21T10:54:25.9990105Z [343s] Generation 18 complete: 
2026-02-21T10:54:25.9990380Z ok=11
2026-02-21T10:54:25.9990559Z min=0.0971
2026-02-21T10:54:25.9990741Z mid=0.0971
2026-02-21T10:54:25.9990928Z max=0.0977
2026-02-21T10:54:25.9991124Z best={'block_sizes': [1],
2026-02-21T10:54:25.9991586Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:54:25.9992199Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:54:25.9992664Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T10:54:25.9993000Z  'num_stages': 5,
2026-02-21T10:54:25.9993228Z  'num_warps': 32,
2026-02-21T10:54:25.9993440Z  'pid_type': 'flat',
2026-02-21T10:54:25.9993661Z  'range_flattens': [None],
2026-02-21T10:54:25.9993905Z  'range_multi_buffers': [None],
2026-02-21T10:54:25.9994581Z  'range_num_stages': [0],
2026-02-21T10:54:25.9994825Z  'range_unroll_factors': [0],
2026-02-21T10:54:25.9995069Z  'range_warp_specializes': [],
2026-02-21T10:54:25.9995314Z  'reduction_loops': [None]}
2026-02-21T10:54:26.0033145Z [343s] Fitting surrogate: 803 points, 803 targets
2026-02-21T10:54:26.1679488Z [343s] Autotuning complete in 343.7s after searching 765 configs.
2026-02-21T10:54:26.1679957Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:54:26.1681874Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', '', '', '', 'last', '', '', ''], num_stages=5, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T10:54:26.1684538Z 
2026-02-21T10:54:26.1684952Z [343s] Code of selected kernel: /tmp/torchinductor_root/vj/cvjgeg7pirctn7pc6jsomokxmvrmw7ezwnl2coi4vn73ld33qrnp.py
2026-02-21T10:54:26.1948252Z from __future__ import annotations
2026-02-21T10:54:26.1948485Z 
2026-02-21T10:54:26.1948577Z import torch
2026-02-21T10:54:26.1948805Z import triton
2026-02-21T10:54:26.1949033Z import triton.language as tl
2026-02-21T10:54:26.1949376Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T10:54:26.1949857Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T10:54:26.1950160Z 
2026-02-21T10:54:26.1950574Z @triton.jit
2026-02-21T10:54:26.1950989Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T10:54:26.1951533Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:54:26.1951903Z     pid_0 = tl.program_id(0)
2026-02-21T10:54:26.1952174Z     offset_0 = pid_0
2026-02-21T10:54:26.1952426Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T10:54:26.1952798Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T10:54:26.1953211Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:54:26.1953685Z     acc = tl.load(x + (indices_0[:, None] * 8192 + indices_1[None, :] * 1), None)
2026-02-21T10:54:26.1954379Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T10:54:26.1954779Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T10:54:26.1955085Z     v_0 = 0.0001220703125
2026-02-21T10:54:26.1955304Z     v_1 = sum_1 * v_0
2026-02-21T10:54:26.1955614Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T10:54:26.1955986Z     subscript = v_1[:, None]
2026-02-21T10:54:26.1956237Z     v_2 = acc - subscript
2026-02-21T10:54:26.1956597Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T10:54:26.1957004Z     v_3 = v_2 * v_2
2026-02-21T10:54:26.1957239Z     sum_2 = tl.cast(tl.sum(v_3, 1), tl.float32)
2026-02-21T10:54:26.1957527Z     v_4 = 0.0001220703125
2026-02-21T10:54:26.1957747Z     v_5 = sum_2 * v_4
2026-02-21T10:54:26.1958061Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T10:54:26.1958421Z     v_6 = v_5 + eps
2026-02-21T10:54:26.1958602Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T10:54:26.1958904Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T10:54:26.1959234Z     subscript_1 = v_7[:, None]
2026-02-21T10:54:26.1959444Z     v_8 = v_2 * subscript_1
2026-02-21T10:54:26.1959761Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:54:26.1960146Z     load_1 = tl.load(weight + indices_1 * 1, None)
2026-02-21T10:54:26.1960412Z     v_9 = load_1[None, :]
2026-02-21T10:54:26.1960600Z     v_10 = v_8 * v_9
2026-02-21T10:54:26.1960830Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T10:54:26.1961123Z     load_2 = tl.load(bias + indices_1 * 1, None)
2026-02-21T10:54:26.1961490Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T10:54:26.1961896Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T10:54:26.1962186Z     # src[layer_norm.py:75]: )
2026-02-21T10:54:26.1962404Z     v_11 = load_2[None, :]
2026-02-21T10:54:26.1962592Z     v_12 = v_10 + v_11
2026-02-21T10:54:26.1962830Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T10:54:26.1963224Z     tl.store(out + (indices_0[:, None] * 8192 + indices_1[None, :] * 1), v_12, None)
2026-02-21T10:54:26.1963611Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T10:54:26.1963903Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T10:54:26.1964305Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T10:54:26.1964584Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T10:54:26.1964948Z 
2026-02-21T10:54:26.1965460Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T10:54:26.1966150Z     """
2026-02-21T10:54:26.1966411Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T10:54:26.1966753Z     Args:
2026-02-21T10:54:26.1967046Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T10:54:26.1967650Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T10:54:26.1968214Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T10:54:26.1968829Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T10:54:26.1969331Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T10:54:26.1969707Z     Returns:
2026-02-21T10:54:26.1969988Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T10:54:26.1970352Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T10:54:26.1970722Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T10:54:26.1971071Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T10:54:26.1971377Z     """
2026-02-21T10:54:26.1971537Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T10:54:26.1971745Z     m, n = x.size()
2026-02-21T10:54:26.1972069Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T10:54:26.1972535Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T10:54:26.1972872Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T10:54:26.1973242Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:54:26.1973602Z     if bias is not None:
2026-02-21T10:54:26.1973918Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T10:54:26.1974505Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T10:54:26.1974879Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T10:54:26.1975269Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T10:54:26.1975612Z     # src[layer_norm.py:52]: )
2026-02-21T10:54:26.1975955Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T10:54:26.1976375Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T10:54:26.1976764Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T10:54:26.1977094Z     # src[layer_norm.py:55]: )
2026-02-21T10:54:26.1977425Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T10:54:26.1977885Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:54:26.1978278Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T10:54:26.1978668Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:54:26.1979054Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:54:26.1979447Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:54:26.1979900Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T10:54:26.1980210Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:54:26.1980452Z     _RDIM_SIZE_1 = 8192
2026-02-21T10:54:26.1980659Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T10:54:26.1980963Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T10:54:26.1981421Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T10:54:26.1981657Z     # src[layer_norm.py:60-80]: ...
2026-02-21T10:54:26.1982096Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=32, num_stages=5)
2026-02-21T10:54:26.1982568Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T10:54:26.1982806Z     return (out, mean, rstd)
2026-02-21T10:54:27.4135316Z WARNING:tritonbench.utils.triton_op:Completed input ID 14:
2026-02-21T10:54:27.4135699Z (M, N)
2026-02-21T10:54:27.4135887Z ------------
2026-02-21T10:54:27.4136075Z (4096, 8192)
2026-02-21T10:54:27.4136714Z 
2026-02-21T10:54:27.4150734Z  50%|█████     | 10/20 [53:24<56:52, 341.24s/it] WARNING:tritonbench.utils.triton_op:Running input ID 15:
2026-02-21T10:54:27.4151214Z (M, N)
2026-02-21T10:54:27.4151394Z ------------
2026-02-21T10:54:27.4151572Z (4096, 8704)
2026-02-21T10:54:27.4153031Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T10:54:28.7663575Z INFO:tritonbench.utils.triton_op:Took 3.15ms to get benchmark function for torch_compile_layer_norm
2026-02-21T10:54:30.2224566Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T10:54:31.6763731Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:54:31.6764233Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:54:31.6764517Z               'dtype': 'torch.float32',
2026-02-21T10:54:31.6764805Z               'shape': (4096, 8704),
2026-02-21T10:54:31.6765066Z               'stride': (8704, 1)},
2026-02-21T10:54:31.6765301Z             (8704,),
2026-02-21T10:54:31.6765508Z             { 'device': 'cuda:0',
2026-02-21T10:54:31.6765758Z               'dtype': 'torch.float32',
2026-02-21T10:54:31.6766044Z               'shape': (8704,),
2026-02-21T10:54:31.6766299Z               'stride': (1,)},
2026-02-21T10:54:31.6766542Z             { 'device': 'cuda:0',
2026-02-21T10:54:31.6766800Z               'dtype': 'torch.float32',
2026-02-21T10:54:31.6767067Z               'shape': (8704,),
2026-02-21T10:54:31.6767298Z               'stride': (1,)},
2026-02-21T10:54:31.6767516Z             1e-05),
2026-02-21T10:54:31.6767713Z   'kwargs': {}}
2026-02-21T10:54:31.6818515Z INFO:tritonbench.utils.triton_op:Took 5.89ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T10:54:31.6903490Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T10:54:31.6904495Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T10:54:31.6905086Z If this is not a tensor operation, please report this as a bug.
2026-02-21T10:54:31.6905441Z While processing:
2026-02-21T10:54:31.6908568Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T10:54:31.6909018Z     if bias is not None:
2026-02-21T10:54:31.6909242Z        ^^^^^^^^^^^^^^^^
2026-02-21T10:54:31.6909387Z 
2026-02-21T10:54:31.8580675Z [0s] Autotune random seed: 2141537047
2026-02-21T10:54:31.9043863Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:55:08.1323742Z [36s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T10:55:08.8620627Z [36s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:55:10.8527676Z [38s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T10:55:15.7993089Z [43s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T10:55:17.6813876Z [45s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T10:55:17.6831834Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T10:55:24.3197119Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.2 configs/s
2026-02-21T10:55:24.3210530Z [52s] Adaptive compile timeout: 30s (90% percentile=14.4s, bounds=[30.0s, 30s])
2026-02-21T10:55:26.3772472Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 477.2 configs/s
2026-02-21T10:55:26.5161241Z [54s] Initial random population of 100, 5 starting points: 
2026-02-21T10:55:26.5161611Z error=7
2026-02-21T10:55:26.5161801Z timeout=5
2026-02-21T10:55:26.5162004Z ok=88
2026-02-21T10:55:26.5162186Z min=0.1180
2026-02-21T10:55:26.5162369Z mid=0.4103
2026-02-21T10:55:26.5162556Z max=35.0804
2026-02-21T10:55:26.5162768Z best={'block_sizes': [1],
2026-02-21T10:55:26.5163215Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:55:26.5163762Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:55:26.5164368Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T10:55:26.5164706Z  'num_stages': 1,
2026-02-21T10:55:26.5164914Z  'num_warps': 4,
2026-02-21T10:55:26.5165125Z  'pid_type': 'flat',
2026-02-21T10:55:26.5165346Z  'range_flattens': [None],
2026-02-21T10:55:26.5165601Z  'range_multi_buffers': [None],
2026-02-21T10:55:26.5165857Z  'range_num_stages': [0],
2026-02-21T10:55:26.5166118Z  'range_unroll_factors': [0],
2026-02-21T10:55:26.5166378Z  'range_warp_specializes': [],
2026-02-21T10:55:26.5166642Z  'reduction_loops': [4096]}
2026-02-21T10:55:26.5183215Z [54s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:55:28.0249866Z [56s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T10:55:44.6012755Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 9.5 configs/s
2026-02-21T10:55:50.3232517Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.6 configs/s
2026-02-21T10:56:03.3443686Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 77.2 configs/s
2026-02-21T10:56:03.9388914Z [92s] Generation 1 complete: 
2026-02-21T10:56:03.9389231Z error=3
2026-02-21T10:56:03.9389412Z ok=94
2026-02-21T10:56:03.9389578Z min=0.1027
2026-02-21T10:56:03.9389756Z mid=0.1419
2026-02-21T10:56:03.9389924Z max=1.5807
2026-02-21T10:56:03.9390104Z best={'block_sizes': [1],
2026-02-21T10:56:03.9390513Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:56:03.9391029Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:56:03.9392199Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T10:56:03.9392565Z  'num_stages': 1,
2026-02-21T10:56:03.9392771Z  'num_warps': 16,
2026-02-21T10:56:03.9392961Z  'pid_type': 'flat',
2026-02-21T10:56:03.9393221Z  'range_flattens': [None],
2026-02-21T10:56:03.9393466Z  'range_multi_buffers': [None],
2026-02-21T10:56:03.9393707Z  'range_num_stages': [0],
2026-02-21T10:56:03.9393940Z  'range_unroll_factors': [0],
2026-02-21T10:56:03.9394587Z  'range_warp_specializes': [],
2026-02-21T10:56:03.9394836Z  'reduction_loops': [8192]}
2026-02-21T10:56:03.9418900Z [92s] Fitting surrogate: 197 points, 197 targets
2026-02-21T10:56:05.3192820Z [93s] Generation 2 starting: 85 neighbors, 5 active search path(s)
2026-02-21T10:56:23.2872721Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 6.7 configs/s
2026-02-21T10:56:28.8507786Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 16.1 configs/s
2026-02-21T10:56:41.3397816Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 80.5 configs/s
2026-02-21T10:56:41.9040694Z [129s] Generation 2 complete: 
2026-02-21T10:56:41.9043247Z error=4
2026-02-21T10:56:41.9043473Z ok=87
2026-02-21T10:56:41.9043665Z min=0.1005
2026-02-21T10:56:41.9043835Z mid=0.1320
2026-02-21T10:56:41.9044203Z max=0.2960
2026-02-21T10:56:41.9044397Z best={'block_sizes': [2],
2026-02-21T10:56:41.9044770Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:56:41.9045243Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:56:41.9045642Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', 'first'],
2026-02-21T10:56:41.9045946Z  'num_stages': 1,
2026-02-21T10:56:41.9046119Z  'num_warps': 4,
2026-02-21T10:56:41.9046283Z  'pid_type': 'flat',
2026-02-21T10:56:41.9046479Z  'range_flattens': [None],
2026-02-21T10:56:41.9046678Z  'range_multi_buffers': [None],
2026-02-21T10:56:41.9046892Z  'range_num_stages': [0],
2026-02-21T10:56:41.9047098Z  'range_unroll_factors': [0],
2026-02-21T10:56:41.9047317Z  'range_warp_specializes': [],
2026-02-21T10:56:41.9047530Z  'reduction_loops': [None]}
2026-02-21T10:56:41.9071649Z [130s] Fitting surrogate: 288 points, 288 targets
2026-02-21T10:56:43.2441474Z [131s] Generation 3 starting: 80 neighbors, 5 active search path(s)
2026-02-21T10:57:01.0957810Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 6.8 configs/s
2026-02-21T10:57:09.3963876Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 10.0 configs/s
2026-02-21T10:57:18.3057138Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 112.7         
2026-02-21T10:57:18.3057659Z                                                                   configs/s     
2026-02-21T10:57:18.7252305Z [166s] Generation 3 complete: 
2026-02-21T10:57:18.7252632Z error=7
2026-02-21T10:57:18.7252819Z ok=79
2026-02-21T10:57:18.7252998Z min=0.0992
2026-02-21T10:57:18.7253173Z mid=0.1432
2026-02-21T10:57:18.7253349Z max=0.7469
2026-02-21T10:57:18.7253571Z best={'block_sizes': [1],
2026-02-21T10:57:18.7254435Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:57:18.7254972Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:57:18.7256161Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', 'first'],
2026-02-21T10:57:18.7256509Z  'num_stages': 1,
2026-02-21T10:57:18.7256730Z  'num_warps': 16,
2026-02-21T10:57:18.7256930Z  'pid_type': 'flat',
2026-02-21T10:57:18.7257142Z  'range_flattens': [None],
2026-02-21T10:57:18.7257378Z  'range_multi_buffers': [None],
2026-02-21T10:57:18.7257621Z  'range_num_stages': [0],
2026-02-21T10:57:18.7257871Z  'range_unroll_factors': [0],
2026-02-21T10:57:18.7258131Z  'range_warp_specializes': [],
2026-02-21T10:57:18.7258432Z  'reduction_loops': [None]}
2026-02-21T10:57:18.7286785Z [166s] Fitting surrogate: 374 points, 374 targets
2026-02-21T10:57:19.7179639Z [167s] Generation 4 starting: 56 neighbors, 5 active search path(s)
2026-02-21T10:57:32.5083633Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 1.3 configs/s
2026-02-21T10:57:35.8001070Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 17.9 configs/s
2026-02-21T10:57:46.0264912Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.3 configs/s
2026-02-21T10:57:46.5074594Z [194s] Generation 4 complete: 
2026-02-21T10:57:46.5074907Z error=5
2026-02-21T10:57:46.5075101Z ok=56
2026-02-21T10:57:46.5075274Z min=0.0985
2026-02-21T10:57:46.5075458Z mid=0.1182
2026-02-21T10:57:46.5075625Z max=0.1888
2026-02-21T10:57:46.5075821Z best={'block_sizes': [1],
2026-02-21T10:57:46.5076244Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T10:57:46.5076785Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T10:57:46.5077237Z  'load_eviction_policies': ['', '', '', 'first', '', '', '', 'first'],
2026-02-21T10:57:46.5077615Z  'num_stages': 1,
2026-02-21T10:57:46.5077884Z  'num_warps': 16,
2026-02-21T10:57:46.5078119Z  'pid_type': 'flat',
2026-02-21T10:57:46.5078369Z  'range_flattens': [None],
2026-02-21T10:57:46.5078595Z  'range_multi_buffers': [None],
2026-02-21T10:57:46.5078849Z  'range_num_stages': [0],
2026-02-21T10:57:46.5079077Z  'range_unroll_factors': [0],
2026-02-21T10:57:46.5079313Z  'range_warp_specializes': [],
2026-02-21T10:57:46.5079552Z  'reduction_loops': [None]}
2026-02-21T10:57:46.5107275Z [194s] Fitting surrogate: 435 points, 435 targets
2026-02-21T10:57:47.2741294Z [195s] Generation 5 starting: 42 neighbors, 4 active search path(s)
2026-02-21T10:57:54.9933014Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 6.7 configs/s
2026-02-21T10:57:58.7373761Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 11.5 configs/s
2026-02-21T10:58:06.7369048Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.7         
2026-02-21T10:58:06.7369530Z                                                                   configs/s     
2026-02-21T10:58:07.0863405Z [215s] Generation 5 complete: 
2026-02-21T10:58:07.0863682Z error=2
2026-02-21T10:58:07.0863855Z ok=44
2026-02-21T10:58:07.0864386Z min=0.1020
2026-02-21T10:58:07.0864599Z mid=0.1167
2026-02-21T10:58:07.0864762Z max=0.4421
2026-02-21T10:58:07.0864943Z best={'block_sizes': [1],
2026-02-21T10:58:07.0865338Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:58:07.0865970Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:58:07.0866444Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:58:07.0866832Z  'load_eviction_policies': ['', 'last', '', '', 'last', '', 'first', 'first'],
2026-02-21T10:58:07.0867236Z  'num_stages': 3,
2026-02-21T10:58:07.0867422Z  'num_warps': 16,
2026-02-21T10:58:07.0867612Z  'pid_type': 'flat',
2026-02-21T10:58:07.0867818Z  'range_flattens': [None],
2026-02-21T10:58:07.0868049Z  'range_multi_buffers': [None],
2026-02-21T10:58:07.0868308Z  'range_num_stages': [0],
2026-02-21T10:58:07.0868533Z  'range_unroll_factors': [0],
2026-02-21T10:58:07.0868779Z  'range_warp_specializes': [],
2026-02-21T10:58:07.0869021Z  'reduction_loops': [None]}
2026-02-21T10:58:07.0895229Z [215s] Fitting surrogate: 481 points, 481 targets
2026-02-21T10:58:07.7607811Z [215s] Generation 6 starting: 37 neighbors, 3 active search path(s)
2026-02-21T10:58:16.9997082Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 9.9 configs/s
2026-02-21T10:58:19.7566884Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 13.9 configs/s
2026-02-21T10:58:26.8912074Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 140.6         
2026-02-21T10:58:26.8913158Z                                                                   configs/s     
2026-02-21T10:58:27.2452859Z [235s] Generation 6 complete: 
2026-02-21T10:58:27.2453127Z ok=41
2026-02-21T10:58:27.2453319Z min=0.1013
2026-02-21T10:58:27.2453504Z mid=0.1093
2026-02-21T10:58:27.2454521Z max=0.3620
2026-02-21T10:58:27.2454748Z best={'block_sizes': [1],
2026-02-21T10:58:27.2455174Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:58:27.2455816Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:58:27.2456464Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:58:27.2456909Z  'load_eviction_policies': ['', 'last', 'last', '', 'last', '', 'first', 'first'],
2026-02-21T10:58:27.2457329Z  'num_stages': 3,
2026-02-21T10:58:27.2457536Z  'num_warps': 16,
2026-02-21T10:58:27.2457741Z  'pid_type': 'flat',
2026-02-21T10:58:27.2457965Z  'range_flattens': [None],
2026-02-21T10:58:27.2458225Z  'range_multi_buffers': [None],
2026-02-21T10:58:27.2458498Z  'range_num_stages': [0],
2026-02-21T10:58:27.2458742Z  'range_unroll_factors': [0],
2026-02-21T10:58:27.2459007Z  'range_warp_specializes': [],
2026-02-21T10:58:27.2459265Z  'reduction_loops': [None]}
2026-02-21T10:58:27.2489484Z [235s] Fitting surrogate: 522 points, 522 targets
2026-02-21T10:58:27.9258797Z [236s] Generation 7 starting: 35 neighbors, 3 active search path(s)
2026-02-21T10:58:34.0699381Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 5.0 configs/s
2026-02-21T10:58:36.2074834Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 35/35 16.7 configs/s
2026-02-21T10:58:43.3210533Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.0         
2026-02-21T10:58:43.3211038Z                                                                   configs/s     
2026-02-21T10:58:43.6773825Z [251s] Generation 7 complete: 
2026-02-21T10:58:43.6774287Z ok=38
2026-02-21T10:58:43.6774475Z min=0.0998
2026-02-21T10:58:43.6774668Z mid=0.1087
2026-02-21T10:58:43.6774841Z max=0.1622
2026-02-21T10:58:43.6775042Z best={'block_sizes': [1],
2026-02-21T10:58:43.6775455Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:58:43.6776117Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:58:43.6776576Z               'pointer', 'pointer'],
2026-02-21T10:58:43.6776976Z  'load_eviction_policies': ['', 'last', 'last', '', 'last', '', 'first', 'first'],
2026-02-21T10:58:43.6794703Z  'num_stages': 4,
2026-02-21T10:58:43.6794884Z  'num_warps': 8,
2026-02-21T10:58:43.6795072Z  'pid_type': 'flat',
2026-02-21T10:58:43.6795279Z  'range_flattens': [None],
2026-02-21T10:58:43.6795497Z  'range_multi_buffers': [None],
2026-02-21T10:58:43.6795722Z  'range_num_stages': [0],
2026-02-21T10:58:43.6795929Z  'range_unroll_factors': [0],
2026-02-21T10:58:43.6796154Z  'range_warp_specializes': [],
2026-02-21T10:58:43.6796372Z  'reduction_loops': [None]}
2026-02-21T10:58:43.6809383Z [251s] Fitting surrogate: 560 points, 560 targets
2026-02-21T10:58:44.2438753Z [252s] Generation 8 starting: 28 neighbors, 2 active search path(s)
2026-02-21T10:58:49.1252421Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 8.3 configs/s
2026-02-21T10:58:50.8288058Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 28/28 16.8 configs/s
2026-02-21T10:58:56.3964806Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 180.0         
2026-02-21T10:58:56.3965384Z                                                                   configs/s     
2026-02-21T10:58:56.6990224Z [264s] Generation 8 complete: 
2026-02-21T10:58:56.6990539Z ok=30
2026-02-21T10:58:56.6990723Z min=0.0992
2026-02-21T10:58:56.6990907Z mid=0.1029
2026-02-21T10:58:56.6991075Z max=0.5469
2026-02-21T10:58:56.6991268Z best={'block_sizes': [1],
2026-02-21T10:58:56.6991687Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:58:56.6992310Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:58:56.6992777Z               'pointer', 'pointer'],
2026-02-21T10:58:56.6993185Z  'load_eviction_policies': ['', 'last', '', '', 'last', '', 'first', 'first'],
2026-02-21T10:58:56.6993583Z  'num_stages': 5,
2026-02-21T10:58:56.6993779Z  'num_warps': 16,
2026-02-21T10:58:56.6994407Z  'pid_type': 'flat',
2026-02-21T10:58:56.6994635Z  'range_flattens': [None],
2026-02-21T10:58:56.6994916Z  'range_multi_buffers': [None],
2026-02-21T10:58:56.6995165Z  'range_num_stages': [0],
2026-02-21T10:58:56.6995396Z  'range_unroll_factors': [0],
2026-02-21T10:58:56.6995647Z  'range_warp_specializes': [],
2026-02-21T10:58:56.6995916Z  'reduction_loops': [None]}
2026-02-21T10:58:56.7030588Z [264s] Fitting surrogate: 590 points, 590 targets
2026-02-21T10:58:57.2745300Z [265s] Generation 9 starting: 29 neighbors, 2 active search path(s)
2026-02-21T10:59:01.9421518Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 11.7 configs/s
2026-02-21T10:59:03.7246826Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 29/29 16.7 configs/s
2026-02-21T10:59:09.4450050Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 175.1         
2026-02-21T10:59:09.4450630Z                                                                   configs/s     
2026-02-21T10:59:09.7547375Z [277s] Generation 9 complete: 
2026-02-21T10:59:09.7547692Z ok=31
2026-02-21T10:59:09.7547924Z min=0.0994
2026-02-21T10:59:09.7548120Z mid=0.1059
2026-02-21T10:59:09.7548317Z max=0.7149
2026-02-21T10:59:09.7548534Z best={'block_sizes': [1],
2026-02-21T10:59:09.7549006Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:59:09.7549726Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:59:09.7550280Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:59:09.7550728Z  'load_eviction_policies': ['', 'last', '', '', 'last', '', 'first', 'first'],
2026-02-21T10:59:09.7551173Z  'num_stages': 5,
2026-02-21T10:59:09.7551399Z  'num_warps': 16,
2026-02-21T10:59:09.7551630Z  'pid_type': 'flat',
2026-02-21T10:59:09.7551871Z  'range_flattens': [None],
2026-02-21T10:59:09.7552148Z  'range_multi_buffers': [None],
2026-02-21T10:59:09.7552428Z  'range_num_stages': [0],
2026-02-21T10:59:09.7552682Z  'range_unroll_factors': [0],
2026-02-21T10:59:09.7552962Z  'range_warp_specializes': [],
2026-02-21T10:59:09.7554405Z  'reduction_loops': [None]}
2026-02-21T10:59:09.7585476Z [277s] Fitting surrogate: 621 points, 621 targets
2026-02-21T10:59:10.3497382Z [278s] Generation 10 starting: 29 neighbors, 2 active search path(s)
2026-02-21T10:59:18.1300869Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 10.0 configs/s
2026-02-21T10:59:20.8872516Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 10.9 configs/s
2026-02-21T10:59:26.5712867Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 176.2         
2026-02-21T10:59:26.8703337Z [294s] Generation 10 complete: 
2026-02-21T10:59:26.8703609Z ok=31
2026-02-21T10:59:26.8703777Z min=0.0997
2026-02-21T10:59:26.8703956Z mid=0.1149
2026-02-21T10:59:26.8704945Z                                                                   configs/s     
2026-02-21T10:59:26.8705305Z max=0.7151
2026-02-21T10:59:26.8705495Z best={'block_sizes': [1],
2026-02-21T10:59:26.8705889Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:59:26.8706524Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:59:26.8706990Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:59:26.8707380Z  'load_eviction_policies': ['', 'last', '', '', 'last', '', 'first', 'first'],
2026-02-21T10:59:26.8707753Z  'num_stages': 5,
2026-02-21T10:59:26.8707946Z  'num_warps': 16,
2026-02-21T10:59:26.8708139Z  'pid_type': 'flat',
2026-02-21T10:59:26.8708343Z  'range_flattens': [None],
2026-02-21T10:59:26.8708576Z  'range_multi_buffers': [None],
2026-02-21T10:59:26.8708811Z  'range_num_stages': [0],
2026-02-21T10:59:26.8709041Z  'range_unroll_factors': [0],
2026-02-21T10:59:26.8709279Z  'range_warp_specializes': [],
2026-02-21T10:59:26.8709507Z  'reduction_loops': [None]}
2026-02-21T10:59:26.8741453Z [294s] Fitting surrogate: 652 points, 652 targets
2026-02-21T10:59:27.3684280Z [295s] Generation 11 starting: 23 neighbors, 2 active search path(s)
2026-02-21T10:59:33.5705942Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 9.3 configs/s
2026-02-21T10:59:35.5429383Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 12.3 configs/s
2026-02-21T10:59:39.6469249Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 243.4         
2026-02-21T10:59:39.6469722Z                                                                   configs/s     
2026-02-21T10:59:39.8823529Z [307s] Generation 11 complete: 
2026-02-21T10:59:39.8823782Z ok=25
2026-02-21T10:59:39.8823958Z min=0.0993
2026-02-21T10:59:39.8824404Z mid=0.1078
2026-02-21T10:59:39.8824573Z max=0.6347
2026-02-21T10:59:39.8824770Z best={'block_sizes': [1],
2026-02-21T10:59:39.8825193Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:59:39.8825810Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:59:39.8826290Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:59:39.8826686Z  'load_eviction_policies': ['', 'last', '', '', 'last', '', '', 'first'],
2026-02-21T10:59:39.8827048Z  'num_stages': 5,
2026-02-21T10:59:39.8827242Z  'num_warps': 16,
2026-02-21T10:59:39.8827429Z  'pid_type': 'flat',
2026-02-21T10:59:39.8827641Z  'range_flattens': [None],
2026-02-21T10:59:39.8827870Z  'range_multi_buffers': [None],
2026-02-21T10:59:39.8828104Z  'range_num_stages': [0],
2026-02-21T10:59:39.8828314Z  'range_unroll_factors': [0],
2026-02-21T10:59:39.8828544Z  'range_warp_specializes': [],
2026-02-21T10:59:39.8828771Z  'reduction_loops': [None]}
2026-02-21T10:59:39.8862298Z [307s] Fitting surrogate: 677 points, 677 targets
2026-02-21T10:59:40.4479930Z [308s] Generation 12 starting: 29 neighbors, 2 active search path(s)
2026-02-21T10:59:45.6898618Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 44.0 configs/s
2026-02-21T10:59:47.3953458Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 18.1 configs/s
2026-02-21T10:59:52.6374629Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 191.0         
2026-02-21T10:59:52.6375163Z                                                                   configs/s     
2026-02-21T10:59:52.9109872Z [321s] Generation 12 complete: 
2026-02-21T10:59:52.9110308Z error=2
2026-02-21T10:59:52.9110572Z ok=29
2026-02-21T10:59:52.9110827Z min=0.0996
2026-02-21T10:59:52.9111093Z mid=0.1117
2026-02-21T10:59:52.9111346Z max=0.1792
2026-02-21T10:59:52.9111662Z best={'block_sizes': [1],
2026-02-21T10:59:52.9112347Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T10:59:52.9113353Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T10:59:52.9114809Z               'tensor_descriptor', 'pointer'],
2026-02-21T10:59:52.9115441Z  'load_eviction_policies': ['', 'last', '', '', 'last', '', '', 'first'],
2026-02-21T10:59:52.9116089Z  'num_stages': 5,
2026-02-21T10:59:52.9116449Z  'num_warps': 16,
2026-02-21T10:59:52.9116676Z  'pid_type': 'flat',
2026-02-21T10:59:52.9116883Z  'range_flattens': [None],
2026-02-21T10:59:52.9117125Z  'range_multi_buffers': [None],
2026-02-21T10:59:52.9117363Z  'range_num_stages': [0],
2026-02-21T10:59:52.9117597Z  'range_unroll_factors': [0],
2026-02-21T10:59:52.9117845Z  'range_warp_specializes': [],
2026-02-21T10:59:52.9118081Z  'reduction_loops': [None]}
2026-02-21T10:59:52.9151130Z [321s] Fitting surrogate: 708 points, 708 targets
2026-02-21T10:59:53.4576880Z [321s] Generation 13 starting: 28 neighbors, 2 active search path(s)
2026-02-21T10:59:58.0588498Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 18.0 configs/s
2026-02-21T10:59:59.7658790Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 17.5 configs/s
2026-02-21T11:00:04.9061209Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 194.7         
2026-02-21T11:00:04.9061712Z                                                                   configs/s     
2026-02-21T11:00:05.1769235Z [333s] Generation 13 complete: 
2026-02-21T11:00:05.1769482Z error=1
2026-02-21T11:00:05.1769652Z ok=29
2026-02-21T11:00:05.1769870Z min=0.0995
2026-02-21T11:00:05.1770027Z mid=0.1110
2026-02-21T11:00:05.1770188Z max=0.7150
2026-02-21T11:00:05.1770361Z best={'block_sizes': [1],
2026-02-21T11:00:05.1770771Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:00:05.1771402Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:00:05.1771838Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:00:05.1772199Z  'load_eviction_policies': ['', 'last', '', '', 'last', 'last', '', 'first'],
2026-02-21T11:00:05.1772547Z  'num_stages': 5,
2026-02-21T11:00:05.1772738Z  'num_warps': 16,
2026-02-21T11:00:05.1772915Z  'pid_type': 'flat',
2026-02-21T11:00:05.1773114Z  'range_flattens': [None],
2026-02-21T11:00:05.1773332Z  'range_multi_buffers': [None],
2026-02-21T11:00:05.1773558Z  'range_num_stages': [0],
2026-02-21T11:00:05.1773770Z  'range_unroll_factors': [0],
2026-02-21T11:00:05.1774271Z  'range_warp_specializes': [],
2026-02-21T11:00:05.1774527Z  'reduction_loops': [None]}
2026-02-21T11:00:05.1813162Z [333s] Fitting surrogate: 738 points, 738 targets
2026-02-21T11:00:05.5879054Z [333s] Generation 14 starting: 18 neighbors, 2 active search path(s)
2026-02-21T11:00:08.4971544Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 14.5 configs/s
2026-02-21T11:00:09.5537918Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.8 configs/s
2026-02-21T11:00:13.2991961Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 266.6         
2026-02-21T11:00:13.2992508Z                                                                   configs/s     
2026-02-21T11:00:13.5231379Z [341s] Generation 14 complete: 
2026-02-21T11:00:13.5231636Z ok=20
2026-02-21T11:00:13.5231793Z min=0.0994
2026-02-21T11:00:13.5231955Z mid=0.1004
2026-02-21T11:00:13.5232515Z max=0.1070
2026-02-21T11:00:13.5232690Z best={'block_sizes': [1],
2026-02-21T11:00:13.5233058Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:00:13.5233648Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:00:13.5234408Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:00:13.5234771Z  'load_eviction_policies': ['', 'last', '', '', 'last', 'last', '', 'first'],
2026-02-21T11:00:13.5235126Z  'num_stages': 5,
2026-02-21T11:00:13.5235300Z  'num_warps': 16,
2026-02-21T11:00:13.5235480Z  'pid_type': 'flat',
2026-02-21T11:00:13.5235671Z  'range_flattens': [None],
2026-02-21T11:00:13.5235891Z  'range_multi_buffers': [None],
2026-02-21T11:00:13.5236424Z  'range_num_stages': [0],
2026-02-21T11:00:13.5236648Z  'range_unroll_factors': [0],
2026-02-21T11:00:13.5236867Z  'range_warp_specializes': [],
2026-02-21T11:00:13.5237096Z  'reduction_loops': [None]}
2026-02-21T11:00:13.5274407Z [341s] Fitting surrogate: 758 points, 758 targets
2026-02-21T11:00:13.9237498Z [342s] Generation 15 starting: 18 neighbors, 2 active search path(s)
2026-02-21T11:00:16.9991882Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 3.2 configs/s
2026-02-21T11:00:18.0906536Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.2 configs/s
2026-02-21T11:00:21.9647422Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 257.7         
2026-02-21T11:00:21.9647885Z                                                                   configs/s     
2026-02-21T11:00:22.1892825Z [350s] Generation 15 complete: 
2026-02-21T11:00:22.1893073Z ok=20
2026-02-21T11:00:22.1893236Z min=0.0996
2026-02-21T11:00:22.1893400Z mid=0.1004
2026-02-21T11:00:22.1893565Z max=0.1416
2026-02-21T11:00:22.1893758Z best={'block_sizes': [1],
2026-02-21T11:00:22.1894399Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:00:22.1894967Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:00:22.1895420Z  'load_eviction_policies': ['', 'last', 'first', '', '', '', 'first', 'first'],
2026-02-21T11:00:22.1895764Z  'num_stages': 8,
2026-02-21T11:00:22.1895943Z  'num_warps': 32,
2026-02-21T11:00:22.1896131Z  'pid_type': 'flat',
2026-02-21T11:00:22.1896345Z  'range_flattens': [None],
2026-02-21T11:00:22.1896570Z  'range_multi_buffers': [None],
2026-02-21T11:00:22.1896812Z  'range_num_stages': [0],
2026-02-21T11:00:22.1897032Z  'range_unroll_factors': [0],
2026-02-21T11:00:22.1897286Z  'range_warp_specializes': [],
2026-02-21T11:00:22.1897529Z  'reduction_loops': [2048]}
2026-02-21T11:00:22.1936878Z [350s] Fitting surrogate: 778 points, 778 targets
2026-02-21T11:00:22.4717885Z [350s] Generation 16 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:00:25.3076242Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 5.1 configs/s
2026-02-21T11:00:25.8438349Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.4 configs/s
2026-02-21T11:00:27.8177276Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 499.2         
2026-02-21T11:00:27.8179034Z                                                                   configs/s     
2026-02-21T11:00:27.9517930Z [356s] Generation 16 complete: 
2026-02-21T11:00:27.9518263Z ok=10
2026-02-21T11:00:27.9518475Z min=0.0994
2026-02-21T11:00:27.9518701Z mid=0.1127
2026-02-21T11:00:27.9518905Z max=0.1329
2026-02-21T11:00:27.9519135Z best={'block_sizes': [1],
2026-02-21T11:00:27.9519675Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:00:27.9520433Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:00:27.9521431Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', 'first', 'first'],
2026-02-21T11:00:27.9521835Z  'num_stages': 8,
2026-02-21T11:00:27.9522032Z  'num_warps': 32,
2026-02-21T11:00:27.9522233Z  'pid_type': 'flat',
2026-02-21T11:00:27.9522450Z  'range_flattens': [None],
2026-02-21T11:00:27.9522680Z  'range_multi_buffers': [None],
2026-02-21T11:00:27.9522928Z  'range_num_stages': [0],
2026-02-21T11:00:27.9523155Z  'range_unroll_factors': [0],
2026-02-21T11:00:27.9523404Z  'range_warp_specializes': [],
2026-02-21T11:00:27.9523654Z  'reduction_loops': [2048]}
2026-02-21T11:00:27.9559884Z [356s] Fitting surrogate: 788 points, 788 targets
2026-02-21T11:00:28.2481010Z [356s] Generation 17 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:00:31.6708354Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 9.9 configs/s
2026-02-21T11:00:32.2730630Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.0 configs/s
2026-02-21T11:00:34.4110492Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 461.9         
2026-02-21T11:00:34.4111043Z                                                                   configs/s     
2026-02-21T11:00:34.5539925Z [362s] Generation 17 complete: 
2026-02-21T11:00:34.5540194Z ok=11
2026-02-21T11:00:34.5540360Z min=0.1000
2026-02-21T11:00:34.5540535Z mid=0.1074
2026-02-21T11:00:34.5540696Z max=0.1324
2026-02-21T11:00:34.5540880Z best={'block_sizes': [1],
2026-02-21T11:00:34.5541311Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:00:34.5541889Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:00:34.5542397Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', 'first', 'first'],
2026-02-21T11:00:34.5542783Z  'num_stages': 8,
2026-02-21T11:00:34.5542980Z  'num_warps': 32,
2026-02-21T11:00:34.5543166Z  'pid_type': 'flat',
2026-02-21T11:00:34.5543375Z  'range_flattens': [None],
2026-02-21T11:00:34.5543614Z  'range_multi_buffers': [None],
2026-02-21T11:00:34.5543858Z  'range_num_stages': [0],
2026-02-21T11:00:34.5544248Z  'range_unroll_factors': [0],
2026-02-21T11:00:34.5544489Z  'range_warp_specializes': [],
2026-02-21T11:00:34.5544743Z  'reduction_loops': [4096]}
2026-02-21T11:00:34.5581168Z [362s] Fitting surrogate: 799 points, 799 targets
2026-02-21T11:00:34.8021521Z [362s] Generation 18 starting: 6 neighbors, 1 active search path(s)
2026-02-21T11:00:37.5495846Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6/6 3.0 configs/s
2026-02-21T11:00:38.0651254Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 6/6 12.1 configs/s
2026-02-21T11:00:39.4154851Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 722.2         
2026-02-21T11:00:39.4155617Z                                                                   configs/s     
2026-02-21T11:00:39.5272479Z [367s] Generation 18 complete: 
2026-02-21T11:00:39.5272758Z ok=7
2026-02-21T11:00:39.5272923Z min=0.0997
2026-02-21T11:00:39.5273133Z mid=0.1092
2026-02-21T11:00:39.5273305Z max=0.1324
2026-02-21T11:00:39.5273484Z best={'block_sizes': [1],
2026-02-21T11:00:39.5273934Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:00:39.5275431Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:00:39.5275974Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', 'first', 'first'],
2026-02-21T11:00:39.5276366Z  'num_stages': 8,
2026-02-21T11:00:39.5276566Z  'num_warps': 32,
2026-02-21T11:00:39.5276758Z  'pid_type': 'flat',
2026-02-21T11:00:39.5276978Z  'range_flattens': [None],
2026-02-21T11:00:39.5277216Z  'range_multi_buffers': [None],
2026-02-21T11:00:39.5277459Z  'range_num_stages': [0],
2026-02-21T11:00:39.5277696Z  'range_unroll_factors': [0],
2026-02-21T11:00:39.5277945Z  'range_warp_specializes': [],
2026-02-21T11:00:39.5278194Z  'reduction_loops': [4096]}
2026-02-21T11:00:39.5319775Z [367s] Fitting surrogate: 806 points, 806 targets
2026-02-21T11:00:39.8038307Z [367s] Generation 19 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:00:43.0908799Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 4.7 configs/s
2026-02-21T11:00:43.6215845Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.7 configs/s
2026-02-21T11:00:45.3563113Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 567.0         
2026-02-21T11:00:45.3563922Z                                                                   configs/s     
2026-02-21T11:00:45.4811475Z [373s] Generation 19 complete: 
2026-02-21T11:00:45.4811730Z ok=10
2026-02-21T11:00:45.4811913Z min=0.0998
2026-02-21T11:00:45.4812086Z mid=0.1000
2026-02-21T11:00:45.4812275Z max=0.1568
2026-02-21T11:00:45.4812470Z best={'block_sizes': [1],
2026-02-21T11:00:45.4812922Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:00:45.4813485Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:00:45.4813931Z  'load_eviction_policies': ['', 'last', 'first', '', '', 'last', 'first', 'first'],
2026-02-21T11:00:45.4814581Z  'num_stages': 8,
2026-02-21T11:00:45.4814738Z  'num_warps': 32,
2026-02-21T11:00:45.4814904Z  'pid_type': 'flat',
2026-02-21T11:00:45.4815084Z  'range_flattens': [None],
2026-02-21T11:00:45.4815282Z  'range_multi_buffers': [None],
2026-02-21T11:00:45.4815489Z  'range_num_stages': [0],
2026-02-21T11:00:45.4815677Z  'range_unroll_factors': [0],
2026-02-21T11:00:45.4815883Z  'range_warp_specializes': [],
2026-02-21T11:00:45.4816081Z  'reduction_loops': [4096]}
2026-02-21T11:00:45.4861296Z [373s] Fitting surrogate: 816 points, 816 targets
2026-02-21T11:00:45.6394921Z [373s] Autotuning complete in 373.7s after searching 775 configs.
2026-02-21T11:00:45.6395449Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:00:45.6397581Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', '', '', 'last', 'first', 'first'], num_stages=8, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[4096]), static_shapes=True)
2026-02-21T11:00:45.6399546Z 
2026-02-21T11:00:45.6399973Z [373s] Code of selected kernel: /tmp/torchinductor_root/qq/cqqsop32ioardyruz32jhhmxalrtgc76mw6dflgvnh35vv57fzk7.py
2026-02-21T11:00:45.6771179Z from __future__ import annotations
2026-02-21T11:00:45.6771389Z 
2026-02-21T11:00:45.6771470Z import torch
2026-02-21T11:00:45.6771665Z import triton
2026-02-21T11:00:45.6771875Z import triton.language as tl
2026-02-21T11:00:45.6772216Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:00:45.6772679Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:00:45.6772961Z 
2026-02-21T11:00:45.6773055Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:00:45.6773226Z 
2026-02-21T11:00:45.6773301Z @triton.jit
2026-02-21T11:00:45.6774489Z def _helion_layer_norm_fwd(x, mean, rstd, weight, bias, out, eps, _REDUCTION_BLOCK_1: tl.constexpr):
2026-02-21T11:00:45.6775040Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:00:45.6775355Z     pid_0 = tl.program_id(0)
2026-02-21T11:00:45.6775619Z     offset_0 = pid_0
2026-02-21T11:00:45.6775867Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:00:45.6776247Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:00:45.6776707Z     sum_1_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T11:00:45.6777174Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:00:45.6777567Z     for roffset_1 in tl.range(0, 8704, _REDUCTION_BLOCK_1):
2026-02-21T11:00:45.6778302Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:00:45.6778690Z         mask_1 = rindex_1 < 8704
2026-02-21T11:00:45.6779105Z         acc = tl.load(x + (indices_0[:, None] * 8704 + rindex_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:00:45.6779652Z         # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:00:45.6780010Z         v_0 = sum_1_acc + acc
2026-02-21T11:00:45.6780243Z         sum_1_acc = v_0
2026-02-21T11:00:45.6780497Z     sum_1 = tl.cast(tl.sum(sum_1_acc, 1), tl.float32)
2026-02-21T11:00:45.6780806Z     v_1 = 0.00011488970588235294
2026-02-21T11:00:45.6781034Z     v_2 = sum_1 * v_1
2026-02-21T11:00:45.6781317Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:00:45.6781670Z     subscript = v_2[:, None]
2026-02-21T11:00:45.6782026Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:00:45.6782544Z     sum_2_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T11:00:45.6783030Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:00:45.6783450Z     for roffset_1 in tl.range(0, 8704, _REDUCTION_BLOCK_1):
2026-02-21T11:00:45.6783815Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:00:45.6784300Z         mask_1 = rindex_1 < 8704
2026-02-21T11:00:45.6784513Z         subscript_copy = subscript
2026-02-21T11:00:45.6784984Z         acc_1 = tl.load(x + (indices_0[:, None] * 8704 + rindex_1[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_last')
2026-02-21T11:00:45.6785524Z         # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:00:45.6785826Z         v_3 = acc_1 - subscript_copy
2026-02-21T11:00:45.6786153Z         # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:00:45.6786489Z         v_4 = v_3 * v_3
2026-02-21T11:00:45.6786921Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _REDUCTION_BLOCK_1]), v_4, tl.full([], 0, tl.float32))
2026-02-21T11:00:45.6787399Z         v_5 = sum_2_acc + _mask_to_1
2026-02-21T11:00:45.6787615Z         sum_2_acc = v_5
2026-02-21T11:00:45.6787832Z     sum_2 = tl.cast(tl.sum(sum_2_acc, 1), tl.float32)
2026-02-21T11:00:45.6788083Z     v_6 = 0.00011488970588235294
2026-02-21T11:00:45.6788276Z     v_7 = sum_2 * v_6
2026-02-21T11:00:45.6788537Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:00:45.6788826Z     v_8 = v_7 + eps
2026-02-21T11:00:45.6789005Z     v_9 = libdevice.rsqrt(v_8)
2026-02-21T11:00:45.6789286Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:00:45.6789598Z     subscript_1 = v_9[:, None]
2026-02-21T11:00:45.6789832Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:00:45.6790103Z     tl.store(mean + indices_0 * 1, v_2, None)
2026-02-21T11:00:45.6790374Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:00:45.6790642Z     tl.store(rstd + indices_0 * 1, v_9, None)
2026-02-21T11:00:45.6790945Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:00:45.6791277Z     for roffset_1 in tl.range(0, 8704, _REDUCTION_BLOCK_1):
2026-02-21T11:00:45.6791804Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:00:45.6792129Z         mask_1 = rindex_1 < 8704
2026-02-21T11:00:45.6792327Z         v_2_copy = v_2
2026-02-21T11:00:45.6792527Z         subscript_1_copy = subscript_1
2026-02-21T11:00:45.6792994Z         acc_2 = tl.load(x + (indices_0[:, None] * 8704 + rindex_1[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_first')
2026-02-21T11:00:45.6793524Z         # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:00:45.6793803Z         subscript_2 = v_2_copy[:, None]
2026-02-21T11:00:45.6794155Z         v_10 = acc_2 - subscript_2
2026-02-21T11:00:45.6794438Z         # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:00:45.6794881Z         v_11 = v_10 * subscript_1_copy
2026-02-21T11:00:45.6795198Z         # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:00:45.6795576Z         load_1 = tl.load(weight + rindex_1 * 1, mask_1, other=0)
2026-02-21T11:00:45.6795850Z         v_12 = load_1[None, :]
2026-02-21T11:00:45.6796030Z         v_13 = v_11 * v_12
2026-02-21T11:00:45.6796241Z         # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:00:45.6796522Z         load_2 = tl.load(bias + rindex_1 * 1, mask_1, other=0)
2026-02-21T11:00:45.6796868Z         # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:00:45.6797223Z         # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:00:45.6797475Z         # src[layer_norm.py:75]: )
2026-02-21T11:00:45.6797676Z         v_14 = load_2[None, :]
2026-02-21T11:00:45.6797851Z         v_15 = v_13 + v_14
2026-02-21T11:00:45.6798080Z         # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:00:45.6798472Z         tl.store(out + (indices_0[:, None] * 8704 + rindex_1[None, :] * 1), v_15, mask_1[None, :])
2026-02-21T11:00:45.6798760Z 
2026-02-21T11:00:45.6799202Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:00:45.6799776Z     """
2026-02-21T11:00:45.6800006Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:00:45.6800294Z     Args:
2026-02-21T11:00:45.6800552Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:00:45.6801073Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:00:45.6801557Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:00:45.6801961Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:00:45.6802453Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:00:45.6802833Z     Returns:
2026-02-21T11:00:45.6803036Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:00:45.6803400Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:00:45.6803769Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:00:45.6804276Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:00:45.6804596Z     """
2026-02-21T11:00:45.6804776Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:00:45.6804990Z     m, n = x.size()
2026-02-21T11:00:45.6805319Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:00:45.6805786Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:00:45.6806138Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:00:45.6806517Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:00:45.6806872Z     if bias is not None:
2026-02-21T11:00:45.6807346Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:00:45.6807780Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:00:45.6808250Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:00:45.6808654Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:00:45.6809001Z     # src[layer_norm.py:52]: )
2026-02-21T11:00:45.6809349Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:00:45.6809910Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:00:45.6810459Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:00:45.6812792Z     # src[layer_norm.py:55]: )
2026-02-21T11:00:45.6813161Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:00:45.6813650Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:00:45.6814244Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:00:45.6814629Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:00:45.6815045Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:00:45.6815425Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:00:45.6815812Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:00:45.6816139Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:00:45.6816427Z     _REDUCTION_BLOCK_1 = 4096
2026-02-21T11:00:45.6816662Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:00:45.6816963Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:00:45.6817264Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:00:45.6817496Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:00:45.6817947Z     _launcher(_helion_layer_norm_fwd, (4096,), x, mean, rstd, weight, bias, out, eps, _REDUCTION_BLOCK_1, num_warps=32, num_stages=8)
2026-02-21T11:00:45.6818435Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:00:45.6818678Z     return (out, mean, rstd)
2026-02-21T11:00:46.9041924Z WARNING:tritonbench.utils.triton_op:Completed input ID 15:
2026-02-21T11:00:46.9042325Z (M, N)
2026-02-21T11:00:46.9042503Z ------------
2026-02-21T11:00:46.9042702Z (4096, 8704)
2026-02-21T11:00:46.9042820Z 
2026-02-21T11:00:46.9062105Z  55%|█████▌    | 11/20 [59:43<52:56, 352.94s/it]WARNING:tritonbench.utils.triton_op:Running input ID 17:
2026-02-21T11:00:46.9062571Z (M, N)
2026-02-21T11:00:46.9062754Z ------------
2026-02-21T11:00:46.9062936Z (4096, 9728)
2026-02-21T11:00:46.9065010Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T11:00:48.2376774Z INFO:tritonbench.utils.triton_op:Took 3.12ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:00:49.9918378Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:00:51.4449964Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:00:51.4450238Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:00:51.4450472Z               'dtype': 'torch.float32',
2026-02-21T11:00:51.4450711Z               'shape': (4096, 9728),
2026-02-21T11:00:51.4450922Z               'stride': (9728, 1)},
2026-02-21T11:00:51.4451124Z             (9728,),
2026-02-21T11:00:51.4451295Z             { 'device': 'cuda:0',
2026-02-21T11:00:51.4451509Z               'dtype': 'torch.float32',
2026-02-21T11:00:51.4451719Z               'shape': (9728,),
2026-02-21T11:00:51.4451934Z               'stride': (1,)},
2026-02-21T11:00:51.4452122Z             { 'device': 'cuda:0',
2026-02-21T11:00:51.4452325Z               'dtype': 'torch.float32',
2026-02-21T11:00:51.4453103Z               'shape': (9728,),
2026-02-21T11:00:51.4453301Z               'stride': (1,)},
2026-02-21T11:00:51.4453487Z             1e-05),
2026-02-21T11:00:51.4453642Z   'kwargs': {}}
2026-02-21T11:00:51.4490971Z INFO:tritonbench.utils.triton_op:Took 4.59ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:00:51.4570627Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:00:51.4571952Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:00:51.4572848Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:00:51.4573350Z While processing:
2026-02-21T11:00:51.4574570Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:00:51.4575230Z     if bias is not None:
2026-02-21T11:00:51.4575552Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:00:51.4575751Z 
2026-02-21T11:00:51.6153794Z [0s] Autotune random seed: 2141537047
2026-02-21T11:00:51.6598885Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:01:26.9180965Z [35s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:01:27.7328735Z [36s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:01:29.8998181Z [38s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:01:35.2842041Z [43s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:01:37.2638377Z [45s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:01:37.2659308Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T11:01:44.4408499Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.0 configs/s
2026-02-21T11:01:44.4422389Z [52s] Adaptive compile timeout: 30s (90% percentile=14.7s, bounds=[30.0s, 30s])
2026-02-21T11:01:46.0831057Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 593.6 configs/s
2026-02-21T11:01:46.2038435Z [54s] Initial random population of 100, 5 starting points: 
2026-02-21T11:01:46.2039007Z error=7
2026-02-21T11:01:46.2039429Z timeout=5
2026-02-21T11:01:46.2039731Z ok=88
2026-02-21T11:01:46.2040820Z min=0.1329
2026-02-21T11:01:46.2041246Z mid=0.4860
2026-02-21T11:01:46.2041589Z max=39.0468
2026-02-21T11:01:46.2041964Z best={'block_sizes': [1],
2026-02-21T11:01:46.2042671Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:01:46.2043677Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:01:46.2044929Z  'load_eviction_policies': ['last', 'first', 'first', 'last', 'first', 'last', '', ''],
2026-02-21T11:01:46.2045685Z  'num_sm_multiplier': 16,
2026-02-21T11:01:46.2045896Z  'num_stages': 8,
2026-02-21T11:01:46.2046070Z  'num_warps': 8,
2026-02-21T11:01:46.2046273Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:01:46.2046529Z  'range_flattens': [False],
2026-02-21T11:01:46.2046741Z  'range_multi_buffers': [None],
2026-02-21T11:01:46.2046968Z  'range_num_stages': [2],
2026-02-21T11:01:46.2047176Z  'range_unroll_factors': [2],
2026-02-21T11:01:46.2047414Z  'range_warp_specializes': [],
2026-02-21T11:01:46.2047638Z  'reduction_loops': [2048]}
2026-02-21T11:01:46.2060915Z [54s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:01:47.6869545Z [56s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T11:02:32.3463105Z [100s] Timeout after 30s compiling Config(block_sizes=[2], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', '', 'first', '', 'last', 'last', 'last', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[1], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T11:02:32.3480892Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 0.3 configs/s
2026-02-21T11:02:38.0665396Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.6 configs/s
2026-02-21T11:02:55.3130101Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 61.6 configs/s
2026-02-21T11:02:56.0182118Z [124s] Generation 1 complete: 
2026-02-21T11:02:56.0182531Z error=1
2026-02-21T11:02:56.0182757Z timeout=1
2026-02-21T11:02:56.0182981Z ok=93
2026-02-21T11:02:56.0183198Z min=0.1167
2026-02-21T11:02:56.0183416Z mid=0.1500
2026-02-21T11:02:56.0183648Z max=1.2009
2026-02-21T11:02:56.0183940Z best={'block_sizes': [1],
2026-02-21T11:02:56.0184782Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:02:56.0185708Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:02:56.0186390Z               'tensor_descriptor'],
2026-02-21T11:02:56.0186957Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:02:56.0187548Z  'maxnreg': 128,
2026-02-21T11:02:56.0187837Z  'num_sm_multiplier': 8,
2026-02-21T11:02:56.0188161Z  'num_stages': 3,
2026-02-21T11:02:56.0188441Z  'num_warps': 8,
2026-02-21T11:02:56.0188745Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:02:56.0189143Z  'range_flattens': [None],
2026-02-21T11:02:56.0190073Z  'range_multi_buffers': [True],
2026-02-21T11:02:56.0190430Z  'range_num_stages': [1],
2026-02-21T11:02:56.0190757Z  'range_unroll_factors': [3],
2026-02-21T11:02:56.0191116Z  'range_warp_specializes': [],
2026-02-21T11:02:56.0191464Z  'reduction_loops': [None]}
2026-02-21T11:02:56.0210782Z [124s] Fitting surrogate: 195 points, 195 targets
2026-02-21T11:02:57.4899171Z [125s] Generation 2 starting: 89 neighbors, 5 active search path(s)
2026-02-21T11:03:13.5076297Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 4.4 configs/s
2026-02-21T11:03:19.0966736Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.6 configs/s
2026-02-21T11:03:34.9119091Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 63.6 configs/s
2026-02-21T11:03:35.6052621Z [163s] Generation 2 complete: 
2026-02-21T11:03:35.6052986Z error=1
2026-02-21T11:03:35.6053166Z ok=93
2026-02-21T11:03:35.6053330Z min=0.1109
2026-02-21T11:03:35.6053512Z mid=0.1355
2026-02-21T11:03:35.6053710Z max=0.7956
2026-02-21T11:03:35.6053908Z best={'block_sizes': [1],
2026-02-21T11:03:35.6054759Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:03:35.6055316Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:03:35.6055784Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:03:35.6056133Z  'num_stages': 1,
2026-02-21T11:03:35.6056333Z  'num_warps': 8,
2026-02-21T11:03:35.6056542Z  'pid_type': 'flat',
2026-02-21T11:03:35.6056765Z  'range_flattens': [None],
2026-02-21T11:03:35.6057000Z  'range_multi_buffers': [None],
2026-02-21T11:03:35.6057272Z  'range_num_stages': [0],
2026-02-21T11:03:35.6057502Z  'range_unroll_factors': [0],
2026-02-21T11:03:35.6057760Z  'range_warp_specializes': [],
2026-02-21T11:03:35.6058002Z  'reduction_loops': [None]}
2026-02-21T11:03:35.6092856Z [163s] Fitting surrogate: 289 points, 289 targets
2026-02-21T11:03:36.9788138Z [165s] Generation 3 starting: 82 neighbors, 5 active search path(s)
2026-02-21T11:03:52.3322162Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 2.9 configs/s
2026-02-21T11:03:57.3377878Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 16.5 configs/s
2026-02-21T11:04:15.3313852Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 59.1 configs/s
2026-02-21T11:04:16.0999219Z [204s] Generation 3 complete: 
2026-02-21T11:04:16.0999548Z error=1
2026-02-21T11:04:16.0999744Z ok=86
2026-02-21T11:04:16.0999924Z min=0.1109
2026-02-21T11:04:16.1000114Z mid=0.1255
2026-02-21T11:04:16.1000282Z max=0.8884
2026-02-21T11:04:16.1000470Z best={'block_sizes': [1],
2026-02-21T11:04:16.1000877Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:04:16.1001478Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:04:16.1001936Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:04:16.1003010Z  'num_stages': 1,
2026-02-21T11:04:16.1003223Z  'num_warps': 8,
2026-02-21T11:04:16.1003433Z  'pid_type': 'flat',
2026-02-21T11:04:16.1003669Z  'range_flattens': [None],
2026-02-21T11:04:16.1003905Z  'range_multi_buffers': [None],
2026-02-21T11:04:16.1004368Z  'range_num_stages': [0],
2026-02-21T11:04:16.1004600Z  'range_unroll_factors': [0],
2026-02-21T11:04:16.1004864Z  'range_warp_specializes': [],
2026-02-21T11:04:16.1005110Z  'reduction_loops': [None]}
2026-02-21T11:04:16.1030857Z [204s] Fitting surrogate: 376 points, 376 targets
2026-02-21T11:04:17.2371049Z [205s] Generation 4 starting: 67 neighbors, 5 active search path(s)
2026-02-21T11:04:28.7121803Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69/69 8.7 configs/s
2026-02-21T11:04:32.7219478Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 69/69 17.1 configs/s
2026-02-21T11:04:45.2869019Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 80.0 configs/s
2026-02-21T11:04:45.8568499Z [234s] Generation 4 complete: 
2026-02-21T11:04:45.8568978Z error=4
2026-02-21T11:04:45.8569260Z ok=68
2026-02-21T11:04:45.8569524Z min=0.1110
2026-02-21T11:04:45.8569803Z mid=0.1308
2026-02-21T11:04:45.8570181Z max=1.0786
2026-02-21T11:04:45.8570488Z best={'block_sizes': [1],
2026-02-21T11:04:45.8571004Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:04:45.8571563Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:04:45.8572020Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:04:45.8572362Z  'num_stages': 2,
2026-02-21T11:04:45.8572561Z  'num_warps': 16,
2026-02-21T11:04:45.8572754Z  'pid_type': 'flat',
2026-02-21T11:04:45.8572984Z  'range_flattens': [None],
2026-02-21T11:04:45.8573744Z  'range_multi_buffers': [None],
2026-02-21T11:04:45.8574515Z  'range_num_stages': [0],
2026-02-21T11:04:45.8574770Z  'range_unroll_factors': [0],
2026-02-21T11:04:45.8575042Z  'range_warp_specializes': [],
2026-02-21T11:04:45.8575297Z  'reduction_loops': [None]}
2026-02-21T11:04:45.8613443Z [234s] Fitting surrogate: 448 points, 448 targets
2026-02-21T11:04:47.1179082Z [235s] Generation 5 starting: 73 neighbors, 5 active search path(s)
2026-02-21T11:04:59.2795892Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75/75 19.7 configs/s
2026-02-21T11:05:03.4545738Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 75/75 17.9 configs/s
2026-02-21T11:05:17.4408923Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 71.9 configs/s
2026-02-21T11:05:18.0807900Z [266s] Generation 5 complete: 
2026-02-21T11:05:18.0808223Z error=7
2026-02-21T11:05:18.0808406Z ok=72
2026-02-21T11:05:18.0808593Z min=0.1106
2026-02-21T11:05:18.0808770Z mid=0.1221
2026-02-21T11:05:18.0808966Z max=0.6939
2026-02-21T11:05:18.0809179Z best={'block_sizes': [1],
2026-02-21T11:05:18.0809602Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:05:18.0810237Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:05:18.0810761Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', 'first'],
2026-02-21T11:05:18.0811128Z  'num_stages': 2,
2026-02-21T11:05:18.0811324Z  'num_warps': 16,
2026-02-21T11:05:18.0811531Z  'pid_type': 'flat',
2026-02-21T11:05:18.0811747Z  'range_flattens': [None],
2026-02-21T11:05:18.0811989Z  'range_multi_buffers': [None],
2026-02-21T11:05:18.0812235Z  'range_num_stages': [0],
2026-02-21T11:05:18.0812471Z  'range_unroll_factors': [0],
2026-02-21T11:05:18.0812746Z  'range_warp_specializes': [],
2026-02-21T11:05:18.0813023Z  'reduction_loops': [None]}
2026-02-21T11:05:18.0857595Z [266s] Fitting surrogate: 527 points, 527 targets
2026-02-21T11:05:19.1960155Z [267s] Generation 6 starting: 64 neighbors, 4 active search path(s)
2026-02-21T11:05:32.2972485Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 1.1 configs/s
2026-02-21T11:05:36.4048896Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.2 configs/s
2026-02-21T11:05:47.7945664Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.3 configs/s
2026-02-21T11:05:48.3370431Z [296s] Generation 6 complete: 
2026-02-21T11:05:48.3370868Z error=4
2026-02-21T11:05:48.3371152Z ok=65
2026-02-21T11:05:48.3371427Z min=0.1103
2026-02-21T11:05:48.3371719Z mid=0.1188
2026-02-21T11:05:48.3371983Z max=1.0825
2026-02-21T11:05:48.3372284Z best={'block_sizes': [1],
2026-02-21T11:05:48.3372928Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:05:48.3373866Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:05:48.3374954Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', 'first'],
2026-02-21T11:05:48.3375312Z  'num_stages': 2,
2026-02-21T11:05:48.3376204Z  'num_warps': 16,
2026-02-21T11:05:48.3376409Z  'pid_type': 'flat',
2026-02-21T11:05:48.3376621Z  'range_flattens': [None],
2026-02-21T11:05:48.3376856Z  'range_multi_buffers': [None],
2026-02-21T11:05:48.3377118Z  'range_num_stages': [0],
2026-02-21T11:05:48.3377342Z  'range_unroll_factors': [0],
2026-02-21T11:05:48.3377608Z  'range_warp_specializes': [],
2026-02-21T11:05:48.3377850Z  'reduction_loops': [None]}
2026-02-21T11:05:48.3413006Z [296s] Fitting surrogate: 596 points, 596 targets
2026-02-21T11:05:48.8999793Z [297s] Generation 7 starting: 29 neighbors, 2 active search path(s)
2026-02-21T11:05:57.8357065Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 2.4 configs/s
2026-02-21T11:05:59.6497042Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 30/30 16.9 configs/s
2026-02-21T11:06:04.4512873Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 208.2         
2026-02-21T11:06:04.4513541Z                                                                   configs/s     
2026-02-21T11:06:04.7122461Z [313s] Generation 7 complete: 
2026-02-21T11:06:04.7122769Z error=1
2026-02-21T11:06:04.7122953Z ok=31
2026-02-21T11:06:04.7123163Z min=0.1109
2026-02-21T11:06:04.7123347Z mid=0.1288
2026-02-21T11:06:04.7123519Z max=0.9070
2026-02-21T11:06:04.7123731Z best={'block_sizes': [1],
2026-02-21T11:06:04.7124552Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:06:04.7125136Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:06:04.7125620Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', 'first'],
2026-02-21T11:06:04.7126007Z  'num_stages': 2,
2026-02-21T11:06:04.7126221Z  'num_warps': 16,
2026-02-21T11:06:04.7126419Z  'pid_type': 'flat',
2026-02-21T11:06:04.7126644Z  'range_flattens': [None],
2026-02-21T11:06:04.7126883Z  'range_multi_buffers': [None],
2026-02-21T11:06:04.7127137Z  'range_num_stages': [0],
2026-02-21T11:06:04.7127379Z  'range_unroll_factors': [0],
2026-02-21T11:06:04.7127635Z  'range_warp_specializes': [],
2026-02-21T11:06:04.7127884Z  'reduction_loops': [None]}
2026-02-21T11:06:04.7160495Z [313s] Fitting surrogate: 628 points, 628 targets
2026-02-21T11:06:05.2881386Z [313s] Generation 8 starting: 30 neighbors, 2 active search path(s)
2026-02-21T11:06:13.6760847Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 4.7 configs/s
2026-02-21T11:06:15.5912358Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 31/31 16.6 configs/s
2026-02-21T11:06:20.2320394Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 215.1         
2026-02-21T11:06:20.2320953Z                                                                   configs/s     
2026-02-21T11:06:20.4706132Z [328s] Generation 8 complete: 
2026-02-21T11:06:20.4706493Z ok=33
2026-02-21T11:06:20.4706719Z min=0.1108
2026-02-21T11:06:20.4706959Z mid=0.1373
2026-02-21T11:06:20.4707185Z max=0.2669
2026-02-21T11:06:20.4707388Z best={'block_sizes': [1],
2026-02-21T11:06:20.4707860Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:06:20.4708446Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:06:20.4709449Z  'load_eviction_policies': ['', '', '', '', '', 'first', '', 'first'],
2026-02-21T11:06:20.4709828Z  'num_stages': 2,
2026-02-21T11:06:20.4710040Z  'num_warps': 16,
2026-02-21T11:06:20.4710244Z  'pid_type': 'flat',
2026-02-21T11:06:20.4710472Z  'range_flattens': [None],
2026-02-21T11:06:20.4710717Z  'range_multi_buffers': [None],
2026-02-21T11:06:20.4710997Z  'range_num_stages': [0],
2026-02-21T11:06:20.4711251Z  'range_unroll_factors': [0],
2026-02-21T11:06:20.4711514Z  'range_warp_specializes': [],
2026-02-21T11:06:20.4711776Z  'reduction_loops': [None]}
2026-02-21T11:06:20.4750156Z [328s] Fitting surrogate: 661 points, 661 targets
2026-02-21T11:06:21.0943719Z [329s] Generation 9 starting: 33 neighbors, 2 active search path(s)
2026-02-21T11:06:28.9163657Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 2.4 configs/s
2026-02-21T11:06:31.2580665Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 34/34 14.7 configs/s
2026-02-21T11:06:37.5433665Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 159.3         
2026-02-21T11:06:37.5435831Z                                                                   configs/s     
2026-02-21T11:06:37.8645549Z [346s] Generation 9 complete: 
2026-02-21T11:06:37.8645881Z error=1
2026-02-21T11:06:37.8646062Z ok=35
2026-02-21T11:06:37.8646240Z min=0.1115
2026-02-21T11:06:37.8646416Z mid=0.1188
2026-02-21T11:06:37.8646592Z max=0.2660
2026-02-21T11:06:37.8646782Z best={'block_sizes': [1],
2026-02-21T11:06:37.8647219Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:06:37.8647860Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:06:37.8648402Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:06:37.8648840Z  'load_eviction_policies': ['', '', 'first', '', 'last', 'first', '', 'first'],
2026-02-21T11:06:37.8649174Z  'maxnreg': 128,
2026-02-21T11:06:37.8649370Z  'num_sm_multiplier': 32,
2026-02-21T11:06:37.8649561Z  'num_stages': 2,
2026-02-21T11:06:37.8649730Z  'num_warps': 8,
2026-02-21T11:06:37.8650039Z  'pid_type': 'persistent_blocked',
2026-02-21T11:06:37.8650285Z  'range_flattens': [None],
2026-02-21T11:06:37.8650485Z  'range_multi_buffers': [False],
2026-02-21T11:06:37.8650706Z  'range_num_stages': [2],
2026-02-21T11:06:37.8650910Z  'range_unroll_factors': [3],
2026-02-21T11:06:37.8651122Z  'range_warp_specializes': [],
2026-02-21T11:06:37.8651342Z  'reduction_loops': [4096]}
2026-02-21T11:06:37.8686542Z [346s] Fitting surrogate: 697 points, 697 targets
2026-02-21T11:06:38.4255274Z [346s] Generation 10 starting: 29 neighbors, 2 active search path(s)
2026-02-21T11:06:45.6251001Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 7.5 configs/s
2026-02-21T11:06:47.4706257Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 16.6 configs/s
2026-02-21T11:06:53.8924662Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 155.9         
2026-02-21T11:06:53.8925234Z                                                                   configs/s     
2026-02-21T11:06:54.2061977Z [362s] Generation 10 complete: 
2026-02-21T11:06:54.2062252Z ok=31
2026-02-21T11:06:54.2062448Z min=0.1118
2026-02-21T11:06:54.2062636Z mid=0.1300
2026-02-21T11:06:54.2062825Z max=0.2660
2026-02-21T11:06:54.2063018Z best={'block_sizes': [1],
2026-02-21T11:06:54.2063462Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:06:54.2064297Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:06:54.2064843Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:06:54.2065288Z  'load_eviction_policies': ['', '', 'first', '', 'last', 'first', '', 'first'],
2026-02-21T11:06:54.2065694Z  'maxnreg': 128,
2026-02-21T11:06:54.2065910Z  'num_sm_multiplier': 32,
2026-02-21T11:06:54.2066160Z  'num_stages': 1,
2026-02-21T11:06:54.2066369Z  'num_warps': 8,
2026-02-21T11:06:54.2066946Z  'pid_type': 'persistent_blocked',
2026-02-21T11:06:54.2067227Z  'range_flattens': [True],
2026-02-21T11:06:54.2067473Z  'range_multi_buffers': [False],
2026-02-21T11:06:54.2067741Z  'range_num_stages': [2],
2026-02-21T11:06:54.2067988Z  'range_unroll_factors': [3],
2026-02-21T11:06:54.2068247Z  'range_warp_specializes': [],
2026-02-21T11:06:54.2068513Z  'reduction_loops': [4096]}
2026-02-21T11:06:54.2103094Z [362s] Fitting surrogate: 728 points, 728 targets
2026-02-21T11:06:54.7840499Z [363s] Generation 11 starting: 30 neighbors, 2 active search path(s)
2026-02-21T11:07:00.7104618Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 7.0 configs/s
2026-02-21T11:07:02.5429931Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 16.8 configs/s
2026-02-21T11:07:09.2846133Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 148.7         
2026-02-21T11:07:09.2846708Z                                                                   configs/s     
2026-02-21T11:07:09.6243020Z [377s] Generation 11 complete: 
2026-02-21T11:07:09.6243472Z ok=32
2026-02-21T11:07:09.6243765Z min=0.1117
2026-02-21T11:07:09.6244339Z mid=0.1146
2026-02-21T11:07:09.6244675Z max=0.1643
2026-02-21T11:07:09.6245022Z best={'block_sizes': [1],
2026-02-21T11:07:09.6245684Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:07:09.6246711Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:07:09.6247501Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:07:09.6248164Z  'load_eviction_policies': ['', '', 'first', '', 'last', 'first', '', 'first'],
2026-02-21T11:07:09.6248783Z  'maxnreg': 128,
2026-02-21T11:07:09.6249103Z  'num_sm_multiplier': 32,
2026-02-21T11:07:09.6249476Z  'num_stages': 1,
2026-02-21T11:07:09.6249781Z  'num_warps': 8,
2026-02-21T11:07:09.6250244Z  'pid_type': 'persistent_blocked',
2026-02-21T11:07:09.6250709Z  'range_flattens': [None],
2026-02-21T11:07:09.6251154Z  'range_multi_buffers': [False],
2026-02-21T11:07:09.6251568Z  'range_num_stages': [2],
2026-02-21T11:07:09.6251774Z  'range_unroll_factors': [3],
2026-02-21T11:07:09.6252009Z  'range_warp_specializes': [],
2026-02-21T11:07:09.6252229Z  'reduction_loops': [4096]}
2026-02-21T11:07:09.6288775Z [377s] Fitting surrogate: 760 points, 760 targets
2026-02-21T11:07:10.1601827Z [378s] Generation 12 starting: 27 neighbors, 2 active search path(s)
2026-02-21T11:07:15.7259991Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 7.0 configs/s
2026-02-21T11:07:17.3470914Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 27/27 17.1 configs/s
2026-02-21T11:07:22.9446193Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 178.8         
2026-02-21T11:07:22.9446753Z                                                                   configs/s     
2026-02-21T11:07:23.2242185Z [391s] Generation 12 complete: 
2026-02-21T11:07:23.2242598Z ok=29
2026-02-21T11:07:23.2243596Z min=0.1114
2026-02-21T11:07:23.2243868Z mid=0.1145
2026-02-21T11:07:23.2244651Z max=0.2659
2026-02-21T11:07:23.2244952Z best={'block_sizes': [1],
2026-02-21T11:07:23.2245604Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:07:23.2246644Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:07:23.2247410Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:07:23.2248051Z  'load_eviction_policies': ['', '', 'first', '', 'last', 'first', '', 'first'],
2026-02-21T11:07:23.2248668Z  'maxnreg': 128,
2026-02-21T11:07:23.2248991Z  'num_sm_multiplier': 32,
2026-02-21T11:07:23.2249354Z  'num_stages': 1,
2026-02-21T11:07:23.2249659Z  'num_warps': 8,
2026-02-21T11:07:23.2250138Z  'pid_type': 'persistent_blocked',
2026-02-21T11:07:23.2250596Z  'range_flattens': [None],
2026-02-21T11:07:23.2250880Z  'range_multi_buffers': [False],
2026-02-21T11:07:23.2251089Z  'range_num_stages': [3],
2026-02-21T11:07:23.2251296Z  'range_unroll_factors': [3],
2026-02-21T11:07:23.2251507Z  'range_warp_specializes': [],
2026-02-21T11:07:23.2251717Z  'reduction_loops': [4096]}
2026-02-21T11:07:23.2286896Z [391s] Fitting surrogate: 789 points, 789 targets
2026-02-21T11:07:23.6483810Z [391s] Generation 13 starting: 19 neighbors, 1 active search path(s)
2026-02-21T11:07:28.4833935Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.5 configs/s
2026-02-21T11:07:29.6639513Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.7 configs/s
2026-02-21T11:07:33.1548939Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 285.2         
2026-02-21T11:07:33.1549499Z                                                                   configs/s     
2026-02-21T11:07:33.3579168Z [401s] Generation 13 complete: 
2026-02-21T11:07:33.3579450Z ok=20
2026-02-21T11:07:33.3579624Z min=0.1145
2026-02-21T11:07:33.3579793Z mid=0.1186
2026-02-21T11:07:33.3579961Z max=0.4228
2026-02-21T11:07:33.3580157Z best={'block_sizes': [1],
2026-02-21T11:07:33.3580569Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:07:33.3581189Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:07:33.3581675Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:07:33.3582069Z  'load_eviction_policies': ['', '', 'first', '', '', 'first', '', 'first'],
2026-02-21T11:07:33.3582433Z  'maxnreg': 128,
2026-02-21T11:07:33.3582634Z  'num_sm_multiplier': 32,
2026-02-21T11:07:33.3582850Z  'num_stages': 1,
2026-02-21T11:07:33.3583054Z  'num_warps': 8,
2026-02-21T11:07:33.3583268Z  'pid_type': 'persistent_blocked',
2026-02-21T11:07:33.3583534Z  'range_flattens': [False],
2026-02-21T11:07:33.3583775Z  'range_multi_buffers': [False],
2026-02-21T11:07:33.3584395Z  'range_num_stages': [3],
2026-02-21T11:07:33.3584643Z  'range_unroll_factors': [3],
2026-02-21T11:07:33.3584901Z  'range_warp_specializes': [],
2026-02-21T11:07:33.3585157Z  'reduction_loops': [4096]}
2026-02-21T11:07:33.3623808Z [401s] Fitting surrogate: 809 points, 809 targets
2026-02-21T11:07:33.8022275Z [402s] Generation 14 starting: 20 neighbors, 1 active search path(s)
2026-02-21T11:07:40.3346995Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 2.8 configs/s
2026-02-21T11:07:41.6436459Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 16.6 configs/s
2026-02-21T11:07:45.2810351Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 273.5         
2026-02-21T11:07:45.2810891Z                                                                   configs/s     
2026-02-21T11:07:45.4868351Z [413s] Generation 14 complete: 
2026-02-21T11:07:45.4868639Z ok=22
2026-02-21T11:07:45.4868818Z min=0.1140
2026-02-21T11:07:45.4869032Z mid=0.1392
2026-02-21T11:07:45.4869205Z max=0.4753
2026-02-21T11:07:45.4869416Z best={'block_sizes': [1],
2026-02-21T11:07:45.4869823Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:07:45.4870957Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:07:45.4871439Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:07:45.4871830Z  'load_eviction_policies': ['', '', 'first', '', '', 'first', '', 'first'],
2026-02-21T11:07:45.4872203Z  'num_stages': 1,
2026-02-21T11:07:45.4872397Z  'num_warps': 32,
2026-02-21T11:07:45.4872599Z  'pid_type': 'flat',
2026-02-21T11:07:45.4872812Z  'range_flattens': [None],
2026-02-21T11:07:45.4873052Z  'range_multi_buffers': [None],
2026-02-21T11:07:45.4873294Z  'range_num_stages': [0],
2026-02-21T11:07:45.4873528Z  'range_unroll_factors': [0],
2026-02-21T11:07:45.4873792Z  'range_warp_specializes': [],
2026-02-21T11:07:45.4874519Z  'reduction_loops': [4096]}
2026-02-21T11:07:45.4915370Z [413s] Fitting surrogate: 831 points, 831 targets
2026-02-21T11:07:45.7734325Z [414s] Generation 15 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:07:47.8445811Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 13.6 configs/s
2026-02-21T11:07:48.4082245Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 19.5 configs/s
2026-02-21T11:07:50.4094760Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 492.7         
2026-02-21T11:07:50.4095241Z                                                                   configs/s     
2026-02-21T11:07:50.5480839Z [418s] Generation 15 complete: 
2026-02-21T11:07:50.5481287Z error=1
2026-02-21T11:07:50.5481589Z ok=10
2026-02-21T11:07:50.5481884Z min=0.1108
2026-02-21T11:07:50.5482163Z mid=0.1137
2026-02-21T11:07:50.5482440Z max=0.1410
2026-02-21T11:07:50.5482736Z best={'block_sizes': [1],
2026-02-21T11:07:50.5483433Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:07:50.5484989Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:07:50.5485796Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:07:50.5486448Z  'load_eviction_policies': ['', '', 'first', '', '', 'first', '', 'first'],
2026-02-21T11:07:50.5487051Z  'num_stages': 1,
2026-02-21T11:07:50.5487368Z  'num_warps': 32,
2026-02-21T11:07:50.5487679Z  'pid_type': 'flat',
2026-02-21T11:07:50.5488018Z  'range_flattens': [None],
2026-02-21T11:07:50.5488390Z  'range_multi_buffers': [None],
2026-02-21T11:07:50.5488778Z  'range_num_stages': [0],
2026-02-21T11:07:50.5489243Z  'range_unroll_factors': [0],
2026-02-21T11:07:50.5489752Z  'range_warp_specializes': [],
2026-02-21T11:07:50.5490070Z  'reduction_loops': [4096]}
2026-02-21T11:07:50.5527824Z [418s] Fitting surrogate: 842 points, 842 targets
2026-02-21T11:07:50.8278674Z [419s] Generation 16 starting: 8 neighbors, 1 active search path(s)
2026-02-21T11:07:53.0928284Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 3.6 configs/s
2026-02-21T11:07:53.5764762Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 18.4 configs/s
2026-02-21T11:07:55.5497575Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 499.5         
2026-02-21T11:07:55.5498114Z                                                                   configs/s     
2026-02-21T11:07:55.6875939Z [424s] Generation 16 complete: 
2026-02-21T11:07:55.6876402Z ok=10
2026-02-21T11:07:55.6876696Z min=0.1135
2026-02-21T11:07:55.6876973Z mid=0.1138
2026-02-21T11:07:55.6877245Z max=0.1177
2026-02-21T11:07:55.6877535Z best={'block_sizes': [1],
2026-02-21T11:07:55.6878245Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:07:55.6879265Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:07:55.6880035Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:07:55.6880708Z  'load_eviction_policies': ['', '', 'first', '', 'last', 'first', '', 'last'],
2026-02-21T11:07:55.6881311Z  'num_stages': 1,
2026-02-21T11:07:55.6881627Z  'num_warps': 32,
2026-02-21T11:07:55.6882779Z  'pid_type': 'flat',
2026-02-21T11:07:55.6883187Z  'range_flattens': [None],
2026-02-21T11:07:55.6883601Z  'range_multi_buffers': [None],
2026-02-21T11:07:55.6883856Z  'range_num_stages': [0],
2026-02-21T11:07:55.6884613Z  'range_unroll_factors': [0],
2026-02-21T11:07:55.6884847Z  'range_warp_specializes': [],
2026-02-21T11:07:55.6885082Z  'reduction_loops': [2048]}
2026-02-21T11:07:55.6921540Z [424s] Fitting surrogate: 852 points, 852 targets
2026-02-21T11:07:55.9790571Z [424s] Generation 17 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:07:57.9357722Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 15.6 configs/s
2026-02-21T11:07:58.5353332Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.1 configs/s
2026-02-21T11:08:00.8335992Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 429.4         
2026-02-21T11:08:00.8336829Z                                                                   configs/s     
2026-02-21T11:08:00.9835186Z [429s] Generation 17 complete: 
2026-02-21T11:08:00.9835644Z ok=11
2026-02-21T11:08:00.9835933Z min=0.1110
2026-02-21T11:08:00.9836220Z mid=0.1236
2026-02-21T11:08:00.9836502Z max=0.1439
2026-02-21T11:08:00.9836806Z best={'block_sizes': [1],
2026-02-21T11:08:00.9837491Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:08:00.9838480Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:08:00.9839277Z               'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:08:00.9839953Z  'load_eviction_policies': ['', '', 'first', '', 'last', 'first', '', 'last'],
2026-02-21T11:08:00.9840561Z  'num_stages': 1,
2026-02-21T11:08:00.9840878Z  'num_warps': 32,
2026-02-21T11:08:00.9841203Z  'pid_type': 'flat',
2026-02-21T11:08:00.9841549Z  'range_flattens': [None],
2026-02-21T11:08:00.9841936Z  'range_multi_buffers': [None],
2026-02-21T11:08:00.9842340Z  'range_num_stages': [0],
2026-02-21T11:08:00.9842712Z  'range_unroll_factors': [0],
2026-02-21T11:08:00.9843139Z  'range_warp_specializes': [],
2026-02-21T11:08:00.9843527Z  'reduction_loops': [4096]}
2026-02-21T11:08:00.9881191Z [429s] Fitting surrogate: 863 points, 863 targets
2026-02-21T11:08:01.2840810Z [429s] Generation 18 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:08:03.3640584Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 6.4 configs/s
2026-02-21T11:08:03.9585656Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.3 configs/s
2026-02-21T11:08:07.0186936Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 479.8         
2026-02-21T11:08:07.0187462Z                                                                   configs/s     
2026-02-21T11:08:07.1623308Z [435s] Generation 18 complete: 
2026-02-21T11:08:07.1623571Z ok=11
2026-02-21T11:08:07.1623742Z min=0.1112
2026-02-21T11:08:07.1623932Z mid=0.1160
2026-02-21T11:08:07.1624233Z max=0.1701
2026-02-21T11:08:07.1624420Z best={'block_sizes': [1],
2026-02-21T11:08:07.1624830Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:08:07.1625452Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:08:07.1625949Z               'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:08:07.1626361Z  'load_eviction_policies': ['', '', 'first', '', 'last', 'first', '', 'last'],
2026-02-21T11:08:07.1626750Z  'num_stages': 1,
2026-02-21T11:08:07.1626940Z  'num_warps': 32,
2026-02-21T11:08:07.1627131Z  'pid_type': 'flat',
2026-02-21T11:08:07.1627334Z  'range_flattens': [None],
2026-02-21T11:08:07.1627571Z  'range_multi_buffers': [None],
2026-02-21T11:08:07.1627814Z  'range_num_stages': [0],
2026-02-21T11:08:07.1628043Z  'range_unroll_factors': [0],
2026-02-21T11:08:07.1628280Z  'range_warp_specializes': [],
2026-02-21T11:08:07.1628521Z  'reduction_loops': [4096]}
2026-02-21T11:08:07.1662646Z [435s] Fitting surrogate: 874 points, 874 targets
2026-02-21T11:08:07.3241250Z [435s] Autotuning complete in 435.7s after searching 833 configs.
2026-02-21T11:08:07.3241685Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:08:07.3243741Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', '', 'first', '', 'last', 'first', '', 'last'], num_stages=1, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[4096]), static_shapes=True)
2026-02-21T11:08:07.3245979Z 
2026-02-21T11:08:07.3246803Z [435s] Code of selected kernel: /tmp/torchinductor_root/5q/c5qcgea3ebngpkbdetrxdlq3wvdwdxuaqzkqtcff3a7mpjdmzsqg.py
2026-02-21T11:08:07.3612504Z from __future__ import annotations
2026-02-21T11:08:07.3612735Z 
2026-02-21T11:08:07.3612818Z import torch
2026-02-21T11:08:07.3613025Z import triton
2026-02-21T11:08:07.3613235Z import triton.language as tl
2026-02-21T11:08:07.3613577Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:08:07.3614203Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:08:07.3614506Z 
2026-02-21T11:08:07.3614603Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:08:07.3614782Z 
2026-02-21T11:08:07.3614860Z @triton.jit
2026-02-21T11:08:07.3615280Z def _helion_layer_norm_fwd(x, mean, rstd, weight, bias, out, eps, _REDUCTION_BLOCK_1: tl.constexpr):
2026-02-21T11:08:07.3615823Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:08:07.3616160Z     pid_0 = tl.program_id(0)
2026-02-21T11:08:07.3616401Z     offset_0 = pid_0
2026-02-21T11:08:07.3616652Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:08:07.3617038Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:08:07.3617511Z     sum_1_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T11:08:07.3617962Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:08:07.3618366Z     for roffset_1 in tl.range(0, 9728, _REDUCTION_BLOCK_1):
2026-02-21T11:08:07.3618791Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:08:07.3619180Z         mask_1 = rindex_1 < 9728
2026-02-21T11:08:07.3619601Z         acc = tl.load(x + (indices_0[:, None] * 9728 + rindex_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:08:07.3620127Z         # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:08:07.3620482Z         v_0 = sum_1_acc + acc
2026-02-21T11:08:07.3620808Z         sum_1_acc = v_0
2026-02-21T11:08:07.3621126Z     sum_1 = tl.cast(tl.sum(sum_1_acc, 1), tl.float32)
2026-02-21T11:08:07.3621451Z     v_1 = 0.00010279605263157894
2026-02-21T11:08:07.3621673Z     v_2 = sum_1 * v_1
2026-02-21T11:08:07.3621948Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:08:07.3622289Z     subscript = v_2[:, None]
2026-02-21T11:08:07.3622641Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:08:07.3623135Z     sum_2_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T11:08:07.3623573Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:08:07.3623962Z     for roffset_1 in tl.range(0, 9728, _REDUCTION_BLOCK_1):
2026-02-21T11:08:07.3624528Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:08:07.3624904Z         mask_1 = rindex_1 < 9728
2026-02-21T11:08:07.3625142Z         subscript_copy = subscript
2026-02-21T11:08:07.3625569Z         acc_1 = tl.load(x + (indices_0[:, None] * 9728 + rindex_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:08:07.3626101Z         # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:08:07.3626455Z         v_3 = acc_1 - subscript_copy
2026-02-21T11:08:07.3627110Z         # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:08:07.3627496Z         v_4 = v_3 * v_3
2026-02-21T11:08:07.3627994Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _REDUCTION_BLOCK_1]), v_4, tl.full([], 0, tl.float32))
2026-02-21T11:08:07.3628546Z         v_5 = sum_2_acc + _mask_to_1
2026-02-21T11:08:07.3628790Z         sum_2_acc = v_5
2026-02-21T11:08:07.3629035Z     sum_2 = tl.cast(tl.sum(sum_2_acc, 1), tl.float32)
2026-02-21T11:08:07.3629333Z     v_6 = 0.00010279605263157894
2026-02-21T11:08:07.3629559Z     v_7 = sum_2 * v_6
2026-02-21T11:08:07.3629833Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:08:07.3630166Z     v_8 = v_7 + eps
2026-02-21T11:08:07.3630498Z     v_9 = libdevice.rsqrt(v_8)
2026-02-21T11:08:07.3630839Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:08:07.3631187Z     subscript_1 = v_9[:, None]
2026-02-21T11:08:07.3631457Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:08:07.3631769Z     tl.store(mean + indices_0 * 1, v_2, None)
2026-02-21T11:08:07.3632052Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:08:07.3632316Z     tl.store(rstd + indices_0 * 1, v_9, None)
2026-02-21T11:08:07.3632597Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:08:07.3632913Z     for roffset_1 in tl.range(0, 9728, _REDUCTION_BLOCK_1):
2026-02-21T11:08:07.3633249Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:08:07.3633554Z         mask_1 = rindex_1 < 9728
2026-02-21T11:08:07.3633746Z         v_2_copy = v_2
2026-02-21T11:08:07.3633927Z         subscript_1_copy = subscript_1
2026-02-21T11:08:07.3634528Z         acc_2 = tl.load(x + (indices_0[:, None] * 9728 + rindex_1[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_first')
2026-02-21T11:08:07.3635025Z         # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:08:07.3635326Z         subscript_2 = v_2_copy[:, None]
2026-02-21T11:08:07.3635541Z         v_10 = acc_2 - subscript_2
2026-02-21T11:08:07.3635817Z         # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:08:07.3636120Z         v_11 = v_10 * subscript_1_copy
2026-02-21T11:08:07.3636419Z         # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:08:07.3636787Z         load_1 = tl.load(weight + rindex_1 * 1, mask_1, other=0)
2026-02-21T11:08:07.3637046Z         v_12 = load_1[None, :]
2026-02-21T11:08:07.3637237Z         v_13 = v_11 * v_12
2026-02-21T11:08:07.3637449Z         # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:08:07.3637820Z         load_2 = tl.load(bias + rindex_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T11:08:07.3638248Z         # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:08:07.3638610Z         # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:08:07.3638875Z         # src[layer_norm.py:75]: )
2026-02-21T11:08:07.3639069Z         v_14 = load_2[None, :]
2026-02-21T11:08:07.3639249Z         v_15 = v_13 + v_14
2026-02-21T11:08:07.3639473Z         # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:08:07.3639860Z         tl.store(out + (indices_0[:, None] * 9728 + rindex_1[None, :] * 1), v_15, mask_1[None, :])
2026-02-21T11:08:07.3640141Z 
2026-02-21T11:08:07.3640592Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:08:07.3641176Z     """
2026-02-21T11:08:07.3641420Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:08:07.3641714Z     Args:
2026-02-21T11:08:07.3641977Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:08:07.3642494Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:08:07.3643174Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:08:07.3643588Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:08:07.3644209Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:08:07.3644594Z     Returns:
2026-02-21T11:08:07.3644788Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:08:07.3645159Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:08:07.3645539Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:08:07.3646025Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:08:07.3646347Z     """
2026-02-21T11:08:07.3646510Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:08:07.3646752Z     m, n = x.size()
2026-02-21T11:08:07.3647079Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:08:07.3647557Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:08:07.3647893Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:08:07.3648268Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:08:07.3648628Z     if bias is not None:
2026-02-21T11:08:07.3648939Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:08:07.3649375Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:08:07.3649733Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:08:07.3650209Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:08:07.3650546Z     # src[layer_norm.py:52]: )
2026-02-21T11:08:07.3650893Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:08:07.3651327Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:08:07.3651705Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:08:07.3652046Z     # src[layer_norm.py:55]: )
2026-02-21T11:08:07.3652376Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:08:07.3652843Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:08:07.3653220Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:08:07.3653598Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:08:07.3654134Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:08:07.3654519Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:08:07.3654948Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:08:07.3655286Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:08:07.3655566Z     _REDUCTION_BLOCK_1 = 4096
2026-02-21T11:08:07.3655796Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:08:07.3656100Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:08:07.3656405Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:08:07.3656639Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:08:07.3657095Z     _launcher(_helion_layer_norm_fwd, (4096,), x, mean, rstd, weight, bias, out, eps, _REDUCTION_BLOCK_1, num_warps=32, num_stages=1)
2026-02-21T11:08:07.3657595Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:08:07.3657851Z     return (out, mean, rstd)
2026-02-21T11:08:08.6386170Z WARNING:tritonbench.utils.triton_op:Completed input ID 17:
2026-02-21T11:08:08.6386954Z (M, N)
2026-02-21T11:08:08.6387130Z ------------
2026-02-21T11:08:08.6387315Z (4096, 9728)
2026-02-21T11:08:08.6387427Z 
2026-02-21T11:08:08.6397969Z  60%|██████    | 12/20 [1:07:05<50:39, 379.95s/it]WARNING:tritonbench.utils.triton_op:Running input ID 18:
2026-02-21T11:08:08.6398410Z (M, N)
2026-02-21T11:08:08.6398561Z -------------
2026-02-21T11:08:08.6398730Z (4096, 10240)
2026-02-21T11:08:08.6400180Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T11:08:09.9595078Z INFO:tritonbench.utils.triton_op:Took 2.95ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:08:12.4091749Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:08:13.8508435Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:08:13.8508796Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:08:13.8509082Z               'dtype': 'torch.float32',
2026-02-21T11:08:13.8509359Z               'shape': (4096, 10240),
2026-02-21T11:08:13.8509651Z               'stride': (10240, 1)},
2026-02-21T11:08:13.8509899Z             (10240,),
2026-02-21T11:08:13.8510105Z             { 'device': 'cuda:0',
2026-02-21T11:08:13.8510356Z               'dtype': 'torch.float32',
2026-02-21T11:08:13.8510611Z               'shape': (10240,),
2026-02-21T11:08:13.8510860Z               'stride': (1,)},
2026-02-21T11:08:13.8511101Z             { 'device': 'cuda:0',
2026-02-21T11:08:13.8511344Z               'dtype': 'torch.float32',
2026-02-21T11:08:13.8511620Z               'shape': (10240,),
2026-02-21T11:08:13.8511848Z               'stride': (1,)},
2026-02-21T11:08:13.8512069Z             1e-05),
2026-02-21T11:08:13.8512257Z   'kwargs': {}}
2026-02-21T11:08:13.8537936Z INFO:tritonbench.utils.triton_op:Took 3.40ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:08:13.8617967Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:08:13.8618876Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:08:13.8619489Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:08:13.8619830Z While processing:
2026-02-21T11:08:13.8620250Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:08:13.8620665Z     if bias is not None:
2026-02-21T11:08:13.8620896Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:08:13.8621025Z 
2026-02-21T11:08:14.0244380Z [0s] Autotune random seed: 2141537047
2026-02-21T11:08:14.0708412Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:08:49.4885032Z [35s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:08:50.3492436Z [36s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:08:52.7241911Z [38s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:08:58.7308818Z [44s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:09:01.0022672Z [46s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:09:01.0040659Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:09:07.8703249Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.6 configs/s
2026-02-21T11:09:07.8717939Z [53s] Adaptive compile timeout: 30s (90% percentile=18.9s, bounds=[30.0s, 30s])
2026-02-21T11:09:09.5896881Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 566.5 configs/s
2026-02-21T11:09:09.7152680Z [55s] Initial random population of 100, 5 starting points: 
2026-02-21T11:09:09.7153249Z error=8
2026-02-21T11:09:09.7153681Z timeout=5
2026-02-21T11:09:09.7154295Z ok=87
2026-02-21T11:09:09.7154709Z min=0.1351
2026-02-21T11:09:09.7155065Z mid=0.4878
2026-02-21T11:09:09.7155451Z max=41.1010
2026-02-21T11:09:09.7155781Z best={'block_sizes': [1],
2026-02-21T11:09:09.7156502Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:09:09.7157578Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:09:09.7158518Z  'load_eviction_policies': ['last', 'first', 'first', 'last', 'first', 'last', '', ''],
2026-02-21T11:09:09.7159212Z  'num_sm_multiplier': 16,
2026-02-21T11:09:09.7159571Z  'num_stages': 8,
2026-02-21T11:09:09.7159876Z  'num_warps': 8,
2026-02-21T11:09:09.7160233Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:09:09.7160682Z  'range_flattens': [False],
2026-02-21T11:09:09.7161070Z  'range_multi_buffers': [None],
2026-02-21T11:09:09.7161455Z  'range_num_stages': [2],
2026-02-21T11:09:09.7161823Z  'range_unroll_factors': [2],
2026-02-21T11:09:09.7162219Z  'range_warp_specializes': [],
2026-02-21T11:09:09.7162605Z  'reduction_loops': [2048]}
2026-02-21T11:09:09.7175629Z [55s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:09:11.1932669Z [57s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T11:09:38.9909725Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 0.8 configs/s
2026-02-21T11:09:44.7816371Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.4 configs/s
2026-02-21T11:10:01.4698824Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 60.2 configs/s
2026-02-21T11:10:02.1671529Z [108s] Generation 1 complete: 
2026-02-21T11:10:02.1672036Z error=1
2026-02-21T11:10:02.1672334Z ok=95
2026-02-21T11:10:02.1673153Z min=0.1193
2026-02-21T11:10:02.1673447Z mid=0.1568
2026-02-21T11:10:02.1673709Z max=2.2336
2026-02-21T11:10:02.1674340Z best={'block_sizes': [1],
2026-02-21T11:10:02.1675069Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:10:02.1676238Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:10:02.1676907Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', ''],
2026-02-21T11:10:02.1677434Z  'num_stages': 1,
2026-02-21T11:10:02.1677749Z  'num_warps': 4,
2026-02-21T11:10:02.1678050Z  'pid_type': 'flat',
2026-02-21T11:10:02.1678395Z  'range_flattens': [None],
2026-02-21T11:10:02.1678761Z  'range_multi_buffers': [None],
2026-02-21T11:10:02.1679149Z  'range_num_stages': [0],
2026-02-21T11:10:02.1680005Z  'range_unroll_factors': [0],
2026-02-21T11:10:02.1680449Z  'range_warp_specializes': [],
2026-02-21T11:10:02.1680881Z  'reduction_loops': [None]}
2026-02-21T11:10:02.1711574Z [108s] Fitting surrogate: 196 points, 196 targets
2026-02-21T11:10:03.2572787Z [109s] Generation 2 starting: 67 neighbors, 5 active search path(s)
2026-02-21T11:10:16.0999677Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 5.9 configs/s
2026-02-21T11:10:21.3022780Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 13.7 configs/s
2026-02-21T11:10:35.1221520Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 72.7 configs/s
2026-02-21T11:10:35.7515689Z [141s] Generation 2 complete: 
2026-02-21T11:10:35.7515997Z error=3
2026-02-21T11:10:35.7516173Z ok=69
2026-02-21T11:10:35.7516351Z min=0.1159
2026-02-21T11:10:35.7516521Z mid=0.1388
2026-02-21T11:10:35.7516698Z max=0.2420
2026-02-21T11:10:35.7516889Z best={'block_sizes': [1],
2026-02-21T11:10:35.7517337Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:10:35.7517884Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:10:35.7518306Z  'load_eviction_policies': ['', '', '', '', 'last', '', 'last', ''],
2026-02-21T11:10:35.7518676Z  'num_stages': 1,
2026-02-21T11:10:35.7518874Z  'num_warps': 16,
2026-02-21T11:10:35.7519081Z  'pid_type': 'flat',
2026-02-21T11:10:35.7519295Z  'range_flattens': [None],
2026-02-21T11:10:35.7519534Z  'range_multi_buffers': [None],
2026-02-21T11:10:35.7519791Z  'range_num_stages': [0],
2026-02-21T11:10:35.7520031Z  'range_unroll_factors': [0],
2026-02-21T11:10:35.7520290Z  'range_warp_specializes': [],
2026-02-21T11:10:35.7520550Z  'reduction_loops': [None]}
2026-02-21T11:10:35.7542293Z [141s] Fitting surrogate: 268 points, 268 targets
2026-02-21T11:10:36.6670458Z [142s] Generation 3 starting: 54 neighbors, 5 active search path(s)
2026-02-21T11:10:47.6937341Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 4.3 configs/s
2026-02-21T11:10:51.0461603Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 17.2 configs/s
2026-02-21T11:11:01.3679500Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 97.2 configs/s
2026-02-21T11:11:01.8298999Z [167s] Generation 3 complete: 
2026-02-21T11:11:01.8299320Z error=2
2026-02-21T11:11:01.8299503Z ok=58
2026-02-21T11:11:01.8299669Z min=0.1165
2026-02-21T11:11:01.8299862Z mid=0.1336
2026-02-21T11:11:01.8300032Z max=0.7586
2026-02-21T11:11:01.8300222Z best={'block_sizes': [1],
2026-02-21T11:11:01.8300631Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:11:01.8301153Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:11:01.8301605Z  'load_eviction_policies': ['', '', '', '', 'last', '', 'last', ''],
2026-02-21T11:11:01.8301953Z  'num_stages': 1,
2026-02-21T11:11:01.8302157Z  'num_warps': 16,
2026-02-21T11:11:01.8302391Z  'pid_type': 'flat',
2026-02-21T11:11:01.8303334Z  'range_flattens': [None],
2026-02-21T11:11:01.8303574Z  'range_multi_buffers': [None],
2026-02-21T11:11:01.8303818Z  'range_num_stages': [0],
2026-02-21T11:11:01.8304555Z  'range_unroll_factors': [0],
2026-02-21T11:11:01.8304821Z  'range_warp_specializes': [],
2026-02-21T11:11:01.8305075Z  'reduction_loops': [None]}
2026-02-21T11:11:01.8328611Z [167s] Fitting surrogate: 328 points, 328 targets
2026-02-21T11:11:02.7317026Z [168s] Generation 4 starting: 54 neighbors, 5 active search path(s)
2026-02-21T11:11:12.6713217Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 9.1 configs/s
2026-02-21T11:11:15.7415230Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 18.2 configs/s
2026-02-21T11:11:27.3803370Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 86.3 configs/s
2026-02-21T11:11:27.9257362Z [193s] Generation 4 complete: 
2026-02-21T11:11:27.9257685Z error=4
2026-02-21T11:11:27.9257862Z ok=56
2026-02-21T11:11:27.9258036Z min=0.1164
2026-02-21T11:11:27.9258211Z mid=0.1235
2026-02-21T11:11:27.9258433Z max=0.2265
2026-02-21T11:11:27.9258616Z best={'block_sizes': [1],
2026-02-21T11:11:27.9259073Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:11:27.9259650Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:11:27.9260075Z  'load_eviction_policies': ['', '', '', '', 'last', '', 'last', ''],
2026-02-21T11:11:27.9267090Z  'num_stages': 1,
2026-02-21T11:11:27.9267345Z  'num_warps': 16,
2026-02-21T11:11:27.9267560Z  'pid_type': 'flat',
2026-02-21T11:11:27.9267780Z  'range_flattens': [None],
2026-02-21T11:11:27.9268018Z  'range_multi_buffers': [None],
2026-02-21T11:11:27.9268266Z  'range_num_stages': [0],
2026-02-21T11:11:27.9268489Z  'range_unroll_factors': [0],
2026-02-21T11:11:27.9268736Z  'range_warp_specializes': [],
2026-02-21T11:11:27.9268972Z  'reduction_loops': [None]}
2026-02-21T11:11:27.9293932Z [193s] Fitting surrogate: 388 points, 388 targets
2026-02-21T11:11:28.8356855Z [194s] Generation 5 starting: 51 neighbors, 5 active search path(s)
2026-02-21T11:11:39.4269729Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 9.1 configs/s
2026-02-21T11:11:42.4241291Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 17.3 configs/s
2026-02-21T11:11:52.4675920Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 100.0         
2026-02-21T11:11:52.4676473Z                                                                   configs/s     
2026-02-21T11:11:52.9467574Z [218s] Generation 5 complete: 
2026-02-21T11:11:52.9467861Z error=1
2026-02-21T11:11:52.9468050Z ok=55
2026-02-21T11:11:52.9468260Z min=0.1165
2026-02-21T11:11:52.9468476Z mid=0.1240
2026-02-21T11:11:52.9468678Z max=0.7249
2026-02-21T11:11:52.9468906Z best={'block_sizes': [1],
2026-02-21T11:11:52.9469417Z  'indexing': ['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:11:52.9470021Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:11:52.9470472Z  'load_eviction_policies': ['', '', '', '', 'last', '', 'last', ''],
2026-02-21T11:11:52.9470833Z  'num_stages': 1,
2026-02-21T11:11:52.9471038Z  'num_warps': 16,
2026-02-21T11:11:52.9471875Z  'pid_type': 'flat',
2026-02-21T11:11:52.9472102Z  'range_flattens': [None],
2026-02-21T11:11:52.9472339Z  'range_multi_buffers': [None],
2026-02-21T11:11:52.9472616Z  'range_num_stages': [0],
2026-02-21T11:11:52.9472851Z  'range_unroll_factors': [0],
2026-02-21T11:11:52.9473106Z  'range_warp_specializes': [],
2026-02-21T11:11:52.9473357Z  'reduction_loops': [None]}
2026-02-21T11:11:52.9505856Z [218s] Fitting surrogate: 444 points, 444 targets
2026-02-21T11:11:53.7931490Z [219s] Generation 6 starting: 46 neighbors, 5 active search path(s)
2026-02-21T11:12:03.0619557Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 5.0 configs/s
2026-02-21T11:12:05.6882220Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 18.6 configs/s
2026-02-21T11:12:14.9632994Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.3         
2026-02-21T11:12:14.9633562Z                                                                   configs/s     
2026-02-21T11:12:15.3879954Z [241s] Generation 6 complete: 
2026-02-21T11:12:15.3880293Z error=4
2026-02-21T11:12:15.3880483Z ok=47
2026-02-21T11:12:15.3880685Z min=0.1159
2026-02-21T11:12:15.3880861Z mid=0.1284
2026-02-21T11:12:15.3881033Z max=0.4951
2026-02-21T11:12:15.3881216Z best={'block_sizes': [1],
2026-02-21T11:12:15.3881718Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:12:15.3882360Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:12:15.3882792Z               'tensor_descriptor'],
2026-02-21T11:12:15.3883205Z  'load_eviction_policies': ['', 'last', '', 'first', 'first', '', 'first', 'first'],
2026-02-21T11:12:15.3883630Z  'num_stages': 8,
2026-02-21T11:12:15.3883858Z  'num_warps': 16,
2026-02-21T11:12:15.3884491Z  'pid_type': 'flat',
2026-02-21T11:12:15.3884701Z  'range_flattens': [None],
2026-02-21T11:12:15.3884908Z  'range_multi_buffers': [None],
2026-02-21T11:12:15.3885146Z  'range_num_stages': [0],
2026-02-21T11:12:15.3885357Z  'range_unroll_factors': [0],
2026-02-21T11:12:15.3885574Z  'range_warp_specializes': [],
2026-02-21T11:12:15.3885788Z  'reduction_loops': [None]}
2026-02-21T11:12:15.3913938Z [241s] Fitting surrogate: 495 points, 495 targets
2026-02-21T11:12:16.0389604Z [241s] Generation 7 starting: 36 neighbors, 4 active search path(s)
2026-02-21T11:12:22.7480583Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 14.0 configs/s
2026-02-21T11:12:24.7555072Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 18.9 configs/s
2026-02-21T11:12:32.1560691Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 135.5         
2026-02-21T11:12:32.1561226Z                                                                   configs/s     
2026-02-21T11:12:32.5252337Z [258s] Generation 7 complete: 
2026-02-21T11:12:32.5252587Z error=3
2026-02-21T11:12:32.5252738Z ok=37
2026-02-21T11:12:32.5252886Z min=0.1160
2026-02-21T11:12:32.5253034Z mid=0.1181
2026-02-21T11:12:32.5253208Z max=0.1935
2026-02-21T11:12:32.5253363Z best={'block_sizes': [1],
2026-02-21T11:12:32.5253723Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:12:32.5254582Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:12:32.5254952Z               'tensor_descriptor'],
2026-02-21T11:12:32.5255285Z  'load_eviction_policies': ['', 'last', '', 'first', 'first', '', 'first', 'first'],
2026-02-21T11:12:32.5255653Z  'num_stages': 8,
2026-02-21T11:12:32.5255852Z  'num_warps': 16,
2026-02-21T11:12:32.5256040Z  'pid_type': 'flat',
2026-02-21T11:12:32.5256251Z  'range_flattens': [None],
2026-02-21T11:12:32.5256482Z  'range_multi_buffers': [None],
2026-02-21T11:12:32.5256723Z  'range_num_stages': [0],
2026-02-21T11:12:32.5256957Z  'range_unroll_factors': [0],
2026-02-21T11:12:32.5257206Z  'range_warp_specializes': [],
2026-02-21T11:12:32.5257465Z  'reduction_loops': [None]}
2026-02-21T11:12:32.5287580Z [258s] Fitting surrogate: 535 points, 535 targets
2026-02-21T11:12:33.0492745Z [258s] Generation 8 starting: 28 neighbors, 3 active search path(s)
2026-02-21T11:12:37.9804510Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 27.1 configs/s
2026-02-21T11:12:39.5712653Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 28/28 18.1 configs/s
2026-02-21T11:12:45.9092090Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 158.0         
2026-02-21T11:12:45.9092622Z                                                                   configs/s     
2026-02-21T11:12:46.2162583Z [272s] Generation 8 complete: 
2026-02-21T11:12:46.2162887Z error=1
2026-02-21T11:12:46.2163069Z ok=30
2026-02-21T11:12:46.2163247Z min=0.1166
2026-02-21T11:12:46.2163423Z mid=0.1188
2026-02-21T11:12:46.2164767Z max=0.1705
2026-02-21T11:12:46.2164997Z best={'block_sizes': [1],
2026-02-21T11:12:46.2165422Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:12:46.2166039Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:12:46.2166457Z               'tensor_descriptor'],
2026-02-21T11:12:46.2166848Z  'load_eviction_policies': ['', 'last', '', 'first', 'first', '', 'first', 'first'],
2026-02-21T11:12:46.2167238Z  'num_stages': 8,
2026-02-21T11:12:46.2167458Z  'num_warps': 16,
2026-02-21T11:12:46.2167656Z  'pid_type': 'flat',
2026-02-21T11:12:46.2167875Z  'range_flattens': [None],
2026-02-21T11:12:46.2168117Z  'range_multi_buffers': [None],
2026-02-21T11:12:46.2168364Z  'range_num_stages': [0],
2026-02-21T11:12:46.2168615Z  'range_unroll_factors': [0],
2026-02-21T11:12:46.2168861Z  'range_warp_specializes': [],
2026-02-21T11:12:46.2169111Z  'reduction_loops': [None]}
2026-02-21T11:12:46.2198263Z [272s] Fitting surrogate: 566 points, 566 targets
2026-02-21T11:12:46.6165661Z [272s] Generation 9 starting: 19 neighbors, 2 active search path(s)
2026-02-21T11:12:50.4778529Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 6.3 configs/s
2026-02-21T11:12:51.5471661Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 20/20 19.7 configs/s
2026-02-21T11:12:56.6307204Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 251.4         
2026-02-21T11:12:56.6307723Z                                                                   configs/s     
2026-02-21T11:12:56.8430247Z [282s] Generation 9 complete: 
2026-02-21T11:12:56.8430520Z error=2
2026-02-21T11:12:56.8430688Z ok=20
2026-02-21T11:12:56.8430863Z min=0.1163
2026-02-21T11:12:56.8431032Z mid=0.1192
2026-02-21T11:12:56.8431208Z max=0.2074
2026-02-21T11:12:56.8431395Z best={'block_sizes': [1],
2026-02-21T11:12:56.8431788Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:12:56.8432394Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:12:56.8432814Z               'tensor_descriptor'],
2026-02-21T11:12:56.8433224Z  'load_eviction_policies': ['', 'last', '', 'first', 'first', '', 'first', 'first'],
2026-02-21T11:12:56.8433610Z  'num_stages': 8,
2026-02-21T11:12:56.8433806Z  'num_warps': 16,
2026-02-21T11:12:56.8434199Z  'pid_type': 'flat',
2026-02-21T11:12:56.8434411Z  'range_flattens': [None],
2026-02-21T11:12:56.8434627Z  'range_multi_buffers': [None],
2026-02-21T11:12:56.8434850Z  'range_num_stages': [0],
2026-02-21T11:12:56.8435072Z  'range_unroll_factors': [0],
2026-02-21T11:12:56.8435293Z  'range_warp_specializes': [],
2026-02-21T11:12:56.8435522Z  'reduction_loops': [None]}
2026-02-21T11:12:56.8461102Z [282s] Fitting surrogate: 588 points, 588 targets
2026-02-21T11:12:57.0026534Z [282s] Autotuning complete in 282.9s after searching 556 configs.
2026-02-21T11:12:57.0026991Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:12:57.0029055Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', 'first', 'first', '', 'first', 'first'], num_stages=8, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T11:12:57.0031539Z 
2026-02-21T11:12:57.0031948Z [282s] Code of selected kernel: /tmp/torchinductor_root/gv/cgvx7afjmlvqnzpvwuoj7udmc7i4nnszmyvvyi4xdciicelrcwn4.py
2026-02-21T11:12:57.0306850Z from __future__ import annotations
2026-02-21T11:12:57.0307041Z 
2026-02-21T11:12:57.0307127Z import torch
2026-02-21T11:12:57.0307306Z import triton
2026-02-21T11:12:57.0307502Z import triton.language as tl
2026-02-21T11:12:57.0308127Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:12:57.0308578Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:12:57.0308857Z 
2026-02-21T11:12:57.0308954Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:12:57.0309126Z 
2026-02-21T11:12:57.0309209Z @triton.jit
2026-02-21T11:12:57.0309581Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T11:12:57.0310087Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:12:57.0310402Z     pid_0 = tl.program_id(0)
2026-02-21T11:12:57.0310623Z     offset_0 = pid_0
2026-02-21T11:12:57.0310863Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:12:57.0311196Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T11:12:57.0311506Z     mask_1 = indices_1 < 10240
2026-02-21T11:12:57.0311857Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:12:57.0312456Z     acc = tl.load(x + (indices_0[:, None] * 10240 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:12:57.0312993Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:12:57.0313368Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T11:12:57.0313650Z     v_0 = 9.765625e-05
2026-02-21T11:12:57.0313856Z     v_1 = sum_1 * v_0
2026-02-21T11:12:57.0314537Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:12:57.0314850Z     subscript = v_1[:, None]
2026-02-21T11:12:57.0315059Z     v_2 = acc - subscript
2026-02-21T11:12:57.0315375Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:12:57.0315728Z     v_3 = v_2 * v_2
2026-02-21T11:12:57.0316145Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T11:12:57.0316679Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:12:57.0316946Z     v_4 = 9.765625e-05
2026-02-21T11:12:57.0317135Z     v_5 = sum_2 * v_4
2026-02-21T11:12:57.0317394Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:12:57.0317704Z     v_6 = v_5 + eps
2026-02-21T11:12:57.0317883Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T11:12:57.0318190Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:12:57.0318524Z     subscript_1 = v_7[:, None]
2026-02-21T11:12:57.0318737Z     v_8 = v_2 * subscript_1
2026-02-21T11:12:57.0319063Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:12:57.0319587Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T11:12:57.0319988Z     v_9 = load_1[None, :]
2026-02-21T11:12:57.0320182Z     v_10 = v_8 * v_9
2026-02-21T11:12:57.0320412Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:12:57.0320741Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T11:12:57.0321140Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:12:57.0321549Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:12:57.0321838Z     # src[layer_norm.py:75]: )
2026-02-21T11:12:57.0322233Z     v_11 = load_2[None, :]
2026-02-21T11:12:57.0322425Z     v_12 = v_10 + v_11
2026-02-21T11:12:57.0322669Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:12:57.0323115Z     tl.store(out + (indices_0[:, None] * 10240 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T11:12:57.0323546Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:12:57.0323804Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T11:12:57.0324178Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:12:57.0324433Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T11:12:57.0324591Z 
2026-02-21T11:12:57.0325166Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:12:57.0325764Z     """
2026-02-21T11:12:57.0325999Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:12:57.0326287Z     Args:
2026-02-21T11:12:57.0326557Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:12:57.0327069Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:12:57.0327553Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:12:57.0327957Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:12:57.0328453Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:12:57.0328832Z     Returns:
2026-02-21T11:12:57.0329026Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:12:57.0329399Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:12:57.0329768Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:12:57.0330207Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:12:57.0330524Z     """
2026-02-21T11:12:57.0330688Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:12:57.0330904Z     m, n = x.size()
2026-02-21T11:12:57.0331223Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:12:57.0331698Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:12:57.0332033Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:12:57.0332412Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:12:57.0332766Z     if bias is not None:
2026-02-21T11:12:57.0333097Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:12:57.0333538Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:12:57.0333919Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:12:57.0334458Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:12:57.0334800Z     # src[layer_norm.py:52]: )
2026-02-21T11:12:57.0335144Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:12:57.0335564Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:12:57.0335968Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:12:57.0336306Z     # src[layer_norm.py:55]: )
2026-02-21T11:12:57.0336632Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:12:57.0337101Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:12:57.0337484Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:12:57.0337869Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:12:57.0338425Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:12:57.0338819Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:12:57.0339219Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:12:57.0339522Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:12:57.0339772Z     _RDIM_SIZE_1 = 16384
2026-02-21T11:12:57.0339980Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:12:57.0340290Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:12:57.0340599Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:12:57.0340831Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:12:57.0341390Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=8)
2026-02-21T11:12:57.0341863Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:12:57.0342113Z     return (out, mean, rstd)
2026-02-21T11:12:58.2715740Z WARNING:tritonbench.utils.triton_op:Completed input ID 18:
2026-02-21T11:12:58.2716118Z (M, N)
2026-02-21T11:12:58.2716294Z -------------
2026-02-21T11:12:58.2716490Z (4096, 10240)
2026-02-21T11:12:58.2716610Z 
2026-02-21T11:12:58.2733267Z  65%|██████▌   | 13/20 [1:11:55<41:08, 352.59s/it]WARNING:tritonbench.utils.triton_op:Running input ID 20:
2026-02-21T11:12:58.2733706Z (M, N)
2026-02-21T11:12:58.2733876Z -------------
2026-02-21T11:12:58.2734205Z (4096, 11264)
2026-02-21T11:12:58.2735858Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T11:12:59.5727242Z INFO:tritonbench.utils.triton_op:Took 3.03ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:13:01.1940126Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:13:02.6190526Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:13:02.6190815Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:13:02.6191101Z               'dtype': 'torch.float32',
2026-02-21T11:13:02.6191349Z               'shape': (4096, 11264),
2026-02-21T11:13:02.6191591Z               'stride': (11264, 1)},
2026-02-21T11:13:02.6191809Z             (11264,),
2026-02-21T11:13:02.6192002Z             { 'device': 'cuda:0',
2026-02-21T11:13:02.6192233Z               'dtype': 'torch.float32',
2026-02-21T11:13:02.6192464Z               'shape': (11264,),
2026-02-21T11:13:02.6192683Z               'stride': (1,)},
2026-02-21T11:13:02.6192891Z             { 'device': 'cuda:0',
2026-02-21T11:13:02.6193127Z               'dtype': 'torch.float32',
2026-02-21T11:13:02.6193356Z               'shape': (11264,),
2026-02-21T11:13:02.6193570Z               'stride': (1,)},
2026-02-21T11:13:02.6193774Z             1e-05),
2026-02-21T11:13:02.6193948Z   'kwargs': {}}
2026-02-21T11:13:02.6217690Z INFO:tritonbench.utils.triton_op:Took 3.13ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:13:02.6301304Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:13:02.6302189Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:13:02.6302794Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:13:02.6303161Z While processing:
2026-02-21T11:13:02.6303591Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:13:02.6304123Z     if bias is not None:
2026-02-21T11:13:02.6304342Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:13:02.6304480Z 
2026-02-21T11:13:02.7893514Z [0s] Autotune random seed: 2141537047
2026-02-21T11:13:02.8353911Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:13:38.2993206Z [35s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:13:39.2346868Z [36s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:13:41.8069811Z [38s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:13:48.1741761Z [45s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:13:50.5953717Z [47s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:13:50.5976064Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:13:57.6957087Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.2 configs/s
2026-02-21T11:13:57.6970099Z [54s] Adaptive compile timeout: 30s (90% percentile=14.6s, bounds=[30.0s, 30s])
2026-02-21T11:13:59.5366974Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 528.6 configs/s
2026-02-21T11:13:59.6670515Z [56s] Initial random population of 100, 5 starting points: 
2026-02-21T11:13:59.6670875Z error=7
2026-02-21T11:13:59.6671071Z timeout=5
2026-02-21T11:13:59.6671246Z ok=88
2026-02-21T11:13:59.6671416Z min=0.1522
2026-02-21T11:13:59.6671589Z mid=0.5348
2026-02-21T11:13:59.6671765Z max=45.3129
2026-02-21T11:13:59.6671954Z best={'block_sizes': [1],
2026-02-21T11:13:59.6672364Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:13:59.6673609Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:13:59.6674559Z  'load_eviction_policies': ['last', 'first', 'first', 'last', 'first', 'last', '', ''],
2026-02-21T11:13:59.6675018Z  'num_sm_multiplier': 16,
2026-02-21T11:13:59.6675273Z  'num_stages': 8,
2026-02-21T11:13:59.6675478Z  'num_warps': 8,
2026-02-21T11:13:59.6675710Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:13:59.6675989Z  'range_flattens': [False],
2026-02-21T11:13:59.6676256Z  'range_multi_buffers': [None],
2026-02-21T11:13:59.6676533Z  'range_num_stages': [2],
2026-02-21T11:13:59.6676799Z  'range_unroll_factors': [2],
2026-02-21T11:13:59.6677079Z  'range_warp_specializes': [],
2026-02-21T11:13:59.6677332Z  'reduction_loops': [2048]}
2026-02-21T11:13:59.6693023Z [56s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:14:01.1435196Z [58s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T11:14:26.9043792Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 0.6 configs/s
2026-02-21T11:14:32.7467691Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.4 configs/s
2026-02-21T11:14:47.0416522Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.2 configs/s
2026-02-21T11:14:47.6271975Z [104s] Generation 1 complete: 
2026-02-21T11:14:47.6272460Z error=2
2026-02-21T11:14:47.6272750Z ok=94
2026-02-21T11:14:47.6273021Z min=0.1373
2026-02-21T11:14:47.6273291Z mid=0.1879
2026-02-21T11:14:47.6273555Z max=2.2464
2026-02-21T11:14:47.6273838Z best={'block_sizes': [1],
2026-02-21T11:14:47.6274820Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:14:47.6275859Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:14:47.6276614Z               'pointer'],
2026-02-21T11:14:47.6277182Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:14:47.6277820Z  'maxnreg': 128,
2026-02-21T11:14:47.6278142Z  'num_sm_multiplier': 8,
2026-02-21T11:14:47.6278522Z  'num_stages': 3,
2026-02-21T11:14:47.6278828Z  'num_warps': 8,
2026-02-21T11:14:47.6279160Z  'pid_type': 'persistent_blocked',
2026-02-21T11:14:47.6279582Z  'range_flattens': [None],
2026-02-21T11:14:47.6280007Z  'range_multi_buffers': [None],
2026-02-21T11:14:47.6280453Z  'range_num_stages': [1],
2026-02-21T11:14:47.6280854Z  'range_unroll_factors': [2],
2026-02-21T11:14:47.6281125Z  'range_warp_specializes': [],
2026-02-21T11:14:47.6281341Z  'reduction_loops': [8192]}
2026-02-21T11:14:47.6297081Z [104s] Fitting surrogate: 196 points, 196 targets
2026-02-21T11:14:49.0701533Z [106s] Generation 2 starting: 89 neighbors, 5 active search path(s)
2026-02-21T11:15:06.6813127Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 8.5 configs/s
2026-02-21T11:15:13.2576545Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 14.4 configs/s
2026-02-21T11:15:31.2632459Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 55.8 configs/s
2026-02-21T11:15:31.9665428Z [149s] Generation 2 complete: 
2026-02-21T11:15:31.9665722Z error=6
2026-02-21T11:15:31.9665894Z ok=89
2026-02-21T11:15:31.9666059Z min=0.1284
2026-02-21T11:15:31.9666228Z mid=0.1564
2026-02-21T11:15:31.9666980Z max=1.3502
2026-02-21T11:15:31.9667157Z best={'block_sizes': [1],
2026-02-21T11:15:31.9667557Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:15:31.9668089Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:15:31.9668500Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:15:31.9668833Z  'num_stages': 1,
2026-02-21T11:15:31.9669017Z  'num_warps': 16,
2026-02-21T11:15:31.9669217Z  'pid_type': 'flat',
2026-02-21T11:15:31.9669428Z  'range_flattens': [None],
2026-02-21T11:15:31.9669661Z  'range_multi_buffers': [None],
2026-02-21T11:15:31.9669908Z  'range_num_stages': [0],
2026-02-21T11:15:31.9670141Z  'range_unroll_factors': [0],
2026-02-21T11:15:31.9670725Z  'range_warp_specializes': [],
2026-02-21T11:15:31.9670982Z  'reduction_loops': [None]}
2026-02-21T11:15:31.9692814Z [149s] Fitting surrogate: 291 points, 291 targets
2026-02-21T11:15:33.0590534Z [150s] Generation 3 starting: 65 neighbors, 5 active search path(s)
2026-02-21T11:15:45.8542210Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 9.2 configs/s
2026-02-21T11:15:49.7897150Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 17.2 configs/s
2026-02-21T11:16:04.0066955Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.7 configs/s
2026-02-21T11:16:04.6256952Z [181s] Generation 3 complete: 
2026-02-21T11:16:04.6257193Z error=3
2026-02-21T11:16:04.6257368Z ok=67
2026-02-21T11:16:04.6257522Z min=0.1272
2026-02-21T11:16:04.6257687Z mid=0.1398
2026-02-21T11:16:04.6257841Z max=0.8913
2026-02-21T11:16:04.6258017Z best={'block_sizes': [1],
2026-02-21T11:16:04.6258383Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:16:04.6258905Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:16:04.6259297Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:16:04.6259625Z  'num_stages': 1,
2026-02-21T11:16:04.6259806Z  'num_warps': 16,
2026-02-21T11:16:04.6259981Z  'pid_type': 'flat',
2026-02-21T11:16:04.6260192Z  'range_flattens': [None],
2026-02-21T11:16:04.6260402Z  'range_multi_buffers': [None],
2026-02-21T11:16:04.6260623Z  'range_num_stages': [0],
2026-02-21T11:16:04.6260834Z  'range_unroll_factors': [0],
2026-02-21T11:16:04.6261058Z  'range_warp_specializes': [],
2026-02-21T11:16:04.6261298Z  'reduction_loops': [None]}
2026-02-21T11:16:04.6292121Z [181s] Fitting surrogate: 361 points, 361 targets
2026-02-21T11:16:05.6244325Z [182s] Generation 4 starting: 58 neighbors, 5 active search path(s)
2026-02-21T11:16:16.7009993Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 11.5 configs/s
2026-02-21T11:16:20.1159734Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 17.5 configs/s
2026-02-21T11:16:33.5991592Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 81.5 configs/s
2026-02-21T11:16:34.1433936Z [211s] Generation 4 complete: 
2026-02-21T11:16:34.1434763Z error=3
2026-02-21T11:16:34.1435044Z ok=60
2026-02-21T11:16:34.1435308Z min=0.1272
2026-02-21T11:16:34.1435614Z mid=0.1421
2026-02-21T11:16:34.1435880Z max=0.4704
2026-02-21T11:16:34.1436178Z best={'block_sizes': [1],
2026-02-21T11:16:34.1436820Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:16:34.1437641Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:16:34.1438320Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:16:34.1438855Z  'num_stages': 1,
2026-02-21T11:16:34.1439173Z  'num_warps': 16,
2026-02-21T11:16:34.1439477Z  'pid_type': 'flat',
2026-02-21T11:16:34.1439817Z  'range_flattens': [None],
2026-02-21T11:16:34.1440184Z  'range_multi_buffers': [None],
2026-02-21T11:16:34.1440615Z  'range_num_stages': [0],
2026-02-21T11:16:34.1440985Z  'range_unroll_factors': [0],
2026-02-21T11:16:34.1441382Z  'range_warp_specializes': [],
2026-02-21T11:16:34.1442357Z  'reduction_loops': [None]}
2026-02-21T11:16:34.1462613Z [211s] Fitting surrogate: 424 points, 424 targets
2026-02-21T11:16:35.1399712Z [212s] Generation 5 starting: 59 neighbors, 4 active search path(s)
2026-02-21T11:17:12.0330380Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 0.2 configs/s
2026-02-21T11:17:15.4631996Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 17.4 configs/s
2026-02-21T11:17:25.7077995Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.0 configs/s
2026-02-21T11:17:26.1754523Z [263s] Generation 5 complete: 
2026-02-21T11:17:26.1754955Z error=3
2026-02-21T11:17:26.1755238Z ok=61
2026-02-21T11:17:26.1755514Z min=0.1272
2026-02-21T11:17:26.1755790Z mid=0.1388
2026-02-21T11:17:26.1756068Z max=1.7790
2026-02-21T11:17:26.1757030Z best={'block_sizes': [1],
2026-02-21T11:17:26.1757732Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:17:26.1758579Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:17:26.1759289Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:17:26.1759829Z  'num_stages': 1,
2026-02-21T11:17:26.1760163Z  'num_warps': 16,
2026-02-21T11:17:26.1760540Z  'pid_type': 'flat',
2026-02-21T11:17:26.1760940Z  'range_flattens': [None],
2026-02-21T11:17:26.1761191Z  'range_multi_buffers': [None],
2026-02-21T11:17:26.1761433Z  'range_num_stages': [0],
2026-02-21T11:17:26.1761656Z  'range_unroll_factors': [0],
2026-02-21T11:17:26.1761900Z  'range_warp_specializes': [],
2026-02-21T11:17:26.1762137Z  'reduction_loops': [None]}
2026-02-21T11:17:26.1790427Z [263s] Fitting surrogate: 488 points, 488 targets
2026-02-21T11:17:27.0596299Z [264s] Generation 6 starting: 50 neighbors, 3 active search path(s)
2026-02-21T11:17:37.6573744Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 6.1 configs/s
2026-02-21T11:17:40.5503150Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 17.6 configs/s
2026-02-21T11:17:49.8606589Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 107.8         
2026-02-21T11:17:49.8607131Z                                                                   configs/s     
2026-02-21T11:17:50.2909266Z [287s] Generation 6 complete: 
2026-02-21T11:17:50.2909554Z error=3
2026-02-21T11:17:50.2909732Z ok=51
2026-02-21T11:17:50.2909907Z min=0.1288
2026-02-21T11:17:50.2910083Z mid=0.1432
2026-02-21T11:17:50.2910253Z max=0.7951
2026-02-21T11:17:50.2910433Z best={'block_sizes': [1],
2026-02-21T11:17:50.2910848Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:17:50.2911364Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:17:50.2911825Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:17:50.2912173Z  'num_stages': 1,
2026-02-21T11:17:50.2912367Z  'num_warps': 16,
2026-02-21T11:17:50.2912565Z  'pid_type': 'flat',
2026-02-21T11:17:50.2912777Z  'range_flattens': [None],
2026-02-21T11:17:50.2913028Z  'range_multi_buffers': [None],
2026-02-21T11:17:50.2913269Z  'range_num_stages': [0],
2026-02-21T11:17:50.2913505Z  'range_unroll_factors': [0],
2026-02-21T11:17:50.2913749Z  'range_warp_specializes': [],
2026-02-21T11:17:50.2914360Z  'reduction_loops': [None]}
2026-02-21T11:17:50.2947242Z [287s] Fitting surrogate: 542 points, 542 targets
2026-02-21T11:17:51.1259302Z [288s] Generation 7 starting: 46 neighbors, 3 active search path(s)
2026-02-21T11:18:00.3876472Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 11.1 configs/s
2026-02-21T11:18:03.0233626Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 18.2 configs/s
2026-02-21T11:18:12.8271496Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.4         
2026-02-21T11:18:12.8274581Z                                                                   configs/s     
2026-02-21T11:18:13.2841512Z [310s] Generation 7 complete: 
2026-02-21T11:18:13.2841953Z error=4
2026-02-21T11:18:13.2842797Z ok=46
2026-02-21T11:18:13.2843107Z min=0.1278
2026-02-21T11:18:13.2843403Z mid=0.1320
2026-02-21T11:18:13.2843664Z max=0.3231
2026-02-21T11:18:13.2843962Z best={'block_sizes': [1],
2026-02-21T11:18:13.2844919Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:18:13.2845770Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:18:13.2846437Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:18:13.2846979Z  'num_stages': 1,
2026-02-21T11:18:13.2847294Z  'num_warps': 16,
2026-02-21T11:18:13.2847597Z  'pid_type': 'flat',
2026-02-21T11:18:13.2847968Z  'range_flattens': [None],
2026-02-21T11:18:13.2848341Z  'range_multi_buffers': [None],
2026-02-21T11:18:13.2849216Z  'range_num_stages': [0],
2026-02-21T11:18:13.2849624Z  'range_unroll_factors': [0],
2026-02-21T11:18:13.2850206Z  'range_warp_specializes': [],
2026-02-21T11:18:13.2850630Z  'reduction_loops': [None]}
2026-02-21T11:18:13.2887888Z [310s] Fitting surrogate: 592 points, 592 targets
2026-02-21T11:18:13.9788896Z [311s] Generation 8 starting: 37 neighbors, 3 active search path(s)
2026-02-21T11:18:21.1848056Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 22.0 configs/s
2026-02-21T11:18:23.3172129Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 17.2 configs/s
2026-02-21T11:18:32.7030405Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 122.3         
2026-02-21T11:18:32.7030919Z                                                                   configs/s     
2026-02-21T11:18:33.0976748Z [330s] Generation 8 complete: 
2026-02-21T11:18:33.0977242Z error=2
2026-02-21T11:18:33.0977569Z ok=39
2026-02-21T11:18:33.0977815Z min=0.1276
2026-02-21T11:18:33.0977986Z mid=0.1303
2026-02-21T11:18:33.0978186Z max=0.3588
2026-02-21T11:18:33.0978375Z best={'block_sizes': [1],
2026-02-21T11:18:33.0978814Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:18:33.0979477Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:18:33.0980031Z  'load_eviction_policies': ['', '', '', 'last', 'first', '', 'last', ''],
2026-02-21T11:18:33.0980395Z  'num_stages': 7,
2026-02-21T11:18:33.0980580Z  'num_warps': 16,
2026-02-21T11:18:33.0980774Z  'pid_type': 'flat',
2026-02-21T11:18:33.0980978Z  'range_flattens': [None],
2026-02-21T11:18:33.0981216Z  'range_multi_buffers': [None],
2026-02-21T11:18:33.0981452Z  'range_num_stages': [0],
2026-02-21T11:18:33.0981682Z  'range_unroll_factors': [0],
2026-02-21T11:18:33.0981927Z  'range_warp_specializes': [],
2026-02-21T11:18:33.0982170Z  'reduction_loops': [None]}
2026-02-21T11:18:33.1010880Z [330s] Fitting surrogate: 633 points, 633 targets
2026-02-21T11:18:33.6781872Z [330s] Generation 9 starting: 27 neighbors, 2 active search path(s)
2026-02-21T11:18:38.9773268Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 12.3 configs/s
2026-02-21T11:18:40.6144898Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 27/27 16.9 configs/s
2026-02-21T11:18:46.5921592Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 167.3         
2026-02-21T11:18:46.5922118Z                                                                   configs/s     
2026-02-21T11:18:46.8979124Z [344s] Generation 9 complete: 
2026-02-21T11:18:46.8979393Z ok=29
2026-02-21T11:18:46.8979561Z min=0.1273
2026-02-21T11:18:46.8979738Z mid=0.1301
2026-02-21T11:18:46.8979911Z max=0.2566
2026-02-21T11:18:46.8980106Z best={'block_sizes': [1],
2026-02-21T11:18:46.8980536Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:18:46.8981725Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:18:46.8982317Z  'load_eviction_policies': ['', '', '', 'last', 'first', 'last', 'last', ''],
2026-02-21T11:18:46.8982716Z  'num_stages': 8,
2026-02-21T11:18:46.8982926Z  'num_warps': 16,
2026-02-21T11:18:46.8983112Z  'pid_type': 'flat',
2026-02-21T11:18:46.8983322Z  'range_flattens': [None],
2026-02-21T11:18:46.8983548Z  'range_multi_buffers': [None],
2026-02-21T11:18:46.8983791Z  'range_num_stages': [0],
2026-02-21T11:18:46.8984343Z  'range_unroll_factors': [0],
2026-02-21T11:18:46.8984603Z  'range_warp_specializes': [],
2026-02-21T11:18:46.8984841Z  'reduction_loops': [None]}
2026-02-21T11:18:46.9023650Z [344s] Fitting surrogate: 662 points, 662 targets
2026-02-21T11:18:47.1857168Z [344s] Generation 10 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:18:49.2573148Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 3.2 configs/s
2026-02-21T11:18:49.7941437Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.4 configs/s
2026-02-21T11:18:51.9618717Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 454.4         
2026-02-21T11:18:51.9619217Z                                                                   configs/s     
2026-02-21T11:18:52.1049570Z [349s] Generation 10 complete: 
2026-02-21T11:18:52.1050150Z ok=10
2026-02-21T11:18:52.1050444Z min=0.1304
2026-02-21T11:18:52.1050726Z mid=0.1312
2026-02-21T11:18:52.1051007Z max=0.1507
2026-02-21T11:18:52.1051310Z best={'block_sizes': [1],
2026-02-21T11:18:52.1052045Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:18:52.1053078Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:18:52.1053794Z               'tensor_descriptor'],
2026-02-21T11:18:52.1054948Z  'load_eviction_policies': ['', '', '', 'last', 'first', 'last', 'last', ''],
2026-02-21T11:18:52.1055565Z  'num_stages': 8,
2026-02-21T11:18:52.1055877Z  'num_warps': 16,
2026-02-21T11:18:52.1056237Z  'pid_type': 'flat',
2026-02-21T11:18:52.1056578Z  'range_flattens': [None],
2026-02-21T11:18:52.1056950Z  'range_multi_buffers': [None],
2026-02-21T11:18:52.1057329Z  'range_num_stages': [0],
2026-02-21T11:18:52.1057701Z  'range_unroll_factors': [0],
2026-02-21T11:18:52.1058084Z  'range_warp_specializes': [],
2026-02-21T11:18:52.1058493Z  'reduction_loops': [None]}
2026-02-21T11:18:52.1096423Z [349s] Fitting surrogate: 672 points, 672 targets
2026-02-21T11:18:52.3921994Z [349s] Generation 11 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:18:54.6452107Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 6.4 configs/s
2026-02-21T11:18:55.1440919Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 22.7 configs/s
2026-02-21T11:18:57.0755519Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 508.8         
2026-02-21T11:18:57.0756033Z                                                                   configs/s     
2026-02-21T11:18:57.2066436Z [354s] Generation 11 complete: 
2026-02-21T11:18:57.2066910Z error=2
2026-02-21T11:18:57.2067181Z ok=9
2026-02-21T11:18:57.2067437Z min=0.1276
2026-02-21T11:18:57.2067719Z mid=0.1304
2026-02-21T11:18:57.2068567Z max=0.1400
2026-02-21T11:18:57.2068876Z best={'block_sizes': [1],
2026-02-21T11:18:57.2069582Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:18:57.2070570Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:18:57.2071253Z               'tensor_descriptor'],
2026-02-21T11:18:57.2071879Z  'load_eviction_policies': ['', '', '', 'last', 'first', 'last', 'last', ''],
2026-02-21T11:18:57.2072497Z  'num_stages': 8,
2026-02-21T11:18:57.2072815Z  'num_warps': 16,
2026-02-21T11:18:57.2073148Z  'pid_type': 'flat',
2026-02-21T11:18:57.2073513Z  'range_flattens': [None],
2026-02-21T11:18:57.2073937Z  'range_multi_buffers': [None],
2026-02-21T11:18:57.2074453Z  'range_num_stages': [0],
2026-02-21T11:18:57.2075006Z  'range_unroll_factors': [0],
2026-02-21T11:18:57.2075242Z  'range_warp_specializes': [],
2026-02-21T11:18:57.2075473Z  'reduction_loops': [None]}
2026-02-21T11:18:57.2113373Z [354s] Fitting surrogate: 683 points, 683 targets
2026-02-21T11:18:57.4962070Z [354s] Generation 12 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:18:59.3241694Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 12.3 configs/s
2026-02-21T11:18:59.7940199Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 19.1 configs/s
2026-02-21T11:19:01.9378181Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 459.4         
2026-02-21T11:19:01.9378686Z                                                                   configs/s     
2026-02-21T11:19:02.0812572Z [359s] Generation 12 complete: 
2026-02-21T11:19:02.0813055Z error=1
2026-02-21T11:19:02.0813342Z ok=10
2026-02-21T11:19:02.0813606Z min=0.1303
2026-02-21T11:19:02.0813888Z mid=0.1307
2026-02-21T11:19:02.0814719Z max=0.1326
2026-02-21T11:19:02.0815028Z best={'block_sizes': [1],
2026-02-21T11:19:02.0815737Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:19:02.0816758Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:02.0817516Z               'tensor_descriptor'],
2026-02-21T11:19:02.0818114Z  'load_eviction_policies': ['', '', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:02.0818482Z  'num_stages': 8,
2026-02-21T11:19:02.0818685Z  'num_warps': 16,
2026-02-21T11:19:02.0818876Z  'pid_type': 'flat',
2026-02-21T11:19:02.0819091Z  'range_flattens': [None],
2026-02-21T11:19:02.0819325Z  'range_multi_buffers': [None],
2026-02-21T11:19:02.0819563Z  'range_num_stages': [0],
2026-02-21T11:19:02.0819796Z  'range_unroll_factors': [0],
2026-02-21T11:19:02.0820047Z  'range_warp_specializes': [],
2026-02-21T11:19:02.0820295Z  'reduction_loops': [None]}
2026-02-21T11:19:02.0850837Z [359s] Fitting surrogate: 694 points, 694 targets
2026-02-21T11:19:02.3699758Z [359s] Generation 13 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:19:05.0627074Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 4.0 configs/s
2026-02-21T11:19:05.5458509Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 21.0 configs/s
2026-02-21T11:19:07.4906036Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 505.1         
2026-02-21T11:19:07.4906551Z                                                                   configs/s     
2026-02-21T11:19:07.6256360Z [364s] Generation 13 complete: 
2026-02-21T11:19:07.6256816Z error=2
2026-02-21T11:19:07.6257110Z ok=9
2026-02-21T11:19:07.6257380Z min=0.1281
2026-02-21T11:19:07.6257644Z mid=0.1346
2026-02-21T11:19:07.6257920Z max=0.1406
2026-02-21T11:19:07.6258203Z best={'block_sizes': [1],
2026-02-21T11:19:07.6258909Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:19:07.6259829Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:07.6260415Z               'tensor_descriptor'],
2026-02-21T11:19:07.6261115Z  'load_eviction_policies': ['', '', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:07.6262034Z  'num_stages': 8,
2026-02-21T11:19:07.6262235Z  'num_warps': 16,
2026-02-21T11:19:07.6262425Z  'pid_type': 'flat',
2026-02-21T11:19:07.6262651Z  'range_flattens': [None],
2026-02-21T11:19:07.6262884Z  'range_multi_buffers': [None],
2026-02-21T11:19:07.6263133Z  'range_num_stages': [0],
2026-02-21T11:19:07.6263357Z  'range_unroll_factors': [0],
2026-02-21T11:19:07.6263608Z  'range_warp_specializes': [],
2026-02-21T11:19:07.6263855Z  'reduction_loops': [None]}
2026-02-21T11:19:07.6293684Z [364s] Fitting surrogate: 705 points, 705 targets
2026-02-21T11:19:07.9114326Z [365s] Generation 14 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:19:09.9665507Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 3.1 configs/s
2026-02-21T11:19:10.5005423Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.5 configs/s
2026-02-21T11:19:12.8749646Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 415.8         
2026-02-21T11:19:12.8751147Z                                                                   configs/s     
2026-02-21T11:19:13.0284655Z [370s] Generation 14 complete: 
2026-02-21T11:19:13.0285068Z ok=11
2026-02-21T11:19:13.0285348Z min=0.1304
2026-02-21T11:19:13.0285568Z mid=0.1318
2026-02-21T11:19:13.0285737Z max=0.1397
2026-02-21T11:19:13.0285928Z best={'block_sizes': [1],
2026-02-21T11:19:13.0286374Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:19:13.0287000Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:13.0287388Z               'tensor_descriptor'],
2026-02-21T11:19:13.0287748Z  'load_eviction_policies': ['', '', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:13.0288135Z  'num_stages': 7,
2026-02-21T11:19:13.0288333Z  'num_warps': 16,
2026-02-21T11:19:13.0288534Z  'pid_type': 'flat',
2026-02-21T11:19:13.0288746Z  'range_flattens': [None],
2026-02-21T11:19:13.0289017Z  'range_multi_buffers': [None],
2026-02-21T11:19:13.0289279Z  'range_num_stages': [0],
2026-02-21T11:19:13.0289522Z  'range_unroll_factors': [0],
2026-02-21T11:19:13.0289850Z  'range_warp_specializes': [],
2026-02-21T11:19:13.0290102Z  'reduction_loops': [None]}
2026-02-21T11:19:13.0321507Z [370s] Fitting surrogate: 716 points, 716 targets
2026-02-21T11:19:13.3074803Z [370s] Generation 15 starting: 7 neighbors, 1 active search path(s)
2026-02-21T11:19:15.1653807Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 7.0 configs/s
2026-02-21T11:19:15.5824265Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 22.3 configs/s
2026-02-21T11:19:17.3189796Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 563.3         
2026-02-21T11:19:17.3190437Z                                                                   configs/s     
2026-02-21T11:19:17.4458701Z [374s] Generation 15 complete: 
2026-02-21T11:19:17.4458966Z error=1
2026-02-21T11:19:17.4459154Z ok=8
2026-02-21T11:19:17.4459323Z min=0.1302
2026-02-21T11:19:17.4459503Z mid=0.1323
2026-02-21T11:19:17.4459679Z max=0.1479
2026-02-21T11:19:17.4459857Z best={'block_sizes': [1],
2026-02-21T11:19:17.4460302Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:19:17.4460894Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:17.4461270Z               'tensor_descriptor'],
2026-02-21T11:19:17.4461646Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:17.4462026Z  'num_stages': 8,
2026-02-21T11:19:17.4462218Z  'num_warps': 16,
2026-02-21T11:19:17.4462406Z  'pid_type': 'flat',
2026-02-21T11:19:17.4462620Z  'range_flattens': [None],
2026-02-21T11:19:17.4462852Z  'range_multi_buffers': [None],
2026-02-21T11:19:17.4463096Z  'range_num_stages': [0],
2026-02-21T11:19:17.4463322Z  'range_unroll_factors': [0],
2026-02-21T11:19:17.4463561Z  'range_warp_specializes': [],
2026-02-21T11:19:17.4464880Z  'reduction_loops': [None]}
2026-02-21T11:19:17.4497411Z [374s] Fitting surrogate: 725 points, 725 targets
2026-02-21T11:19:17.7281611Z [374s] Generation 16 starting: 8 neighbors, 1 active search path(s)
2026-02-21T11:19:19.7885682Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 6.5 configs/s
2026-02-21T11:19:20.3352858Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.0 configs/s
2026-02-21T11:19:22.4874533Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 457.4         
2026-02-21T11:19:22.4875172Z                                                                   configs/s     
2026-02-21T11:19:22.6322023Z [379s] Generation 16 complete: 
2026-02-21T11:19:22.6322325Z ok=10
2026-02-21T11:19:22.6322514Z min=0.1276
2026-02-21T11:19:22.6323239Z mid=0.1292
2026-02-21T11:19:22.6323433Z max=0.1458
2026-02-21T11:19:22.6323631Z best={'block_sizes': [1],
2026-02-21T11:19:22.6324230Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:19:22.6324907Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:22.6325380Z               'tensor_descriptor'],
2026-02-21T11:19:22.6325773Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:22.6326168Z  'num_stages': 8,
2026-02-21T11:19:22.6326362Z  'num_warps': 8,
2026-02-21T11:19:22.6326571Z  'pid_type': 'flat',
2026-02-21T11:19:22.6326784Z  'range_flattens': [None],
2026-02-21T11:19:22.6327025Z  'range_multi_buffers': [None],
2026-02-21T11:19:22.6327266Z  'range_num_stages': [0],
2026-02-21T11:19:22.6327501Z  'range_unroll_factors': [0],
2026-02-21T11:19:22.6327753Z  'range_warp_specializes': [],
2026-02-21T11:19:22.6328011Z  'reduction_loops': [None]}
2026-02-21T11:19:22.6360806Z [379s] Fitting surrogate: 735 points, 735 targets
2026-02-21T11:19:22.9131174Z [380s] Generation 17 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:19:24.6956134Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 12.8 configs/s
2026-02-21T11:19:25.2184416Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 19.0 configs/s
2026-02-21T11:19:27.3602787Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 459.8         
2026-02-21T11:19:27.3603304Z                                                                   configs/s     
2026-02-21T11:19:27.5039409Z [384s] Generation 17 complete: 
2026-02-21T11:19:27.5039704Z ok=10
2026-02-21T11:19:27.5039889Z min=0.1303
2026-02-21T11:19:27.5040069Z mid=0.1315
2026-02-21T11:19:27.5040247Z max=0.1318
2026-02-21T11:19:27.5040432Z best={'block_sizes': [1],
2026-02-21T11:19:27.5040915Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:19:27.5041512Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:27.5041920Z               'tensor_descriptor'],
2026-02-21T11:19:27.5042893Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:27.5043293Z  'num_stages': 8,
2026-02-21T11:19:27.5043497Z  'num_warps': 16,
2026-02-21T11:19:27.5043693Z  'pid_type': 'flat',
2026-02-21T11:19:27.5043918Z  'range_flattens': [None],
2026-02-21T11:19:27.5044497Z  'range_multi_buffers': [None],
2026-02-21T11:19:27.5044803Z  'range_num_stages': [0],
2026-02-21T11:19:27.5045077Z  'range_unroll_factors': [0],
2026-02-21T11:19:27.5045322Z  'range_warp_specializes': [],
2026-02-21T11:19:27.5045560Z  'reduction_loops': [None]}
2026-02-21T11:19:27.5079028Z [384s] Fitting surrogate: 745 points, 745 targets
2026-02-21T11:19:27.7817448Z [384s] Generation 18 starting: 8 neighbors, 1 active search path(s)
2026-02-21T11:19:30.0671799Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 3.6 configs/s
2026-02-21T11:19:30.5530797Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 20.9 configs/s
2026-02-21T11:19:32.4797710Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 509.5         
2026-02-21T11:19:32.4798815Z                                                                   configs/s     
2026-02-21T11:19:32.6138950Z [389s] Generation 18 complete: 
2026-02-21T11:19:32.6139214Z error=1
2026-02-21T11:19:32.6139387Z ok=9
2026-02-21T11:19:32.6139542Z min=0.1272
2026-02-21T11:19:32.6139723Z mid=0.1301
2026-02-21T11:19:32.6139887Z max=0.1405
2026-02-21T11:19:32.6140069Z best={'block_sizes': [1],
2026-02-21T11:19:32.6140504Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:19:32.6141101Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:32.6141512Z               'tensor_descriptor'],
2026-02-21T11:19:32.6141908Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:32.6142296Z  'num_stages': 8,
2026-02-21T11:19:32.6142485Z  'num_warps': 16,
2026-02-21T11:19:32.6142678Z  'pid_type': 'flat',
2026-02-21T11:19:32.6142903Z  'range_flattens': [None],
2026-02-21T11:19:32.6143139Z  'range_multi_buffers': [None],
2026-02-21T11:19:32.6143395Z  'range_num_stages': [0],
2026-02-21T11:19:32.6143631Z  'range_unroll_factors': [0],
2026-02-21T11:19:32.6143884Z  'range_warp_specializes': [],
2026-02-21T11:19:32.6144488Z  'reduction_loops': [None]}
2026-02-21T11:19:32.6182285Z [389s] Fitting surrogate: 755 points, 755 targets
2026-02-21T11:19:32.9015311Z [390s] Generation 19 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:19:34.9392487Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 3.1 configs/s
2026-02-21T11:19:35.4665663Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.8 configs/s
2026-02-21T11:19:37.8388624Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 416.2         
2026-02-21T11:19:37.8389131Z                                                                   configs/s     
2026-02-21T11:19:37.9913497Z [395s] Generation 19 complete: 
2026-02-21T11:19:37.9913963Z ok=11
2026-02-21T11:19:37.9914465Z min=0.1303
2026-02-21T11:19:37.9914744Z mid=0.1316
2026-02-21T11:19:37.9915004Z max=0.1406
2026-02-21T11:19:37.9915331Z best={'block_sizes': [1],
2026-02-21T11:19:37.9916030Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:19:37.9916960Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:19:37.9917568Z               'tensor_descriptor'],
2026-02-21T11:19:37.9918170Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:37.9918780Z  'num_stages': 8,
2026-02-21T11:19:37.9919084Z  'num_warps': 16,
2026-02-21T11:19:37.9919395Z  'pid_type': 'flat',
2026-02-21T11:19:37.9919761Z  'range_flattens': [None],
2026-02-21T11:19:37.9920148Z  'range_multi_buffers': [None],
2026-02-21T11:19:37.9920539Z  'range_num_stages': [0],
2026-02-21T11:19:37.9920907Z  'range_unroll_factors': [0],
2026-02-21T11:19:37.9922078Z  'range_warp_specializes': [],
2026-02-21T11:19:37.9922528Z  'reduction_loops': [None]}
2026-02-21T11:19:37.9950618Z [395s] Fitting surrogate: 766 points, 766 targets
2026-02-21T11:19:38.2818408Z [395s] Generation 20 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:19:40.5078496Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 3.1 configs/s
2026-02-21T11:19:41.0892818Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.8 configs/s
2026-02-21T11:19:43.5048781Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 408.3         
2026-02-21T11:19:43.5049258Z                                                                   configs/s     
2026-02-21T11:19:43.6592383Z [400s] Generation 20 complete: 
2026-02-21T11:19:43.6592908Z ok=11
2026-02-21T11:19:43.6593893Z min=0.1304
2026-02-21T11:19:43.6594736Z mid=0.1319
2026-02-21T11:19:43.6595028Z max=0.1739
2026-02-21T11:19:43.6595334Z best={'block_sizes': [1],
2026-02-21T11:19:43.6596110Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:19:43.6597162Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:19:43.6597666Z  'load_eviction_policies': ['', 'last', '', 'last', 'last', 'last', 'last', ''],
2026-02-21T11:19:43.6598027Z  'num_stages': 8,
2026-02-21T11:19:43.6598205Z  'num_warps': 16,
2026-02-21T11:19:43.6598402Z  'pid_type': 'flat',
2026-02-21T11:19:43.6598594Z  'range_flattens': [None],
2026-02-21T11:19:43.6598814Z  'range_multi_buffers': [None],
2026-02-21T11:19:43.6599034Z  'range_num_stages': [0],
2026-02-21T11:19:43.6599251Z  'range_unroll_factors': [0],
2026-02-21T11:19:43.6599477Z  'range_warp_specializes': [],
2026-02-21T11:19:43.6599705Z  'reduction_loops': [None]}
2026-02-21T11:19:43.6633026Z [400s] Fitting surrogate: 777 points, 777 targets
2026-02-21T11:19:43.8276802Z [400s] Autotuning complete in 401.0s after searching 731 configs.
2026-02-21T11:19:43.8277291Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:19:43.8279281Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', 'last', 'last', 'last', 'last', ''], num_stages=8, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T11:19:43.8281147Z 
2026-02-21T11:19:43.8281561Z [400s] Code of selected kernel: /tmp/torchinductor_root/5g/c5gurmd36fsgxei6ksjblaz5fc36mhtwm3ene4jps2olk7evv3g2.py
2026-02-21T11:19:43.8558400Z from __future__ import annotations
2026-02-21T11:19:43.8558591Z 
2026-02-21T11:19:43.8558664Z import torch
2026-02-21T11:19:43.8558828Z import triton
2026-02-21T11:19:43.8559014Z import triton.language as tl
2026-02-21T11:19:43.8559309Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:19:43.8559721Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:19:43.8559972Z 
2026-02-21T11:19:43.8560057Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:19:43.8560199Z 
2026-02-21T11:19:43.8560262Z @triton.jit
2026-02-21T11:19:43.8560579Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T11:19:43.8561042Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:19:43.8561305Z     pid_0 = tl.program_id(0)
2026-02-21T11:19:43.8561506Z     offset_0 = pid_0
2026-02-21T11:19:43.8561711Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:19:43.8562013Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T11:19:43.8562280Z     mask_1 = indices_1 < 11264
2026-02-21T11:19:43.8562553Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:19:43.8563020Z     acc = tl.load(x + (indices_0[:, None] * 11264 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:19:43.8563839Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:19:43.8564373Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T11:19:43.8564622Z     v_0 = 8.87784090909091e-05
2026-02-21T11:19:43.8564820Z     v_1 = sum_1 * v_0
2026-02-21T11:19:43.8565072Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:19:43.8565392Z     subscript = v_1[:, None]
2026-02-21T11:19:43.8565601Z     v_2 = acc - subscript
2026-02-21T11:19:43.8565904Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:19:43.8566264Z     v_3 = v_2 * v_2
2026-02-21T11:19:43.8566966Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T11:19:43.8567506Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:19:43.8567779Z     v_4 = 8.87784090909091e-05
2026-02-21T11:19:43.8567989Z     v_5 = sum_2 * v_4
2026-02-21T11:19:43.8568247Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:19:43.8568561Z     v_6 = v_5 + eps
2026-02-21T11:19:43.8568748Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T11:19:43.8569044Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:19:43.8569385Z     subscript_1 = v_7[:, None]
2026-02-21T11:19:43.8569602Z     v_8 = v_2 * subscript_1
2026-02-21T11:19:43.8570024Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:19:43.8570531Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T11:19:43.8570933Z     v_9 = load_1[None, :]
2026-02-21T11:19:43.8571132Z     v_10 = v_8 * v_9
2026-02-21T11:19:43.8571358Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:19:43.8571689Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T11:19:43.8572082Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:19:43.8572490Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:19:43.8572777Z     # src[layer_norm.py:75]: )
2026-02-21T11:19:43.8572994Z     v_11 = load_2[None, :]
2026-02-21T11:19:43.8573185Z     v_12 = v_10 + v_11
2026-02-21T11:19:43.8573432Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:19:43.8573874Z     tl.store(out + (indices_0[:, None] * 11264 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T11:19:43.8574469Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:19:43.8574768Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T11:19:43.8575049Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:19:43.8575345Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T11:19:43.8575524Z 
2026-02-21T11:19:43.8576046Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:19:43.8576710Z     """
2026-02-21T11:19:43.8576941Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:19:43.8577228Z     Args:
2026-02-21T11:19:43.8577502Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:19:43.8578024Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:19:43.8578508Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:19:43.8578921Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:19:43.8579412Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:19:43.8579788Z     Returns:
2026-02-21T11:19:43.8579980Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:19:43.8580349Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:19:43.8580901Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:19:43.8581255Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:19:43.8581572Z     """
2026-02-21T11:19:43.8581733Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:19:43.8581953Z     m, n = x.size()
2026-02-21T11:19:43.8582275Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:19:43.8582751Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:19:43.8583089Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:19:43.8583615Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:19:43.8584112Z     if bias is not None:
2026-02-21T11:19:43.8584455Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:19:43.8584914Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:19:43.8585276Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:19:43.8585672Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:19:43.8586011Z     # src[layer_norm.py:52]: )
2026-02-21T11:19:43.8586374Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:19:43.8586798Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:19:43.8587193Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:19:43.8587533Z     # src[layer_norm.py:55]: )
2026-02-21T11:19:43.8587869Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:19:43.8588343Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:19:43.8588734Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:19:43.8589112Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:19:43.8589510Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:19:43.8589891Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:19:43.8590284Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:19:43.8590586Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:19:43.8590835Z     _RDIM_SIZE_1 = 16384
2026-02-21T11:19:43.8591046Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:19:43.8591353Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:19:43.8591666Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:19:43.8591901Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:19:43.8592342Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=8)
2026-02-21T11:19:43.8592810Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:19:43.8593057Z     return (out, mean, rstd)
2026-02-21T11:19:45.0071347Z WARNING:tritonbench.utils.triton_op:Completed input ID 20:
2026-02-21T11:19:45.0071747Z (M, N)
2026-02-21T11:19:45.0071929Z -------------
2026-02-21T11:19:45.0072125Z (4096, 11264)
2026-02-21T11:19:45.0072421Z 
2026-02-21T11:19:45.0090141Z  70%|███████   | 14/20 [1:18:41<36:53, 368.95s/it]WARNING:tritonbench.utils.triton_op:Running input ID 21:
2026-02-21T11:19:45.0090614Z (M, N)
2026-02-21T11:19:45.0090772Z -------------
2026-02-21T11:19:45.0090949Z (4096, 11776)
2026-02-21T11:19:45.0093588Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T11:19:46.2990904Z INFO:tritonbench.utils.triton_op:Took 3.32ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:19:47.7919254Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:19:49.2108138Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:19:49.2108446Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:19:49.2108708Z               'dtype': 'torch.float32',
2026-02-21T11:19:49.2108979Z               'shape': (4096, 11776),
2026-02-21T11:19:49.2109232Z               'stride': (11776, 1)},
2026-02-21T11:19:49.2109472Z             (11776,),
2026-02-21T11:19:49.2109674Z             { 'device': 'cuda:0',
2026-02-21T11:19:49.2109931Z               'dtype': 'torch.float32',
2026-02-21T11:19:49.2110407Z               'shape': (11776,),
2026-02-21T11:19:49.2110878Z               'stride': (1,)},
2026-02-21T11:19:49.2111872Z             { 'device': 'cuda:0',
2026-02-21T11:19:49.2112322Z               'dtype': 'torch.float32',
2026-02-21T11:19:49.2112745Z               'shape': (11776,),
2026-02-21T11:19:49.2113121Z               'stride': (1,)},
2026-02-21T11:19:49.2113505Z             1e-05),
2026-02-21T11:19:49.2113822Z   'kwargs': {}}
2026-02-21T11:19:49.2160369Z INFO:tritonbench.utils.triton_op:Took 5.56ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:19:49.2243563Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:19:49.2245238Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:19:49.2246205Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:19:49.2246761Z While processing:
2026-02-21T11:19:49.2247437Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:19:49.2248122Z     if bias is not None:
2026-02-21T11:19:49.2248473Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:19:49.2248711Z 
2026-02-21T11:19:49.3867449Z [0s] Autotune random seed: 2141537047
2026-02-21T11:19:49.4320587Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:20:25.0708093Z [35s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:20:26.1300512Z [36s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:20:28.8813826Z [39s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:20:35.8609789Z [46s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:20:38.4767513Z [49s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:20:38.4788314Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:20:45.7325257Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.8 configs/s
2026-02-21T11:20:45.7339017Z [56s] Adaptive compile timeout: 30s (90% percentile=15.9s, bounds=[30.0s, 30s])
2026-02-21T11:20:49.1799661Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 433.2 configs/s
2026-02-21T11:20:49.3218125Z [59s] Initial random population of 100, 5 starting points: 
2026-02-21T11:20:49.3218717Z error=7
2026-02-21T11:20:49.3218995Z timeout=5
2026-02-21T11:20:49.3219255Z ok=88
2026-02-21T11:20:49.3219523Z min=0.1610
2026-02-21T11:20:49.3219790Z mid=0.5716
2026-02-21T11:20:49.3220058Z max=48.0522
2026-02-21T11:20:49.3220389Z best={'block_sizes': [1],
2026-02-21T11:20:49.3221020Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:20:49.3222062Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:20:49.3223043Z  'load_eviction_policies': ['last', 'first', 'first', 'last', 'first', 'last', '', ''],
2026-02-21T11:20:49.3223462Z  'num_sm_multiplier': 16,
2026-02-21T11:20:49.3223673Z  'num_stages': 8,
2026-02-21T11:20:49.3223871Z  'num_warps': 8,
2026-02-21T11:20:49.3224246Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:20:49.3224530Z  'range_flattens': [False],
2026-02-21T11:20:49.3224759Z  'range_multi_buffers': [None],
2026-02-21T11:20:49.3225007Z  'range_num_stages': [2],
2026-02-21T11:20:49.3225231Z  'range_unroll_factors': [2],
2026-02-21T11:20:49.3225471Z  'range_warp_specializes': [],
2026-02-21T11:20:49.3225714Z  'reduction_loops': [2048]}
2026-02-21T11:20:49.3239426Z [59s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:20:50.8173870Z [61s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T11:21:28.1367265Z [98s] Timeout after 30s compiling Config(block_sizes=[2], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', '', 'first', '', 'last', 'first', 'last', 'last'], maxnreg=128, num_sm_multiplier=8, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T11:21:28.1389007Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96/96 0.3 configs/s
2026-02-21T11:21:33.8552740Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 96/96 16.9 configs/s
2026-02-21T11:21:50.4609373Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 60.4 configs/s
2026-02-21T11:21:51.1105437Z [121s] Generation 1 complete: 
2026-02-21T11:21:51.1105931Z error=5
2026-02-21T11:21:51.1106225Z timeout=1
2026-02-21T11:21:51.1106488Z ok=91
2026-02-21T11:21:51.1107522Z min=0.1423
2026-02-21T11:21:51.1107801Z mid=0.1957
2026-02-21T11:21:51.1108074Z max=2.3636
2026-02-21T11:21:51.1108362Z best={'block_sizes': [1],
2026-02-21T11:21:51.1109027Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:21:51.1110025Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:21:51.1110792Z               'tensor_descriptor'],
2026-02-21T11:21:51.1111437Z  'load_eviction_policies': ['last', '', 'first', 'last', 'last', 'last', 'last', 'last'],
2026-02-21T11:21:51.1112100Z  'maxnreg': 128,
2026-02-21T11:21:51.1112430Z  'num_sm_multiplier': 8,
2026-02-21T11:21:51.1112775Z  'num_stages': 3,
2026-02-21T11:21:51.1113082Z  'num_warps': 8,
2026-02-21T11:21:51.1113827Z  'pid_type': 'persistent_blocked',
2026-02-21T11:21:51.1114808Z  'range_flattens': [None],
2026-02-21T11:21:51.1115231Z  'range_multi_buffers': [None],
2026-02-21T11:21:51.1115513Z  'range_num_stages': [1],
2026-02-21T11:21:51.1115720Z  'range_unroll_factors': [4],
2026-02-21T11:21:51.1115959Z  'range_warp_specializes': [],
2026-02-21T11:21:51.1116186Z  'reduction_loops': [None]}
2026-02-21T11:21:51.1139346Z [121s] Fitting surrogate: 197 points, 197 targets
2026-02-21T11:21:52.5692213Z [123s] Generation 2 starting: 88 neighbors, 5 active search path(s)
2026-02-21T11:22:15.4112660Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 0.7 configs/s
2026-02-21T11:22:20.7454344Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 17.4 configs/s
2026-02-21T11:22:36.7895391Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 62.6 configs/s
2026-02-21T11:22:37.4330618Z [168s] Generation 2 complete: 
2026-02-21T11:22:37.4331061Z error=7
2026-02-21T11:22:37.4331334Z ok=87
2026-02-21T11:22:37.4331633Z min=0.1388
2026-02-21T11:22:37.4331905Z mid=0.1792
2026-02-21T11:22:37.4332176Z max=2.5076
2026-02-21T11:22:37.4332474Z best={'block_sizes': [1],
2026-02-21T11:22:37.4333146Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:22:37.4334340Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:22:37.4335089Z  'load_eviction_policies': ['', '', 'first', '', '', '', '', ''],
2026-02-21T11:22:37.4335627Z  'num_stages': 1,
2026-02-21T11:22:37.4335962Z  'num_warps': 32,
2026-02-21T11:22:37.4336292Z  'pid_type': 'flat',
2026-02-21T11:22:37.4336626Z  'range_flattens': [None],
2026-02-21T11:22:37.4337032Z  'range_multi_buffers': [None],
2026-02-21T11:22:37.4337502Z  'range_num_stages': [0],
2026-02-21T11:22:37.4337963Z  'range_unroll_factors': [0],
2026-02-21T11:22:37.4338342Z  'range_warp_specializes': [],
2026-02-21T11:22:37.4338578Z  'reduction_loops': [2048]}
2026-02-21T11:22:37.4360992Z [168s] Fitting surrogate: 291 points, 291 targets
2026-02-21T11:22:38.6917600Z [169s] Generation 3 starting: 76 neighbors, 5 active search path(s)
2026-02-21T11:23:00.6113412Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 1.4 configs/s
2026-02-21T11:23:05.3132234Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 17.2 configs/s
2026-02-21T11:23:18.6118234Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 75.5 configs/s
2026-02-21T11:23:19.1426953Z [209s] Generation 3 complete: 
2026-02-21T11:23:19.1427535Z error=5
2026-02-21T11:23:19.1427826Z ok=77
2026-02-21T11:23:19.1428096Z min=0.1343
2026-02-21T11:23:19.1428382Z mid=0.1658
2026-02-21T11:23:19.1428674Z max=2.5437
2026-02-21T11:23:19.1428981Z best={'block_sizes': [1],
2026-02-21T11:23:19.1429660Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:23:19.1430683Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:23:19.1431483Z               'tensor_descriptor'],
2026-02-21T11:23:19.1432122Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:23:19.1433382Z  'num_stages': 3,
2026-02-21T11:23:19.1433693Z  'num_warps': 32,
2026-02-21T11:23:19.1434502Z  'pid_type': 'flat',
2026-02-21T11:23:19.1434865Z  'range_flattens': [None],
2026-02-21T11:23:19.1435252Z  'range_multi_buffers': [None],
2026-02-21T11:23:19.1435654Z  'range_num_stages': [0],
2026-02-21T11:23:19.1436047Z  'range_unroll_factors': [0],
2026-02-21T11:23:19.1436689Z  'range_warp_specializes': [],
2026-02-21T11:23:19.1437107Z  'reduction_loops': [4096]}
2026-02-21T11:23:19.1462391Z [209s] Fitting surrogate: 373 points, 373 targets
2026-02-21T11:23:20.3949113Z [210s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T11:23:34.1233725Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 20.3 configs/s
2026-02-21T11:23:37.8683899Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 17.8 configs/s
2026-02-21T11:23:50.9944785Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 76.5 configs/s
2026-02-21T11:23:51.5823940Z [242s] Generation 4 complete: 
2026-02-21T11:23:51.5824500Z error=5
2026-02-21T11:23:51.5824675Z ok=65
2026-02-21T11:23:51.5824943Z min=0.1340
2026-02-21T11:23:51.5825137Z mid=0.1487
2026-02-21T11:23:51.5825406Z max=0.4927
2026-02-21T11:23:51.5825610Z best={'block_sizes': [1],
2026-02-21T11:23:51.5826117Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:23:51.5826752Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:23:51.5827979Z               'tensor_descriptor'],
2026-02-21T11:23:51.5828414Z  'load_eviction_policies': ['last', '', 'first', '', '', 'last', 'last', 'last'],
2026-02-21T11:23:51.5828830Z  'num_stages': 3,
2026-02-21T11:23:51.5829029Z  'num_warps': 32,
2026-02-21T11:23:51.5829227Z  'pid_type': 'flat',
2026-02-21T11:23:51.5829465Z  'range_flattens': [None],
2026-02-21T11:23:51.5829705Z  'range_multi_buffers': [None],
2026-02-21T11:23:51.5829944Z  'range_num_stages': [0],
2026-02-21T11:23:51.5830189Z  'range_unroll_factors': [0],
2026-02-21T11:23:51.5830430Z  'range_warp_specializes': [],
2026-02-21T11:23:51.5830675Z  'reduction_loops': [4096]}
2026-02-21T11:23:51.5862100Z [242s] Fitting surrogate: 443 points, 443 targets
2026-02-21T11:23:52.6912420Z [243s] Generation 5 starting: 64 neighbors, 5 active search path(s)
2026-02-21T11:24:15.4522307Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 0.2 configs/s
2026-02-21T11:24:19.1417855Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 17.8 configs/s
2026-02-21T11:24:34.0600113Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 73.5 configs/s
2026-02-21T11:24:34.6580878Z [285s] Generation 5 complete: 
2026-02-21T11:24:34.6581155Z error=5
2026-02-21T11:24:34.6581336Z ok=64
2026-02-21T11:24:34.6581513Z min=0.1330
2026-02-21T11:24:34.6581841Z mid=0.1489
2026-02-21T11:24:34.6582114Z max=1.6555
2026-02-21T11:24:34.6582333Z best={'block_sizes': [1],
2026-02-21T11:24:34.6582761Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:24:34.6583855Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:24:34.6584681Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:24:34.6585107Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', 'first', '', ''],
2026-02-21T11:24:34.6585525Z  'num_stages': 2,
2026-02-21T11:24:34.6585727Z  'num_warps': 16,
2026-02-21T11:24:34.6585944Z  'pid_type': 'flat',
2026-02-21T11:24:34.6586165Z  'range_flattens': [None],
2026-02-21T11:24:34.6586417Z  'range_multi_buffers': [None],
2026-02-21T11:24:34.6586681Z  'range_num_stages': [0],
2026-02-21T11:24:34.6586922Z  'range_unroll_factors': [0],
2026-02-21T11:24:34.6587185Z  'range_warp_specializes': [],
2026-02-21T11:24:34.6587770Z  'reduction_loops': [None]}
2026-02-21T11:24:34.6614639Z [285s] Fitting surrogate: 512 points, 512 targets
2026-02-21T11:24:35.3475515Z [285s] Generation 6 starting: 37 neighbors, 3 active search path(s)
2026-02-21T11:24:43.4569721Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 5.3 configs/s
2026-02-21T11:24:45.7202259Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 17.1 configs/s
2026-02-21T11:24:54.0161751Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 120.7         
2026-02-21T11:24:54.0162313Z                                                                   configs/s     
2026-02-21T11:24:54.3830893Z [304s] Generation 6 complete: 
2026-02-21T11:24:54.3831154Z error=1
2026-02-21T11:24:54.3831314Z ok=39
2026-02-21T11:24:54.3831477Z min=0.1327
2026-02-21T11:24:54.3831644Z mid=0.1460
2026-02-21T11:24:54.3831813Z max=0.2947
2026-02-21T11:24:54.3831995Z best={'block_sizes': [1],
2026-02-21T11:24:54.3832424Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:24:54.3833429Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:24:54.3834836Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:24:54.3835474Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', 'first', '', ''],
2026-02-21T11:24:54.3836080Z  'num_stages': 2,
2026-02-21T11:24:54.3836413Z  'num_warps': 16,
2026-02-21T11:24:54.3836724Z  'pid_type': 'flat',
2026-02-21T11:24:54.3837065Z  'range_flattens': [None],
2026-02-21T11:24:54.3837435Z  'range_multi_buffers': [None],
2026-02-21T11:24:54.3837826Z  'range_num_stages': [0],
2026-02-21T11:24:54.3838183Z  'range_unroll_factors': [0],
2026-02-21T11:24:54.3838576Z  'range_warp_specializes': [],
2026-02-21T11:24:54.3838962Z  'reduction_loops': [None]}
2026-02-21T11:24:54.3872449Z [304s] Fitting surrogate: 552 points, 552 targets
2026-02-21T11:24:54.7870077Z [305s] Generation 7 starting: 15 neighbors, 2 active search path(s)
2026-02-21T11:24:58.3463535Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 10.3 configs/s
2026-02-21T11:24:59.2075530Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 16/16 19.8 configs/s
2026-02-21T11:25:02.2443122Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 325.8         
2026-02-21T11:25:02.2443661Z                                                                   configs/s     
2026-02-21T11:25:02.4200773Z [312s] Generation 7 complete: 
2026-02-21T11:25:02.4201045Z error=2
2026-02-21T11:25:02.4201229Z ok=15
2026-02-21T11:25:02.4201403Z min=0.1326
2026-02-21T11:25:02.4201571Z mid=0.1502
2026-02-21T11:25:02.4201744Z max=0.2931
2026-02-21T11:25:02.4201925Z best={'block_sizes': [1],
2026-02-21T11:25:02.4202376Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:25:02.4203038Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:25:02.4203525Z               'pointer'],
2026-02-21T11:25:02.4203865Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', 'first', '', ''],
2026-02-21T11:25:02.4204617Z  'num_stages': 2,
2026-02-21T11:25:02.4205415Z  'num_warps': 16,
2026-02-21T11:25:02.4205618Z  'pid_type': 'flat',
2026-02-21T11:25:02.4205855Z  'range_flattens': [None],
2026-02-21T11:25:02.4206094Z  'range_multi_buffers': [None],
2026-02-21T11:25:02.4206342Z  'range_num_stages': [0],
2026-02-21T11:25:02.4206569Z  'range_unroll_factors': [0],
2026-02-21T11:25:02.4206819Z  'range_warp_specializes': [],
2026-02-21T11:25:02.4207060Z  'reduction_loops': [None]}
2026-02-21T11:25:02.4233715Z [312s] Fitting surrogate: 569 points, 569 targets
2026-02-21T11:25:02.8233365Z [313s] Generation 8 starting: 17 neighbors, 2 active search path(s)
2026-02-21T11:25:06.5528411Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 6.0 configs/s
2026-02-21T11:25:07.5039207Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 17/17 18.9 configs/s
2026-02-21T11:25:11.5554710Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 245.7         
2026-02-21T11:25:11.5555239Z                                                                   configs/s     
2026-02-21T11:25:11.7715709Z [322s] Generation 8 complete: 
2026-02-21T11:25:11.7715994Z error=1
2026-02-21T11:25:11.7716171Z ok=18
2026-02-21T11:25:11.7716338Z min=0.1332
2026-02-21T11:25:11.7716519Z mid=0.1354
2026-02-21T11:25:11.7716684Z max=0.1837
2026-02-21T11:25:11.7716875Z best={'block_sizes': [1],
2026-02-21T11:25:11.7717339Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:25:11.7718023Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:25:11.7718484Z               'pointer'],
2026-02-21T11:25:11.7718829Z  'load_eviction_policies': ['', 'last', '', 'first', 'last', 'first', '', ''],
2026-02-21T11:25:11.7719213Z  'num_stages': 2,
2026-02-21T11:25:11.7719436Z  'num_warps': 16,
2026-02-21T11:25:11.7719645Z  'pid_type': 'flat',
2026-02-21T11:25:11.7719873Z  'range_flattens': [None],
2026-02-21T11:25:11.7720122Z  'range_multi_buffers': [None],
2026-02-21T11:25:11.7720379Z  'range_num_stages': [0],
2026-02-21T11:25:11.7720605Z  'range_unroll_factors': [0],
2026-02-21T11:25:11.7720872Z  'range_warp_specializes': [],
2026-02-21T11:25:11.7721121Z  'reduction_loops': [None]}
2026-02-21T11:25:11.7751037Z [322s] Fitting surrogate: 588 points, 588 targets
2026-02-21T11:25:12.0558042Z [322s] Generation 9 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:25:14.0715629Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 11.5 configs/s
2026-02-21T11:25:14.6080163Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━━ 9/9 18.4 configs/s
2026-02-21T11:25:17.0977852Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 396.4         
2026-02-21T11:25:17.0978353Z                                                                   configs/s     
2026-02-21T11:25:17.2533211Z [327s] Generation 9 complete: 
2026-02-21T11:25:17.2533634Z ok=11
2026-02-21T11:25:17.2533932Z min=0.1330
2026-02-21T11:25:17.2534482Z mid=0.1355
2026-02-21T11:25:17.2534822Z max=0.1784
2026-02-21T11:25:17.2535130Z best={'block_sizes': [1],
2026-02-21T11:25:17.2535831Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:25:17.2536809Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T11:25:17.2537496Z               'tensor_descriptor'],
2026-02-21T11:25:17.2538108Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', 'first', 'last'],
2026-02-21T11:25:17.2538815Z  'num_stages': 8,
2026-02-21T11:25:17.2539202Z  'num_warps': 16,
2026-02-21T11:25:17.2539449Z  'pid_type': 'flat',
2026-02-21T11:25:17.2539667Z  'range_flattens': [None],
2026-02-21T11:25:17.2539902Z  'range_multi_buffers': [None],
2026-02-21T11:25:17.2540145Z  'range_num_stages': [0],
2026-02-21T11:25:17.2540381Z  'range_unroll_factors': [0],
2026-02-21T11:25:17.2540624Z  'range_warp_specializes': [],
2026-02-21T11:25:17.2540870Z  'reduction_loops': [None]}
2026-02-21T11:25:17.2566890Z [327s] Fitting surrogate: 599 points, 599 targets
2026-02-21T11:25:17.5459923Z [328s] Generation 10 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:25:19.6232510Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 8.1 configs/s
2026-02-21T11:25:20.1632532Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 18.3 configs/s
2026-02-21T11:25:22.3691941Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 446.1         
2026-02-21T11:25:22.3692499Z                                                                   configs/s     
2026-02-21T11:25:22.5102085Z [333s] Generation 10 complete: 
2026-02-21T11:25:22.5102609Z ok=10
2026-02-21T11:25:22.5102959Z min=0.1358
2026-02-21T11:25:22.5103277Z mid=0.1370
2026-02-21T11:25:22.5103466Z max=0.1447
2026-02-21T11:25:22.5104614Z best={'block_sizes': [1],
2026-02-21T11:25:22.5105073Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:25:22.5105694Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T11:25:22.5106109Z               'tensor_descriptor'],
2026-02-21T11:25:22.5106482Z  'load_eviction_policies': ['', '', 'last', 'first', '', '', 'first', 'last'],
2026-02-21T11:25:22.5106857Z  'num_stages': 8,
2026-02-21T11:25:22.5107063Z  'num_warps': 16,
2026-02-21T11:25:22.5107254Z  'pid_type': 'flat',
2026-02-21T11:25:22.5136514Z  'range_flattens': [None],
2026-02-21T11:25:22.5136733Z  'range_multi_buffers': [None],
2026-02-21T11:25:22.5136946Z  'range_num_stages': [0],
2026-02-21T11:25:22.5137150Z  'range_unroll_factors': [0],
2026-02-21T11:25:22.5137459Z  'range_warp_specializes': [],
2026-02-21T11:25:22.5137678Z  'reduction_loops': [None]}
2026-02-21T11:25:22.5137917Z [333s] Fitting surrogate: 609 points, 609 targets
2026-02-21T11:25:22.6721190Z [333s] Autotuning complete in 333.2s after searching 582 configs.
2026-02-21T11:25:22.6721756Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:25:22.6724822Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', '', 'last', 'first', '', '', 'first', 'last'], num_stages=8, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T11:25:22.6727209Z 
2026-02-21T11:25:22.6727718Z [333s] Code of selected kernel: /tmp/torchinductor_root/wl/cwlqsuanhory6chuphvcfvglw22zmrospw2lrwtfhxsip54lzu75.py
2026-02-21T11:25:22.7007557Z from __future__ import annotations
2026-02-21T11:25:22.7007811Z 
2026-02-21T11:25:22.7007916Z import torch
2026-02-21T11:25:22.7008155Z import triton
2026-02-21T11:25:22.7008405Z import triton.language as tl
2026-02-21T11:25:22.7008817Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:25:22.7009375Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:25:22.7009720Z 
2026-02-21T11:25:22.7009832Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:25:22.7010029Z 
2026-02-21T11:25:22.7010145Z @triton.jit
2026-02-21T11:25:22.7010685Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T11:25:22.7011314Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:25:22.7011726Z     pid_0 = tl.program_id(0)
2026-02-21T11:25:22.7012004Z     offset_0 = pid_0
2026-02-21T11:25:22.7012405Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:25:22.7012939Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T11:25:22.7013354Z     mask_1 = indices_1 < 11776
2026-02-21T11:25:22.7013764Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:25:22.7014616Z     acc = tl.load(x + (indices_0[:, None] * 11776 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:25:22.7015641Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:25:22.7016127Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T11:25:22.7016505Z     v_0 = 8.491847826086956e-05
2026-02-21T11:25:22.7016797Z     v_1 = sum_1 * v_0
2026-02-21T11:25:22.7017163Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:25:22.7017610Z     subscript = v_1[:, None]
2026-02-21T11:25:22.7017917Z     v_2 = acc - subscript
2026-02-21T11:25:22.7018357Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:25:22.7018859Z     v_3 = v_2 * v_2
2026-02-21T11:25:22.7019633Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T11:25:22.7020380Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:25:22.7020774Z     v_4 = 8.491847826086956e-05
2026-02-21T11:25:22.7021061Z     v_5 = sum_2 * v_4
2026-02-21T11:25:22.7021443Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:25:22.7021884Z     v_6 = v_5 + eps
2026-02-21T11:25:22.7022156Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T11:25:22.7022584Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:25:22.7023005Z     subscript_1 = v_7[:, None]
2026-02-21T11:25:22.7023236Z     v_8 = v_2 * subscript_1
2026-02-21T11:25:22.7023572Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:25:22.7024171Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0)
2026-02-21T11:25:22.7024497Z     v_9 = load_1[None, :]
2026-02-21T11:25:22.7024721Z     v_10 = v_8 * v_9
2026-02-21T11:25:22.7024969Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:25:22.7025419Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T11:25:22.7025967Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:25:22.7026410Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:25:22.7026734Z     # src[layer_norm.py:75]: )
2026-02-21T11:25:22.7026963Z     v_11 = load_2[None, :]
2026-02-21T11:25:22.7027177Z     v_12 = v_10 + v_11
2026-02-21T11:25:22.7027432Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:25:22.7027914Z     tl.store(out + (indices_0[:, None] * 11776 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T11:25:22.7028374Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:25:22.7028683Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T11:25:22.7028993Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:25:22.7029297Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T11:25:22.7029502Z 
2026-02-21T11:25:22.7030056Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:25:22.7030778Z     """
2026-02-21T11:25:22.7031061Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:25:22.7031420Z     Args:
2026-02-21T11:25:22.7031730Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:25:22.7032385Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:25:22.7032963Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:25:22.7033409Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:25:22.7033940Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:25:22.7034512Z     Returns:
2026-02-21T11:25:22.7034736Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:25:22.7035139Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:25:22.7035707Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:25:22.7036081Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:25:22.7036437Z     """
2026-02-21T11:25:22.7036621Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:25:22.7036853Z     m, n = x.size()
2026-02-21T11:25:22.7037211Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:25:22.7037718Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:25:22.7038085Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:25:22.7038609Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:25:22.7039011Z     if bias is not None:
2026-02-21T11:25:22.7039354Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:25:22.7039826Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:25:22.7040228Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:25:22.7040645Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:25:22.7041022Z     # src[layer_norm.py:52]: )
2026-02-21T11:25:22.7041390Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:25:22.7041843Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:25:22.7042255Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:25:22.7042622Z     # src[layer_norm.py:55]: )
2026-02-21T11:25:22.7042978Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:25:22.7043447Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:25:22.7043835Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:25:22.7044343Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:25:22.7044762Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:25:22.7045152Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:25:22.7045535Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:25:22.7045849Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:25:22.7046090Z     _RDIM_SIZE_1 = 16384
2026-02-21T11:25:22.7046305Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:25:22.7046623Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:25:22.7046940Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:25:22.7047184Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:25:22.7047614Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=8)
2026-02-21T11:25:22.7048098Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:25:22.7048343Z     return (out, mean, rstd)
2026-02-21T11:25:23.8989047Z WARNING:tritonbench.utils.triton_op:Completed input ID 21:
2026-02-21T11:25:23.8989409Z (M, N)
2026-02-21T11:25:23.8989587Z -------------
2026-02-21T11:25:23.8989768Z (4096, 11776)
2026-02-21T11:25:23.8989881Z 
2026-02-21T11:25:23.9009841Z  75%|███████▌  | 15/20 [1:24:20<29:59, 359.89s/it]WARNING:tritonbench.utils.triton_op:Running input ID 23:
2026-02-21T11:25:23.9010270Z (M, N)
2026-02-21T11:25:23.9010490Z -------------
2026-02-21T11:25:23.9010663Z (4096, 12800)
2026-02-21T11:25:23.9013342Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T11:25:25.1779353Z INFO:tritonbench.utils.triton_op:Took 3.22ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:25:26.7782617Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:25:28.1864561Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:25:28.1864881Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:25:28.1865141Z               'dtype': 'torch.float32',
2026-02-21T11:25:28.1865418Z               'shape': (4096, 12800),
2026-02-21T11:25:28.1865670Z               'stride': (12800, 1)},
2026-02-21T11:25:28.1865906Z             (12800,),
2026-02-21T11:25:28.1866109Z             { 'device': 'cuda:0',
2026-02-21T11:25:28.1866486Z               'dtype': 'torch.float32',
2026-02-21T11:25:28.1866994Z               'shape': (12800,),
2026-02-21T11:25:28.1867431Z               'stride': (1,)},
2026-02-21T11:25:28.1867808Z             { 'device': 'cuda:0',
2026-02-21T11:25:28.1869023Z               'dtype': 'torch.float32',
2026-02-21T11:25:28.1869471Z               'shape': (12800,),
2026-02-21T11:25:28.1869848Z               'stride': (1,)},
2026-02-21T11:25:28.1870191Z             1e-05),
2026-02-21T11:25:28.1870514Z   'kwargs': {}}
2026-02-21T11:25:28.1916886Z INFO:tritonbench.utils.triton_op:Took 5.60ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:25:28.1996856Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:25:28.1998291Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:25:28.1999253Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:25:28.1999813Z While processing:
2026-02-21T11:25:28.2000515Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:25:28.2001194Z     if bias is not None:
2026-02-21T11:25:28.2001547Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:25:28.2001769Z 
2026-02-21T11:25:28.3595620Z [0s] Autotune random seed: 2141537047
2026-02-21T11:25:28.4052237Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:26:04.2924782Z [35s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:26:05.4338569Z [37s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:26:08.5035678Z [40s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:26:16.1765323Z [47s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:26:19.0595445Z [50s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:26:19.0613637Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:26:26.3928843Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.7 configs/s
2026-02-21T11:26:26.3941724Z [57s] Adaptive compile timeout: 30s (90% percentile=17.6s, bounds=[30.0s, 30s])
2026-02-21T11:26:28.1098175Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 563.2 configs/s
2026-02-21T11:26:28.2398098Z [59s] Initial random population of 100, 5 starting points: 
2026-02-21T11:26:28.2404946Z error=8
2026-02-21T11:26:28.2405301Z timeout=5
2026-02-21T11:26:28.2405622Z ok=87
2026-02-21T11:26:28.2405885Z min=0.1833
2026-02-21T11:26:28.2406168Z mid=0.6152
2026-02-21T11:26:28.2406434Z max=52.4476
2026-02-21T11:26:28.2406744Z best={'block_sizes': [1],
2026-02-21T11:26:28.2407457Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:26:28.2408651Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:26:28.2409295Z  'load_eviction_policies': ['last', 'first', 'first', 'last', 'first', 'last', '', ''],
2026-02-21T11:26:28.2409745Z  'num_sm_multiplier': 16,
2026-02-21T11:26:28.2409985Z  'num_stages': 8,
2026-02-21T11:26:28.2410189Z  'num_warps': 8,
2026-02-21T11:26:28.2410534Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:26:28.2410833Z  'range_flattens': [False],
2026-02-21T11:26:28.2411091Z  'range_multi_buffers': [None],
2026-02-21T11:26:28.2411347Z  'range_num_stages': [2],
2026-02-21T11:26:28.2411593Z  'range_unroll_factors': [2],
2026-02-21T11:26:28.2411856Z  'range_warp_specializes': [],
2026-02-21T11:26:28.2412108Z  'reduction_loops': [2048]}
2026-02-21T11:26:28.2419712Z [59s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:26:29.7371657Z [61s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T11:26:55.8148295Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 1.8 configs/s
2026-02-21T11:27:01.6524294Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.4 configs/s
2026-02-21T11:27:19.6322780Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 55.8 configs/s
2026-02-21T11:27:20.3112996Z [111s] Generation 1 complete: 
2026-02-21T11:27:20.3113441Z error=3
2026-02-21T11:27:20.3113718Z ok=94
2026-02-21T11:27:20.3114476Z min=0.1511
2026-02-21T11:27:20.3114777Z mid=0.1988
2026-02-21T11:27:20.3115051Z max=2.4992
2026-02-21T11:27:20.3115339Z best={'block_sizes': [1],
2026-02-21T11:27:20.3115999Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:27:20.3117036Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:27:20.3117773Z               'tensor_descriptor'],
2026-02-21T11:27:20.3119110Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:27:20.3119776Z  'maxnreg': 128,
2026-02-21T11:27:20.3120097Z  'num_sm_multiplier': 8,
2026-02-21T11:27:20.3120462Z  'num_stages': 3,
2026-02-21T11:27:20.3120794Z  'num_warps': 8,
2026-02-21T11:27:20.3121142Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:27:20.3121583Z  'range_flattens': [False],
2026-02-21T11:27:20.3121952Z  'range_multi_buffers': [None],
2026-02-21T11:27:20.3122338Z  'range_num_stages': [1],
2026-02-21T11:27:20.3122698Z  'range_unroll_factors': [3],
2026-02-21T11:27:20.3123099Z  'range_warp_specializes': [],
2026-02-21T11:27:20.3123490Z  'reduction_loops': [8192]}
2026-02-21T11:27:20.3139637Z [111s] Fitting surrogate: 197 points, 197 targets
2026-02-21T11:27:21.5585119Z [113s] Generation 2 starting: 76 neighbors, 5 active search path(s)
2026-02-21T11:27:48.8438633Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 0.6 configs/s
2026-02-21T11:27:53.1709959Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 18.7 configs/s
2026-02-21T11:28:07.8601980Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 68.3 configs/s
2026-02-21T11:28:08.4278211Z [160s] Generation 2 complete: 
2026-02-21T11:28:08.4278446Z error=12
2026-02-21T11:28:08.4278593Z ok=70
2026-02-21T11:28:08.4278741Z min=0.1475
2026-02-21T11:28:08.4278883Z mid=0.1695
2026-02-21T11:28:08.4279028Z max=1.2461
2026-02-21T11:28:08.4279187Z best={'block_sizes': [1],
2026-02-21T11:28:08.4279547Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:28:08.4279996Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:28:08.4280351Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:28:08.4280647Z  'num_stages': 1,
2026-02-21T11:28:08.4280812Z  'num_warps': 32,
2026-02-21T11:28:08.4280982Z  'pid_type': 'flat',
2026-02-21T11:28:08.4281159Z  'range_flattens': [None],
2026-02-21T11:28:08.4281378Z  'range_multi_buffers': [None],
2026-02-21T11:28:08.4281588Z  'range_num_stages': [0],
2026-02-21T11:28:08.4281780Z  'range_unroll_factors': [0],
2026-02-21T11:28:08.4281989Z  'range_warp_specializes': [],
2026-02-21T11:28:08.4282206Z  'reduction_loops': [4096]}
2026-02-21T11:28:08.4305462Z [160s] Fitting surrogate: 279 points, 279 targets
2026-02-21T11:28:09.4952648Z [161s] Generation 3 starting: 64 neighbors, 5 active search path(s)
2026-02-21T11:28:24.9663081Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 4.6 configs/s
2026-02-21T11:28:29.1163741Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.1 configs/s
2026-02-21T11:28:44.6364705Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.2 configs/s
2026-02-21T11:28:45.2205422Z [196s] Generation 3 complete: 
2026-02-21T11:28:45.2205928Z error=1
2026-02-21T11:28:45.2206233Z ok=68
2026-02-21T11:28:45.2206516Z min=0.1450
2026-02-21T11:28:45.2206793Z mid=0.1594
2026-02-21T11:28:45.2207106Z max=1.2193
2026-02-21T11:28:45.2207399Z best={'block_sizes': [1],
2026-02-21T11:28:45.2208084Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:28:45.2209866Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:28:45.2210659Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', 'first'],
2026-02-21T11:28:45.2211237Z  'num_stages': 1,
2026-02-21T11:28:45.2211549Z  'num_warps': 16,
2026-02-21T11:28:45.2211866Z  'pid_type': 'flat',
2026-02-21T11:28:45.2212205Z  'range_flattens': [None],
2026-02-21T11:28:45.2212592Z  'range_multi_buffers': [None],
2026-02-21T11:28:45.2213002Z  'range_num_stages': [0],
2026-02-21T11:28:45.2213296Z  'range_unroll_factors': [0],
2026-02-21T11:28:45.2213514Z  'range_warp_specializes': [],
2026-02-21T11:28:45.2213731Z  'reduction_loops': [None]}
2026-02-21T11:28:45.2229986Z [196s] Fitting surrogate: 348 points, 348 targets
2026-02-21T11:28:46.2775122Z [197s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T11:29:01.5158358Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 5.2 configs/s
2026-02-21T11:29:05.6945217Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.2 configs/s
2026-02-21T11:29:20.0141523Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.1 configs/s
2026-02-21T11:29:20.5984498Z [232s] Generation 4 complete: 
2026-02-21T11:29:20.5984838Z ok=71
2026-02-21T11:29:20.5985021Z min=0.1442
2026-02-21T11:29:20.5985196Z mid=0.1557
2026-02-21T11:29:20.5985356Z max=0.7824
2026-02-21T11:29:20.5985537Z best={'block_sizes': [1],
2026-02-21T11:29:20.5985944Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:29:20.5986493Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:29:20.5986948Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', 'first'],
2026-02-21T11:29:20.5987302Z  'num_stages': 1,
2026-02-21T11:29:20.5987542Z  'num_warps': 16,
2026-02-21T11:29:20.5987731Z  'pid_type': 'flat',
2026-02-21T11:29:20.5987937Z  'range_flattens': [None],
2026-02-21T11:29:20.5988173Z  'range_multi_buffers': [None],
2026-02-21T11:29:20.5988431Z  'range_num_stages': [0],
2026-02-21T11:29:20.5988639Z  'range_unroll_factors': [0],
2026-02-21T11:29:20.5988868Z  'range_warp_specializes': [],
2026-02-21T11:29:20.5989086Z  'reduction_loops': [None]}
2026-02-21T11:29:20.6016658Z [232s] Fitting surrogate: 419 points, 419 targets
2026-02-21T11:29:21.6045704Z [233s] Generation 5 starting: 62 neighbors, 5 active search path(s)
2026-02-21T11:29:35.1142702Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 9.5 configs/s
2026-02-21T11:29:38.8092434Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 17.5 configs/s
2026-02-21T11:29:52.9561982Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 71.0 configs/s
2026-02-21T11:29:53.5448613Z [265s] Generation 5 complete: 
2026-02-21T11:29:53.5449135Z error=3
2026-02-21T11:29:53.5449431Z ok=65
2026-02-21T11:29:53.5449707Z min=0.1445
2026-02-21T11:29:53.5450483Z mid=0.1503
2026-02-21T11:29:53.5450909Z max=0.9497
2026-02-21T11:29:53.5451283Z best={'block_sizes': [1],
2026-02-21T11:29:53.5452057Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:29:53.5452992Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:29:53.5453779Z  'load_eviction_policies': ['', '', '', '', 'last', '', '', 'first'],
2026-02-21T11:29:53.5454670Z  'num_stages': 1,
2026-02-21T11:29:53.5454985Z  'num_warps': 16,
2026-02-21T11:29:53.5455300Z  'pid_type': 'flat',
2026-02-21T11:29:53.5455645Z  'range_flattens': [None],
2026-02-21T11:29:53.5456019Z  'range_multi_buffers': [None],
2026-02-21T11:29:53.5456423Z  'range_num_stages': [0],
2026-02-21T11:29:53.5456817Z  'range_unroll_factors': [0],
2026-02-21T11:29:53.5457211Z  'range_warp_specializes': [],
2026-02-21T11:29:53.5457612Z  'reduction_loops': [None]}
2026-02-21T11:29:53.5483658Z [265s] Fitting surrogate: 487 points, 487 targets
2026-02-21T11:29:54.6341608Z [266s] Generation 6 starting: 64 neighbors, 5 active search path(s)
2026-02-21T11:30:09.0799723Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 2.3 configs/s
2026-02-21T11:30:12.9242145Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 16.8 configs/s
2026-02-21T11:30:29.1294367Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 66.4 configs/s
2026-02-21T11:30:29.7572216Z [301s] Generation 6 complete: 
2026-02-21T11:30:29.7572686Z error=1
2026-02-21T11:30:29.7572962Z ok=69
2026-02-21T11:30:29.7573243Z min=0.1450
2026-02-21T11:30:29.7573540Z mid=0.1490
2026-02-21T11:30:29.7573823Z max=1.0999
2026-02-21T11:30:29.7574575Z best={'block_sizes': [1],
2026-02-21T11:30:29.7575296Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:30:29.7577221Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:30:29.7577751Z  'load_eviction_policies': ['', '', '', '', 'last', 'first', '', 'first'],
2026-02-21T11:30:29.7578135Z  'num_stages': 1,
2026-02-21T11:30:29.7578357Z  'num_warps': 16,
2026-02-21T11:30:29.7578556Z  'pid_type': 'flat',
2026-02-21T11:30:29.7578765Z  'range_flattens': [None],
2026-02-21T11:30:29.7579001Z  'range_multi_buffers': [None],
2026-02-21T11:30:29.7579238Z  'range_num_stages': [0],
2026-02-21T11:30:29.7579464Z  'range_unroll_factors': [0],
2026-02-21T11:30:29.7579703Z  'range_warp_specializes': [],
2026-02-21T11:30:29.7579946Z  'reduction_loops': [None]}
2026-02-21T11:30:29.7606279Z [301s] Fitting surrogate: 557 points, 557 targets
2026-02-21T11:30:30.7052222Z [302s] Generation 7 starting: 54 neighbors, 4 active search path(s)
2026-02-21T11:30:42.7117231Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 5.3 configs/s
2026-02-21T11:30:45.6160884Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 18.9 configs/s
2026-02-21T11:30:56.9078519Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.8 configs/s
2026-02-21T11:30:57.3980398Z [328s] Generation 7 complete: 
2026-02-21T11:30:57.3980684Z error=7
2026-02-21T11:30:57.3980845Z ok=52
2026-02-21T11:30:57.3981008Z min=0.1451
2026-02-21T11:30:57.3981174Z mid=0.1474
2026-02-21T11:30:57.3981353Z max=0.6176
2026-02-21T11:30:57.3981534Z best={'block_sizes': [1],
2026-02-21T11:30:57.3981963Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:30:57.3982639Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:30:57.3983200Z  'load_eviction_policies': ['', '', '', '', 'first', '', 'first', 'first'],
2026-02-21T11:30:57.3983574Z  'num_stages': 8,
2026-02-21T11:30:57.3983765Z  'num_warps': 16,
2026-02-21T11:30:57.3983956Z  'pid_type': 'flat',
2026-02-21T11:30:57.3984502Z  'range_flattens': [None],
2026-02-21T11:30:57.3984748Z  'range_multi_buffers': [None],
2026-02-21T11:30:57.3984981Z  'range_num_stages': [0],
2026-02-21T11:30:57.3985210Z  'range_unroll_factors': [0],
2026-02-21T11:30:57.3985448Z  'range_warp_specializes': [],
2026-02-21T11:30:57.3985687Z  'reduction_loops': [None]}
2026-02-21T11:30:57.4020933Z [328s] Fitting surrogate: 616 points, 616 targets
2026-02-21T11:30:58.2307540Z [329s] Generation 8 starting: 47 neighbors, 3 active search path(s)
2026-02-21T11:31:08.7147440Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 5.8 configs/s
2026-02-21T11:31:11.6085355Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.5 configs/s
2026-02-21T11:31:22.0822768Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 95.7 configs/s
2026-02-21T11:31:22.5332187Z [354s] Generation 8 complete: 
2026-02-21T11:31:22.5332638Z ok=50
2026-02-21T11:31:22.5332854Z min=0.1455
2026-02-21T11:31:22.5333025Z mid=0.1492
2026-02-21T11:31:22.5333196Z max=1.3784
2026-02-21T11:31:22.5333401Z best={'block_sizes': [1],
2026-02-21T11:31:22.5333837Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:31:22.5334826Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:31:22.5335724Z               'tensor_descriptor'],
2026-02-21T11:31:22.5336117Z  'load_eviction_policies': ['last', '', '', '', '', 'last', 'last', 'last'],
2026-02-21T11:31:22.5336488Z  'maxnreg': 128,
2026-02-21T11:31:22.5336695Z  'num_sm_multiplier': 32,
2026-02-21T11:31:22.5336914Z  'num_stages': 4,
2026-02-21T11:31:22.5337106Z  'num_warps': 8,
2026-02-21T11:31:22.5337322Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:31:22.5337600Z  'range_flattens': [True],
2026-02-21T11:31:22.5337828Z  'range_multi_buffers': [True],
2026-02-21T11:31:22.5338077Z  'range_num_stages': [2],
2026-02-21T11:31:22.5338311Z  'range_unroll_factors': [1],
2026-02-21T11:31:22.5338555Z  'range_warp_specializes': [],
2026-02-21T11:31:22.5339108Z  'reduction_loops': [8192]}
2026-02-21T11:31:22.5375325Z [354s] Fitting surrogate: 666 points, 666 targets
2026-02-21T11:31:23.1085231Z [354s] Generation 9 starting: 28 neighbors, 2 active search path(s)
2026-02-21T11:31:29.3354980Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 13.9 configs/s
2026-02-21T11:31:31.0400470Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 28/28 16.9 configs/s
2026-02-21T11:31:37.5347618Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 153.7         
2026-02-21T11:31:37.5348334Z                                                                   configs/s     
2026-02-21T11:31:37.8343668Z [369s] Generation 9 complete: 
2026-02-21T11:31:37.8343911Z ok=31
2026-02-21T11:31:37.8344407Z min=0.1451
2026-02-21T11:31:37.8344591Z mid=0.1597
2026-02-21T11:31:37.8344754Z max=0.6272
2026-02-21T11:31:37.8344925Z best={'block_sizes': [1],
2026-02-21T11:31:37.8345343Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:31:37.8345954Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:31:37.8347947Z  'load_eviction_policies': ['', '', '', '', 'first', '', 'first', 'first'],
2026-02-21T11:31:37.8348408Z  'num_stages': 8,
2026-02-21T11:31:37.8348608Z  'num_warps': 16,
2026-02-21T11:31:37.8348795Z  'pid_type': 'flat',
2026-02-21T11:31:37.8348990Z  'range_flattens': [None],
2026-02-21T11:31:37.8349217Z  'range_multi_buffers': [None],
2026-02-21T11:31:37.8349437Z  'range_num_stages': [0],
2026-02-21T11:31:37.8349655Z  'range_unroll_factors': [0],
2026-02-21T11:31:37.8349882Z  'range_warp_specializes': [],
2026-02-21T11:31:37.8350108Z  'reduction_loops': [None]}
2026-02-21T11:31:37.8384314Z [369s] Fitting surrogate: 697 points, 697 targets
2026-02-21T11:31:38.1070088Z [369s] Generation 10 starting: 7 neighbors, 1 active search path(s)
2026-02-21T11:31:39.9329514Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7/7 7.6 configs/s
2026-02-21T11:31:40.2927097Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 7/7 19.4 configs/s
2026-02-21T11:31:41.9084284Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 602.6         
2026-02-21T11:31:41.9085508Z                                                                   configs/s     
2026-02-21T11:31:42.0313125Z [373s] Generation 10 complete: 
2026-02-21T11:31:42.0313402Z error=1
2026-02-21T11:31:42.0313574Z ok=7
2026-02-21T11:31:42.0313743Z min=0.1477
2026-02-21T11:31:42.0313913Z mid=0.1477
2026-02-21T11:31:42.0314279Z max=0.1701
2026-02-21T11:31:42.0314468Z best={'block_sizes': [1],
2026-02-21T11:31:42.0314934Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:31:42.0315563Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:31:42.0316135Z  'load_eviction_policies': ['', 'last', '', '', 'first', '', 'first', 'first'],
2026-02-21T11:31:42.0316549Z  'num_stages': 8,
2026-02-21T11:31:42.0317128Z  'num_warps': 16,
2026-02-21T11:31:42.0317312Z  'pid_type': 'flat',
2026-02-21T11:31:42.0317502Z  'range_flattens': [None],
2026-02-21T11:31:42.0317720Z  'range_multi_buffers': [None],
2026-02-21T11:31:42.0317939Z  'range_num_stages': [0],
2026-02-21T11:31:42.0318150Z  'range_unroll_factors': [0],
2026-02-21T11:31:42.0318370Z  'range_warp_specializes': [],
2026-02-21T11:31:42.0318577Z  'reduction_loops': [None]}
2026-02-21T11:31:42.0356325Z [373s] Fitting surrogate: 705 points, 705 targets
2026-02-21T11:31:42.1925309Z [373s] Autotuning complete in 373.8s after searching 667 configs.
2026-02-21T11:31:42.1925808Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:31:42.1927858Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', '', 'first', '', 'first', 'first'], num_stages=8, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T11:31:42.1929854Z 
2026-02-21T11:31:42.1930287Z [373s] Code of selected kernel: /tmp/torchinductor_root/xh/cxh5zwu2yxro3ihjttzp3z373rtfrcpqsyejuusedcdtowcaf63a.py
2026-02-21T11:31:42.2198752Z from __future__ import annotations
2026-02-21T11:31:42.2198969Z 
2026-02-21T11:31:42.2199048Z import torch
2026-02-21T11:31:42.2199241Z import triton
2026-02-21T11:31:42.2199456Z import triton.language as tl
2026-02-21T11:31:42.2199794Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:31:42.2200240Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:31:42.2200518Z 
2026-02-21T11:31:42.2200637Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:31:42.2200818Z 
2026-02-21T11:31:42.2200896Z @triton.jit
2026-02-21T11:31:42.2201286Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T11:31:42.2201801Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:31:42.2202122Z     pid_0 = tl.program_id(0)
2026-02-21T11:31:42.2202357Z     offset_0 = pid_0
2026-02-21T11:31:42.2202598Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:31:42.2202940Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T11:31:42.2203244Z     mask_1 = indices_1 < 12800
2026-02-21T11:31:42.2203564Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:31:42.2204437Z     acc = tl.load(x + (indices_0[:, None] * 12800 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:31:42.2204974Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:31:42.2205353Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T11:31:42.2205630Z     v_0 = 7.8125e-05
2026-02-21T11:31:42.2205837Z     v_1 = sum_1 * v_0
2026-02-21T11:31:42.2206133Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:31:42.2206505Z     subscript = v_1[:, None]
2026-02-21T11:31:42.2206703Z     v_2 = acc - subscript
2026-02-21T11:31:42.2207440Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:31:42.2207773Z     v_3 = v_2 * v_2
2026-02-21T11:31:42.2208165Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T11:31:42.2208656Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:31:42.2208904Z     v_4 = 7.8125e-05
2026-02-21T11:31:42.2209071Z     v_5 = sum_2 * v_4
2026-02-21T11:31:42.2209311Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:31:42.2209709Z     v_6 = v_5 + eps
2026-02-21T11:31:42.2209888Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T11:31:42.2210164Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:31:42.2210707Z     subscript_1 = v_7[:, None]
2026-02-21T11:31:42.2210912Z     v_8 = v_2 * subscript_1
2026-02-21T11:31:42.2211211Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:31:42.2211683Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T11:31:42.2212054Z     v_9 = load_1[None, :]
2026-02-21T11:31:42.2212230Z     v_10 = v_8 * v_9
2026-02-21T11:31:42.2212446Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:31:42.2212755Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T11:31:42.2213124Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:31:42.2213520Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:31:42.2213796Z     # src[layer_norm.py:75]: )
2026-02-21T11:31:42.2214143Z     v_11 = load_2[None, :]
2026-02-21T11:31:42.2214329Z     v_12 = v_10 + v_11
2026-02-21T11:31:42.2214564Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:31:42.2214985Z     tl.store(out + (indices_0[:, None] * 12800 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T11:31:42.2215386Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:31:42.2215667Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T11:31:42.2215929Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:31:42.2216206Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T11:31:42.2216376Z 
2026-02-21T11:31:42.2216854Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:31:42.2217459Z     """
2026-02-21T11:31:42.2217694Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:31:42.2217981Z     Args:
2026-02-21T11:31:42.2218246Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:31:42.2218766Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:31:42.2219250Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:31:42.2219654Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:31:42.2220138Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:31:42.2220513Z     Returns:
2026-02-21T11:31:42.2220706Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:31:42.2221069Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:31:42.2221447Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:31:42.2221806Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:31:42.2222118Z     """
2026-02-21T11:31:42.2222273Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:31:42.2222491Z     m, n = x.size()
2026-02-21T11:31:42.2222808Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:31:42.2223295Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:31:42.2223825Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:31:42.2224339Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:31:42.2224721Z     if bias is not None:
2026-02-21T11:31:42.2225036Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:31:42.2225471Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:31:42.2225830Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:31:42.2226234Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:31:42.2226783Z     # src[layer_norm.py:52]: )
2026-02-21T11:31:42.2227135Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:31:42.2227564Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:31:42.2227944Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:31:42.2228277Z     # src[layer_norm.py:55]: )
2026-02-21T11:31:42.2228603Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:31:42.2229087Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:31:42.2229490Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:31:42.2229874Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:31:42.2230275Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:31:42.2230657Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:31:42.2231055Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:31:42.2231369Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:31:42.2231614Z     _RDIM_SIZE_1 = 16384
2026-02-21T11:31:42.2231825Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:31:42.2232133Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:31:42.2232457Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:31:42.2232694Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:31:42.2233136Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=8)
2026-02-21T11:31:42.2233611Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:31:42.2233865Z     return (out, mean, rstd)
2026-02-21T11:31:43.3695444Z WARNING:tritonbench.utils.triton_op:Completed input ID 23:
2026-02-21T11:31:43.3695838Z (M, N)
2026-02-21T11:31:43.3696023Z -------------
2026-02-21T11:31:43.3696212Z (4096, 12800)
2026-02-21T11:31:43.3696568Z 
2026-02-21T11:31:43.3714878Z  80%|████████  | 16/20 [1:30:40<24:23, 365.78s/it]WARNING:tritonbench.utils.triton_op:Running input ID 24:
2026-02-21T11:31:43.3715327Z (M, N)
2026-02-21T11:31:43.3715479Z -------------
2026-02-21T11:31:43.3715650Z (4096, 13312)
2026-02-21T11:31:43.3718308Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T11:31:44.6400357Z INFO:tritonbench.utils.triton_op:Took 3.37ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:31:46.1820495Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:31:47.5765738Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:31:47.5766102Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:31:47.5766379Z               'dtype': 'torch.float32',
2026-02-21T11:31:47.5766688Z               'shape': (4096, 13312),
2026-02-21T11:31:47.5766943Z               'stride': (13312, 1)},
2026-02-21T11:31:47.5767190Z             (13312,),
2026-02-21T11:31:47.5767407Z             { 'device': 'cuda:0',
2026-02-21T11:31:47.5768180Z               'dtype': 'torch.float32',
2026-02-21T11:31:47.5768450Z               'shape': (13312,),
2026-02-21T11:31:47.5768692Z               'stride': (1,)},
2026-02-21T11:31:47.5768928Z             { 'device': 'cuda:0',
2026-02-21T11:31:47.5769173Z               'dtype': 'torch.float32',
2026-02-21T11:31:47.5769431Z               'shape': (13312,),
2026-02-21T11:31:47.5769774Z               'stride': (1,)},
2026-02-21T11:31:47.5770001Z             1e-05),
2026-02-21T11:31:47.5770190Z   'kwargs': {}}
2026-02-21T11:31:47.5815306Z INFO:tritonbench.utils.triton_op:Took 5.33ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:31:47.5898979Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:31:47.5900072Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:31:47.5900990Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:31:47.5901411Z While processing:
2026-02-21T11:31:47.5901907Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:31:47.5902339Z     if bias is not None:
2026-02-21T11:31:47.5902548Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:31:47.5902687Z 
2026-02-21T11:31:47.7540401Z [0s] Autotune random seed: 2141537047
2026-02-21T11:31:47.7998217Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:32:23.8907587Z [36s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:32:25.1074773Z [37s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:32:28.3614935Z [40s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:32:36.3738703Z [48s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:32:39.3586213Z [51s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:32:39.3603766Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:32:46.8432237Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.4 configs/s
2026-02-21T11:32:46.8442047Z [59s] Adaptive compile timeout: 30s (90% percentile=18.4s, bounds=[30.0s, 30s])
2026-02-21T11:32:50.1314569Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 298.5 configs/s
2026-02-21T11:32:50.3094953Z [62s] Initial random population of 100, 5 starting points: 
2026-02-21T11:32:50.3095321Z error=7
2026-02-21T11:32:50.3095501Z timeout=5
2026-02-21T11:32:50.3095667Z ok=88
2026-02-21T11:32:50.3095831Z min=0.1995
2026-02-21T11:32:50.3096005Z mid=0.6345
2026-02-21T11:32:50.3096180Z max=54.5317
2026-02-21T11:32:50.3096368Z best={'block_sizes': [1],
2026-02-21T11:32:50.3096765Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:32:50.3097412Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:32:50.3097885Z               'tensor_descriptor'],
2026-02-21T11:32:50.3098295Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:32:50.3098702Z  'maxnreg': 128,
2026-02-21T11:32:50.3098899Z  'num_sm_multiplier': 8,
2026-02-21T11:32:50.3099125Z  'num_stages': 3,
2026-02-21T11:32:50.3099313Z  'num_warps': 4,
2026-02-21T11:32:50.3099540Z  'pid_type': 'persistent_blocked',
2026-02-21T11:32:50.3099795Z  'range_flattens': [None],
2026-02-21T11:32:50.3100037Z  'range_multi_buffers': [None],
2026-02-21T11:32:50.3100273Z  'range_num_stages': [1],
2026-02-21T11:32:50.3100499Z  'range_unroll_factors': [3],
2026-02-21T11:32:50.3100737Z  'range_warp_specializes': [],
2026-02-21T11:32:50.3100979Z  'reduction_loops': [8192]}
2026-02-21T11:32:50.3117241Z [62s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:32:51.7962436Z [63s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T11:33:15.2351631Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 2.7 configs/s
2026-02-21T11:33:21.0568161Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.4 configs/s
2026-02-21T11:33:37.2197205Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 62.1 configs/s
2026-02-21T11:33:37.8159572Z [110s] Generation 1 complete: 
2026-02-21T11:33:37.8160005Z error=2
2026-02-21T11:33:37.8160292Z ok=95
2026-02-21T11:33:37.8160561Z min=0.1530
2026-02-21T11:33:37.8160872Z mid=0.2135
2026-02-21T11:33:37.8161137Z max=0.8368
2026-02-21T11:33:37.8161468Z best={'block_sizes': [1],
2026-02-21T11:33:37.8162122Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:33:37.8162960Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:33:37.8163635Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:33:37.8164635Z  'num_stages': 1,
2026-02-21T11:33:37.8164973Z  'num_warps': 8,
2026-02-21T11:33:37.8165292Z  'pid_type': 'flat',
2026-02-21T11:33:37.8165641Z  'range_flattens': [None],
2026-02-21T11:33:37.8166014Z  'range_multi_buffers': [None],
2026-02-21T11:33:37.8166411Z  'range_num_stages': [0],
2026-02-21T11:33:37.8166773Z  'range_unroll_factors': [0],
2026-02-21T11:33:37.8167197Z  'range_warp_specializes': [],
2026-02-21T11:33:37.8167620Z  'reduction_loops': [None]}
2026-02-21T11:33:37.8187145Z [110s] Fitting surrogate: 197 points, 197 targets
2026-02-21T11:33:39.2817769Z [111s] Generation 2 starting: 89 neighbors, 5 active search path(s)
2026-02-21T11:34:11.7284855Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 0.6 configs/s
2026-02-21T11:34:16.5452142Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 19.5 configs/s
2026-02-21T11:34:32.0961803Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 64.6 configs/s
2026-02-21T11:34:32.7068874Z [164s] Generation 2 complete: 
2026-02-21T11:34:32.7069167Z error=17
2026-02-21T11:34:32.7069367Z ok=77
2026-02-21T11:34:32.7069546Z min=0.1512
2026-02-21T11:34:32.7069728Z mid=0.1768
2026-02-21T11:34:32.7069910Z max=1.0724
2026-02-21T11:34:32.7070103Z best={'block_sizes': [1],
2026-02-21T11:34:32.7070543Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:34:32.7071677Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:34:32.7072165Z               'tensor_descriptor'],
2026-02-21T11:34:32.7072579Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:34:32.7073008Z  'num_stages': 4,
2026-02-21T11:34:32.7073214Z  'num_warps': 32,
2026-02-21T11:34:32.7073408Z  'pid_type': 'flat',
2026-02-21T11:34:32.7073653Z  'range_flattens': [None],
2026-02-21T11:34:32.7073897Z  'range_multi_buffers': [None],
2026-02-21T11:34:32.7074345Z  'range_num_stages': [0],
2026-02-21T11:34:32.7074615Z  'range_unroll_factors': [0],
2026-02-21T11:34:32.7074866Z  'range_warp_specializes': [],
2026-02-21T11:34:32.7075122Z  'reduction_loops': [4096]}
2026-02-21T11:34:32.7097297Z [164s] Fitting surrogate: 291 points, 291 targets
2026-02-21T11:34:34.0319477Z [166s] Generation 3 starting: 80 neighbors, 5 active search path(s)
2026-02-21T11:35:00.3023427Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 0.4 configs/s
2026-02-21T11:35:05.1187284Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 17.4 configs/s
2026-02-21T11:35:22.2642426Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 63.5 configs/s
2026-02-21T11:35:22.8882035Z [215s] Generation 3 complete: 
2026-02-21T11:35:22.8882488Z error=6
2026-02-21T11:35:22.8882766Z ok=79
2026-02-21T11:35:22.8883035Z min=0.1511
2026-02-21T11:35:22.8883308Z mid=0.1723
2026-02-21T11:35:22.8883582Z max=5.3628
2026-02-21T11:35:22.8883876Z best={'block_sizes': [1],
2026-02-21T11:35:22.8885067Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:35:22.8886099Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:35:22.8886847Z               'tensor_descriptor'],
2026-02-21T11:35:22.8887494Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:35:22.8888124Z  'num_stages': 4,
2026-02-21T11:35:22.8888475Z  'num_warps': 32,
2026-02-21T11:35:22.8888790Z  'pid_type': 'flat',
2026-02-21T11:35:22.8889137Z  'range_flattens': [None],
2026-02-21T11:35:22.8889518Z  'range_multi_buffers': [None],
2026-02-21T11:35:22.8890064Z  'range_num_stages': [0],
2026-02-21T11:35:22.8890462Z  'range_unroll_factors': [0],
2026-02-21T11:35:22.8890903Z  'range_warp_specializes': [],
2026-02-21T11:35:22.8891316Z  'reduction_loops': [4096]}
2026-02-21T11:35:22.8911153Z [215s] Fitting surrogate: 376 points, 376 targets
2026-02-21T11:35:23.9112789Z [216s] Generation 4 starting: 63 neighbors, 5 active search path(s)
2026-02-21T11:35:38.6355074Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 8.6 configs/s
2026-02-21T11:35:42.4336081Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 17.3 configs/s
2026-02-21T11:35:57.8732081Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 65.0 configs/s
2026-02-21T11:35:58.4857365Z [250s] Generation 4 complete: 
2026-02-21T11:35:58.4857650Z error=3
2026-02-21T11:35:58.4857819Z ok=66
2026-02-21T11:35:58.4857979Z min=0.1510
2026-02-21T11:35:58.4858152Z mid=0.1619
2026-02-21T11:35:58.4858312Z max=0.5500
2026-02-21T11:35:58.4858496Z best={'block_sizes': [1],
2026-02-21T11:35:58.4859329Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:35:58.4859948Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:35:58.4860401Z               'tensor_descriptor'],
2026-02-21T11:35:58.4860788Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:35:58.4861187Z  'num_stages': 4,
2026-02-21T11:35:58.4861374Z  'num_warps': 32,
2026-02-21T11:35:58.4861565Z  'pid_type': 'flat',
2026-02-21T11:35:58.4861769Z  'range_flattens': [None],
2026-02-21T11:35:58.4862000Z  'range_multi_buffers': [None],
2026-02-21T11:35:58.4862246Z  'range_num_stages': [0],
2026-02-21T11:35:58.4862476Z  'range_unroll_factors': [0],
2026-02-21T11:35:58.4863001Z  'range_warp_specializes': [],
2026-02-21T11:35:58.4863263Z  'reduction_loops': [4096]}
2026-02-21T11:35:58.4897432Z [250s] Fitting surrogate: 445 points, 445 targets
2026-02-21T11:35:59.4650481Z [251s] Generation 5 starting: 57 neighbors, 4 active search path(s)
2026-02-21T11:36:19.4101039Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 0.3 configs/s
2026-02-21T11:36:22.7927389Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 17.4 configs/s
2026-02-21T11:36:36.1130309Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 75.3 configs/s
2026-02-21T11:36:36.6499996Z [288s] Generation 5 complete: 
2026-02-21T11:36:36.6500280Z error=3
2026-02-21T11:36:36.6500468Z ok=59
2026-02-21T11:36:36.6500647Z min=0.1501
2026-02-21T11:36:36.6500822Z mid=0.1639
2026-02-21T11:36:36.6500996Z max=1.4279
2026-02-21T11:36:36.6501184Z best={'block_sizes': [1],
2026-02-21T11:36:36.6501697Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:36:36.6502372Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:36:36.6502811Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', '', 'first'],
2026-02-21T11:36:36.6503189Z  'num_stages': 2,
2026-02-21T11:36:36.6503373Z  'num_warps': 16,
2026-02-21T11:36:36.6503565Z  'pid_type': 'flat',
2026-02-21T11:36:36.6503764Z  'range_flattens': [None],
2026-02-21T11:36:36.6504298Z  'range_multi_buffers': [None],
2026-02-21T11:36:36.6504538Z  'range_num_stages': [0],
2026-02-21T11:36:36.6504774Z  'range_unroll_factors': [0],
2026-02-21T11:36:36.6505011Z  'range_warp_specializes': [],
2026-02-21T11:36:36.6505252Z  'reduction_loops': [None]}
2026-02-21T11:36:36.6541997Z [288s] Fitting surrogate: 507 points, 507 targets
2026-02-21T11:36:37.5824741Z [289s] Generation 6 starting: 54 neighbors, 4 active search path(s)
2026-02-21T11:36:50.1677646Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 10.8 configs/s
2026-02-21T11:36:53.4793704Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.8 configs/s
2026-02-21T11:37:08.7100486Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 72.3 configs/s
2026-02-21T11:37:09.2738016Z [321s] Generation 6 complete: 
2026-02-21T11:37:09.2738267Z error=1
2026-02-21T11:37:09.2738436Z ok=57
2026-02-21T11:37:09.2738596Z min=0.1500
2026-02-21T11:37:09.2738767Z mid=0.1580
2026-02-21T11:37:09.2738930Z max=0.5207
2026-02-21T11:37:09.2739110Z best={'block_sizes': [1],
2026-02-21T11:37:09.2739549Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:37:09.2740131Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:37:09.2740606Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', '', 'first'],
2026-02-21T11:37:09.2741090Z  'num_stages': 2,
2026-02-21T11:37:09.2741309Z  'num_warps': 16,
2026-02-21T11:37:09.2741563Z  'pid_type': 'flat',
2026-02-21T11:37:09.2741835Z  'range_flattens': [None],
2026-02-21T11:37:09.2742094Z  'range_multi_buffers': [None],
2026-02-21T11:37:09.2742337Z  'range_num_stages': [0],
2026-02-21T11:37:09.2742567Z  'range_unroll_factors': [0],
2026-02-21T11:37:09.2742814Z  'range_warp_specializes': [],
2026-02-21T11:37:09.2743057Z  'reduction_loops': [None]}
2026-02-21T11:37:09.2773748Z [321s] Fitting surrogate: 565 points, 565 targets
2026-02-21T11:37:10.2332848Z [322s] Generation 7 starting: 55 neighbors, 4 active search path(s)
2026-02-21T11:37:23.2760624Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 2.2 configs/s
2026-02-21T11:37:26.3946485Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 18.2 configs/s
2026-02-21T11:37:38.5713671Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 82.4 configs/s
2026-02-21T11:37:39.0785964Z [351s] Generation 7 complete: 
2026-02-21T11:37:39.0786345Z error=5
2026-02-21T11:37:39.0786553Z ok=54
2026-02-21T11:37:39.0786746Z min=0.1500
2026-02-21T11:37:39.0787753Z mid=0.1575
2026-02-21T11:37:39.0787960Z max=0.5485
2026-02-21T11:37:39.0788157Z best={'block_sizes': [1],
2026-02-21T11:37:39.0788627Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:37:39.0789279Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:37:39.0789809Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', '', 'first'],
2026-02-21T11:37:39.0790183Z  'num_stages': 2,
2026-02-21T11:37:39.0790380Z  'num_warps': 16,
2026-02-21T11:37:39.0790580Z  'pid_type': 'flat',
2026-02-21T11:37:39.0790803Z  'range_flattens': [None],
2026-02-21T11:37:39.0791042Z  'range_multi_buffers': [None],
2026-02-21T11:37:39.0791285Z  'range_num_stages': [0],
2026-02-21T11:37:39.0791538Z  'range_unroll_factors': [0],
2026-02-21T11:37:39.0791790Z  'range_warp_specializes': [],
2026-02-21T11:37:39.0792041Z  'reduction_loops': [None]}
2026-02-21T11:37:39.0832940Z [351s] Fitting surrogate: 624 points, 624 targets
2026-02-21T11:37:40.0502393Z [352s] Generation 8 starting: 55 neighbors, 4 active search path(s)
2026-02-21T11:37:52.6103507Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 8.4 configs/s
2026-02-21T11:37:55.7694779Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 17.7 configs/s
2026-02-21T11:38:09.0361681Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 75.6 configs/s
2026-02-21T11:38:09.5858400Z [381s] Generation 8 complete: 
2026-02-21T11:38:09.5858649Z error=3
2026-02-21T11:38:09.5858823Z ok=56
2026-02-21T11:38:09.5858990Z min=0.1503
2026-02-21T11:38:09.5859165Z mid=0.1527
2026-02-21T11:38:09.5859329Z max=0.4237
2026-02-21T11:38:09.5859523Z best={'block_sizes': [1],
2026-02-21T11:38:09.5859953Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:38:09.5860531Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:38:09.5860956Z               'tensor_descriptor'],
2026-02-21T11:38:09.5861312Z  'load_eviction_policies': ['', '', '', 'last', '', 'first', '', 'first'],
2026-02-21T11:38:09.5861678Z  'num_stages': 2,
2026-02-21T11:38:09.5862209Z  'num_warps': 16,
2026-02-21T11:38:09.5862407Z  'pid_type': 'flat',
2026-02-21T11:38:09.5862614Z  'range_flattens': [None],
2026-02-21T11:38:09.5862848Z  'range_multi_buffers': [None],
2026-02-21T11:38:09.5863086Z  'range_num_stages': [0],
2026-02-21T11:38:09.5863315Z  'range_unroll_factors': [0],
2026-02-21T11:38:09.5863562Z  'range_warp_specializes': [],
2026-02-21T11:38:09.5863800Z  'reduction_loops': [None]}
2026-02-21T11:38:09.5908239Z [381s] Fitting surrogate: 683 points, 683 targets
2026-02-21T11:38:10.3791953Z [382s] Generation 9 starting: 45 neighbors, 3 active search path(s)
2026-02-21T11:38:20.8293607Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 9.1 configs/s
2026-02-21T11:38:23.4633558Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 17.4 configs/s
2026-02-21T11:38:34.3554848Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 92.1 configs/s
2026-02-21T11:38:34.8352055Z [407s] Generation 9 complete: 
2026-02-21T11:38:34.8352328Z error=2
2026-02-21T11:38:34.8352492Z ok=46
2026-02-21T11:38:34.8352647Z min=0.1512
2026-02-21T11:38:34.8352810Z mid=0.1544
2026-02-21T11:38:34.8352960Z max=0.5200
2026-02-21T11:38:34.8353153Z best={'block_sizes': [1],
2026-02-21T11:38:34.8353531Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:38:34.8354706Z               'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T11:38:34.8355634Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:38:34.8356297Z  'load_eviction_policies': ['last', 'last', '', '', '', 'last', '', ''],
2026-02-21T11:38:34.8356893Z  'maxnreg': 128,
2026-02-21T11:38:34.8357220Z  'num_sm_multiplier': 64,
2026-02-21T11:38:34.8357579Z  'num_stages': 6,
2026-02-21T11:38:34.8357881Z  'num_warps': 8,
2026-02-21T11:38:34.8358246Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:38:34.8358687Z  'range_flattens': [False],
2026-02-21T11:38:34.8359070Z  'range_multi_buffers': [True],
2026-02-21T11:38:34.8359472Z  'range_num_stages': [2],
2026-02-21T11:38:34.8359829Z  'range_unroll_factors': [1],
2026-02-21T11:38:34.8360228Z  'range_warp_specializes': [],
2026-02-21T11:38:34.8360623Z  'reduction_loops': [8192]}
2026-02-21T11:38:34.8401846Z [407s] Fitting surrogate: 731 points, 731 targets
2026-02-21T11:38:35.3435969Z [407s] Generation 10 starting: 26 neighbors, 2 active search path(s)
2026-02-21T11:38:41.3632102Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 8.1 configs/s
2026-02-21T11:38:42.6991611Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 20.3 configs/s
2026-02-21T11:38:50.0901900Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 165.2         
2026-02-21T11:38:50.0902442Z                                                                   configs/s     
2026-02-21T11:38:50.3760257Z [422s] Generation 10 complete: 
2026-02-21T11:38:50.3760772Z error=4
2026-02-21T11:38:50.3761051Z ok=25
2026-02-21T11:38:50.3761321Z min=0.1501
2026-02-21T11:38:50.3761646Z mid=0.1529
2026-02-21T11:38:50.3761923Z max=0.1997
2026-02-21T11:38:50.3762217Z best={'block_sizes': [1],
2026-02-21T11:38:50.3762955Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:38:50.3763900Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:38:50.3765066Z               'tensor_descriptor'],
2026-02-21T11:38:50.3765736Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', '', 'first'],
2026-02-21T11:38:50.3766170Z  'num_stages': 3,
2026-02-21T11:38:50.3766341Z  'num_warps': 16,
2026-02-21T11:38:50.3766509Z  'pid_type': 'flat',
2026-02-21T11:38:50.3766696Z  'range_flattens': [None],
2026-02-21T11:38:50.3766894Z  'range_multi_buffers': [None],
2026-02-21T11:38:50.3767124Z  'range_num_stages': [0],
2026-02-21T11:38:50.3767321Z  'range_unroll_factors': [0],
2026-02-21T11:38:50.3767541Z  'range_warp_specializes': [],
2026-02-21T11:38:50.3767775Z  'reduction_loops': [None]}
2026-02-21T11:38:50.3796855Z [422s] Fitting surrogate: 760 points, 760 targets
2026-02-21T11:38:50.9011036Z [423s] Generation 11 starting: 26 neighbors, 2 active search path(s)
2026-02-21T11:38:57.2335997Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 5.3 configs/s
2026-02-21T11:38:58.7773954Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 16.7 configs/s
2026-02-21T11:39:05.2796594Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 153.8         
2026-02-21T11:39:05.2797109Z                                                                   configs/s     
2026-02-21T11:39:05.5857911Z [437s] Generation 11 complete: 
2026-02-21T11:39:05.5858200Z error=1
2026-02-21T11:39:05.5858370Z ok=27
2026-02-21T11:39:05.5858529Z min=0.1499
2026-02-21T11:39:05.5859390Z mid=0.1528
2026-02-21T11:39:05.5859568Z max=0.1709
2026-02-21T11:39:05.5859749Z best={'block_sizes': [1],
2026-02-21T11:39:05.5860183Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:39:05.5860818Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:39:05.5861247Z               'tensor_descriptor'],
2026-02-21T11:39:05.5861622Z  'load_eviction_policies': ['', 'last', '', 'last', 'first', 'first', '', 'first'],
2026-02-21T11:39:05.5862011Z  'num_stages': 3,
2026-02-21T11:39:05.5862195Z  'num_warps': 16,
2026-02-21T11:39:05.5862396Z  'pid_type': 'flat',
2026-02-21T11:39:05.5862599Z  'range_flattens': [None],
2026-02-21T11:39:05.5862830Z  'range_multi_buffers': [None],
2026-02-21T11:39:05.5863068Z  'range_num_stages': [0],
2026-02-21T11:39:05.5863288Z  'range_unroll_factors': [0],
2026-02-21T11:39:05.5863535Z  'range_warp_specializes': [],
2026-02-21T11:39:05.5863770Z  'reduction_loops': [None]}
2026-02-21T11:39:05.5902450Z [437s] Fitting surrogate: 788 points, 788 targets
2026-02-21T11:39:06.1325576Z [438s] Generation 12 starting: 28 neighbors, 2 active search path(s)
2026-02-21T11:39:12.8578661Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 5.7 configs/s
2026-02-21T11:39:14.4521233Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 28/28 18.1 configs/s
2026-02-21T11:39:21.1938107Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 148.4         
2026-02-21T11:39:21.1938627Z                                                                   configs/s     
2026-02-21T11:39:21.5060125Z [453s] Generation 12 complete: 
2026-02-21T11:39:21.5060412Z error=2
2026-02-21T11:39:21.5060583Z ok=28
2026-02-21T11:39:21.5060759Z min=0.1497
2026-02-21T11:39:21.5060928Z mid=0.1514
2026-02-21T11:39:21.5061102Z max=0.1708
2026-02-21T11:39:21.5061282Z best={'block_sizes': [1],
2026-02-21T11:39:21.5061747Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:39:21.5062383Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:39:21.5062804Z               'tensor_descriptor'],
2026-02-21T11:39:21.5063191Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'first', '', 'first'],
2026-02-21T11:39:21.5063563Z  'num_stages': 3,
2026-02-21T11:39:21.5063754Z  'num_warps': 16,
2026-02-21T11:39:21.5063940Z  'pid_type': 'flat',
2026-02-21T11:39:21.5064290Z  'range_flattens': [None],
2026-02-21T11:39:21.5064516Z  'range_multi_buffers': [None],
2026-02-21T11:39:21.5064759Z  'range_num_stages': [0],
2026-02-21T11:39:21.5064983Z  'range_unroll_factors': [0],
2026-02-21T11:39:21.5065219Z  'range_warp_specializes': [],
2026-02-21T11:39:21.5065470Z  'reduction_loops': [None]}
2026-02-21T11:39:21.5107125Z [453s] Fitting surrogate: 818 points, 818 targets
2026-02-21T11:39:22.0282644Z [454s] Generation 13 starting: 27 neighbors, 2 active search path(s)
2026-02-21T11:39:28.3877984Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 9.2 configs/s
2026-02-21T11:39:29.9735635Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 27/27 17.5 configs/s
2026-02-21T11:39:36.6955848Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 148.8         
2026-02-21T11:39:36.6956392Z                                                                   configs/s     
2026-02-21T11:39:37.0095821Z [469s] Generation 13 complete: 
2026-02-21T11:39:37.0096127Z error=1
2026-02-21T11:39:37.0096310Z ok=28
2026-02-21T11:39:37.0096490Z min=0.1495
2026-02-21T11:39:37.0096670Z mid=0.1512
2026-02-21T11:39:37.0096837Z max=0.1695
2026-02-21T11:39:37.0097036Z best={'block_sizes': [1],
2026-02-21T11:39:37.0097505Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:39:37.0098354Z               'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:39:37.0098935Z               'tensor_descriptor'],
2026-02-21T11:39:37.0099876Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'first', '', 'first'],
2026-02-21T11:39:37.0100273Z  'num_stages': 2,
2026-02-21T11:39:37.0100461Z  'num_warps': 16,
2026-02-21T11:39:37.0100679Z  'pid_type': 'flat',
2026-02-21T11:39:37.0100887Z  'range_flattens': [None],
2026-02-21T11:39:37.0101125Z  'range_multi_buffers': [None],
2026-02-21T11:39:37.0142203Z  'range_num_stages': [0],
2026-02-21T11:39:37.0142442Z  'range_unroll_factors': [0],
2026-02-21T11:39:37.0142686Z  'range_warp_specializes': [],
2026-02-21T11:39:37.0142935Z  'reduction_loops': [None]}
2026-02-21T11:39:37.0143212Z [469s] Fitting surrogate: 847 points, 847 targets
2026-02-21T11:39:37.2842707Z [469s] Generation 14 starting: 8 neighbors, 1 active search path(s)
2026-02-21T11:39:39.5649279Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 4.9 configs/s
2026-02-21T11:39:40.0463055Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 18.5 configs/s
2026-02-21T11:39:42.1869589Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 458.2         
2026-02-21T11:39:42.1870094Z                                                                   configs/s     
2026-02-21T11:39:42.3297263Z [474s] Generation 14 complete: 
2026-02-21T11:39:42.3297532Z ok=9
2026-02-21T11:39:42.3297707Z min=0.1498
2026-02-21T11:39:42.3297880Z mid=0.1536
2026-02-21T11:39:42.3298048Z max=0.1689
2026-02-21T11:39:42.3298230Z best={'block_sizes': [1],
2026-02-21T11:39:42.3298676Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor',
2026-02-21T11:39:42.3299332Z               'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:39:42.3299787Z               'tensor_descriptor'],
2026-02-21T11:39:42.3300166Z  'load_eviction_policies': ['', 'last', '', 'last', '', 'first', '', 'first'],
2026-02-21T11:39:42.3300558Z  'num_stages': 2,
2026-02-21T11:39:42.3300757Z  'num_warps': 16,
2026-02-21T11:39:42.3300970Z  'pid_type': 'flat',
2026-02-21T11:39:42.3301198Z  'range_flattens': [None],
2026-02-21T11:39:42.3301479Z  'range_multi_buffers': [None],
2026-02-21T11:39:42.3301780Z  'range_num_stages': [0],
2026-02-21T11:39:42.3302016Z  'range_unroll_factors': [0],
2026-02-21T11:39:42.3302254Z  'range_warp_specializes': [],
2026-02-21T11:39:42.3302495Z  'reduction_loops': [None]}
2026-02-21T11:39:42.3344941Z [474s] Fitting surrogate: 856 points, 856 targets
2026-02-21T11:39:42.4918925Z [474s] Autotuning complete in 474.7s after searching 815 configs.
2026-02-21T11:39:42.4919435Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:39:42.4921581Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last', '', 'last', '', 'first', '', 'first'], num_stages=2, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T11:39:42.4924428Z 
2026-02-21T11:39:42.4924878Z [474s] Code of selected kernel: /tmp/torchinductor_root/2c/c2cevolainhk634pylyc6m3yvj47gc2g2fbjemkrril4335qjrbm.py
2026-02-21T11:39:42.5209137Z from __future__ import annotations
2026-02-21T11:39:42.5209346Z 
2026-02-21T11:39:42.5209439Z import torch
2026-02-21T11:39:42.5209648Z import triton
2026-02-21T11:39:42.5209953Z import triton.language as tl
2026-02-21T11:39:42.5210290Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:39:42.5210765Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:39:42.5211054Z 
2026-02-21T11:39:42.5211160Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:39:42.5211336Z 
2026-02-21T11:39:42.5211435Z @triton.jit
2026-02-21T11:39:42.5212226Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T11:39:42.5212728Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:39:42.5213007Z     pid_0 = tl.program_id(0)
2026-02-21T11:39:42.5213227Z     offset_0 = pid_0
2026-02-21T11:39:42.5213450Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:39:42.5213768Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T11:39:42.5214202Z     mask_1 = indices_1 < 13312
2026-02-21T11:39:42.5214510Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:39:42.5214981Z     acc = tl.load(x + (indices_0[:, None] * 13312 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:39:42.5215455Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:39:42.5215788Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T11:39:42.5216043Z     v_0 = 7.512019230769231e-05
2026-02-21T11:39:42.5216255Z     v_1 = sum_1 * v_0
2026-02-21T11:39:42.5216520Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:39:42.5216827Z     subscript = v_1[:, None]
2026-02-21T11:39:42.5217025Z     v_2 = acc - subscript
2026-02-21T11:39:42.5217333Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:39:42.5217684Z     v_3 = v_2 * v_2
2026-02-21T11:39:42.5218081Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T11:39:42.5218574Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:39:42.5218830Z     v_4 = 7.512019230769231e-05
2026-02-21T11:39:42.5219018Z     v_5 = sum_2 * v_4
2026-02-21T11:39:42.5219280Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:39:42.5219593Z     v_6 = v_5 + eps
2026-02-21T11:39:42.5219774Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T11:39:42.5220076Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:39:42.5220403Z     subscript_1 = v_7[:, None]
2026-02-21T11:39:42.5220617Z     v_8 = v_2 * subscript_1
2026-02-21T11:39:42.5220929Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:39:42.5221398Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T11:39:42.5221782Z     v_9 = load_1[None, :]
2026-02-21T11:39:42.5221961Z     v_10 = v_8 * v_9
2026-02-21T11:39:42.5222172Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:39:42.5222488Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0)
2026-02-21T11:39:42.5222865Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:39:42.5223226Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:39:42.5223481Z     # src[layer_norm.py:75]: )
2026-02-21T11:39:42.5223678Z     v_11 = load_2[None, :]
2026-02-21T11:39:42.5223848Z     v_12 = v_10 + v_11
2026-02-21T11:39:42.5224214Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:39:42.5224632Z     tl.store(out + (indices_0[:, None] * 13312 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T11:39:42.5225042Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:39:42.5225580Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T11:39:42.5225849Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:39:42.5226120Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T11:39:42.5226280Z 
2026-02-21T11:39:42.5226725Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:39:42.5227306Z     """
2026-02-21T11:39:42.5227541Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:39:42.5227828Z     Args:
2026-02-21T11:39:42.5228102Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:39:42.5228793Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:39:42.5229307Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:39:42.5229720Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:39:42.5230212Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:39:42.5230590Z     Returns:
2026-02-21T11:39:42.5230787Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:39:42.5231168Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:39:42.5231548Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:39:42.5231906Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:39:42.5232215Z     """
2026-02-21T11:39:42.5232379Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:39:42.5232596Z     m, n = x.size()
2026-02-21T11:39:42.5232920Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:39:42.5233389Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:39:42.5233724Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:39:42.5234254Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:39:42.5234637Z     if bias is not None:
2026-02-21T11:39:42.5234957Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:39:42.5235396Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:39:42.5235759Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:39:42.5236147Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:39:42.5236481Z     # src[layer_norm.py:52]: )
2026-02-21T11:39:42.5236825Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:39:42.5237285Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:39:42.5237701Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:39:42.5238054Z     # src[layer_norm.py:55]: )
2026-02-21T11:39:42.5238390Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:39:42.5238870Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:39:42.5239248Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:39:42.5239632Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:39:42.5240028Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:39:42.5240418Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:39:42.5240822Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:39:42.5241129Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:39:42.5241556Z     _RDIM_SIZE_1 = 16384
2026-02-21T11:39:42.5241768Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:39:42.5242088Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:39:42.5242392Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:39:42.5242627Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:39:42.5243061Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=2)
2026-02-21T11:39:42.5243529Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:39:42.5243777Z     return (out, mean, rstd)
2026-02-21T11:39:43.7292977Z WARNING:tritonbench.utils.triton_op:Completed input ID 24:
2026-02-21T11:39:43.7293589Z (M, N)
2026-02-21T11:39:43.7294847Z -------------
2026-02-21T11:39:43.7295204Z (4096, 13312)
2026-02-21T11:39:43.7295408Z 
2026-02-21T11:39:43.7316215Z  85%|████████▌ | 17/20 [1:38:40<20:00, 400.24s/it]WARNING:tritonbench.utils.triton_op:Running input ID 26:
2026-02-21T11:39:43.7316627Z (M, N)
2026-02-21T11:39:43.7316775Z -------------
2026-02-21T11:39:43.7316925Z (4096, 14336)
2026-02-21T11:39:43.7319031Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for torch_layer_norm
2026-02-21T11:39:44.9865704Z INFO:tritonbench.utils.triton_op:Took 3.71ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:39:46.5793431Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:39:47.9567007Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:39:47.9567603Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:39:47.9568041Z               'dtype': 'torch.float32',
2026-02-21T11:39:47.9568489Z               'shape': (4096, 14336),
2026-02-21T11:39:47.9568928Z               'stride': (14336, 1)},
2026-02-21T11:39:47.9569315Z             (14336,),
2026-02-21T11:39:47.9569648Z             { 'device': 'cuda:0',
2026-02-21T11:39:47.9570200Z               'dtype': 'torch.float32',
2026-02-21T11:39:47.9570636Z               'shape': (14336,),
2026-02-21T11:39:47.9571012Z               'stride': (1,)},
2026-02-21T11:39:47.9571387Z             { 'device': 'cuda:0',
2026-02-21T11:39:47.9571780Z               'dtype': 'torch.float32',
2026-02-21T11:39:47.9572193Z               'shape': (14336,),
2026-02-21T11:39:47.9572555Z               'stride': (1,)},
2026-02-21T11:39:47.9572903Z             1e-05),
2026-02-21T11:39:47.9573197Z   'kwargs': {}}
2026-02-21T11:39:47.9625055Z INFO:tritonbench.utils.triton_op:Took 6.30ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:39:47.9717278Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:39:47.9718711Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:39:47.9719673Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:39:47.9720830Z While processing:
2026-02-21T11:39:47.9721533Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:39:47.9722487Z     if bias is not None:
2026-02-21T11:39:47.9722837Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:39:47.9723065Z 
2026-02-21T11:39:48.1395114Z [0s] Autotune random seed: 2141537047
2026-02-21T11:39:48.1860360Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:40:24.5106409Z [36s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:40:25.7191591Z [37s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:40:29.1892760Z [41s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:40:37.7124514Z [49s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:40:40.8707780Z [52s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:40:40.8730074Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:40:48.5426275Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.1 configs/s
2026-02-21T11:40:48.5438708Z [60s] Adaptive compile timeout: 30s (90% percentile=19.6s, bounds=[30.0s, 30s])
2026-02-21T11:40:51.4730036Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━━━ 948/948 316.4 configs/s
2026-02-21T11:40:51.6405803Z [63s] Initial random population of 100, 5 starting points: 
2026-02-21T11:40:51.6406420Z error=7
2026-02-21T11:40:51.6407273Z timeout=5
2026-02-21T11:40:51.6407545Z ok=88
2026-02-21T11:40:51.6407810Z min=0.2115
2026-02-21T11:40:51.6408072Z mid=0.6906
2026-02-21T11:40:51.6408339Z max=58.3281
2026-02-21T11:40:51.6408645Z best={'block_sizes': [1],
2026-02-21T11:40:51.6409304Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:40:51.6410405Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:40:51.6411158Z  'load_eviction_policies': ['last', 'first', 'first', 'last', 'first', 'last', '', ''],
2026-02-21T11:40:51.6411533Z  'num_sm_multiplier': 16,
2026-02-21T11:40:51.6411725Z  'num_stages': 8,
2026-02-21T11:40:51.6411896Z  'num_warps': 8,
2026-02-21T11:40:51.6412084Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:40:51.6412628Z  'range_flattens': [False],
2026-02-21T11:40:51.6412840Z  'range_multi_buffers': [None],
2026-02-21T11:40:51.6413055Z  'range_num_stages': [2],
2026-02-21T11:40:51.6413246Z  'range_unroll_factors': [2],
2026-02-21T11:40:51.6413466Z  'range_warp_specializes': [],
2026-02-21T11:40:51.6413674Z  'reduction_loops': [2048]}
2026-02-21T11:40:51.6430152Z [63s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:40:53.1344476Z [64s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T11:41:15.5732677Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 6.5 configs/s
2026-02-21T11:41:21.3513014Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.4 configs/s
2026-02-21T11:41:42.7120018Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 50.3 configs/s
2026-02-21T11:41:43.4098073Z [115s] Generation 1 complete: 
2026-02-21T11:41:43.4098335Z error=2
2026-02-21T11:41:43.4098509Z ok=95
2026-02-21T11:41:43.4098680Z min=0.1646
2026-02-21T11:41:43.4098885Z mid=0.2258
2026-02-21T11:41:43.4099050Z max=0.8058
2026-02-21T11:41:43.4099237Z best={'block_sizes': [1],
2026-02-21T11:41:43.4099632Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:41:43.4100159Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:41:43.4100563Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:41:43.4100907Z  'num_stages': 1,
2026-02-21T11:41:43.4101104Z  'num_warps': 8,
2026-02-21T11:41:43.4101305Z  'pid_type': 'flat',
2026-02-21T11:41:43.4101514Z  'range_flattens': [None],
2026-02-21T11:41:43.4101740Z  'range_multi_buffers': [None],
2026-02-21T11:41:43.4101981Z  'range_num_stages': [0],
2026-02-21T11:41:43.4102205Z  'range_unroll_factors': [0],
2026-02-21T11:41:43.4102449Z  'range_warp_specializes': [],
2026-02-21T11:41:43.4102685Z  'reduction_loops': [None]}
2026-02-21T11:41:43.4138741Z [115s] Fitting surrogate: 197 points, 197 targets
2026-02-21T11:41:44.8569446Z [116s] Generation 2 starting: 88 neighbors, 5 active search path(s)
2026-02-21T11:42:07.5235853Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 2.1 configs/s
2026-02-21T11:42:12.3843940Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 19.3 configs/s
2026-02-21T11:42:28.4200786Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 62.6 configs/s
2026-02-21T11:42:29.0172911Z [160s] Generation 2 complete: 
2026-02-21T11:42:29.0173373Z error=16
2026-02-21T11:42:29.0173657Z ok=78
2026-02-21T11:42:29.0173928Z min=0.1623
2026-02-21T11:42:29.0174951Z mid=0.2046
2026-02-21T11:42:29.0175231Z max=0.6109
2026-02-21T11:42:29.0175551Z best={'block_sizes': [1],
2026-02-21T11:42:29.0176237Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:42:29.0177056Z               'pointer', 'pointer', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:42:29.0177784Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:42:29.0178430Z  'num_stages': 1,
2026-02-21T11:42:29.0178633Z  'num_warps': 16,
2026-02-21T11:42:29.0178830Z  'pid_type': 'flat',
2026-02-21T11:42:29.0179052Z  'range_flattens': [None],
2026-02-21T11:42:29.0179735Z  'range_multi_buffers': [None],
2026-02-21T11:42:29.0179989Z  'range_num_stages': [0],
2026-02-21T11:42:29.0180231Z  'range_unroll_factors': [0],
2026-02-21T11:42:29.0180472Z  'range_warp_specializes': [],
2026-02-21T11:42:29.0180728Z  'reduction_loops': [None]}
2026-02-21T11:42:29.0206748Z [160s] Fitting surrogate: 291 points, 291 targets
2026-02-21T11:42:30.1618156Z [161s] Generation 3 starting: 64 neighbors, 5 active search path(s)
2026-02-21T11:42:56.8368584Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 0.2 configs/s
2026-02-21T11:43:00.6087333Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 17.7 configs/s
2026-02-21T11:43:15.9826404Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 65.3 configs/s
2026-02-21T11:43:16.5782953Z [208s] Generation 3 complete: 
2026-02-21T11:43:16.5783242Z error=5
2026-02-21T11:43:16.5783409Z ok=65
2026-02-21T11:43:16.5783575Z min=0.1627
2026-02-21T11:43:16.5783746Z mid=0.1771
2026-02-21T11:43:16.5783935Z max=2.9132
2026-02-21T11:43:16.5784284Z best={'block_sizes': [1],
2026-02-21T11:43:16.5784700Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:43:16.5785266Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:43:16.5785715Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:43:16.5786059Z  'num_stages': 2,
2026-02-21T11:43:16.5786247Z  'num_warps': 16,
2026-02-21T11:43:16.5786441Z  'pid_type': 'flat',
2026-02-21T11:43:16.5786650Z  'range_flattens': [None],
2026-02-21T11:43:16.5786895Z  'range_multi_buffers': [None],
2026-02-21T11:43:16.5787142Z  'range_num_stages': [0],
2026-02-21T11:43:16.5787366Z  'range_unroll_factors': [0],
2026-02-21T11:43:16.5787629Z  'range_warp_specializes': [],
2026-02-21T11:43:16.5787880Z  'reduction_loops': [None]}
2026-02-21T11:43:16.5814520Z [208s] Fitting surrogate: 361 points, 361 targets
2026-02-21T11:43:17.6457218Z [209s] Generation 4 starting: 63 neighbors, 5 active search path(s)
2026-02-21T11:43:33.1363608Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 7.3 configs/s
2026-02-21T11:43:36.7055557Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 18.2 configs/s
2026-02-21T11:43:53.9173183Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 63.2 configs/s
2026-02-21T11:43:54.5153425Z [246s] Generation 4 complete: 
2026-02-21T11:43:54.5153878Z error=6
2026-02-21T11:43:54.5154414Z ok=62
2026-02-21T11:43:54.5154695Z min=0.1628
2026-02-21T11:43:54.5154972Z mid=0.1804
2026-02-21T11:43:54.5155249Z max=0.3171
2026-02-21T11:43:54.5155552Z best={'block_sizes': [1],
2026-02-21T11:43:54.5156266Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:43:54.5157389Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:43:54.5158092Z               'tensor_descriptor'],
2026-02-21T11:43:54.5158458Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'first'],
2026-02-21T11:43:54.5158813Z  'num_stages': 4,
2026-02-21T11:43:54.5158992Z  'num_warps': 32,
2026-02-21T11:43:54.5159157Z  'pid_type': 'flat',
2026-02-21T11:43:54.5159344Z  'range_flattens': [None],
2026-02-21T11:43:54.5159550Z  'range_multi_buffers': [None],
2026-02-21T11:43:54.5159757Z  'range_num_stages': [0],
2026-02-21T11:43:54.5159958Z  'range_unroll_factors': [0],
2026-02-21T11:43:54.5160166Z  'range_warp_specializes': [],
2026-02-21T11:43:54.5160380Z  'reduction_loops': [4096]}
2026-02-21T11:43:54.5187675Z [246s] Fitting surrogate: 429 points, 429 targets
2026-02-21T11:43:55.4677585Z [247s] Generation 5 starting: 56 neighbors, 5 active search path(s)
2026-02-21T11:44:09.5034741Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 7.3 configs/s
2026-02-21T11:44:12.8298639Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 17.7 configs/s
2026-02-21T11:44:26.3567291Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 74.1 configs/s
2026-02-21T11:44:26.8875594Z [278s] Generation 5 complete: 
2026-02-21T11:44:26.8876053Z error=3
2026-02-21T11:44:26.8876352Z ok=58
2026-02-21T11:44:26.8876615Z min=0.1620
2026-02-21T11:44:26.8876891Z mid=0.1717
2026-02-21T11:44:26.8877150Z max=0.7183
2026-02-21T11:44:26.8877443Z best={'block_sizes': [1],
2026-02-21T11:44:26.8878119Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:44:26.8879084Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:44:26.8879932Z  'load_eviction_policies': ['', '', '', '', '', '', '', 'first'],
2026-02-21T11:44:26.8880537Z  'num_stages': 1,
2026-02-21T11:44:26.8880719Z  'num_warps': 16,
2026-02-21T11:44:26.8881273Z  'pid_type': 'flat',
2026-02-21T11:44:26.8881496Z  'range_flattens': [None],
2026-02-21T11:44:26.8881731Z  'range_multi_buffers': [None],
2026-02-21T11:44:26.8881964Z  'range_num_stages': [0],
2026-02-21T11:44:26.8882180Z  'range_unroll_factors': [0],
2026-02-21T11:44:26.8882411Z  'range_warp_specializes': [],
2026-02-21T11:44:26.8882630Z  'reduction_loops': [None]}
2026-02-21T11:44:26.8917543Z [278s] Fitting surrogate: 490 points, 490 targets
2026-02-21T11:44:27.8306691Z [279s] Generation 6 starting: 55 neighbors, 5 active search path(s)
2026-02-21T11:44:41.7634803Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 2.9 configs/s
2026-02-21T11:44:45.1242502Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 16.9 configs/s
2026-02-21T11:44:59.3757486Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.4 configs/s
2026-02-21T11:44:59.9453164Z [311s] Generation 6 complete: 
2026-02-21T11:44:59.9453612Z error=1
2026-02-21T11:44:59.9453893Z ok=59
2026-02-21T11:44:59.9454362Z min=0.1623
2026-02-21T11:44:59.9454547Z mid=0.1659
2026-02-21T11:44:59.9454712Z max=0.3608
2026-02-21T11:44:59.9454902Z best={'block_sizes': [1],
2026-02-21T11:44:59.9455324Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:44:59.9455946Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:44:59.9456480Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'first'],
2026-02-21T11:44:59.9456837Z  'num_stages': 1,
2026-02-21T11:44:59.9457041Z  'num_warps': 16,
2026-02-21T11:44:59.9457237Z  'pid_type': 'flat',
2026-02-21T11:44:59.9457469Z  'range_flattens': [None],
2026-02-21T11:44:59.9457707Z  'range_multi_buffers': [None],
2026-02-21T11:44:59.9457962Z  'range_num_stages': [0],
2026-02-21T11:44:59.9458201Z  'range_unroll_factors': [0],
2026-02-21T11:44:59.9458452Z  'range_warp_specializes': [],
2026-02-21T11:44:59.9458691Z  'reduction_loops': [None]}
2026-02-21T11:44:59.9498122Z [311s] Fitting surrogate: 550 points, 550 targets
2026-02-21T11:45:01.0017775Z [312s] Generation 7 starting: 57 neighbors, 5 active search path(s)
2026-02-21T11:45:15.2987408Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 2.4 configs/s
2026-02-21T11:45:18.5816203Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 17.9 configs/s
2026-02-21T11:45:33.1909274Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 68.7 configs/s
2026-02-21T11:45:33.7631495Z [345s] Generation 7 complete: 
2026-02-21T11:45:33.7631945Z error=4
2026-02-21T11:45:33.7632225Z ok=58
2026-02-21T11:45:33.7632512Z min=0.1618
2026-02-21T11:45:33.7632801Z mid=0.1667
2026-02-21T11:45:33.7633074Z max=0.4151
2026-02-21T11:45:33.7633410Z best={'block_sizes': [1],
2026-02-21T11:45:33.7634588Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:45:33.7635564Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:45:33.7636413Z  'load_eviction_policies': ['', '', 'last', '', '', '', '', 'first'],
2026-02-21T11:45:33.7637009Z  'num_stages': 1,
2026-02-21T11:45:33.7637336Z  'num_warps': 16,
2026-02-21T11:45:33.7637960Z  'pid_type': 'flat',
2026-02-21T11:45:33.7638148Z  'range_flattens': [None],
2026-02-21T11:45:33.7638344Z  'range_multi_buffers': [None],
2026-02-21T11:45:33.7638553Z  'range_num_stages': [0],
2026-02-21T11:45:33.7638755Z  'range_unroll_factors': [0],
2026-02-21T11:45:33.7638970Z  'range_warp_specializes': [],
2026-02-21T11:45:33.7639193Z  'reduction_loops': [None]}
2026-02-21T11:45:33.7678818Z [345s] Fitting surrogate: 612 points, 612 targets
2026-02-21T11:45:34.5624411Z [346s] Generation 8 starting: 42 neighbors, 4 active search path(s)
2026-02-21T11:45:46.5246376Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 7.4 configs/s
2026-02-21T11:45:48.9489247Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 18.1 configs/s
2026-02-21T11:45:59.2046528Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 97.6 configs/s
2026-02-21T11:45:59.6260686Z [371s] Generation 8 complete: 
2026-02-21T11:45:59.6260958Z error=3
2026-02-21T11:45:59.6261160Z ok=43
2026-02-21T11:45:59.6261426Z min=0.1620
2026-02-21T11:45:59.6261610Z mid=0.1649
2026-02-21T11:45:59.6261829Z max=0.4079
2026-02-21T11:45:59.6262020Z best={'block_sizes': [1],
2026-02-21T11:45:59.6262462Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:45:59.6263088Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:45:59.6263658Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', 'first'],
2026-02-21T11:45:59.6264259Z  'num_stages': 1,
2026-02-21T11:45:59.6264501Z  'num_warps': 16,
2026-02-21T11:45:59.6264738Z  'pid_type': 'flat',
2026-02-21T11:45:59.6264985Z  'range_flattens': [None],
2026-02-21T11:45:59.6265259Z  'range_multi_buffers': [None],
2026-02-21T11:45:59.6265600Z  'range_num_stages': [0],
2026-02-21T11:45:59.6265839Z  'range_unroll_factors': [0],
2026-02-21T11:45:59.6266088Z  'range_warp_specializes': [],
2026-02-21T11:45:59.6266317Z  'reduction_loops': [None]}
2026-02-21T11:45:59.6302601Z [371s] Fitting surrogate: 658 points, 658 targets
2026-02-21T11:46:00.3243309Z [372s] Generation 9 starting: 37 neighbors, 3 active search path(s)
2026-02-21T11:46:10.2842446Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 1.4 configs/s
2026-02-21T11:46:12.4362546Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 18.1 configs/s
2026-02-21T11:46:21.7863552Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 107.1         
2026-02-21T11:46:21.7867582Z                                                                   configs/s     
2026-02-21T11:46:22.1798048Z [393s] Generation 9 complete: 
2026-02-21T11:46:22.1798488Z error=3
2026-02-21T11:46:22.1798772Z ok=37
2026-02-21T11:46:22.1799034Z min=0.1623
2026-02-21T11:46:22.1799314Z mid=0.1652
2026-02-21T11:46:22.1799613Z max=0.4136
2026-02-21T11:46:22.1799917Z best={'block_sizes': [1],
2026-02-21T11:46:22.1800578Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:46:22.1802111Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:46:22.1802949Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', 'first'],
2026-02-21T11:46:22.1803539Z  'num_stages': 2,
2026-02-21T11:46:22.1803863Z  'num_warps': 16,
2026-02-21T11:46:22.1804713Z  'pid_type': 'flat',
2026-02-21T11:46:22.1805062Z  'range_flattens': [None],
2026-02-21T11:46:22.1805439Z  'range_multi_buffers': [None],
2026-02-21T11:46:22.1805834Z  'range_num_stages': [0],
2026-02-21T11:46:22.1806196Z  'range_unroll_factors': [0],
2026-02-21T11:46:22.1806591Z  'range_warp_specializes': [],
2026-02-21T11:46:22.1806975Z  'reduction_loops': [None]}
2026-02-21T11:46:22.1841274Z [393s] Fitting surrogate: 698 points, 698 targets
2026-02-21T11:46:22.8078309Z [394s] Generation 10 starting: 34 neighbors, 3 active search path(s)
2026-02-21T11:46:31.3221001Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 18.8 configs/s
2026-02-21T11:46:33.3957414Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 17.2 configs/s
2026-02-21T11:46:42.3632362Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 111.6         
2026-02-21T11:46:42.3632880Z                                                                   configs/s     
2026-02-21T11:46:42.7575158Z [414s] Generation 10 complete: 
2026-02-21T11:46:42.7575753Z error=1
2026-02-21T11:46:42.7576166Z ok=36
2026-02-21T11:46:42.7576463Z min=0.1623
2026-02-21T11:46:42.7576660Z mid=0.1636
2026-02-21T11:46:42.7576862Z max=0.2430
2026-02-21T11:46:42.7577054Z best={'block_sizes': [1],
2026-02-21T11:46:42.7577478Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:46:42.7578109Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:46:42.7578640Z  'load_eviction_policies': ['last', '', '', '', 'last', '', 'first', 'first'],
2026-02-21T11:46:42.7579017Z  'num_stages': 7,
2026-02-21T11:46:42.7579218Z  'num_warps': 16,
2026-02-21T11:46:42.7579413Z  'pid_type': 'flat',
2026-02-21T11:46:42.7579616Z  'range_flattens': [None],
2026-02-21T11:46:42.7579847Z  'range_multi_buffers': [None],
2026-02-21T11:46:42.7580088Z  'range_num_stages': [0],
2026-02-21T11:46:42.7580311Z  'range_unroll_factors': [0],
2026-02-21T11:46:42.7580563Z  'range_warp_specializes': [],
2026-02-21T11:46:42.7580805Z  'reduction_loops': [None]}
2026-02-21T11:46:42.7627982Z [414s] Fitting surrogate: 735 points, 735 targets
2026-02-21T11:46:43.4416131Z [415s] Generation 11 starting: 37 neighbors, 3 active search path(s)
2026-02-21T11:46:52.6100846Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 2.9 configs/s
2026-02-21T11:46:54.6924223Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 18.2 configs/s
2026-02-21T11:47:03.7776168Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 110.2         
2026-02-21T11:47:03.7780450Z                                                                   configs/s     
2026-02-21T11:47:04.1655027Z [435s] Generation 11 complete: 
2026-02-21T11:47:04.1655501Z error=3
2026-02-21T11:47:04.1655777Z ok=37
2026-02-21T11:47:04.1656065Z min=0.1621
2026-02-21T11:47:04.1656342Z mid=0.1631
2026-02-21T11:47:04.1656616Z max=0.2930
2026-02-21T11:47:04.1656907Z best={'block_sizes': [1],
2026-02-21T11:47:04.1657661Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:47:04.1658679Z               'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:47:04.1659578Z  'load_eviction_policies': ['last', '', '', '', 'last', '', 'first', 'first'],
2026-02-21T11:47:04.1660350Z  'num_stages': 8,
2026-02-21T11:47:04.1660659Z  'num_warps': 16,
2026-02-21T11:47:04.1660870Z  'pid_type': 'flat',
2026-02-21T11:47:04.1661074Z  'range_flattens': [None],
2026-02-21T11:47:04.1661310Z  'range_multi_buffers': [None],
2026-02-21T11:47:04.1661544Z  'range_num_stages': [0],
2026-02-21T11:47:04.1662270Z  'range_unroll_factors': [0],
2026-02-21T11:47:04.1662528Z  'range_warp_specializes': [],
2026-02-21T11:47:04.1662780Z  'reduction_loops': [None]}
2026-02-21T11:47:04.1700669Z [435s] Fitting surrogate: 775 points, 775 targets
2026-02-21T11:47:04.6733067Z [436s] Generation 12 starting: 24 neighbors, 2 active search path(s)
2026-02-21T11:47:10.9337267Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 7.5 configs/s
2026-02-21T11:47:12.4632759Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 16.8 configs/s
2026-02-21T11:47:18.9914273Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 152.9         
2026-02-21T11:47:18.9914794Z                                                                   configs/s     
2026-02-21T11:47:19.2890044Z [451s] Generation 12 complete: 
2026-02-21T11:47:19.2890334Z ok=27
2026-02-21T11:47:19.2890526Z min=0.1620
2026-02-21T11:47:19.2890685Z mid=0.1629
2026-02-21T11:47:19.2890832Z max=0.4078
2026-02-21T11:47:19.2891006Z best={'block_sizes': [1],
2026-02-21T11:47:19.2891404Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:47:19.2891973Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:47:19.2892473Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', '', 'first'],
2026-02-21T11:47:19.2892798Z  'num_stages': 3,
2026-02-21T11:47:19.2892965Z  'num_warps': 16,
2026-02-21T11:47:19.2893137Z  'pid_type': 'flat',
2026-02-21T11:47:19.2893316Z  'range_flattens': [None],
2026-02-21T11:47:19.2893520Z  'range_multi_buffers': [None],
2026-02-21T11:47:19.2893727Z  'range_num_stages': [0],
2026-02-21T11:47:19.2893931Z  'range_unroll_factors': [0],
2026-02-21T11:47:19.2894408Z  'range_warp_specializes': [],
2026-02-21T11:47:19.2894640Z  'reduction_loops': [None]}
2026-02-21T11:47:19.2938757Z [451s] Fitting surrogate: 802 points, 802 targets
2026-02-21T11:47:19.5728067Z [451s] Generation 13 starting: 8 neighbors, 1 active search path(s)
2026-02-21T11:47:21.6886488Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 14.4 configs/s
2026-02-21T11:47:22.1601058Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 19.0 configs/s
2026-02-21T11:47:24.4419841Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 429.7         
2026-02-21T11:47:24.4420500Z                                                                   configs/s     
2026-02-21T11:47:24.5885423Z [456s] Generation 13 complete: 
2026-02-21T11:47:24.5885688Z ok=9
2026-02-21T11:47:24.5885862Z min=0.1646
2026-02-21T11:47:24.5886068Z mid=0.1649
2026-02-21T11:47:24.5886238Z max=0.2166
2026-02-21T11:47:24.5886432Z best={'block_sizes': [1],
2026-02-21T11:47:24.5886913Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:47:24.5887550Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:47:24.5888002Z               'tensor_descriptor'],
2026-02-21T11:47:24.5888392Z  'load_eviction_policies': ['', '', 'last', '', 'first', '', 'last', 'first'],
2026-02-21T11:47:24.5888784Z  'num_stages': 3,
2026-02-21T11:47:24.5888978Z  'num_warps': 16,
2026-02-21T11:47:24.5889171Z  'pid_type': 'flat',
2026-02-21T11:47:24.5889384Z  'range_flattens': [None],
2026-02-21T11:47:24.5889625Z  'range_multi_buffers': [None],
2026-02-21T11:47:24.5889951Z  'range_num_stages': [0],
2026-02-21T11:47:24.5890192Z  'range_unroll_factors': [0],
2026-02-21T11:47:24.5890435Z  'range_warp_specializes': [],
2026-02-21T11:47:24.5890676Z  'reduction_loops': [None]}
2026-02-21T11:47:24.5931251Z [456s] Fitting surrogate: 811 points, 811 targets
2026-02-21T11:47:24.7528834Z [456s] Autotuning complete in 456.6s after searching 770 configs.
2026-02-21T11:47:24.7529284Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:47:24.7531198Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', '', 'last', '', 'first', '', 'last', 'first'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[None]), static_shapes=True)
2026-02-21T11:47:24.7533448Z 
2026-02-21T11:47:24.7533819Z [456s] Code of selected kernel: /tmp/torchinductor_root/2z/c2zi643bxekszqvgws4ksxzyy6lhofgnthcuxvcc6fczrvhyqxcb.py
2026-02-21T11:47:24.7822956Z from __future__ import annotations
2026-02-21T11:47:24.7823154Z 
2026-02-21T11:47:24.7823235Z import torch
2026-02-21T11:47:24.7823426Z import triton
2026-02-21T11:47:24.7823926Z import triton.language as tl
2026-02-21T11:47:24.7824429Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:47:24.7824870Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:47:24.7825149Z 
2026-02-21T11:47:24.7825231Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:47:24.7825388Z 
2026-02-21T11:47:24.7825453Z @triton.jit
2026-02-21T11:47:24.7825790Z def _helion_layer_norm_fwd(x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1: tl.constexpr):
2026-02-21T11:47:24.7826259Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:47:24.7826553Z     pid_0 = tl.program_id(0)
2026-02-21T11:47:24.7826764Z     offset_0 = pid_0
2026-02-21T11:47:24.7826985Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:47:24.7827292Z     indices_1 = tl.arange(0, _RDIM_SIZE_1).to(tl.int32)
2026-02-21T11:47:24.7827579Z     mask_1 = indices_1 < 14336
2026-02-21T11:47:24.7827862Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:47:24.7828355Z     acc = tl.load(x + (indices_0[:, None] * 14336 + indices_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:47:24.7828854Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:47:24.7829198Z     sum_1 = tl.cast(tl.sum(acc, 1), tl.float32)
2026-02-21T11:47:24.7829462Z     v_0 = 6.975446428571428e-05
2026-02-21T11:47:24.7829665Z     v_1 = sum_1 * v_0
2026-02-21T11:47:24.7829942Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:47:24.7830254Z     subscript = v_1[:, None]
2026-02-21T11:47:24.7830464Z     v_2 = acc - subscript
2026-02-21T11:47:24.7830781Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:47:24.7831129Z     v_3 = v_2 * v_2
2026-02-21T11:47:24.7831554Z     _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _RDIM_SIZE_1]), v_3, tl.full([], 0, tl.float32))
2026-02-21T11:47:24.7832078Z     sum_2 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:47:24.7832351Z     v_4 = 6.975446428571428e-05
2026-02-21T11:47:24.7832556Z     v_5 = sum_2 * v_4
2026-02-21T11:47:24.7832809Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:47:24.7833119Z     v_6 = v_5 + eps
2026-02-21T11:47:24.7833310Z     v_7 = libdevice.rsqrt(v_6)
2026-02-21T11:47:24.7833614Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:47:24.7833941Z     subscript_1 = v_7[:, None]
2026-02-21T11:47:24.7834293Z     v_8 = v_2 * subscript_1
2026-02-21T11:47:24.7834609Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:47:24.7835031Z     load_1 = tl.load(weight + indices_1 * 1, mask_1, other=0)
2026-02-21T11:47:24.7835333Z     v_9 = load_1[None, :]
2026-02-21T11:47:24.7835505Z     v_10 = v_8 * v_9
2026-02-21T11:47:24.7835710Z     # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:47:24.7836065Z     load_2 = tl.load(bias + indices_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T11:47:24.7836514Z     # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:47:24.7836877Z     # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:47:24.7837286Z     # src[layer_norm.py:75]: )
2026-02-21T11:47:24.7837476Z     v_11 = load_2[None, :]
2026-02-21T11:47:24.7837648Z     v_12 = v_10 + v_11
2026-02-21T11:47:24.7837863Z     # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:47:24.7838243Z     tl.store(out + (indices_0[:, None] * 14336 + indices_1[None, :] * 1), v_12, mask_1[None, :])
2026-02-21T11:47:24.7838631Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:47:24.7838890Z     tl.store(mean + indices_0 * 1, v_1, None)
2026-02-21T11:47:24.7839134Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:47:24.7839382Z     tl.store(rstd + indices_0 * 1, v_7, None)
2026-02-21T11:47:24.7839538Z 
2026-02-21T11:47:24.7840102Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:47:24.7840685Z     """
2026-02-21T11:47:24.7840914Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:47:24.7841209Z     Args:
2026-02-21T11:47:24.7841476Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:47:24.7841998Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:47:24.7842483Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:47:24.7842891Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:47:24.7843386Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:47:24.7843755Z     Returns:
2026-02-21T11:47:24.7843954Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:47:24.7844458Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:47:24.7844837Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:47:24.7845223Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:47:24.7845529Z     """
2026-02-21T11:47:24.7845696Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:47:24.7845908Z     m, n = x.size()
2026-02-21T11:47:24.7846234Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:47:24.7846708Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:47:24.7847042Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:47:24.7847417Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:47:24.7847775Z     if bias is not None:
2026-02-21T11:47:24.7848096Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:47:24.7848526Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:47:24.7848890Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:47:24.7849279Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:47:24.7849616Z     # src[layer_norm.py:52]: )
2026-02-21T11:47:24.7850043Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:47:24.7850460Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:47:24.7850842Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:47:24.7851178Z     # src[layer_norm.py:55]: )
2026-02-21T11:47:24.7851500Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:47:24.7851968Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:47:24.7852340Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:47:24.7852882Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:47:24.7853275Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:47:24.7853677Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:47:24.7854195Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:47:24.7854509Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:47:24.7854757Z     _RDIM_SIZE_1 = 16384
2026-02-21T11:47:24.7854961Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:47:24.7855272Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:47:24.7855576Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:47:24.7855964Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:47:24.7856411Z     _launcher(_helion_layer_norm_fwd, (4096,), x, weight, bias, out, mean, rstd, eps, _RDIM_SIZE_1, num_warps=16, num_stages=3)
2026-02-21T11:47:24.7856884Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:47:24.7857146Z     return (out, mean, rstd)
2026-02-21T11:47:25.9415256Z WARNING:tritonbench.utils.triton_op:Completed input ID 26:
2026-02-21T11:47:25.9415980Z (M, N)
2026-02-21T11:47:25.9416218Z -------------
2026-02-21T11:47:25.9416396Z (4096, 14336)
2026-02-21T11:47:25.9416508Z 
2026-02-21T11:47:25.9432878Z  90%|█████████ | 18/20 [1:46:22<13:57, 418.86s/it]WARNING:tritonbench.utils.triton_op:Running input ID 27:
2026-02-21T11:47:25.9433304Z (M, N)
2026-02-21T11:47:25.9433479Z -------------
2026-02-21T11:47:25.9433643Z (4096, 14848)
2026-02-21T11:47:25.9436380Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T11:47:27.1928113Z INFO:tritonbench.utils.triton_op:Took 3.28ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:47:28.7719561Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:47:30.1509439Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:47:30.1509969Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:47:30.1510427Z               'dtype': 'torch.float32',
2026-02-21T11:47:30.1510865Z               'shape': (4096, 14848),
2026-02-21T11:47:30.1511304Z               'stride': (14848, 1)},
2026-02-21T11:47:30.1511728Z             (14848,),
2026-02-21T11:47:30.1512082Z             { 'device': 'cuda:0',
2026-02-21T11:47:30.1512473Z               'dtype': 'torch.float32',
2026-02-21T11:47:30.1512887Z               'shape': (14848,),
2026-02-21T11:47:30.1513287Z               'stride': (1,)},
2026-02-21T11:47:30.1513671Z             { 'device': 'cuda:0',
2026-02-21T11:47:30.1514569Z               'dtype': 'torch.float32',
2026-02-21T11:47:30.1514986Z               'shape': (14848,),
2026-02-21T11:47:30.1515378Z               'stride': (1,)},
2026-02-21T11:47:30.1515717Z             1e-05),
2026-02-21T11:47:30.1516043Z   'kwargs': {}}
2026-02-21T11:47:30.1559554Z INFO:tritonbench.utils.triton_op:Took 5.39ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:47:30.1644888Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:47:30.1646344Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:47:30.1647363Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:47:30.1647986Z While processing:
2026-02-21T11:47:30.1648732Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:47:30.1649126Z     if bias is not None:
2026-02-21T11:47:30.1649315Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:47:30.1649428Z 
2026-02-21T11:47:30.3294902Z [0s] Autotune random seed: 2141537047
2026-02-21T11:47:30.3760982Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:48:08.3102510Z [37s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:48:09.7368093Z [39s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:48:13.4762997Z [43s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:48:22.7097230Z [52s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:48:26.1539908Z [55s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:48:26.1559425Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:48:33.9321997Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.9 configs/s
2026-02-21T11:48:33.9338476Z [63s] Adaptive compile timeout: 30s (90% percentile=21.0s, bounds=[30.0s, 30s])
2026-02-21T11:48:37.1941757Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━━━ 898/898 269.4 configs/s
2026-02-21T11:48:37.3729304Z [66s] Initial random population of 100, 5 starting points: 
2026-02-21T11:48:37.3729677Z error=7
2026-02-21T11:48:37.3729858Z timeout=5
2026-02-21T11:48:37.3730123Z ok=88
2026-02-21T11:48:37.3730300Z min=0.2231
2026-02-21T11:48:37.3730470Z mid=0.7102
2026-02-21T11:48:37.3730645Z max=61.2382
2026-02-21T11:48:37.3730837Z best={'block_sizes': [1],
2026-02-21T11:48:37.3731256Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:48:37.3731927Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:48:37.3732391Z               'tensor_descriptor'],
2026-02-21T11:48:37.3733387Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:48:37.3733796Z  'maxnreg': 128,
2026-02-21T11:48:37.3734342Z  'num_sm_multiplier': 8,
2026-02-21T11:48:37.3734570Z  'num_stages': 3,
2026-02-21T11:48:37.3734774Z  'num_warps': 4,
2026-02-21T11:48:37.3735034Z  'pid_type': 'persistent_blocked',
2026-02-21T11:48:37.3735370Z  'range_flattens': [None],
2026-02-21T11:48:37.3735634Z  'range_multi_buffers': [None],
2026-02-21T11:48:37.3735866Z  'range_num_stages': [1],
2026-02-21T11:48:37.3736104Z  'range_unroll_factors': [3],
2026-02-21T11:48:37.3736349Z  'range_warp_specializes': [],
2026-02-21T11:48:37.3736590Z  'reduction_loops': [8192]}
2026-02-21T11:48:37.3752122Z [66s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:48:38.8543753Z [68s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T11:49:02.9725669Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 6.6 configs/s
2026-02-21T11:49:08.7462245Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.6 configs/s
2026-02-21T11:49:22.5777651Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 72.4 configs/s
2026-02-21T11:49:23.0725843Z [112s] Generation 1 complete: 
2026-02-21T11:49:23.0726126Z error=3
2026-02-21T11:49:23.0726302Z ok=94
2026-02-21T11:49:23.0726487Z min=0.1771
2026-02-21T11:49:23.0726671Z mid=0.2718
2026-02-21T11:49:23.0726848Z max=0.8586
2026-02-21T11:49:23.0727029Z best={'block_sizes': [1],
2026-02-21T11:49:23.0727448Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:49:23.0728032Z               'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:49:23.0728458Z               'tensor_descriptor'],
2026-02-21T11:49:23.0728872Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:49:23.0729295Z  'maxnreg': 128,
2026-02-21T11:49:23.0729509Z  'num_sm_multiplier': 8,
2026-02-21T11:49:23.0729777Z  'num_stages': 3,
2026-02-21T11:49:23.0730105Z  'num_warps': 16,
2026-02-21T11:49:23.0730327Z  'pid_type': 'persistent_blocked',
2026-02-21T11:49:23.0730597Z  'range_flattens': [None],
2026-02-21T11:49:23.0730833Z  'range_multi_buffers': [None],
2026-02-21T11:49:23.0731085Z  'range_num_stages': [1],
2026-02-21T11:49:23.0731317Z  'range_unroll_factors': [2],
2026-02-21T11:49:23.0731575Z  'range_warp_specializes': [],
2026-02-21T11:49:23.0731823Z  'reduction_loops': [8192]}
2026-02-21T11:49:23.0754534Z [112s] Fitting surrogate: 197 points, 197 targets
2026-02-21T11:49:24.5808417Z [114s] Generation 2 starting: 94 neighbors, 5 active search path(s)
2026-02-21T11:50:17.3355541Z [166s] Timeout after 30s compiling Config(block_sizes=[4], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last', 'first', 'first', 'last', 'first', '', 'last'], maxnreg=128, num_sm_multiplier=64, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[True], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T11:50:17.3376579Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98/98 0.3 configs/s
2026-02-21T11:50:22.2389179Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 98/98 20.2 configs/s
2026-02-21T11:50:40.8001807Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 54.1 configs/s
2026-02-21T11:50:41.4669939Z [191s] Generation 2 complete: 
2026-02-21T11:50:41.4670212Z error=20
2026-02-21T11:50:41.4670392Z timeout=1
2026-02-21T11:50:41.4670555Z ok=79
2026-02-21T11:50:41.4670720Z min=0.1691
2026-02-21T11:50:41.4670908Z mid=0.2081
2026-02-21T11:50:41.4671075Z max=1.3844
2026-02-21T11:50:41.4671255Z best={'block_sizes': [2],
2026-02-21T11:50:41.4671648Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:50:41.4673239Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:50:41.4674507Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T11:50:41.4675045Z  'num_stages': 1,
2026-02-21T11:50:41.4675355Z  'num_warps': 32,
2026-02-21T11:50:41.4675679Z  'pid_type': 'flat',
2026-02-21T11:50:41.4676017Z  'range_flattens': [None],
2026-02-21T11:50:41.4676419Z  'range_multi_buffers': [None],
2026-02-21T11:50:41.4676802Z  'range_num_stages': [0],
2026-02-21T11:50:41.4677166Z  'range_unroll_factors': [0],
2026-02-21T11:50:41.4677550Z  'range_warp_specializes': [],
2026-02-21T11:50:41.4677942Z  'reduction_loops': [None]}
2026-02-21T11:50:41.4703747Z [191s] Fitting surrogate: 297 points, 297 targets
2026-02-21T11:50:42.6522876Z [192s] Generation 3 starting: 75 neighbors, 5 active search path(s)
2026-02-21T11:51:02.8571322Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 4.8 configs/s
2026-02-21T11:51:07.0180960Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 19.5 configs/s
2026-02-21T11:51:24.8672250Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 60.6 configs/s
2026-02-21T11:51:25.4713927Z [235s] Generation 3 complete: 
2026-02-21T11:51:25.4714854Z error=13
2026-02-21T11:51:25.4715148Z ok=68
2026-02-21T11:51:25.4715413Z min=0.1683
2026-02-21T11:51:25.4715700Z mid=0.2016
2026-02-21T11:51:25.4715976Z max=0.4553
2026-02-21T11:51:25.4716284Z best={'block_sizes': [2],
2026-02-21T11:51:25.4716953Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:51:25.4717851Z               'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T11:51:25.4718610Z  'load_eviction_policies': ['', '', '', '', '', '', '', ''],
2026-02-21T11:51:25.4719138Z  'num_stages': 1,
2026-02-21T11:51:25.4719473Z  'num_warps': 32,
2026-02-21T11:51:25.4719802Z  'pid_type': 'flat',
2026-02-21T11:51:25.4720146Z  'range_flattens': [None],
2026-02-21T11:51:25.4720543Z  'range_multi_buffers': [None],
2026-02-21T11:51:25.4720941Z  'range_num_stages': [0],
2026-02-21T11:51:25.4721302Z  'range_unroll_factors': [0],
2026-02-21T11:51:25.4721706Z  'range_warp_specializes': [],
2026-02-21T11:51:25.4722094Z  'reduction_loops': [None]}
2026-02-21T11:51:25.4743104Z [235s] Fitting surrogate: 378 points, 378 targets
2026-02-21T11:51:26.5316722Z [236s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T11:51:48.7863658Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 0.3 configs/s
2026-02-21T11:51:52.3361834Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 19.1 configs/s
2026-02-21T11:52:05.0964977Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 78.5 configs/s
2026-02-21T11:52:05.5905071Z [275s] Generation 4 complete: 
2026-02-21T11:52:05.5905388Z error=10
2026-02-21T11:52:05.5905570Z ok=61
2026-02-21T11:52:05.5905740Z min=0.1676
2026-02-21T11:52:05.5905906Z mid=0.1800
2026-02-21T11:52:05.5906771Z max=0.9194
2026-02-21T11:52:05.5906952Z best={'block_sizes': [2],
2026-02-21T11:52:05.5907376Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:52:05.5907956Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T11:52:05.5908379Z               'tensor_descriptor'],
2026-02-21T11:52:05.5908735Z  'load_eviction_policies': ['', '', 'last', 'last', '', '', 'first', 'first'],
2026-02-21T11:52:05.5909115Z  'num_stages': 8,
2026-02-21T11:52:05.5909310Z  'num_warps': 32,
2026-02-21T11:52:05.5909499Z  'pid_type': 'flat',
2026-02-21T11:52:05.5909714Z  'range_flattens': [None],
2026-02-21T11:52:05.5909943Z  'range_multi_buffers': [None],
2026-02-21T11:52:05.5910184Z  'range_num_stages': [0],
2026-02-21T11:52:05.5910739Z  'range_unroll_factors': [0],
2026-02-21T11:52:05.5910996Z  'range_warp_specializes': [],
2026-02-21T11:52:05.5911232Z  'reduction_loops': [None]}
2026-02-21T11:52:05.5947466Z [275s] Fitting surrogate: 449 points, 449 targets
2026-02-21T11:52:06.5151595Z [276s] Generation 5 starting: 55 neighbors, 5 active search path(s)
2026-02-21T11:52:20.7966764Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 5.5 configs/s
2026-02-21T11:52:23.7944259Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 19.3 configs/s
2026-02-21T11:52:35.7952786Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 83.5 configs/s
2026-02-21T11:52:36.2784780Z [305s] Generation 5 complete: 
2026-02-21T11:52:36.2785088Z error=8
2026-02-21T11:52:36.2785256Z ok=52
2026-02-21T11:52:36.2785424Z min=0.1678
2026-02-21T11:52:36.2785593Z mid=0.1772
2026-02-21T11:52:36.2785771Z max=0.4140
2026-02-21T11:52:36.2785947Z best={'block_sizes': [1],
2026-02-21T11:52:36.2786371Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:52:36.2786924Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:52:36.2787389Z  'load_eviction_policies': ['last', '', '', '', '', '', '', ''],
2026-02-21T11:52:36.2787725Z  'num_stages': 1,
2026-02-21T11:52:36.2787913Z  'num_warps': 32,
2026-02-21T11:52:36.2788106Z  'pid_type': 'flat',
2026-02-21T11:52:36.2788313Z  'range_flattens': [None],
2026-02-21T11:52:36.2788546Z  'range_multi_buffers': [None],
2026-02-21T11:52:36.2788780Z  'range_num_stages': [0],
2026-02-21T11:52:36.2789019Z  'range_unroll_factors': [0],
2026-02-21T11:52:36.2789271Z  'range_warp_specializes': [],
2026-02-21T11:52:36.2789512Z  'reduction_loops': [4096]}
2026-02-21T11:52:36.2826035Z [305s] Fitting surrogate: 509 points, 509 targets
2026-02-21T11:52:37.0910178Z [306s] Generation 6 starting: 47 neighbors, 4 active search path(s)
2026-02-21T11:52:50.7343719Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 1.7 configs/s
2026-02-21T11:52:53.5140682Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 17.9 configs/s
2026-02-21T11:53:05.1321680Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 86.3 configs/s
2026-02-21T11:53:05.6103019Z [335s] Generation 6 complete: 
2026-02-21T11:53:05.6103316Z error=3
2026-02-21T11:53:05.6103492Z ok=49
2026-02-21T11:53:05.6103656Z min=0.1678
2026-02-21T11:53:05.6103828Z mid=0.1749
2026-02-21T11:53:05.6104158Z max=1.0156
2026-02-21T11:53:05.6104354Z best={'block_sizes': [1],
2026-02-21T11:53:05.6104755Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T11:53:05.6105297Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:53:05.6105748Z  'load_eviction_policies': ['last', '', '', '', '', '', '', ''],
2026-02-21T11:53:05.6106077Z  'num_stages': 1,
2026-02-21T11:53:05.6106275Z  'num_warps': 32,
2026-02-21T11:53:05.6106495Z  'pid_type': 'flat',
2026-02-21T11:53:05.6106709Z  'range_flattens': [None],
2026-02-21T11:53:05.6106949Z  'range_multi_buffers': [None],
2026-02-21T11:53:05.6107200Z  'range_num_stages': [0],
2026-02-21T11:53:05.6108008Z  'range_unroll_factors': [0],
2026-02-21T11:53:05.6108249Z  'range_warp_specializes': [],
2026-02-21T11:53:05.6108495Z  'reduction_loops': [4096]}
2026-02-21T11:53:05.6145926Z [335s] Fitting surrogate: 561 points, 561 targets
2026-02-21T11:53:06.1495231Z [335s] Generation 7 starting: 27 neighbors, 3 active search path(s)
2026-02-21T11:53:13.7002443Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 2.1 configs/s
2026-02-21T11:53:15.1967027Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 27/27 18.7 configs/s
2026-02-21T11:53:24.2968250Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 131.6         
2026-02-21T11:53:24.2968780Z                                                                   configs/s     
2026-02-21T11:53:24.6272455Z [354s] Generation 7 complete: 
2026-02-21T11:53:24.6272794Z error=2
2026-02-21T11:53:24.6272980Z ok=29
2026-02-21T11:53:24.6273152Z min=0.1676
2026-02-21T11:53:24.6273335Z mid=0.1715
2026-02-21T11:53:24.6273538Z max=0.2093
2026-02-21T11:53:24.6273730Z best={'block_sizes': [1],
2026-02-21T11:53:24.6274392Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:53:24.6274991Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:53:24.6275451Z  'load_eviction_policies': ['last', '', '', '', '', '', '', ''],
2026-02-21T11:53:24.6275825Z  'num_stages': 1,
2026-02-21T11:53:24.6276050Z  'num_warps': 32,
2026-02-21T11:53:24.6276243Z  'pid_type': 'flat',
2026-02-21T11:53:24.6276436Z  'range_flattens': [None],
2026-02-21T11:53:24.6276658Z  'range_multi_buffers': [None],
2026-02-21T11:53:24.6276897Z  'range_num_stages': [0],
2026-02-21T11:53:24.6277102Z  'range_unroll_factors': [0],
2026-02-21T11:53:24.6277330Z  'range_warp_specializes': [],
2026-02-21T11:53:24.6277540Z  'reduction_loops': [4096]}
2026-02-21T11:53:24.6302908Z [354s] Fitting surrogate: 592 points, 592 targets
2026-02-21T11:53:25.0069325Z [354s] Generation 8 starting: 15 neighbors, 2 active search path(s)
2026-02-21T11:53:29.2906607Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 2.7 configs/s
2026-02-21T11:53:30.2440091Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 16/16 17.6 configs/s
2026-02-21T11:53:34.9209362Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 212.5         
2026-02-21T11:53:34.9210018Z                                                                   configs/s     
2026-02-21T11:53:35.1503791Z [364s] Generation 8 complete: 
2026-02-21T11:53:35.1504213Z ok=18
2026-02-21T11:53:35.1504385Z min=0.1671
2026-02-21T11:53:35.1504563Z mid=0.1715
2026-02-21T11:53:35.1504728Z max=0.2368
2026-02-21T11:53:35.1504910Z best={'block_sizes': [1],
2026-02-21T11:53:35.1505371Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:53:35.1505948Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:53:35.1506391Z  'load_eviction_policies': ['last', '', '', '', '', '', '', ''],
2026-02-21T11:53:35.1506739Z  'num_stages': 1,
2026-02-21T11:53:35.1506928Z  'num_warps': 32,
2026-02-21T11:53:35.1507115Z  'pid_type': 'flat',
2026-02-21T11:53:35.1507323Z  'range_flattens': [None],
2026-02-21T11:53:35.1507549Z  'range_multi_buffers': [None],
2026-02-21T11:53:35.1507787Z  'range_num_stages': [0],
2026-02-21T11:53:35.1508005Z  'range_unroll_factors': [0],
2026-02-21T11:53:35.1508257Z  'range_warp_specializes': [],
2026-02-21T11:53:35.1508495Z  'reduction_loops': [4096]}
2026-02-21T11:53:35.1540111Z [364s] Fitting surrogate: 610 points, 610 targets
2026-02-21T11:53:35.5331793Z [365s] Generation 9 starting: 17 neighbors, 2 active search path(s)
2026-02-21T11:53:40.2632477Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 3.5 configs/s
2026-02-21T11:53:41.0933932Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 17/17 22.0 configs/s
2026-02-21T11:53:45.2050399Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 241.3         
2026-02-21T11:53:45.2051534Z                                                                   configs/s     
2026-02-21T11:53:45.4161395Z [375s] Generation 9 complete: 
2026-02-21T11:53:45.4161697Z error=3
2026-02-21T11:53:45.4161870Z ok=17
2026-02-21T11:53:45.4162044Z min=0.1676
2026-02-21T11:53:45.4162227Z mid=0.1714
2026-02-21T11:53:45.4162406Z max=0.9960
2026-02-21T11:53:45.4162595Z best={'block_sizes': [1],
2026-02-21T11:53:45.4163040Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:53:45.4163630Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:53:45.4164279Z  'load_eviction_policies': ['last', '', '', '', '', '', '', ''],
2026-02-21T11:53:45.4165233Z  'num_stages': 1,
2026-02-21T11:53:45.4165468Z  'num_warps': 32,
2026-02-21T11:53:45.4165680Z  'pid_type': 'flat',
2026-02-21T11:53:45.4165900Z  'range_flattens': [None],
2026-02-21T11:53:45.4166145Z  'range_multi_buffers': [None],
2026-02-21T11:53:45.4166406Z  'range_num_stages': [0],
2026-02-21T11:53:45.4166635Z  'range_unroll_factors': [0],
2026-02-21T11:53:45.4166885Z  'range_warp_specializes': [],
2026-02-21T11:53:45.4167126Z  'reduction_loops': [4096]}
2026-02-21T11:53:45.4197974Z [375s] Fitting surrogate: 630 points, 630 targets
2026-02-21T11:53:45.8172163Z [375s] Generation 10 starting: 17 neighbors, 2 active search path(s)
2026-02-21T11:53:50.4812301Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 8.3 configs/s
2026-02-21T11:53:51.4976901Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 18.6 configs/s
2026-02-21T11:53:55.7857362Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 231.3         
2026-02-21T11:53:55.7858010Z                                                                   configs/s     
2026-02-21T11:53:55.9970029Z [385s] Generation 10 complete: 
2026-02-21T11:53:55.9970326Z error=1
2026-02-21T11:53:55.9970505Z ok=19
2026-02-21T11:53:55.9970697Z min=0.1675
2026-02-21T11:53:55.9970875Z mid=0.1711
2026-02-21T11:53:55.9971042Z max=0.9909
2026-02-21T11:53:55.9971233Z best={'block_sizes': [1],
2026-02-21T11:53:55.9971673Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:53:55.9972276Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:53:55.9972729Z  'load_eviction_policies': ['last', '', '', '', '', '', '', ''],
2026-02-21T11:53:55.9973070Z  'num_stages': 1,
2026-02-21T11:53:55.9973275Z  'num_warps': 32,
2026-02-21T11:53:55.9973468Z  'pid_type': 'flat',
2026-02-21T11:53:55.9973685Z  'range_flattens': [None],
2026-02-21T11:53:55.9973914Z  'range_multi_buffers': [None],
2026-02-21T11:53:55.9974544Z  'range_num_stages': [0],
2026-02-21T11:53:55.9974784Z  'range_unroll_factors': [0],
2026-02-21T11:53:55.9975033Z  'range_warp_specializes': [],
2026-02-21T11:53:55.9975273Z  'reduction_loops': [4096]}
2026-02-21T11:53:56.0008821Z [385s] Fitting surrogate: 650 points, 650 targets
2026-02-21T11:53:56.2819590Z [385s] Generation 11 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:53:59.1739963Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 2.4 configs/s
2026-02-21T11:53:59.7702576Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 18.2 configs/s
2026-02-21T11:54:02.8402521Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 321.6         
2026-02-21T11:54:02.8403046Z                                                                   configs/s     
2026-02-21T11:54:03.0138899Z [392s] Generation 11 complete: 
2026-02-21T11:54:03.0139182Z ok=12
2026-02-21T11:54:03.0139356Z min=0.1675
2026-02-21T11:54:03.0139540Z mid=0.1724
2026-02-21T11:54:03.0139713Z max=0.1798
2026-02-21T11:54:03.0140604Z best={'block_sizes': [1],
2026-02-21T11:54:03.0141084Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:54:03.0141672Z               'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:54:03.0142157Z  'load_eviction_policies': ['last', '', '', '', '', '', '', ''],
2026-02-21T11:54:03.0142564Z  'num_stages': 1,
2026-02-21T11:54:03.0142811Z  'num_warps': 32,
2026-02-21T11:54:03.0143026Z  'pid_type': 'flat',
2026-02-21T11:54:03.0143240Z  'range_flattens': [None],
2026-02-21T11:54:03.0143474Z  'range_multi_buffers': [None],
2026-02-21T11:54:03.0143709Z  'range_num_stages': [0],
2026-02-21T11:54:03.0143939Z  'range_unroll_factors': [0],
2026-02-21T11:54:03.0144491Z  'range_warp_specializes': [],
2026-02-21T11:54:03.0144744Z  'reduction_loops': [4096]}
2026-02-21T11:54:03.0176720Z [392s] Fitting surrogate: 662 points, 662 targets
2026-02-21T11:54:03.1665446Z [392s] Autotuning complete in 392.8s after searching 628 configs.
2026-02-21T11:54:03.1665929Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:54:03.1667851Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', '', '', '', '', '', '', ''], num_stages=1, num_warps=32, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[4096]), static_shapes=True)
2026-02-21T11:54:03.1669651Z 
2026-02-21T11:54:03.1670061Z [392s] Code of selected kernel: /tmp/torchinductor_root/dl/cdlung7yfzny3kvhbmcbmeowrkh4a5gjb6ppemfpdlytatygk554.py
2026-02-21T11:54:03.2035797Z from __future__ import annotations
2026-02-21T11:54:03.2036031Z 
2026-02-21T11:54:03.2036112Z import torch
2026-02-21T11:54:03.2036311Z import triton
2026-02-21T11:54:03.2036521Z import triton.language as tl
2026-02-21T11:54:03.2036887Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:54:03.2037361Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:54:03.2037673Z 
2026-02-21T11:54:03.2037773Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:54:03.2037944Z 
2026-02-21T11:54:03.2038022Z @triton.jit
2026-02-21T11:54:03.2038430Z def _helion_layer_norm_fwd(x, mean, rstd, weight, bias, out, eps, _REDUCTION_BLOCK_1: tl.constexpr):
2026-02-21T11:54:03.2038978Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:54:03.2039298Z     pid_0 = tl.program_id(0)
2026-02-21T11:54:03.2039541Z     offset_0 = pid_0
2026-02-21T11:54:03.2039784Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:54:03.2040174Z     # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:54:03.2040646Z     sum_1_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T11:54:03.2041136Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:54:03.2041552Z     for roffset_1 in tl.range(0, 14848, _REDUCTION_BLOCK_1):
2026-02-21T11:54:03.2041981Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:54:03.2042759Z         mask_1 = rindex_1 < 14848
2026-02-21T11:54:03.2043258Z         acc = tl.load(x + (indices_0[:, None] * 14848 + rindex_1[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_last')
2026-02-21T11:54:03.2043846Z         # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T11:54:03.2044520Z         v_0 = sum_1_acc + acc
2026-02-21T11:54:03.2044732Z         sum_1_acc = v_0
2026-02-21T11:54:03.2044965Z     sum_1 = tl.cast(tl.sum(sum_1_acc, 1), tl.float32)
2026-02-21T11:54:03.2045236Z     v_1 = 6.734913793103448e-05
2026-02-21T11:54:03.2045445Z     v_2 = sum_1 * v_1
2026-02-21T11:54:03.2045692Z     # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:54:03.2046007Z     subscript = v_2[:, None]
2026-02-21T11:54:03.2046592Z     # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:54:03.2047068Z     sum_2_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T11:54:03.2047483Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:54:03.2047843Z     for roffset_1 in tl.range(0, 14848, _REDUCTION_BLOCK_1):
2026-02-21T11:54:03.2048237Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:54:03.2048580Z         mask_1 = rindex_1 < 14848
2026-02-21T11:54:03.2048811Z         subscript_copy = subscript
2026-02-21T11:54:03.2049202Z         acc_1 = tl.load(x + (indices_0[:, None] * 14848 + rindex_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:54:03.2049688Z         # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:54:03.2050119Z         v_3 = acc_1 - subscript_copy
2026-02-21T11:54:03.2050463Z         # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T11:54:03.2050834Z         v_4 = v_3 * v_3
2026-02-21T11:54:03.2051324Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _REDUCTION_BLOCK_1]), v_4, tl.full([], 0, tl.float32))
2026-02-21T11:54:03.2051847Z         v_5 = sum_2_acc + _mask_to_1
2026-02-21T11:54:03.2052076Z         sum_2_acc = v_5
2026-02-21T11:54:03.2052300Z     sum_2 = tl.cast(tl.sum(sum_2_acc, 1), tl.float32)
2026-02-21T11:54:03.2052578Z     v_6 = 6.734913793103448e-05
2026-02-21T11:54:03.2052802Z     v_7 = sum_2 * v_6
2026-02-21T11:54:03.2053067Z     # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T11:54:03.2053364Z     v_8 = v_7 + eps
2026-02-21T11:54:03.2053536Z     v_9 = libdevice.rsqrt(v_8)
2026-02-21T11:54:03.2053808Z     # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:54:03.2054231Z     subscript_1 = v_9[:, None]
2026-02-21T11:54:03.2054457Z     # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T11:54:03.2054719Z     tl.store(mean + indices_0 * 1, v_2, None)
2026-02-21T11:54:03.2054978Z     # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T11:54:03.2055226Z     tl.store(rstd + indices_0 * 1, v_9, None)
2026-02-21T11:54:03.2055519Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:54:03.2055837Z     for roffset_1 in tl.range(0, 14848, _REDUCTION_BLOCK_1):
2026-02-21T11:54:03.2056182Z         rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T11:54:03.2056487Z         mask_1 = rindex_1 < 14848
2026-02-21T11:54:03.2056680Z         v_2_copy = v_2
2026-02-21T11:54:03.2056869Z         subscript_1_copy = subscript_1
2026-02-21T11:54:03.2057224Z         acc_2 = tl.load(x + (indices_0[:, None] * 14848 + rindex_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:54:03.2057657Z         # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T11:54:03.2057936Z         subscript_2 = v_2_copy[:, None]
2026-02-21T11:54:03.2058160Z         v_10 = acc_2 - subscript_2
2026-02-21T11:54:03.2058440Z         # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T11:54:03.2058748Z         v_11 = v_10 * subscript_1_copy
2026-02-21T11:54:03.2059260Z         # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:54:03.2059626Z         load_1 = tl.load(weight + rindex_1 * 1, mask_1, other=0)
2026-02-21T11:54:03.2059893Z         v_12 = load_1[None, :]
2026-02-21T11:54:03.2060075Z         v_13 = v_11 * v_12
2026-02-21T11:54:03.2060295Z         # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T11:54:03.2060592Z         load_2 = tl.load(bias + rindex_1 * 1, mask_1, other=0)
2026-02-21T11:54:03.2060936Z         # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T11:54:03.2061302Z         # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T11:54:03.2061562Z         # src[layer_norm.py:75]: )
2026-02-21T11:54:03.2061766Z         v_14 = load_2[None, :]
2026-02-21T11:54:03.2062102Z         v_15 = v_13 + v_14
2026-02-21T11:54:03.2062344Z         # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T11:54:03.2062731Z         tl.store(out + (indices_0[:, None] * 14848 + rindex_1[None, :] * 1), v_15, mask_1[None, :])
2026-02-21T11:54:03.2063040Z 
2026-02-21T11:54:03.2063481Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T11:54:03.2064190Z     """
2026-02-21T11:54:03.2064415Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T11:54:03.2064705Z     Args:
2026-02-21T11:54:03.2064975Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T11:54:03.2065493Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T11:54:03.2065973Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T11:54:03.2066390Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T11:54:03.2066877Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T11:54:03.2067270Z     Returns:
2026-02-21T11:54:03.2067478Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T11:54:03.2067836Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T11:54:03.2068208Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T11:54:03.2068555Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T11:54:03.2068874Z     """
2026-02-21T11:54:03.2069033Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T11:54:03.2069269Z     m, n = x.size()
2026-02-21T11:54:03.2069595Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T11:54:03.2070068Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T11:54:03.2070412Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T11:54:03.2070794Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:54:03.2071162Z     if bias is not None:
2026-02-21T11:54:03.2071471Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T11:54:03.2071907Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T11:54:03.2072266Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T11:54:03.2072651Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T11:54:03.2072996Z     # src[layer_norm.py:52]: )
2026-02-21T11:54:03.2073326Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T11:54:03.2073749Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T11:54:03.2074243Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T11:54:03.2074580Z     # src[layer_norm.py:55]: )
2026-02-21T11:54:03.2075094Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T11:54:03.2075552Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:54:03.2075933Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T11:54:03.2076302Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:54:03.2076696Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:54:03.2077079Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:54:03.2077461Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T11:54:03.2077932Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:54:03.2078205Z     _REDUCTION_BLOCK_1 = 4096
2026-02-21T11:54:03.2078436Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T11:54:03.2078745Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T11:54:03.2079042Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T11:54:03.2079284Z     # src[layer_norm.py:60-80]: ...
2026-02-21T11:54:03.2079731Z     _launcher(_helion_layer_norm_fwd, (4096,), x, mean, rstd, weight, bias, out, eps, _REDUCTION_BLOCK_1, num_warps=32, num_stages=1)
2026-02-21T11:54:03.2080220Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T11:54:03.2080477Z     return (out, mean, rstd)
2026-02-21T11:54:04.3573258Z WARNING:tritonbench.utils.triton_op:Completed input ID 27:
2026-02-21T11:54:04.3573722Z (M, N)
2026-02-21T11:54:04.3573938Z -------------
2026-02-21T11:54:04.3574389Z (4096, 14848)
2026-02-21T11:54:04.3574501Z 
2026-02-21T11:54:04.3596166Z  95%|█████████▌| 19/20 [1:53:01<06:52, 412.72s/it]WARNING:tritonbench.utils.triton_op:Running input ID 29:
2026-02-21T11:54:04.3596651Z (M, N)
2026-02-21T11:54:04.3596823Z -------------
2026-02-21T11:54:04.3597022Z (4096, 15872)
2026-02-21T11:54:04.3598778Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for torch_layer_norm
2026-02-21T11:54:05.5880562Z INFO:tritonbench.utils.triton_op:Took 3.36ms to get benchmark function for torch_compile_layer_norm
2026-02-21T11:54:07.1885682Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for liger_layer_norm
2026-02-21T11:54:08.5561764Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:54:08.5562106Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:54:08.5562408Z               'dtype': 'torch.float32',
2026-02-21T11:54:08.5562696Z               'shape': (4096, 15872),
2026-02-21T11:54:08.5562959Z               'stride': (15872, 1)},
2026-02-21T11:54:08.5563209Z             (15872,),
2026-02-21T11:54:08.5563436Z             { 'device': 'cuda:0',
2026-02-21T11:54:08.5563710Z               'dtype': 'torch.float32',
2026-02-21T11:54:08.5564285Z               'shape': (15872,),
2026-02-21T11:54:08.5564535Z               'stride': (1,)},
2026-02-21T11:54:08.5564778Z             { 'device': 'cuda:0',
2026-02-21T11:54:08.5565026Z               'dtype': 'torch.float32',
2026-02-21T11:54:08.5565298Z               'shape': (15872,),
2026-02-21T11:54:08.5565547Z               'stride': (1,)},
2026-02-21T11:54:08.5565770Z             1e-05),
2026-02-21T11:54:08.5565959Z   'kwargs': {}}
2026-02-21T11:54:08.5603275Z INFO:tritonbench.utils.triton_op:Took 4.53ms to get benchmark function for helion_layer_norm_tritonbench
2026-02-21T11:54:08.5686891Z WARNING[TensorOperationInWrapper]: A tensor operation outside of the `hl.tile` or `hl.grid` loop will not be fused in the generated kernel.
2026-02-21T11:54:08.5687785Z Use @helion.kernel(ignore_warnings=[helion.exc.TensorOperationInWrapper]) to suppress this warning.
2026-02-21T11:54:08.5688405Z If this is not a tensor operation, please report this as a bug.
2026-02-21T11:54:08.5688774Z While processing:
2026-02-21T11:54:08.5689241Z   File "/__w/helion/helion/examples/layer_norm.py", line 48, in layer_norm_fwd
2026-02-21T11:54:08.5690263Z     if bias is not None:
2026-02-21T11:54:08.5690495Z        ^^^^^^^^^^^^^^^^
2026-02-21T11:54:08.5690631Z 
2026-02-21T11:54:08.7274787Z [0s] Autotune random seed: 2141537047
2026-02-21T11:54:08.7729268Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:54:45.2395683Z [36s] Timeout after 30s compiling Config(block_sizes=[256], indexing=['pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first', 'last', 'last', 'first', '', 'first', 'last'], maxnreg=32, num_sm_multiplier=8, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True], range_multi_buffers=[None], range_num_stages=[3], range_unroll_factors=[2], range_warp_specializes=[], reduction_loops=[2048])
2026-02-21T11:54:46.7145332Z [37s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last', 'first', 'last', 'last', '', 'first', ''], num_stages=3, num_warps=4, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:54:50.5673255Z [41s] Timeout after 30s compiling Config(block_sizes=[64], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'last', 'first', '', 'first', 'last', '', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[0], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[512])
2026-02-21T11:55:00.0166284Z [51s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first', 'last', 'first', 'last', 'first', 'first', 'last'], num_sm_multiplier=16, num_stages=3, num_warps=16, pid_type='persistent_blocked', range_flattens=[None], range_multi_buffers=[False], range_num_stages=[2], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[256])
2026-02-21T11:55:03.5251428Z [54s] Timeout after 30s compiling Config(block_sizes=[1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', '', 'last', 'last', 'first', 'last', 'first', 'last'], maxnreg=256, num_sm_multiplier=1, num_stages=6, num_warps=16, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[1], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[1024])
2026-02-21T11:55:03.5273540Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T11:55:11.5081065Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.6 configs/s
2026-02-21T11:55:11.5093446Z [62s] Adaptive compile timeout: 30s (90% percentile=21.5s, bounds=[30.0s, 30s])
2026-02-21T11:55:16.1156256Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━━━ 823/823 175.9 configs/s
2026-02-21T11:55:16.3263371Z [67s] Initial random population of 100, 5 starting points: 
2026-02-21T11:55:16.3263784Z error=7
2026-02-21T11:55:16.3264343Z timeout=5
2026-02-21T11:55:16.3264550Z ok=88
2026-02-21T11:55:16.3266660Z min=0.2422
2026-02-21T11:55:16.3266882Z mid=0.7604
2026-02-21T11:55:16.3267508Z max=64.3352
2026-02-21T11:55:16.3267709Z best={'block_sizes': [1],
2026-02-21T11:55:16.3268128Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:55:16.3268788Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:55:16.3269269Z               'tensor_descriptor'],
2026-02-21T11:55:16.3269675Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:55:16.3270085Z  'maxnreg': 128,
2026-02-21T11:55:16.3270294Z  'num_sm_multiplier': 8,
2026-02-21T11:55:16.3270521Z  'num_stages': 3,
2026-02-21T11:55:16.3270724Z  'num_warps': 4,
2026-02-21T11:55:16.3270945Z  'pid_type': 'persistent_blocked',
2026-02-21T11:55:16.3271206Z  'range_flattens': [None],
2026-02-21T11:55:16.3271771Z  'range_multi_buffers': [None],
2026-02-21T11:55:16.3272037Z  'range_num_stages': [1],
2026-02-21T11:55:16.3272277Z  'range_unroll_factors': [3],
2026-02-21T11:55:16.3272527Z  'range_warp_specializes': [],
2026-02-21T11:55:16.3272797Z  'reduction_loops': [8192]}
2026-02-21T11:55:16.3285083Z [67s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:55:17.9355918Z [69s] Generation 1 starting: 97 neighbors, 5 active search path(s)
2026-02-21T11:55:47.6883694Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 102/102 2.3 configs/s
2026-02-21T11:55:53.9259376Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━ 102/102 16.5 configs/s
2026-02-21T11:56:09.7154740Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 63.4 configs/s
2026-02-21T11:56:10.2473233Z [121s] Generation 1 complete: 
2026-02-21T11:56:10.2473532Z error=3
2026-02-21T11:56:10.2473707Z ok=100
2026-02-21T11:56:10.2473883Z min=0.1864
2026-02-21T11:56:10.2474466Z mid=0.2792
2026-02-21T11:56:10.2474695Z max=0.6714
2026-02-21T11:56:10.2474880Z best={'block_sizes': [2],
2026-02-21T11:56:10.2475298Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:56:10.2475969Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:56:10.2476461Z               'tensor_descriptor'],
2026-02-21T11:56:10.2476869Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:56:10.2477271Z  'maxnreg': 128,
2026-02-21T11:56:10.2477480Z  'num_sm_multiplier': 8,
2026-02-21T11:56:10.2477700Z  'num_stages': 3,
2026-02-21T11:56:10.2477893Z  'num_warps': 16,
2026-02-21T11:56:10.2478102Z  'pid_type': 'persistent_blocked',
2026-02-21T11:56:10.2478368Z  'range_flattens': [None],
2026-02-21T11:56:10.2478614Z  'range_multi_buffers': [True],
2026-02-21T11:56:10.2478862Z  'range_num_stages': [1],
2026-02-21T11:56:10.2479096Z  'range_unroll_factors': [3],
2026-02-21T11:56:10.2479341Z  'range_warp_specializes': [],
2026-02-21T11:56:10.2479588Z  'reduction_loops': [8192]}
2026-02-21T11:56:10.2502474Z [121s] Fitting surrogate: 203 points, 203 targets
2026-02-21T11:56:11.8128910Z [123s] Generation 2 starting: 95 neighbors, 5 active search path(s)
2026-02-21T11:57:07.2984385Z [178s] Timeout after 30s compiling Config(block_sizes=[2], indexing=['pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', '', 'first', 'last', '', 'last', 'first', ''], maxnreg=256, num_sm_multiplier=4, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None], range_multi_buffers=[None], range_num_stages=[4], range_unroll_factors=[3], range_warp_specializes=[], reduction_loops=[8192])
2026-02-21T11:57:07.3002393Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 100/100 0.3 configs/s
2026-02-21T11:57:13.8894995Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━ 100/100 14.5 configs/s
2026-02-21T11:57:27.6678524Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 72.6 configs/s
2026-02-21T11:57:28.1539788Z [199s] Generation 2 complete: 
2026-02-21T11:57:28.1540732Z error=19
2026-02-21T11:57:28.1540914Z timeout=1
2026-02-21T11:57:28.1541073Z ok=81
2026-02-21T11:57:28.1541236Z min=0.1863
2026-02-21T11:57:28.1541408Z mid=0.2689
2026-02-21T11:57:28.1541567Z max=2.6486
2026-02-21T11:57:28.1541758Z best={'block_sizes': [2],
2026-02-21T11:57:28.1542172Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T11:57:28.1542796Z               'tensor_descriptor', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'pointer',
2026-02-21T11:57:28.1543246Z               'tensor_descriptor'],
2026-02-21T11:57:28.1543636Z  'load_eviction_policies': ['last', '', 'first', '', 'last', 'last', 'last', 'last'],
2026-02-21T11:57:28.1544450Z  'maxnreg': 128,
2026-02-21T11:57:28.1544668Z  'num_sm_multiplier': 8,
2026-02-21T11:57:28.1545230Z  'num_stages': 3,
2026-02-21T11:57:28.1545446Z  'num_warps': 16,
2026-02-21T11:57:28.1545673Z  'pid_type': 'persistent_blocked',
2026-02-21T11:57:28.1545939Z  'range_flattens': [None],
2026-02-21T11:57:28.1546175Z  'range_multi_buffers': [True],
2026-02-21T11:57:28.1546409Z  'range_num_stages': [1],
2026-02-21T11:57:28.1546642Z  'range_unroll_factors': [3],
2026-02-21T11:57:28.1546880Z  'range_warp_specializes': [],
2026-02-21T11:57:28.1547104Z  'reduction_loops': [8192]}
2026-02-21T11:57:28.1568491Z [199s] Fitting surrogate: 304 points, 304 targets
2026-02-21T11:57:29.5314647Z [200s] Generation 3 starting: 85 neighbors, 5 active search path(s)
2026-02-21T11:57:59.1622678Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 0.7 configs/s
2026-02-21T11:58:04.1269304Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 17.7 configs/s
2026-02-21T11:58:24.5837103Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 49.1 configs/s
2026-02-21T11:58:25.2966834Z [256s] Generation 3 complete: 
2026-02-21T11:58:25.2967152Z error=9
2026-02-21T11:58:25.2967337Z ok=82
2026-02-21T11:58:25.2967501Z min=0.1832
2026-02-21T11:58:25.2967680Z mid=0.2136
2026-02-21T11:58:25.2967867Z max=1.0465
2026-02-21T11:58:25.2968057Z best={'block_sizes': [1],
2026-02-21T11:58:25.2968490Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:58:25.2969129Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer',
2026-02-21T11:58:25.2969608Z               'tensor_descriptor', 'pointer'],
2026-02-21T11:58:25.2970168Z  'load_eviction_policies': ['last', 'last', 'first', 'first', 'last', 'first', '', 'first'],
2026-02-21T11:58:25.2970593Z  'maxnreg': 128,
2026-02-21T11:58:25.2970794Z  'num_sm_multiplier': 64,
2026-02-21T11:58:25.2971023Z  'num_stages': 2,
2026-02-21T11:58:25.2971220Z  'num_warps': 8,
2026-02-21T11:58:25.2971430Z  'pid_type': 'persistent_blocked',
2026-02-21T11:58:25.2971700Z  'range_flattens': [None],
2026-02-21T11:58:25.2971933Z  'range_multi_buffers': [True],
2026-02-21T11:58:25.2972178Z  'range_num_stages': [3],
2026-02-21T11:58:25.2972405Z  'range_unroll_factors': [3],
2026-02-21T11:58:25.2972659Z  'range_warp_specializes': [],
2026-02-21T11:58:25.2972896Z  'reduction_loops': [8192]}
2026-02-21T11:58:25.3004754Z [256s] Fitting surrogate: 395 points, 395 targets
2026-02-21T11:58:26.5644908Z [257s] Generation 4 starting: 80 neighbors, 5 active search path(s)
2026-02-21T11:58:51.0776392Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 1.3 configs/s
2026-02-21T11:58:55.9271506Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 17.1 configs/s
2026-02-21T11:59:15.8075121Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 50.5 configs/s
2026-02-21T11:59:16.5178185Z [307s] Generation 4 complete: 
2026-02-21T11:59:16.5178506Z error=4
2026-02-21T11:59:16.5178680Z ok=81
2026-02-21T11:59:16.5178861Z min=0.1832
2026-02-21T11:59:16.5179072Z mid=0.1988
2026-02-21T11:59:16.5179246Z max=1.4447
2026-02-21T11:59:16.5179433Z best={'block_sizes': [1],
2026-02-21T11:59:16.5179847Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T11:59:16.5181165Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T11:59:16.5181793Z               'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:59:16.5182288Z  'load_eviction_policies': ['last', 'last', 'first', 'first', 'last', 'first', '', 'first'],
2026-02-21T11:59:16.5182708Z  'maxnreg': 128,
2026-02-21T11:59:16.5182912Z  'num_sm_multiplier': 64,
2026-02-21T11:59:16.5183130Z  'num_stages': 2,
2026-02-21T11:59:16.5183315Z  'num_warps': 8,
2026-02-21T11:59:16.5183523Z  'pid_type': 'persistent_blocked',
2026-02-21T11:59:16.5183777Z  'range_flattens': [None],
2026-02-21T11:59:16.5184332Z  'range_multi_buffers': [True],
2026-02-21T11:59:16.5184580Z  'range_num_stages': [3],
2026-02-21T11:59:16.5185156Z  'range_unroll_factors': [3],
2026-02-21T11:59:16.5185404Z  'range_warp_specializes': [],
2026-02-21T11:59:16.5185643Z  'reduction_loops': [8192]}
2026-02-21T11:59:16.5214703Z [307s] Fitting surrogate: 480 points, 480 targets
2026-02-21T11:59:17.8992511Z [309s] Generation 5 starting: 86 neighbors, 5 active search path(s)
2026-02-21T11:59:43.0584401Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 4.6 configs/s
2026-02-21T11:59:47.9894384Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 17.8 configs/s
2026-02-21T12:00:07.8884541Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 50.4 configs/s
2026-02-21T12:00:08.6025747Z [359s] Generation 5 complete: 
2026-02-21T12:00:08.6026047Z error=8
2026-02-21T12:00:08.6026216Z ok=83
2026-02-21T12:00:08.6026389Z min=0.1829
2026-02-21T12:00:08.6026559Z mid=0.1932
2026-02-21T12:00:08.6026736Z max=0.5977
2026-02-21T12:00:08.6026917Z best={'block_sizes': [1],
2026-02-21T12:00:08.6027355Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer', 'tensor_descriptor',
2026-02-21T12:00:08.6027974Z               'tensor_descriptor', 'pointer', 'tensor_descriptor', 'tensor_descriptor', 'pointer',
2026-02-21T12:00:08.6028477Z               'pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:00:08.6028931Z  'load_eviction_policies': ['last', 'last', 'first', 'first', 'last', 'first', '', 'first'],
2026-02-21T12:00:08.6029323Z  'maxnreg': 128,
2026-02-21T12:00:08.6029521Z  'num_sm_multiplier': 64,
2026-02-21T12:00:08.6029722Z  'num_stages': 2,
2026-02-21T12:00:08.6029899Z  'num_warps': 8,
2026-02-21T12:00:08.6030086Z  'pid_type': 'persistent_blocked',
2026-02-21T12:00:08.6030325Z  'range_flattens': [None],
2026-02-21T12:00:08.6030533Z  'range_multi_buffers': [True],
2026-02-21T12:00:08.6030769Z  'range_num_stages': [3],
2026-02-21T12:00:08.6030975Z  'range_unroll_factors': [3],
2026-02-21T12:00:08.6031204Z  'range_warp_specializes': [],
2026-02-21T12:00:08.6031429Z  'reduction_loops': [8192]}
2026-02-21T12:00:08.6075487Z [359s] Fitting surrogate: 571 points, 571 targets
2026-02-21T12:00:09.7011288Z [360s] Generation 6 starting: 65 neighbors, 4 active search path(s)
2026-02-21T12:00:27.8642556Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 4.6 configs/s
2026-02-21T12:00:31.4913272Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 18.4 configs/s
2026-02-21T12:00:47.2421094Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 63.7 configs/s
2026-02-21T12:00:47.8247177Z [399s] Generation 6 complete: 
2026-02-21T12:00:47.8247509Z error=8
2026-02-21T12:00:47.8247705Z ok=62
2026-02-21T12:00:47.8247891Z min=0.1819
2026-02-21T12:00:47.8248070Z mid=0.1906
2026-02-21T12:00:47.8248244Z max=0.4630
2026-02-21T12:00:47.8248433Z best={'block_sizes': [1],
2026-02-21T12:00:47.8248849Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T12:00:47.8249437Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T12:00:47.8250113Z  'load_eviction_policies': ['last', '', 'first', '', 'first', 'last', '', ''],
2026-02-21T12:00:47.8250495Z  'maxnreg': 128,
2026-02-21T12:00:47.8250713Z  'num_sm_multiplier': 32,
2026-02-21T12:00:47.8251595Z  'num_stages': 8,
2026-02-21T12:00:47.8251820Z  'num_warps': 8,
2026-02-21T12:00:47.8252056Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:00:47.8252338Z  'range_flattens': [None],
2026-02-21T12:00:47.8252587Z  'range_multi_buffers': [True],
2026-02-21T12:00:47.8252832Z  'range_num_stages': [2],
2026-02-21T12:00:47.8253068Z  'range_unroll_factors': [1],
2026-02-21T12:00:47.8253315Z  'range_warp_specializes': [],
2026-02-21T12:00:47.8253570Z  'reduction_loops': [8192]}
2026-02-21T12:00:47.8288214Z [399s] Fitting surrogate: 641 points, 641 targets
2026-02-21T12:00:48.8650879Z [400s] Generation 7 starting: 60 neighbors, 4 active search path(s)
2026-02-21T12:01:05.4951187Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 4.5 configs/s
2026-02-21T12:01:08.9689349Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 17.5 configs/s
2026-02-21T12:01:24.2267591Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 65.7 configs/s
2026-02-21T12:01:24.8004334Z [436s] Generation 7 complete: 
2026-02-21T12:01:24.8004669Z error=4
2026-02-21T12:01:24.8004857Z ok=60
2026-02-21T12:01:24.8005031Z min=0.1820
2026-02-21T12:01:24.8005224Z mid=0.1856
2026-02-21T12:01:24.8005403Z max=0.4656
2026-02-21T12:01:24.8005588Z best={'block_sizes': [1],
2026-02-21T12:01:24.8006009Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T12:01:24.8006629Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T12:01:24.8007181Z  'load_eviction_policies': ['last', '', 'first', '', 'first', 'last', '', ''],
2026-02-21T12:01:24.8007566Z  'maxnreg': 128,
2026-02-21T12:01:24.8007784Z  'num_sm_multiplier': 32,
2026-02-21T12:01:24.8008012Z  'num_stages': 8,
2026-02-21T12:01:24.8008233Z  'num_warps': 8,
2026-02-21T12:01:24.8008464Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:01:24.8008745Z  'range_flattens': [True],
2026-02-21T12:01:24.8008988Z  'range_multi_buffers': [True],
2026-02-21T12:01:24.8009246Z  'range_num_stages': [2],
2026-02-21T12:01:24.8009475Z  'range_unroll_factors': [1],
2026-02-21T12:01:24.8009720Z  'range_warp_specializes': [],
2026-02-21T12:01:24.8009969Z  'reduction_loops': [8192]}
2026-02-21T12:01:24.8045811Z [436s] Fitting surrogate: 705 points, 705 targets
2026-02-21T12:01:25.4678784Z [436s] Generation 8 starting: 36 neighbors, 2 active search path(s)
2026-02-21T12:01:35.8226299Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 4.2 configs/s
2026-02-21T12:01:37.8892089Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 17.8 configs/s
2026-02-21T12:01:48.9721300Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 103.4         
2026-02-21T12:01:48.9724541Z                                                                   configs/s     
2026-02-21T12:01:49.3693831Z [460s] Generation 8 complete: 
2026-02-21T12:01:49.3694594Z error=3
2026-02-21T12:01:49.3694881Z ok=36
2026-02-21T12:01:49.3695150Z min=0.1820
2026-02-21T12:01:49.3695884Z mid=0.1904
2026-02-21T12:01:49.3696150Z max=0.2954
2026-02-21T12:01:49.3696447Z best={'block_sizes': [1],
2026-02-21T12:01:49.3697106Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T12:01:49.3698063Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T12:01:49.3699089Z  'load_eviction_policies': ['last', '', 'first', '', 'first', 'last', '', ''],
2026-02-21T12:01:49.3699715Z  'maxnreg': 128,
2026-02-21T12:01:49.3699917Z  'num_sm_multiplier': 32,
2026-02-21T12:01:49.3700135Z  'num_stages': 8,
2026-02-21T12:01:49.3700329Z  'num_warps': 8,
2026-02-21T12:01:49.3700539Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:01:49.3700823Z  'range_flattens': [True],
2026-02-21T12:01:49.3701331Z  'range_multi_buffers': [True],
2026-02-21T12:01:49.3701574Z  'range_num_stages': [2],
2026-02-21T12:01:49.3701799Z  'range_unroll_factors': [1],
2026-02-21T12:01:49.3702043Z  'range_warp_specializes': [],
2026-02-21T12:01:49.3702288Z  'reduction_loops': [8192]}
2026-02-21T12:01:49.3736896Z [460s] Fitting surrogate: 744 points, 744 targets
2026-02-21T12:01:49.7717610Z [460s] Generation 9 starting: 17 neighbors, 1 active search path(s)
2026-02-21T12:01:55.1018738Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 6.9 configs/s
2026-02-21T12:01:56.0619819Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 19.8 configs/s
2026-02-21T12:01:59.9575248Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 254.1         
2026-02-21T12:01:59.9575789Z                                                                   configs/s     
2026-02-21T12:02:00.1539400Z [471s] Generation 9 complete: 
2026-02-21T12:02:00.1539660Z error=3
2026-02-21T12:02:00.1539840Z ok=16
2026-02-21T12:02:00.1540037Z min=0.1822
2026-02-21T12:02:00.1540215Z mid=0.1930
2026-02-21T12:02:00.1540383Z max=0.2873
2026-02-21T12:02:00.1540579Z best={'block_sizes': [1],
2026-02-21T12:02:00.1541003Z  'indexing': ['pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer', 'pointer',
2026-02-21T12:02:00.1541590Z               'tensor_descriptor', 'tensor_descriptor', 'pointer', 'pointer', 'pointer'],
2026-02-21T12:02:00.1542131Z  'load_eviction_policies': ['last', '', 'first', '', 'first', 'last', '', ''],
2026-02-21T12:02:00.1542509Z  'maxnreg': 128,
2026-02-21T12:02:00.1542722Z  'num_sm_multiplier': 32,
2026-02-21T12:02:00.1542940Z  'num_stages': 8,
2026-02-21T12:02:00.1543133Z  'num_warps': 8,
2026-02-21T12:02:00.1543342Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:02:00.1543615Z  'range_flattens': [True],
2026-02-21T12:02:00.1543846Z  'range_multi_buffers': [True],
2026-02-21T12:02:00.1544420Z  'range_num_stages': [2],
2026-02-21T12:02:00.1544650Z  'range_unroll_factors': [1],
2026-02-21T12:02:00.1544893Z  'range_warp_specializes': [],
2026-02-21T12:02:00.1545136Z  'reduction_loops': [8192]}
2026-02-21T12:02:00.1591660Z [471s] Fitting surrogate: 763 points, 763 targets
2026-02-21T12:02:00.5514592Z [471s] Generation 10 starting: 17 neighbors, 1 active search path(s)
2026-02-21T12:02:05.9892645Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 5.6 configs/s
2026-02-21T12:02:07.0673677Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.4 configs/s
2026-02-21T12:02:09.8482496Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 353.2         
2026-02-21T12:02:09.8483564Z                                                                   configs/s     
2026-02-21T12:02:10.0108816Z [481s] Generation 10 complete: 
2026-02-21T12:02:10.0109071Z error=1
2026-02-21T12:02:10.0109264Z ok=18
2026-02-21T12:02:10.0109432Z min=0.1805
2026-02-21T12:02:10.0109600Z mid=0.2323
2026-02-21T12:02:10.0109769Z max=0.7480
2026-02-21T12:02:10.0109947Z best={'block_sizes': [1],
2026-02-21T12:02:10.0110418Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T12:02:10.0111036Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T12:02:10.0112080Z               'tensor_descriptor'],
2026-02-21T12:02:10.0112453Z  'load_eviction_policies': ['last', '', 'first', 'last', '', '', '', 'first'],
2026-02-21T12:02:10.0112831Z  'maxnreg': 32,
2026-02-21T12:02:10.0113031Z  'num_sm_multiplier': 64,
2026-02-21T12:02:10.0113256Z  'num_stages': 8,
2026-02-21T12:02:10.0113449Z  'num_warps': 32,
2026-02-21T12:02:10.0113652Z  'pid_type': 'persistent_blocked',
2026-02-21T12:02:10.0113911Z  'range_flattens': [False],
2026-02-21T12:02:10.0114441Z  'range_multi_buffers': [True],
2026-02-21T12:02:10.0114669Z  'range_num_stages': [3],
2026-02-21T12:02:10.0114874Z  'range_unroll_factors': [0],
2026-02-21T12:02:10.0115103Z  'range_warp_specializes': [],
2026-02-21T12:02:10.0115642Z  'reduction_loops': [4096]}
2026-02-21T12:02:10.0166850Z [481s] Fitting surrogate: 782 points, 782 targets
2026-02-21T12:02:10.4323512Z [481s] Generation 11 starting: 18 neighbors, 1 active search path(s)
2026-02-21T12:02:15.8099844Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 6.1 configs/s
2026-02-21T12:02:16.8734661Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.7 configs/s
2026-02-21T12:02:21.1706662Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 230.8         
2026-02-21T12:02:21.1707590Z                                                                   configs/s     
2026-02-21T12:02:21.3845877Z [492s] Generation 11 complete: 
2026-02-21T12:02:21.3846150Z error=1
2026-02-21T12:02:21.3846334Z ok=18
2026-02-21T12:02:21.3846509Z min=0.1801
2026-02-21T12:02:21.3846685Z mid=0.1804
2026-02-21T12:02:21.3846863Z max=1.0625
2026-02-21T12:02:21.3847047Z best={'block_sizes': [1],
2026-02-21T12:02:21.3847546Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T12:02:21.3848181Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T12:02:21.3848621Z               'tensor_descriptor'],
2026-02-21T12:02:21.3849017Z  'load_eviction_policies': ['last', '', 'first', 'last', '', '', '', ''],
2026-02-21T12:02:21.3849402Z  'maxnreg': 32,
2026-02-21T12:02:21.3849611Z  'num_sm_multiplier': 64,
2026-02-21T12:02:21.3849833Z  'num_stages': 7,
2026-02-21T12:02:21.3850099Z  'num_warps': 32,
2026-02-21T12:02:21.3850316Z  'pid_type': 'persistent_blocked',
2026-02-21T12:02:21.3850587Z  'range_flattens': [False],
2026-02-21T12:02:21.3850842Z  'range_multi_buffers': [True],
2026-02-21T12:02:21.3851104Z  'range_num_stages': [3],
2026-02-21T12:02:21.3851353Z  'range_unroll_factors': [0],
2026-02-21T12:02:21.3851594Z  'range_warp_specializes': [],
2026-02-21T12:02:21.3851796Z  'reduction_loops': [4096]}
2026-02-21T12:02:21.3895159Z [492s] Fitting surrogate: 801 points, 801 targets
2026-02-21T12:02:21.8160281Z [493s] Generation 12 starting: 19 neighbors, 1 active search path(s)
2026-02-21T12:02:27.4999790Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.0 configs/s
2026-02-21T12:02:28.6851582Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.6 configs/s
2026-02-21T12:02:34.0345680Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 185.8         
2026-02-21T12:02:34.0346184Z                                                                   configs/s     
2026-02-21T12:02:34.2781024Z [505s] Generation 12 complete: 
2026-02-21T12:02:34.2781607Z ok=20
2026-02-21T12:02:34.2781853Z min=0.1803
2026-02-21T12:02:34.2782053Z mid=0.1805
2026-02-21T12:02:34.2782252Z max=0.3887
2026-02-21T12:02:34.2782436Z best={'block_sizes': [1],
2026-02-21T12:02:34.2782890Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T12:02:34.2783551Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T12:02:34.2783969Z               'tensor_descriptor'],
2026-02-21T12:02:34.2784671Z  'load_eviction_policies': ['last', '', 'first', 'last', '', '', '', ''],
2026-02-21T12:02:34.2785543Z  'maxnreg': 64,
2026-02-21T12:02:34.2785745Z  'num_sm_multiplier': 64,
2026-02-21T12:02:34.2785963Z  'num_stages': 7,
2026-02-21T12:02:34.2786157Z  'num_warps': 32,
2026-02-21T12:02:34.2786361Z  'pid_type': 'persistent_blocked',
2026-02-21T12:02:34.2786620Z  'range_flattens': [False],
2026-02-21T12:02:34.2786850Z  'range_multi_buffers': [False],
2026-02-21T12:02:34.2787096Z  'range_num_stages': [3],
2026-02-21T12:02:34.2787321Z  'range_unroll_factors': [0],
2026-02-21T12:02:34.2787571Z  'range_warp_specializes': [],
2026-02-21T12:02:34.2787812Z  'reduction_loops': [4096]}
2026-02-21T12:02:34.2827312Z [505s] Fitting surrogate: 821 points, 821 targets
2026-02-21T12:02:34.7174464Z [505s] Generation 13 starting: 19 neighbors, 1 active search path(s)
2026-02-21T12:02:40.5003785Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 11.3 configs/s
2026-02-21T12:02:41.6901382Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.5 configs/s
2026-02-21T12:02:46.7393459Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 196.9         
2026-02-21T12:02:46.7394098Z                                                                   configs/s     
2026-02-21T12:02:46.9768741Z [518s] Generation 13 complete: 
2026-02-21T12:02:46.9768998Z error=1
2026-02-21T12:02:46.9769175Z ok=20
2026-02-21T12:02:46.9769325Z min=0.1801
2026-02-21T12:02:46.9769484Z mid=0.1802
2026-02-21T12:02:46.9769632Z max=0.2788
2026-02-21T12:02:46.9769793Z best={'block_sizes': [1],
2026-02-21T12:02:46.9770263Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor',
2026-02-21T12:02:46.9770819Z               'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer',
2026-02-21T12:02:46.9771192Z               'tensor_descriptor'],
2026-02-21T12:02:46.9771523Z  'load_eviction_policies': ['last', '', 'first', 'last', '', '', '', ''],
2026-02-21T12:02:46.9771850Z  'maxnreg': 64,
2026-02-21T12:02:46.9772025Z  'num_sm_multiplier': 64,
2026-02-21T12:02:46.9772230Z  'num_stages': 7,
2026-02-21T12:02:46.9772406Z  'num_warps': 32,
2026-02-21T12:02:46.9772600Z  'pid_type': 'persistent_blocked',
2026-02-21T12:02:46.9772831Z  'range_flattens': [True],
2026-02-21T12:02:46.9773039Z  'range_multi_buffers': [False],
2026-02-21T12:02:46.9773249Z  'range_num_stages': [3],
2026-02-21T12:02:46.9773459Z  'range_unroll_factors': [0],
2026-02-21T12:02:46.9773669Z  'range_warp_specializes': [],
2026-02-21T12:02:46.9773882Z  'reduction_loops': [4096]}
2026-02-21T12:02:46.9846166Z [518s] Fitting surrogate: 842 points, 842 targets
2026-02-21T12:02:47.1487106Z [518s] Autotuning complete in 518.4s after searching 808 configs.
2026-02-21T12:02:47.1487530Z One can hardcode the best config and skip autotuning with:
2026-02-21T12:02:47.1489513Z     @helion.kernel(config=helion.Config(block_sizes=[1], indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', '', 'first', 'last', '', '', '', ''], maxnreg=64, num_sm_multiplier=64, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True], range_multi_buffers=[False], range_num_stages=[3], range_unroll_factors=[0], range_warp_specializes=[], reduction_loops=[4096]), static_shapes=True)
2026-02-21T12:02:47.1491472Z 
2026-02-21T12:02:47.1491842Z [518s] Code of selected kernel: /tmp/torchinductor_root/km/ckm4gv7yvzfgysbsevbf2uu5axwwmvyh7qhn7rcsnp6viv2p6jmz.py
2026-02-21T12:02:47.1895949Z from __future__ import annotations
2026-02-21T12:02:47.1896155Z 
2026-02-21T12:02:47.1896223Z import torch
2026-02-21T12:02:47.1896390Z import helion
2026-02-21T12:02:47.1896545Z import triton
2026-02-21T12:02:47.1896719Z import triton.language as tl
2026-02-21T12:02:47.1897009Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T12:02:47.1897398Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T12:02:47.1897640Z 
2026-02-21T12:02:47.1898056Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T12:02:47.1898204Z 
2026-02-21T12:02:47.1898267Z @triton.jit
2026-02-21T12:02:47.1898687Z def _helion_layer_norm_fwd(x, mean, rstd, weight, bias, out, eps, _NUM_SM: tl.constexpr, _REDUCTION_BLOCK_1: tl.constexpr):
2026-02-21T12:02:47.1899276Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T12:02:47.1899679Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T12:02:47.1900054Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T12:02:47.1900345Z     # src[layer_norm.py:60-80]: ...
2026-02-21T12:02:47.1900587Z     total_pids = 4096
2026-02-21T12:02:47.1900830Z     block_size = tl.cdiv(total_pids, _NUM_SM * 64)
2026-02-21T12:02:47.1901143Z     start_pid = tl.program_id(0) * block_size
2026-02-21T12:02:47.1901702Z     end_pid = tl.minimum(start_pid + block_size, total_pids)
2026-02-21T12:02:47.1902278Z     for virtual_pid in tl.range(start_pid, end_pid, num_stages=3, disallow_acc_multi_buffer=True, flatten=True):
2026-02-21T12:02:47.1902835Z         # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T12:02:47.1903141Z         pid_0 = virtual_pid
2026-02-21T12:02:47.1903357Z         offset_0 = pid_0
2026-02-21T12:02:47.1903607Z         indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T12:02:47.1904284Z         # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T12:02:47.1904733Z         sum_1_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T12:02:47.1905188Z         # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T12:02:47.1905602Z         for roffset_1 in tl.range(0, 15872, _REDUCTION_BLOCK_1):
2026-02-21T12:02:47.1906040Z             rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T12:02:47.1906422Z             mask_1 = rindex_1 < 15872
2026-02-21T12:02:47.1906946Z             acc = tl.load(x + (indices_0[:, None] * 15872 + rindex_1[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_last')
2026-02-21T12:02:47.1907567Z             # src[layer_norm.py:63]: mean_val = torch.sum(acc, dim=-1) / n
2026-02-21T12:02:47.1907913Z             v_0 = sum_1_acc + acc
2026-02-21T12:02:47.1908152Z             sum_1_acc = v_0
2026-02-21T12:02:47.1908409Z         sum_1 = tl.cast(tl.sum(sum_1_acc, 1), tl.float32)
2026-02-21T12:02:47.1908706Z         v_1 = 6.300403225806451e-05
2026-02-21T12:02:47.1908938Z         v_2 = sum_1 * v_1
2026-02-21T12:02:47.1909231Z         # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T12:02:47.1909581Z         subscript = v_2[:, None]
2026-02-21T12:02:47.1909937Z         # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T12:02:47.1910348Z         sum_2_acc = tl.full([_BLOCK_SIZE_0, _REDUCTION_BLOCK_1], 0, tl.float32)
2026-02-21T12:02:47.1910708Z         # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T12:02:47.1911034Z         for roffset_1 in tl.range(0, 15872, _REDUCTION_BLOCK_1):
2026-02-21T12:02:47.1911384Z             rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T12:02:47.1911706Z             mask_1 = rindex_1 < 15872
2026-02-21T12:02:47.1911928Z             subscript_copy = subscript
2026-02-21T12:02:47.1912283Z             acc_1 = tl.load(x + (indices_0[:, None] * 15872 + rindex_1[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T12:02:47.1912721Z             # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T12:02:47.1913012Z             v_3 = acc_1 - subscript_copy
2026-02-21T12:02:47.1913336Z             # src[layer_norm.py:66]: var_val = torch.sum(centered * centered, dim=-1) / n
2026-02-21T12:02:47.1913656Z             v_4 = v_3 * v_3
2026-02-21T12:02:47.1914211Z             _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _REDUCTION_BLOCK_1]), v_4, tl.full([], 0, tl.float32))
2026-02-21T12:02:47.1914688Z             v_5 = sum_2_acc + _mask_to_1
2026-02-21T12:02:47.1914895Z             sum_2_acc = v_5
2026-02-21T12:02:47.1915266Z         sum_2 = tl.cast(tl.sum(sum_2_acc, 1), tl.float32)
2026-02-21T12:02:47.1915513Z         v_6 = 6.300403225806451e-05
2026-02-21T12:02:47.1915714Z         v_7 = sum_2 * v_6
2026-02-21T12:02:47.1915969Z         # src[layer_norm.py:68]: rstd_val = torch.rsqrt(var_val + eps)
2026-02-21T12:02:47.1916258Z         v_8 = v_7 + eps
2026-02-21T12:02:47.1916441Z         v_9 = libdevice.rsqrt(v_8)
2026-02-21T12:02:47.1916714Z         # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T12:02:47.1917009Z         subscript_1 = v_9[:, None]
2026-02-21T12:02:47.1917237Z         # src[layer_norm.py:79]: mean[tile_m] = mean_val
2026-02-21T12:02:47.1917504Z         tl.store(mean + indices_0 * 1, v_2, None)
2026-02-21T12:02:47.1917891Z         # src[layer_norm.py:80]: rstd[tile_m] = rstd_val
2026-02-21T12:02:47.1918159Z         tl.store(rstd + indices_0 * 1, v_9, None)
2026-02-21T12:02:47.1918442Z         # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T12:02:47.1918795Z         for roffset_1 in tl.range(0, 15872, _REDUCTION_BLOCK_1):
2026-02-21T12:02:47.1919184Z             rindex_1 = roffset_1 + tl.arange(0, _REDUCTION_BLOCK_1).to(tl.int32)
2026-02-21T12:02:47.1919505Z             mask_1 = rindex_1 < 15872
2026-02-21T12:02:47.1919716Z             v_2_copy = v_2
2026-02-21T12:02:47.1919913Z             subscript_1_copy = subscript_1
2026-02-21T12:02:47.1920366Z             acc_2 = tl.load(x + (indices_0[:, None] * 15872 + rindex_1[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_first')
2026-02-21T12:02:47.1920877Z             # src[layer_norm.py:65]: centered = acc - mean_val[:, None]
2026-02-21T12:02:47.1921165Z             subscript_2 = v_2_copy[:, None]
2026-02-21T12:02:47.1921391Z             v_10 = acc_2 - subscript_2
2026-02-21T12:02:47.1921688Z             # src[layer_norm.py:70]: normalized = centered * rstd_val[:, None]
2026-02-21T12:02:47.1922000Z             v_11 = v_10 * subscript_1_copy
2026-02-21T12:02:47.1922316Z             # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T12:02:47.1922776Z             load_1 = tl.load(weight + rindex_1 * 1, mask_1, other=0, eviction_policy='evict_last')
2026-02-21T12:02:47.1923132Z             v_12 = load_1[None, :]
2026-02-21T12:02:47.1923325Z             v_13 = v_11 * v_12
2026-02-21T12:02:47.1923560Z             # src[layer_norm.py:74]: bias[:].to(torch.float32)
2026-02-21T12:02:47.1923860Z             load_2 = tl.load(bias + rindex_1 * 1, mask_1, other=0)
2026-02-21T12:02:47.1924357Z             # src[layer_norm.py:73]: acc = normalized * (weight[:].to(torch.float32)) + (
2026-02-21T12:02:47.1924716Z             # src[layer_norm.py:74]:     bias[:].to(torch.float32)
2026-02-21T12:02:47.1924984Z             # src[layer_norm.py:75]: )
2026-02-21T12:02:47.1925199Z             v_14 = load_2[None, :]
2026-02-21T12:02:47.1925387Z             v_15 = v_13 + v_14
2026-02-21T12:02:47.1925623Z             # src[layer_norm.py:78]: out[tile_m, :] = acc.to(x.dtype)
2026-02-21T12:02:47.1926022Z             tl.store(out + (indices_0[:, None] * 15872 + rindex_1[None, :] * 1), v_15, mask_1[None, :])
2026-02-21T12:02:47.1926313Z 
2026-02-21T12:02:47.1926754Z def layer_norm_fwd(x: torch.Tensor, normalized_shape: list[int], weight: torch.Tensor, bias: torch.Tensor | None=None, eps: float=1e-05, *, _launcher=_default_launcher):
2026-02-21T12:02:47.1927324Z     """
2026-02-21T12:02:47.1927554Z     Performs 1D layer normalization on the input tensor using Helion.
2026-02-21T12:02:47.1927847Z     Args:
2026-02-21T12:02:47.1928106Z         x (torch.Tensor): Input tensor of shape [batch_size, dim], expected to be FP16.
2026-02-21T12:02:47.1928629Z         normalized_shape (list[int]): List containing the dimension to normalize over (should be length 1).
2026-02-21T12:02:47.1929120Z         weight (torch.Tensor): Learnable scale parameter of shape [dim].
2026-02-21T12:02:47.1929535Z         bias (torch.Tensor | None): Optional learnable bias parameter of shape [dim].
2026-02-21T12:02:47.1930269Z         eps (float, optional): Small value added to variance for numerical stability. Default is 1e-5.
2026-02-21T12:02:47.1930647Z     Returns:
2026-02-21T12:02:47.1930853Z         tuple[torch.Tensor, torch.Tensor, torch.Tensor]:
2026-02-21T12:02:47.1931217Z             - The layer-normalized output tensor of shape [batch_size, dim], in FP16.
2026-02-21T12:02:47.1931589Z             - Mean tensor of shape [batch_size], in FP32.
2026-02-21T12:02:47.1931940Z             - Reciprocal standard deviation tensor of shape [batch_size], in FP32.
2026-02-21T12:02:47.1932260Z     """
2026-02-21T12:02:47.1932417Z     # src[layer_norm.py:46]: m, n = x.size()
2026-02-21T12:02:47.1932650Z     m, n = x.size()
2026-02-21T12:02:47.1933115Z     # src[layer_norm.py:47]: assert weight.size(0) == n, f"weight size mismatch {weight.size(0)} != {n}"
2026-02-21T12:02:47.1933593Z     assert weight.size(0) == n, f'weight size mismatch {weight.size(0)} != {n}'
2026-02-21T12:02:47.1933933Z     # src[layer_norm.py:48]: if bias is not None:
2026-02-21T12:02:47.1934467Z     # src[layer_norm.py:49]:     assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T12:02:47.1934831Z     if bias is not None:
2026-02-21T12:02:47.1935145Z         # src[layer_norm.py:49]: assert bias.size(0) == n, f"bias size mismatch {bias.size(0)} != {n}"
2026-02-21T12:02:47.1935586Z         assert bias.size(0) == n, f'bias size mismatch {bias.size(0)} != {n}'
2026-02-21T12:02:47.1935944Z     # src[layer_norm.py:50]: assert len(normalized_shape) == 1, (
2026-02-21T12:02:47.1936342Z     # src[layer_norm.py:51]:     "Helion layer norm only supports 1D layer norm currently"
2026-02-21T12:02:47.1936683Z     # src[layer_norm.py:52]: )
2026-02-21T12:02:47.1937032Z     assert len(normalized_shape) == 1, 'Helion layer norm only supports 1D layer norm currently'
2026-02-21T12:02:47.1937484Z     # src[layer_norm.py:53]: assert normalized_shape[0] == n, (
2026-02-21T12:02:47.1937869Z     # src[layer_norm.py:54]:     f"normalized shape mismatch {normalized_shape[0]} != {n}"
2026-02-21T12:02:47.1938211Z     # src[layer_norm.py:55]: )
2026-02-21T12:02:47.1938539Z     assert normalized_shape[0] == n, f'normalized shape mismatch {normalized_shape[0]} != {n}'
2026-02-21T12:02:47.1939001Z     # src[layer_norm.py:56]: out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T12:02:47.1939391Z     out = torch.empty([m, n], dtype=x.dtype, device=x.device)
2026-02-21T12:02:47.1939763Z     # src[layer_norm.py:57]: mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T12:02:47.1940159Z     mean = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T12:02:47.1940538Z     # src[layer_norm.py:58]: rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T12:02:47.1940927Z     rstd = torch.empty([m], dtype=torch.float32, device=x.device)
2026-02-21T12:02:47.1941226Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T12:02:47.1941500Z     _NUM_SM = helion.runtime.get_num_sm(x.device)
2026-02-21T12:02:47.1941800Z     # src[layer_norm.py:61]: acc = x[tile_m, :].to(torch.float32)
2026-02-21T12:02:47.1942067Z     _REDUCTION_BLOCK_1 = 4096
2026-02-21T12:02:47.1942288Z     # src[layer_norm.py:60]: for tile_m in hl.tile(m):
2026-02-21T12:02:47.1942586Z     # src[layer_norm.py:61]:     acc = x[tile_m, :].to(torch.float32)
2026-02-21T12:02:47.1942894Z     # src[layer_norm.py:62]:     # Compute mean
2026-02-21T12:02:47.1943127Z     # src[layer_norm.py:60-80]: ...
2026-02-21T12:02:47.1943653Z     _launcher(_helion_layer_norm_fwd, (_NUM_SM * 64,), x, mean, rstd, weight, bias, out, eps, _NUM_SM, _REDUCTION_BLOCK_1, num_warps=32, num_stages=7, maxnreg=64)
2026-02-21T12:02:47.1944336Z     # src[layer_norm.py:81]: return out, mean, rstd
2026-02-21T12:02:47.1944577Z     return (out, mean, rstd)
2026-02-21T12:02:48.3206265Z WARNING:tritonbench.utils.triton_op:Completed input ID 29:
2026-02-21T12:02:48.3206873Z (M, N)
2026-02-21T12:02:48.3207154Z -------------
2026-02-21T12:02:48.3207461Z (4096, 15872)
2026-02-21T12:02:48.3208244Z 
2026-02-21T12:02:48.3208704Z 100%|██████████| 20/20 [2:01:45<00:00, 446.12s/it]
2026-02-21T12:02:48.3209324Z 100%|██████████| 20/20 [2:01:45<00:00, 365.25s/it]
2026-02-21T12:02:48.3250203Z INFO:tritonbench.utils.run_utils:[tritonbench] Output result csv to /tmp/tmp1qefpzd0.csv
2026-02-21T12:02:52.2445752Z        (M, N)    torch_compile_layer_norm-speedup    torch_compile_layer_norm-accuracy    liger_layer_norm-speedup    liger_layer_norm-accuracy    helion_layer_norm_tritonbench-speedup    helion_layer_norm_tritonbench-accuracy
2026-02-21T12:02:52.2447058Z -------------  ----------------------------------  -----------------------------------  --------------------------  ---------------------------  ---------------------------------------  ----------------------------------------
2026-02-21T12:02:52.2448365Z  (4096, 1024)                             1.31955                                    1                     1.27761                            1                                  1.2649                                          1
2026-02-21T12:02:52.2449145Z  (4096, 2048)                             1.25179                                    1                     1.24306                            1                                  1.29404                                         1
2026-02-21T12:02:52.2449894Z  (4096, 2560)                             1.22317                                    1                     1.25068                            1                                  1.23882                                         1
2026-02-21T12:02:52.2450720Z  (4096, 3584)                             1.29135                                    1                     1.29308                            1                                  1.29194                                         1
2026-02-21T12:02:52.2451460Z  (4096, 4096)                             1.34502                                    1                     1.32821                            1                                  1.34039                                         1
2026-02-21T12:02:52.2452205Z  (4096, 5120)                             1.43047                                    1                     1.36837                            1                                  1.40695                                         1
2026-02-21T12:02:52.2452999Z  (4096, 5632)                             1.47775                                    1                     1.44908                            1                                  1.44913                                         1
2026-02-21T12:02:52.2453784Z  (4096, 6656)                             1.51871                                    1                     1.5149                             1                                  1.5142                                          1
2026-02-21T12:02:52.2454773Z  (4096, 7168)                             1.53204                                    1                     1.52229                            1                                  1.52067                                         1
2026-02-21T12:02:52.2455571Z  (4096, 8192)                             1.54882                                    1                     1.53346                            1                                  1.53968                                         1
2026-02-21T12:02:52.2456357Z  (4096, 8704)                             1.56063                                    1                     1.2954                             1                                  1.58708                                         1
2026-02-21T12:02:52.2457145Z  (4096, 9728)                             1.56638                                    1                     1.39278                            1                                  1.569                                           1
2026-02-21T12:02:52.2457941Z (4096, 10240)                             1.57408                                    1                     1.42825                            1                                  1.5535                                          1
2026-02-21T12:02:52.2458918Z (4096, 11264)                             1.56286                                    1                     1.50554                            1                                  1.57275                                         1
2026-02-21T12:02:52.2459710Z (4096, 11776)                             1.58857                                    1                     1.52485                            1                                  1.57227                                         1
2026-02-21T12:02:52.2460504Z (4096, 12800)                             1.56868                                    1                     1.55644                            1                                  1.56982                                         1
2026-02-21T12:02:52.2461438Z (4096, 13312)                             1.5714                                     1                     1.56963                            1                                  1.57434                                         1
2026-02-21T12:02:52.2462232Z (4096, 14336)                             1.57566                                    1                     1.5891                             1                                  1.5786                                          1
2026-02-21T12:02:52.2463033Z (4096, 14848)                             1.55823                                    1                     1.59032                            1                                  1.5921                                          1
2026-02-21T12:02:52.2463730Z (4096, 15872)                             1.55826                                    1                     1.58253                            1                                  1.5837                                          1
2026-02-21T12:02:52.2464552Z       average                             1.48117                                    1                     1.44078                            1                                  1.48069                                         1
2026-02-21T12:03:01.4323155Z ✅ Completed benchmark for kernel: layer_norm
2026-02-21T12:03:01.4338918Z [
2026-02-21T12:03:01.4339108Z   {
2026-02-21T12:03:01.4339359Z     "benchmark": {
2026-02-21T12:03:01.4339574Z       "name": "Helion Benchmark",
2026-02-21T12:03:01.4339834Z       "extra_info": {
2026-02-21T12:03:01.4340041Z         "device": "NVIDIA H100"
2026-02-21T12:03:01.4340265Z       }
2026-02-21T12:03:01.4340422Z     },
2026-02-21T12:03:01.4340593Z     "model": {
2026-02-21T12:03:01.4340778Z       "name": "layer_norm"
2026-02-21T12:03:01.4340987Z     },
2026-02-21T12:03:01.4341156Z     "metric": {
2026-02-21T12:03:01.4341359Z       "name": "torch_compile_speedup",
2026-02-21T12:03:01.4341628Z       "benchmark_values": [
2026-02-21T12:03:01.4341872Z         1.3195463757778438,
2026-02-21T12:03:01.4342080Z         1.2517930517760274,
2026-02-21T12:03:01.4342281Z         1.223174859836371,
2026-02-21T12:03:01.4342495Z         1.29134518951899,
2026-02-21T12:03:01.4342715Z         1.3450231895774414,
2026-02-21T12:03:01.4342918Z         1.430474732133176,
2026-02-21T12:03:01.4343114Z         1.4777502468212136,
2026-02-21T12:03:01.4343315Z         1.5187078653628638,
2026-02-21T12:03:01.4343511Z         1.5320417139651905,
2026-02-21T12:03:01.4343715Z         1.5488191177193418,
2026-02-21T12:03:01.4343917Z         1.5606330161877608,
2026-02-21T12:03:01.4344250Z         1.5663841123033053,
2026-02-21T12:03:01.4344454Z         1.5740800996106024,
2026-02-21T12:03:01.4344665Z         1.5628612072243793,
2026-02-21T12:03:01.4344868Z         1.5885728460393584,
2026-02-21T12:03:01.4345066Z         1.5686789225730664,
2026-02-21T12:03:01.4345270Z         1.5713960848092567,
2026-02-21T12:03:01.4345466Z         1.5756558916731631,
2026-02-21T12:03:01.4345674Z         1.5582290782256694,
2026-02-21T12:03:01.4345870Z         1.5582555246514596
2026-02-21T12:03:01.4346068Z       ]
2026-02-21T12:03:01.4346228Z     },
2026-02-21T12:03:01.4346385Z     "shape": [
2026-02-21T12:03:01.4347089Z       "(4096, 1024)",
2026-02-21T12:03:01.4347279Z       "(4096, 2048)",
2026-02-21T12:03:01.4347466Z       "(4096, 2560)",
2026-02-21T12:03:01.4347654Z       "(4096, 3584)",
2026-02-21T12:03:01.4347842Z       "(4096, 4096)",
2026-02-21T12:03:01.4348022Z       "(4096, 5120)",
2026-02-21T12:03:01.4348205Z       "(4096, 5632)",
2026-02-21T12:03:01.4348381Z       "(4096, 6656)",
2026-02-21T12:03:01.4348562Z       "(4096, 7168)",
2026-02-21T12:03:01.4348738Z       "(4096, 8192)",
2026-02-21T12:03:01.4348919Z       "(4096, 8704)",
2026-02-21T12:03:01.4349109Z       "(4096, 9728)",
2026-02-21T12:03:01.4349285Z       "(4096, 10240)",
2026-02-21T12:03:01.4349473Z       "(4096, 11264)",
2026-02-21T12:03:01.4349653Z       "(4096, 11776)",
2026-02-21T12:03:01.4349837Z       "(4096, 12800)",
2026-02-21T12:03:01.4350275Z       "(4096, 13312)",
2026-02-21T12:03:01.4350443Z       "(4096, 14336)",
2026-02-21T12:03:01.4350592Z       "(4096, 14848)",
2026-02-21T12:03:01.4350743Z       "(4096, 15872)"
2026-02-21T12:03:01.4350890Z     ]
2026-02-21T12:03:01.4351021Z   },
2026-02-21T12:03:01.4351153Z   {
2026-02-21T12:03:01.4351287Z     "benchmark": {
2026-02-21T12:03:01.4351453Z       "name": "Helion Benchmark",
2026-02-21T12:03:01.4351649Z       "extra_info": {
2026-02-21T12:03:01.4351819Z         "device": "NVIDIA H100"
2026-02-21T12:03:01.4351995Z       }
2026-02-21T12:03:01.4352128Z     },
2026-02-21T12:03:01.4352258Z     "model": {
2026-02-21T12:03:01.4352414Z       "name": "layer_norm"
2026-02-21T12:03:01.4352576Z     },
2026-02-21T12:03:01.4352712Z     "metric": {
2026-02-21T12:03:01.4352875Z       "name": "torch_compile_accuracy",
2026-02-21T12:03:01.4353092Z       "benchmark_values": [
2026-02-21T12:03:01.4353267Z         1.0,
2026-02-21T12:03:01.4353404Z         1.0,
2026-02-21T12:03:01.4353541Z         1.0,
2026-02-21T12:03:01.4353679Z         1.0,
2026-02-21T12:03:01.4353831Z         1.0,
2026-02-21T12:03:01.4353960Z         1.0,
2026-02-21T12:03:01.4354262Z         1.0,
2026-02-21T12:03:01.4354396Z         1.0,
2026-02-21T12:03:01.4354536Z         1.0,
2026-02-21T12:03:01.4354669Z         1.0,
2026-02-21T12:03:01.4354806Z         1.0,
2026-02-21T12:03:01.4354942Z         1.0,
2026-02-21T12:03:01.4355079Z         1.0,
2026-02-21T12:03:01.4355221Z         1.0,
2026-02-21T12:03:01.4355355Z         1.0,
2026-02-21T12:03:01.4355501Z         1.0,
2026-02-21T12:03:01.4355650Z         1.0,
2026-02-21T12:03:01.4355790Z         1.0,
2026-02-21T12:03:01.4355919Z         1.0,
2026-02-21T12:03:01.4356057Z         1.0
2026-02-21T12:03:01.4356190Z       ]
2026-02-21T12:03:01.4356330Z     },
2026-02-21T12:03:01.4356463Z     "shape": [
2026-02-21T12:03:01.4356616Z       "(4096, 1024)",
2026-02-21T12:03:01.4356768Z       "(4096, 2048)",
2026-02-21T12:03:01.4356920Z       "(4096, 2560)",
2026-02-21T12:03:01.4357068Z       "(4096, 3584)",
2026-02-21T12:03:01.4357222Z       "(4096, 4096)",
2026-02-21T12:03:01.4357371Z       "(4096, 5120)",
2026-02-21T12:03:01.4357518Z       "(4096, 5632)",
2026-02-21T12:03:01.4357670Z       "(4096, 6656)",
2026-02-21T12:03:01.4357819Z       "(4096, 7168)",
2026-02-21T12:03:01.4357971Z       "(4096, 8192)",
2026-02-21T12:03:01.4358118Z       "(4096, 8704)",
2026-02-21T12:03:01.4358269Z       "(4096, 9728)",
2026-02-21T12:03:01.4358428Z       "(4096, 10240)",
2026-02-21T12:03:01.4358592Z       "(4096, 11264)",
2026-02-21T12:03:01.4358743Z       "(4096, 11776)",
2026-02-21T12:03:01.4358896Z       "(4096, 12800)",
2026-02-21T12:03:01.4359050Z       "(4096, 13312)",
2026-02-21T12:03:01.4359205Z       "(4096, 14336)",
2026-02-21T12:03:01.4359361Z       "(4096, 14848)",
2026-02-21T12:03:01.4359508Z       "(4096, 15872)"
2026-02-21T12:03:01.4359661Z     ]
2026-02-21T12:03:01.4359788Z   },
2026-02-21T12:03:01.4359920Z   {
2026-02-21T12:03:01.4360053Z     "benchmark": {
2026-02-21T12:03:01.4360250Z       "name": "Helion Benchmark",
2026-02-21T12:03:01.4360448Z       "extra_info": {
2026-02-21T12:03:01.4360621Z         "device": "NVIDIA H100"
2026-02-21T12:03:01.4360802Z       }
2026-02-21T12:03:01.4361100Z     },
2026-02-21T12:03:01.4361283Z     "model": {
2026-02-21T12:03:01.4361446Z       "name": "layer_norm"
2026-02-21T12:03:01.4361614Z     },
2026-02-21T12:03:01.4361751Z     "metric": {
2026-02-21T12:03:01.4361916Z       "name": "triton_speedup",
2026-02-21T12:03:01.4362121Z       "benchmark_values": [
2026-02-21T12:03:01.4362302Z         1.2776119402985076,
2026-02-21T12:03:01.4362476Z         1.2430600515082202,
2026-02-21T12:03:01.4362643Z         1.2506848403202684,
2026-02-21T12:03:01.4362813Z         1.293076859466835,
2026-02-21T12:03:01.4362977Z         1.3282091847399138,
2026-02-21T12:03:01.4363143Z         1.3683664311002814,
2026-02-21T12:03:01.4363311Z         1.4490783080912972,
2026-02-21T12:03:01.4363473Z         1.5149027195428717,
2026-02-21T12:03:01.4363636Z         1.5222851989503905,
2026-02-21T12:03:01.4363936Z         1.5334634655751984,
2026-02-21T12:03:01.4364268Z         1.2954031434270974,
2026-02-21T12:03:01.4364429Z         1.3927801991023572,
2026-02-21T12:03:01.4364598Z         1.4282525931641932,
2026-02-21T12:03:01.4364757Z         1.505535729569709,
2026-02-21T12:03:01.4364925Z         1.524850389701097,
2026-02-21T12:03:01.4365086Z         1.55644075265446,
2026-02-21T12:03:01.4365255Z         1.5696341314243958,
2026-02-21T12:03:01.4365420Z         1.5891045190194053,
2026-02-21T12:03:01.4365580Z         1.5903229695871606,
2026-02-21T12:03:01.4365747Z         1.582531963669026
2026-02-21T12:03:01.4365903Z       ]
2026-02-21T12:03:01.4366036Z     },
2026-02-21T12:03:01.4366169Z     "shape": [
2026-02-21T12:03:01.4366318Z       "(4096, 1024)",
2026-02-21T12:03:01.4366486Z       "(4096, 2048)",
2026-02-21T12:03:01.4366642Z       "(4096, 2560)",
2026-02-21T12:03:01.4366790Z       "(4096, 3584)",
2026-02-21T12:03:01.4366942Z       "(4096, 4096)",
2026-02-21T12:03:01.4367091Z       "(4096, 5120)",
2026-02-21T12:03:01.4367246Z       "(4096, 5632)",
2026-02-21T12:03:01.4367399Z       "(4096, 6656)",
2026-02-21T12:03:01.4367551Z       "(4096, 7168)",
2026-02-21T12:03:01.4367705Z       "(4096, 8192)",
2026-02-21T12:03:01.4367849Z       "(4096, 8704)",
2026-02-21T12:03:01.4368000Z       "(4096, 9728)",
2026-02-21T12:03:01.4368158Z       "(4096, 10240)",
2026-02-21T12:03:01.4368318Z       "(4096, 11264)",
2026-02-21T12:03:01.4368471Z       "(4096, 11776)",
2026-02-21T12:03:01.4368623Z       "(4096, 12800)",
2026-02-21T12:03:01.4368773Z       "(4096, 13312)",
2026-02-21T12:03:01.4368931Z       "(4096, 14336)",
2026-02-21T12:03:01.4369090Z       "(4096, 14848)",
2026-02-21T12:03:01.4369244Z       "(4096, 15872)"
2026-02-21T12:03:01.4369397Z     ]
2026-02-21T12:03:01.4369525Z   },
2026-02-21T12:03:01.4369660Z   {
2026-02-21T12:03:01.4369795Z     "benchmark": {
2026-02-21T12:03:01.4369971Z       "name": "Helion Benchmark",
2026-02-21T12:03:01.4370278Z       "extra_info": {
2026-02-21T12:03:01.4370459Z         "device": "NVIDIA H100"
2026-02-21T12:03:01.4370639Z       }
2026-02-21T12:03:01.4370774Z     },
2026-02-21T12:03:01.4370904Z     "model": {
2026-02-21T12:03:01.4371058Z       "name": "layer_norm"
2026-02-21T12:03:01.4371230Z     },
2026-02-21T12:03:01.4371357Z     "metric": {
2026-02-21T12:03:01.4371518Z       "name": "triton_accuracy",
2026-02-21T12:03:01.4371710Z       "benchmark_values": [
2026-02-21T12:03:01.4371884Z         1.0,
2026-02-21T12:03:01.4372016Z         1.0,
2026-02-21T12:03:01.4372152Z         1.0,
2026-02-21T12:03:01.4372283Z         1.0,
2026-02-21T12:03:01.4372416Z         1.0,
2026-02-21T12:03:01.4372543Z         1.0,
2026-02-21T12:03:01.4372678Z         1.0,
2026-02-21T12:03:01.4372806Z         1.0,
2026-02-21T12:03:01.4372942Z         1.0,
2026-02-21T12:03:01.4373079Z         1.0,
2026-02-21T12:03:01.4373207Z         1.0,
2026-02-21T12:03:01.4373343Z         1.0,
2026-02-21T12:03:01.4373472Z         1.0,
2026-02-21T12:03:01.4373606Z         1.0,
2026-02-21T12:03:01.4373741Z         1.0,
2026-02-21T12:03:01.4373878Z         1.0,
2026-02-21T12:03:01.4374149Z         1.0,
2026-02-21T12:03:01.4374289Z         1.0,
2026-02-21T12:03:01.4374421Z         1.0,
2026-02-21T12:03:01.4374710Z         1.0
2026-02-21T12:03:01.4374840Z       ]
2026-02-21T12:03:01.4374975Z     },
2026-02-21T12:03:01.4375104Z     "shape": [
2026-02-21T12:03:01.4375260Z       "(4096, 1024)",
2026-02-21T12:03:01.4375415Z       "(4096, 2048)",
2026-02-21T12:03:01.4375581Z       "(4096, 2560)",
2026-02-21T12:03:01.4375735Z       "(4096, 3584)",
2026-02-21T12:03:01.4375883Z       "(4096, 4096)",
2026-02-21T12:03:01.4376035Z       "(4096, 5120)",
2026-02-21T12:03:01.4376218Z       "(4096, 5632)",
2026-02-21T12:03:01.4376480Z       "(4096, 6656)",
2026-02-21T12:03:01.4376672Z       "(4096, 7168)",
2026-02-21T12:03:01.4376820Z       "(4096, 8192)",
2026-02-21T12:03:01.4376979Z       "(4096, 8704)",
2026-02-21T12:03:01.4377127Z       "(4096, 9728)",
2026-02-21T12:03:01.4377286Z       "(4096, 10240)",
2026-02-21T12:03:01.4377594Z       "(4096, 11264)",
2026-02-21T12:03:01.4377771Z       "(4096, 11776)",
2026-02-21T12:03:01.4377929Z       "(4096, 12800)",
2026-02-21T12:03:01.4378084Z       "(4096, 13312)",
2026-02-21T12:03:01.4378245Z       "(4096, 14336)",
2026-02-21T12:03:01.4378395Z       "(4096, 14848)",
2026-02-21T12:03:01.4378548Z       "(4096, 15872)"
2026-02-21T12:03:01.4378691Z     ]
2026-02-21T12:03:01.4378822Z   },
2026-02-21T12:03:01.4378946Z   {
2026-02-21T12:03:01.4379085Z     "benchmark": {
2026-02-21T12:03:01.4379261Z       "name": "Helion Benchmark",
2026-02-21T12:03:01.4379457Z       "extra_info": {
2026-02-21T12:03:01.4379623Z         "device": "NVIDIA H100"
2026-02-21T12:03:01.4379799Z       }
2026-02-21T12:03:01.4379929Z     },
2026-02-21T12:03:01.4380056Z     "model": {
2026-02-21T12:03:01.4380213Z       "name": "layer_norm"
2026-02-21T12:03:01.4380390Z     },
2026-02-21T12:03:01.4380525Z     "metric": {
2026-02-21T12:03:01.4380680Z       "name": "helion_speedup",
2026-02-21T12:03:01.4380876Z       "benchmark_values": [
2026-02-21T12:03:01.4381047Z         1.2649008093404088,
2026-02-21T12:03:01.4381217Z         1.294041706306562,
2026-02-21T12:03:01.4381378Z         1.2388245849836497,
2026-02-21T12:03:01.4381551Z         1.2919387104789792,
2026-02-21T12:03:01.4381715Z         1.3403917043843354,
2026-02-21T12:03:01.4381874Z         1.4069483252167958,
2026-02-21T12:03:01.4382042Z         1.4491327270620573,
2026-02-21T12:03:01.4382204Z         1.5141990602769704,
2026-02-21T12:03:01.4382373Z         1.5206694469947972,
2026-02-21T12:03:01.4382534Z         1.539683422785522,
2026-02-21T12:03:01.4382735Z         1.58707686051562,
2026-02-21T12:03:01.4382911Z         1.5689961381980855,
2026-02-21T12:03:01.4383082Z         1.553498738043487,
2026-02-21T12:03:01.4383250Z         1.5727540049853257,
2026-02-21T12:03:01.4383411Z         1.572266597253938,
2026-02-21T12:03:01.4383579Z         1.5698218797943828,
2026-02-21T12:03:01.4383739Z         1.5743417962512762,
2026-02-21T12:03:01.4383909Z         1.578601664981743,
2026-02-21T12:03:01.4384211Z         1.5920976101645108,
2026-02-21T12:03:01.4384379Z         1.5836990095138523
2026-02-21T12:03:01.4384533Z       ]
2026-02-21T12:03:01.4384664Z     },
2026-02-21T12:03:01.4384800Z     "shape": [
2026-02-21T12:03:01.4384950Z       "(4096, 1024)",
2026-02-21T12:03:01.4385101Z       "(4096, 2048)",
2026-02-21T12:03:01.4385256Z       "(4096, 2560)",
2026-02-21T12:03:01.4385411Z       "(4096, 3584)",
2026-02-21T12:03:01.4385559Z       "(4096, 4096)",
2026-02-21T12:03:01.4385713Z       "(4096, 5120)",
2026-02-21T12:03:01.4385862Z       "(4096, 5632)",
2026-02-21T12:03:01.4386025Z       "(4096, 6656)",
2026-02-21T12:03:01.4386175Z       "(4096, 7168)",
2026-02-21T12:03:01.4386329Z       "(4096, 8192)",
2026-02-21T12:03:01.4386473Z       "(4096, 8704)",
2026-02-21T12:03:01.4386631Z       "(4096, 9728)",
2026-02-21T12:03:01.4386778Z       "(4096, 10240)",
2026-02-21T12:03:01.4386935Z       "(4096, 11264)",
2026-02-21T12:03:01.4387088Z       "(4096, 11776)",
2026-02-21T12:03:01.4387241Z       "(4096, 12800)",
2026-02-21T12:03:01.4387401Z       "(4096, 13312)",
2026-02-21T12:03:01.4387548Z       "(4096, 14336)",
2026-02-21T12:03:01.4387707Z       "(4096, 14848)",
2026-02-21T12:03:01.4388007Z       "(4096, 15872)"
2026-02-21T12:03:01.4388155Z     ]
2026-02-21T12:03:01.4388282Z   },
2026-02-21T12:03:01.4388411Z   {
2026-02-21T12:03:01.4388538Z     "benchmark": {
2026-02-21T12:03:01.4388707Z       "name": "Helion Benchmark",
2026-02-21T12:03:01.4388892Z       "extra_info": {
2026-02-21T12:03:01.4389057Z         "device": "NVIDIA H100"
2026-02-21T12:03:01.4389232Z       }
2026-02-21T12:03:01.4389357Z     },
2026-02-21T12:03:01.4389508Z     "model": {
2026-02-21T12:03:01.4389661Z       "name": "layer_norm"
2026-02-21T12:03:01.4389828Z     },
2026-02-21T12:03:01.4389957Z     "metric": {
2026-02-21T12:03:01.4390120Z       "name": "helion_accuracy",
2026-02-21T12:03:01.4390310Z       "benchmark_values": [
2026-02-21T12:03:01.4390482Z         1.0,
2026-02-21T12:03:01.4390795Z         1.0,
2026-02-21T12:03:01.4390944Z         1.0,
2026-02-21T12:03:01.4391077Z         1.0,
2026-02-21T12:03:01.4391213Z         1.0,
2026-02-21T12:03:01.4391349Z         1.0,
2026-02-21T12:03:01.4391482Z         1.0,
2026-02-21T12:03:01.4391620Z         1.0,
2026-02-21T12:03:01.4391749Z         1.0,
2026-02-21T12:03:01.4391885Z         1.0,
2026-02-21T12:03:01.4392015Z         1.0,
2026-02-21T12:03:01.4392148Z         1.0,
2026-02-21T12:03:01.4392276Z         1.0,
2026-02-21T12:03:01.4392412Z         1.0,
2026-02-21T12:03:01.4399871Z         1.0,
2026-02-21T12:03:01.4400084Z         1.0,
2026-02-21T12:03:01.4400234Z         1.0,
2026-02-21T12:03:01.4400378Z         1.0,
2026-02-21T12:03:01.4400512Z         1.0,
2026-02-21T12:03:01.4400653Z         1.0
2026-02-21T12:03:01.4400786Z       ]
2026-02-21T12:03:01.4400923Z     },
2026-02-21T12:03:01.4401068Z     "shape": [
2026-02-21T12:03:01.4401221Z       "(4096, 1024)",
2026-02-21T12:03:01.4401412Z       "(4096, 2048)",
2026-02-21T12:03:01.4401583Z       "(4096, 2560)",
2026-02-21T12:03:01.4401749Z       "(4096, 3584)",
2026-02-21T12:03:01.4401899Z       "(4096, 4096)",
2026-02-21T12:03:01.4402053Z       "(4096, 5120)",
2026-02-21T12:03:01.4402196Z       "(4096, 5632)",
2026-02-21T12:03:01.4402354Z       "(4096, 6656)",
2026-02-21T12:03:01.4402502Z       "(4096, 7168)",
2026-02-21T12:03:01.4402654Z       "(4096, 8192)",
2026-02-21T12:03:01.4402801Z       "(4096, 8704)",
2026-02-21T12:03:01.4402959Z       "(4096, 9728)",
2026-02-21T12:03:01.4403122Z       "(4096, 10240)",
2026-02-21T12:03:01.4403283Z       "(4096, 11264)",
2026-02-21T12:03:01.4403442Z       "(4096, 11776)",
2026-02-21T12:03:01.4403591Z       "(4096, 12800)",
2026-02-21T12:03:01.4403747Z       "(4096, 13312)",
2026-02-21T12:03:01.4403900Z       "(4096, 14336)",
2026-02-21T12:03:01.4404237Z       "(4096, 14848)",
2026-02-21T12:03:01.4404398Z       "(4096, 15872)"
2026-02-21T12:03:01.4404555Z     ]
2026-02-21T12:03:01.4404687Z   }
2026-02-21T12:03:01.4404830Z ]
2026-02-21T12:03:01.4482696Z ##[group]Run pytorch/test-infra/.github/actions/gather-benchmark-metadata@main
2026-02-21T12:03:01.4483079Z with:
2026-02-21T12:03:01.4483713Z   github-token: ***
2026-02-21T12:03:01.4483903Z   venv: .venv/bin/activate
2026-02-21T12:03:01.4484282Z   schema-version: v3
2026-02-21T12:03:01.4484442Z env:
2026-02-21T12:03:01.4484598Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:01.4484839Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4485151Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:01.4485460Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4485725Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4485990Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4486303Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:01.4486662Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:01.4486956Z ##[endgroup]
2026-02-21T12:03:01.4553807Z ##[group]Run set -eux
2026-02-21T12:03:01.4554159Z set -eux
2026-02-21T12:03:01.4554325Z 
2026-02-21T12:03:01.4554500Z if [[ -z "${GITHUB_TOKEN}" ]]; then
2026-02-21T12:03:01.4554947Z   echo "Missing github-token input"
2026-02-21T12:03:01.4555179Z   exit 1
2026-02-21T12:03:01.4555328Z fi
2026-02-21T12:03:01.4556220Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T12:03:01.4556479Z env:
2026-02-21T12:03:01.4556640Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:01.4556894Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4557213Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:01.4557516Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4557777Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4558046Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.4558363Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:01.4558720Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:01.4559130Z   GITHUB_TOKEN: ***
2026-02-21T12:03:01.4559300Z ##[endgroup]
2026-02-21T12:03:01.7091779Z + [[ -z *** ]]
2026-02-21T12:03:01.7168781Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main
2026-02-21T12:03:01.7169123Z with:
2026-02-21T12:03:01.7169470Z   github-token: ***
2026-02-21T12:03:01.7169645Z env:
2026-02-21T12:03:01.7169794Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:01.7170043Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7170446Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:01.7170766Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7171028Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7171297Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7171631Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:01.7171989Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:01.7172253Z ##[endgroup]
2026-02-21T12:03:01.7185195Z ##[group]Run set -eux
2026-02-21T12:03:01.7185414Z set -eux
2026-02-21T12:03:01.7185577Z 
2026-02-21T12:03:01.7185937Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2026-02-21T12:03:01.7186465Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T12:03:01.7186709Z env:
2026-02-21T12:03:01.7186862Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:01.7187104Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7187418Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:01.7187721Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7187988Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7188560Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:01.7188910Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:01.7189264Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:01.7189712Z   GITHUB_TOKEN: ***
2026-02-21T12:03:01.7189902Z ##[endgroup]
2026-02-21T12:03:02.0685513Z + python3 /__w/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 22253280836 i-094f68f2a7449fe73-1002
2026-02-21T12:03:05.6576991Z setting job-id=64380330160
2026-02-21T12:03:05.6577463Z setting job-name=run-h100 (layer_norm) / benchmark-cu128-layer_norm-py3.12-h100
2026-02-21T12:03:05.6780461Z ##[group]Run set -eux
2026-02-21T12:03:05.6780685Z set -eux
2026-02-21T12:03:05.6780837Z 
2026-02-21T12:03:05.6781015Z if [[ -n ".venv/bin/activate" ]]; then
2026-02-21T12:03:05.6781282Z   source ".venv/bin/activate"
2026-02-21T12:03:05.6781491Z fi
2026-02-21T12:03:05.6781653Z 
2026-02-21T12:03:05.6781947Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \
2026-02-21T12:03:05.6782358Z   --schema-version "${SCHEMA_VERSION}" \
2026-02-21T12:03:05.6782852Z   --repo "${REPO}" \
2026-02-21T12:03:05.6783076Z   --head-branch "${HEAD_BRANCH}" \
2026-02-21T12:03:05.6783308Z   --head-sha "${HEAD_SHA}" \
2026-02-21T12:03:05.6783560Z   --workflow-id "${WORKFLOW_RUN_ID}" \
2026-02-21T12:03:05.6783809Z   --run-attempt "${RUN_ATTEMPT}" \
2026-02-21T12:03:05.6784213Z   --job-id "${JOB_ID}" \
2026-02-21T12:03:05.6784442Z   --job-name "${JOB_NAME}"
2026-02-21T12:03:05.6784782Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T12:03:05.6785029Z env:
2026-02-21T12:03:05.6785190Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:05.6785434Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.6785743Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:05.6786062Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.6786343Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.6786605Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.6786937Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:05.6787293Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:05.6787567Z   SCHEMA_VERSION: v3
2026-02-21T12:03:05.6787743Z   REPO: pytorch/helion
2026-02-21T12:03:05.6787926Z   HEAD_BRANCH: refs/heads/main
2026-02-21T12:03:05.6788153Z   HEAD_SHA: 874a7d0cadab18218a84ad3579d329dc95c51820
2026-02-21T12:03:05.6788395Z   WORKFLOW_RUN_ID: 22253280836
2026-02-21T12:03:05.6788591Z   RUN_ATTEMPT: 1
2026-02-21T12:03:05.6788748Z   JOB_ID: 64380330160
2026-02-21T12:03:05.6789026Z   JOB_NAME: run-h100 (layer_norm) / benchmark-cu128-layer_norm-py3.12-h100
2026-02-21T12:03:05.6789329Z ##[endgroup]
2026-02-21T12:03:05.8315145Z + [[ -n .venv/bin/activate ]]
2026-02-21T12:03:05.8315446Z + source .venv/bin/activate
2026-02-21T12:03:05.8315682Z ++ '[' -z '' ']'
2026-02-21T12:03:05.8315858Z ++ '[' -n x ']'
2026-02-21T12:03:05.8316054Z ++ SCRIPT_PATH=.venv/bin/activate
2026-02-21T12:03:05.8316429Z ++ '[' .venv/bin/activate = /__w/_temp/d4253bcc-f72c-4641-bca1-474ee88cccb5.sh ']'
2026-02-21T12:03:05.8316829Z ++ deactivate nondestructive
2026-02-21T12:03:05.8317049Z ++ unset -f pydoc
2026-02-21T12:03:05.8317236Z ++ '[' -z '' ']'
2026-02-21T12:03:05.8317414Z ++ '[' -z '' ']'
2026-02-21T12:03:05.8317578Z ++ hash -r
2026-02-21T12:03:05.8317742Z ++ '[' -z '' ']'
2026-02-21T12:03:05.8317913Z ++ unset VIRTUAL_ENV
2026-02-21T12:03:05.8318121Z ++ unset VIRTUAL_ENV_PROMPT
2026-02-21T12:03:05.8318359Z ++ '[' '!' nondestructive = nondestructive ']'
2026-02-21T12:03:05.8318643Z ++ VIRTUAL_ENV=/__w/helion/helion/.venv
2026-02-21T12:03:05.8322189Z ++ '[' linux-gnu = cygwin ']'
2026-02-21T12:03:05.8322411Z ++ '[' linux-gnu = msys ']'
2026-02-21T12:03:05.8324946Z ++ export VIRTUAL_ENV
2026-02-21T12:03:05.8325204Z ++ '[' -z '' ']'
2026-02-21T12:03:05.8325399Z ++ unset SCRIPT_PATH
2026-02-21T12:03:05.8326283Z ++ _OLD_VIRTUAL_PATH=/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T12:03:05.8327961Z ++ PATH=/__w/helion/helion/.venv/bin:/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T12:03:05.8328922Z ++ export PATH
2026-02-21T12:03:05.8329107Z ++ '[' xhelion '!=' x ']'
2026-02-21T12:03:05.8329321Z ++ VIRTUAL_ENV_PROMPT=helion
2026-02-21T12:03:05.8329544Z ++ export VIRTUAL_ENV_PROMPT
2026-02-21T12:03:05.8329754Z ++ '[' -z '' ']'
2026-02-21T12:03:05.8329920Z ++ '[' -z '' ']'
2026-02-21T12:03:05.8330224Z ++ _OLD_VIRTUAL_PS1=
2026-02-21T12:03:05.8330417Z ++ PS1='(helion) '
2026-02-21T12:03:05.8330589Z ++ export PS1
2026-02-21T12:03:05.8330761Z ++ alias pydoc
2026-02-21T12:03:05.8330923Z ++ true
2026-02-21T12:03:05.8331307Z ++ hash -r
2026-02-21T12:03:05.8332800Z + python3 /__w/_actions/pytorch/test-infra/main/.github/actions/gather-benchmark-metadata/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/helion --head-branch refs/heads/main --head-sha 874a7d0cadab18218a84ad3579d329dc95c51820 --workflow-id 22253280836 --run-attempt 1 --job-id 64380330160 --job-name 'run-h100 (layer_norm) / benchmark-cu128-layer_norm-py3.12-h100'
2026-02-21T12:03:05.8797271Z ##[group]Run pytorch/test-infra/.github/actions/gather-runners-info@main
2026-02-21T12:03:05.8797624Z with:
2026-02-21T12:03:05.8797785Z   venv: .venv/bin/activate
2026-02-21T12:03:05.8797959Z env:
2026-02-21T12:03:05.8798110Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:05.8798348Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8798663Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:05.8798965Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8799230Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8799508Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8799875Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:05.8800245Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:05.8800508Z ##[endgroup]
2026-02-21T12:03:05.8813393Z ##[group]Run set -eux
2026-02-21T12:03:05.8813645Z set -eux
2026-02-21T12:03:05.8813806Z 
2026-02-21T12:03:05.8814131Z if command -v nvidia-smi; then
2026-02-21T12:03:05.8814372Z   DEVICE_NAME=cuda
2026-02-21T12:03:05.8814566Z   nvidia-smi
2026-02-21T12:03:05.8814747Z elif command -v rocm-smi; then
2026-02-21T12:03:05.8814978Z   DEVICE_NAME=rocm
2026-02-21T12:03:05.8815195Z   rocm-smi
2026-02-21T12:03:05.8815378Z elif command -v hl-smi; then
2026-02-21T12:03:05.8815596Z   DEVICE_NAME=hpu
2026-02-21T12:03:05.8815783Z   hl-smi
2026-02-21T12:03:05.8815937Z else
2026-02-21T12:03:05.8816098Z   arch=$(uname -m)
2026-02-21T12:03:05.8816279Z 
2026-02-21T12:03:05.8816425Z   case "$arch" in
2026-02-21T12:03:05.8816614Z     aarch64|arm64)
2026-02-21T12:03:05.8816810Z       DEVICE_NAME=arm64-cpu
2026-02-21T12:03:05.8817034Z       ;;
2026-02-21T12:03:05.8817186Z     *)
2026-02-21T12:03:05.8817353Z       DEVICE_NAME=cpu
2026-02-21T12:03:05.8817559Z       ;;
2026-02-21T12:03:05.8817709Z   esac
2026-02-21T12:03:05.8817857Z   lscpu
2026-02-21T12:03:05.8818008Z fi
2026-02-21T12:03:05.8818205Z echo "DEVICE_NAME=$DEVICE_NAME" >> $GITHUB_ENV
2026-02-21T12:03:05.8818555Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T12:03:05.8818809Z env:
2026-02-21T12:03:05.8818964Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:05.8819202Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8819503Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:05.8819805Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8820063Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8820314Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:05.8820626Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:05.8820979Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:05.8821249Z ##[endgroup]
2026-02-21T12:03:06.0761457Z + command -v nvidia-smi
2026-02-21T12:03:06.0761696Z + DEVICE_NAME=cuda
2026-02-21T12:03:06.0761884Z + nvidia-smi
2026-02-21T12:03:06.0762064Z /usr/bin/nvidia-smi
2026-02-21T12:03:06.0946830Z Sat Feb 21 12:03:06 2026       
2026-02-21T12:03:06.0947191Z +-----------------------------------------------------------------------------------------+
2026-02-21T12:03:06.0947717Z | NVIDIA-SMI 580.95.05              Driver Version: 580.95.05      CUDA Version: 13.0     |
2026-02-21T12:03:06.0948544Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T12:03:06.0949048Z | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
2026-02-21T12:03:06.0949606Z | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
2026-02-21T12:03:06.0950295Z |                                         |                        |               MIG M. |
2026-02-21T12:03:06.0950669Z |=========================================+========================+======================|
2026-02-21T12:03:06.1167795Z |   0  NVIDIA H100 80GB HBM3          On  |   00000000:64:00.0 Off |                    0 |
2026-02-21T12:03:06.1168268Z | N/A   42C    P0             73W /  500W |       0MiB /  81559MiB |      0%      Default |
2026-02-21T12:03:06.1168655Z |                                         |                        |             Disabled |
2026-02-21T12:03:06.1169057Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T12:03:06.1171675Z 
2026-02-21T12:03:06.1172027Z +-----------------------------------------------------------------------------------------+
2026-02-21T12:03:06.1172524Z | Processes:                                                                              |
2026-02-21T12:03:06.1172988Z |  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
2026-02-21T12:03:06.1173411Z |        ID   ID                                                               Usage      |
2026-02-21T12:03:06.1173740Z |=========================================================================================|
2026-02-21T12:03:06.1178556Z |  No running processes found                                                             |
2026-02-21T12:03:06.1178998Z +-----------------------------------------------------------------------------------------+
2026-02-21T12:03:06.1943687Z + echo DEVICE_NAME=cuda
2026-02-21T12:03:06.1994987Z ##[group]Run set -eux
2026-02-21T12:03:06.1995241Z set -eux
2026-02-21T12:03:06.1995412Z 
2026-02-21T12:03:06.1995591Z if [[ "${DEVICE_NAME}" == "cuda" ]]; then
2026-02-21T12:03:06.1995882Z   # Return the same device name as PyTorch
2026-02-21T12:03:06.1996242Z   DEVICE_TYPE=$(nvidia-smi -i 0 --query-gpu=name --format=csv,noheader)
2026-02-21T12:03:06.1996640Z elif [[ "${DEVICE_NAME}" == "rocm" ]]; then
2026-02-21T12:03:06.1997063Z   DEVICE_TYPE=$(rocminfo | grep "Marketing Name" | tail -n1 | awk -F':' '{print $2}' | xargs)
2026-02-21T12:03:06.1997531Z elif [[ "${DEVICE_NAME}" == "hpu" ]]; then
2026-02-21T12:03:06.1998004Z   DEVICE_TYPE="Intel Gaudi3 "$(hl-smi -q | grep "Product Name" | head -n 1 | awk -F ':' '{print $2}' | sed 's/^ *//')
2026-02-21T12:03:06.1998471Z elif [[ "${DEVICE_NAME}" == "cpu" ]]; then
2026-02-21T12:03:06.1999378Z   DEVICE_TYPE="$(lscpu | grep "Model name" | sed -E 's/.*Model name:[[:space:]]*//; s/Intel\(R\)//g; s/\(R\)//g; s/\(TM\)//g; s/CPU//g; s/Processor//g; s/[[:space:]]+/ /g; s/^ //; s/ $//; s/ /_/g')_$(awk -F: '/Core\(s\) per socket/ {c=$2} /Socket\(s\)/ {s=$2} END {gsub(/ /,"",c); gsub(/ /,"",s); printf "%sc", c*s}' < <(lscpu))"
2026-02-21T12:03:06.2000345Z elif [[ "${DEVICE_NAME}" == "arm64-cpu" ]]; then
2026-02-21T12:03:06.2000762Z   DEVICE_TYPE=$(lscpu | grep 'Vendor ID' | cut -f 2 -d ":" | awk '{$1=$1}1' | cut -f 2 -d " ")
2026-02-21T12:03:06.2001143Z fi
2026-02-21T12:03:06.2001353Z echo "DEVICE_TYPE=$DEVICE_TYPE" >> $GITHUB_ENV
2026-02-21T12:03:06.2001822Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T12:03:06.2002070Z env:
2026-02-21T12:03:06.2002224Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:06.2002467Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.2002774Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:06.2003334Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.2003599Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.2003868Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.2004368Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:06.2004736Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:06.2005250Z   DEVICE_NAME: cuda
2026-02-21T12:03:06.2005441Z ##[endgroup]
2026-02-21T12:03:06.4463309Z + [[ cuda == \c\u\d\a ]]
2026-02-21T12:03:06.4466894Z ++ nvidia-smi -i 0 --query-gpu=name --format=csv,noheader
2026-02-21T12:03:06.4682885Z + DEVICE_TYPE='NVIDIA H100 80GB HBM3'
2026-02-21T12:03:06.4683211Z + echo 'DEVICE_TYPE=NVIDIA H100 80GB HBM3'
2026-02-21T12:03:06.4731125Z ##[group]Run set -eux
2026-02-21T12:03:06.4731348Z set -eux
2026-02-21T12:03:06.4731506Z 
2026-02-21T12:03:06.4731696Z if [[ -n ".venv/bin/activate" ]]; then
2026-02-21T12:03:06.4731994Z   source ".venv/bin/activate"
2026-02-21T12:03:06.4732218Z fi
2026-02-21T12:03:06.4732362Z 
2026-02-21T12:03:06.4732611Z python3 -mpip install psutil==7.0.0 nvidia-ml-py==13.580.82
2026-02-21T12:03:06.4733077Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_runners_info.py"
2026-02-21T12:03:06.4733556Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T12:03:06.4733814Z env:
2026-02-21T12:03:06.4734109Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:06.4734361Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.4734667Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:06.4734962Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.4735231Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.4735494Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:06.4735824Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:06.4736209Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:06.4736484Z   DEVICE_NAME: cuda
2026-02-21T12:03:06.4736664Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T12:03:06.4736867Z ##[endgroup]
2026-02-21T12:03:06.5188043Z + [[ -n .venv/bin/activate ]]
2026-02-21T12:03:06.5188333Z + source .venv/bin/activate
2026-02-21T12:03:06.5188571Z ++ '[' -z '' ']'
2026-02-21T12:03:06.5188791Z ++ '[' -n x ']'
2026-02-21T12:03:06.5188997Z ++ SCRIPT_PATH=.venv/bin/activate
2026-02-21T12:03:06.5189380Z ++ '[' .venv/bin/activate = /__w/_temp/02af7367-d5a4-4793-9d5c-8ddbb5cede23.sh ']'
2026-02-21T12:03:06.5189807Z ++ deactivate nondestructive
2026-02-21T12:03:06.5190037Z ++ unset -f pydoc
2026-02-21T12:03:06.5190232Z ++ '[' -z '' ']'
2026-02-21T12:03:06.5190407Z ++ '[' -z '' ']'
2026-02-21T12:03:06.5190582Z ++ hash -r
2026-02-21T12:03:06.5190744Z ++ '[' -z '' ']'
2026-02-21T12:03:06.5190926Z ++ unset VIRTUAL_ENV
2026-02-21T12:03:06.5191129Z ++ unset VIRTUAL_ENV_PROMPT
2026-02-21T12:03:06.5191402Z ++ '[' '!' nondestructive = nondestructive ']'
2026-02-21T12:03:06.5191701Z ++ VIRTUAL_ENV=/__w/helion/helion/.venv
2026-02-21T12:03:06.5193869Z ++ '[' linux-gnu = cygwin ']'
2026-02-21T12:03:06.5194242Z ++ '[' linux-gnu = msys ']'
2026-02-21T12:03:06.5196049Z ++ export VIRTUAL_ENV
2026-02-21T12:03:06.5196242Z ++ '[' -z '' ']'
2026-02-21T12:03:06.5196423Z ++ unset SCRIPT_PATH
2026-02-21T12:03:06.5197299Z ++ _OLD_VIRTUAL_PATH=/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T12:03:06.5198977Z ++ PATH=/__w/helion/helion/.venv/bin:/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T12:03:06.5200223Z ++ export PATH
2026-02-21T12:03:06.5200403Z ++ '[' xhelion '!=' x ']'
2026-02-21T12:03:06.5200614Z ++ VIRTUAL_ENV_PROMPT=helion
2026-02-21T12:03:06.5200854Z ++ export VIRTUAL_ENV_PROMPT
2026-02-21T12:03:06.5201065Z ++ '[' -z '' ']'
2026-02-21T12:03:06.5201230Z ++ '[' -z '' ']'
2026-02-21T12:03:06.5201403Z ++ _OLD_VIRTUAL_PS1=
2026-02-21T12:03:06.5201587Z ++ PS1='(helion) '
2026-02-21T12:03:06.5201771Z ++ export PS1
2026-02-21T12:03:06.5202169Z ++ alias pydoc
2026-02-21T12:03:06.5202347Z ++ true
2026-02-21T12:03:06.5202498Z ++ hash -r
2026-02-21T12:03:06.5202755Z + python3 -mpip install psutil==7.0.0 nvidia-ml-py==13.580.82
2026-02-21T12:03:07.3846129Z Collecting psutil==7.0.0
2026-02-21T12:03:07.4561289Z   Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (22 kB)
2026-02-21T12:03:07.4816275Z Collecting nvidia-ml-py==13.580.82
2026-02-21T12:03:07.4932764Z   Downloading nvidia_ml_py-13.580.82-py3-none-any.whl.metadata (9.6 kB)
2026-02-21T12:03:07.5106718Z Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB)
2026-02-21T12:03:07.5483205Z Downloading nvidia_ml_py-13.580.82-py3-none-any.whl (49 kB)
2026-02-21T12:03:07.6771878Z Installing collected packages: nvidia-ml-py, psutil
2026-02-21T12:03:07.6778070Z   Attempting uninstall: nvidia-ml-py
2026-02-21T12:03:07.6796699Z     Found existing installation: nvidia-ml-py 13.590.48
2026-02-21T12:03:07.6815099Z     Uninstalling nvidia-ml-py-13.590.48:
2026-02-21T12:03:07.7908389Z       Successfully uninstalled nvidia-ml-py-13.590.48
2026-02-21T12:03:07.8463394Z   Attempting uninstall: psutil
2026-02-21T12:03:07.8510156Z     Found existing installation: psutil 7.2.2
2026-02-21T12:03:07.8533718Z     Uninstalling psutil-7.2.2:
2026-02-21T12:03:07.8540564Z       Successfully uninstalled psutil-7.2.2
2026-02-21T12:03:08.0018086Z 
2026-02-21T12:03:08.0073109Z Successfully installed nvidia-ml-py-13.580.82 psutil-7.0.0
2026-02-21T12:03:08.1618271Z + python3 /__w/_actions/pytorch/test-infra/main/.github/actions/gather-runners-info/../../scripts/benchmarks/gather_runners_info.py
2026-02-21T12:03:10.0800552Z ##[group]Run pytorch/test-infra/.github/actions/gather-dependencies@main
2026-02-21T12:03:10.0800927Z with:
2026-02-21T12:03:10.0801089Z   venv: .venv/bin/activate
2026-02-21T12:03:10.0801265Z env:
2026-02-21T12:03:10.0801419Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:10.0801658Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0801981Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:10.0802283Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0802554Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0802821Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0803149Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:10.0803525Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:10.0803814Z   DEVICE_NAME: cuda
2026-02-21T12:03:10.0804150Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T12:03:10.0804407Z ##[endgroup]
2026-02-21T12:03:10.0816672Z ##[group]Run set -eux
2026-02-21T12:03:10.0816872Z set -eux
2026-02-21T12:03:10.0817036Z 
2026-02-21T12:03:10.0817219Z # TODO (huydhn): Implement this part
2026-02-21T12:03:10.0817509Z echo "dependencies={}" >> "${GITHUB_OUTPUT}"
2026-02-21T12:03:10.0817875Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T12:03:10.0818119Z env:
2026-02-21T12:03:10.0818282Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:10.0818536Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0818855Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:10.0819168Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0819440Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0819984Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.0820305Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:10.0820681Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:10.0820969Z   DEVICE_NAME: cuda
2026-02-21T12:03:10.0821143Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T12:03:10.0821358Z ##[endgroup]
2026-02-21T12:03:10.3423965Z + echo 'dependencies={}'
2026-02-21T12:03:10.3494222Z ##[group]Run actions/upload-artifact@v6
2026-02-21T12:03:10.3494498Z with:
2026-02-21T12:03:10.3494681Z   name: benchmark-results-h100-layer_norm
2026-02-21T12:03:10.3494921Z   path: test/test-reports
2026-02-21T12:03:10.3495123Z   if-no-files-found: warn
2026-02-21T12:03:10.3495306Z   compression-level: 6
2026-02-21T12:03:10.3495494Z   overwrite: false
2026-02-21T12:03:10.3495660Z   include-hidden-files: false
2026-02-21T12:03:10.3495849Z env:
2026-02-21T12:03:10.3495996Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T12:03:10.3496253Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.3496592Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T12:03:10.3496913Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.3497178Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.3497435Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T12:03:10.3497799Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T12:03:10.3498164Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T12:03:10.3498432Z   DEVICE_NAME: cuda
2026-02-21T12:03:10.3498612Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T12:03:10.3498818Z ##[endgroup]
2026-02-21T12:03:10.3501610Z ##[command]/usr/bin/docker exec  e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T12:03:10.5892027Z With the provided path, there will be 1 file uploaded
2026-02-21T12:03:10.5896718Z Artifact name is valid!
2026-02-21T12:03:10.5897659Z Root directory input is valid!
2026-02-21T12:03:10.6818253Z Beginning upload of artifact content to blob storage
2026-02-21T12:03:10.7999353Z Uploaded bytes 1064
2026-02-21T12:03:10.8307066Z Finished uploading artifact content to blob storage!
2026-02-21T12:03:10.8307745Z SHA256 digest of uploaded artifact zip is ac9e7fdfe54c95d7ae4c83b098f7c9a21a037097c6032d97c1519805833fe7ad
2026-02-21T12:03:10.8309060Z Finalizing artifact upload
2026-02-21T12:03:10.9487646Z Artifact benchmark-results-h100-layer_norm.zip successfully finalized. Artifact ID 5601168183
2026-02-21T12:03:10.9489412Z Artifact benchmark-results-h100-layer_norm has been successfully uploaded! Final size is 1064 bytes. Artifact ID is 5601168183
2026-02-21T12:03:10.9492096Z Artifact download URL: https://github.com/pytorch/helion/actions/runs/22253280836/artifacts/5601168183
2026-02-21T12:03:10.9678742Z Post job cleanup.
2026-02-21T12:03:10.9683447Z ##[command]/usr/bin/docker exec  e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T12:03:11.4010234Z UV_PYTHON_INSTALL_DIR is already set to /github/home/.local/share/uv/python
2026-02-21T12:03:11.4013459Z (node:340203) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.
2026-02-21T12:03:11.4014376Z (Use `node --trace-deprecation ...` to show where the warning was created)
2026-02-21T12:03:11.4192186Z Post job cleanup.
2026-02-21T12:03:11.4195665Z ##[command]/usr/bin/docker exec  e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T12:03:11.6514701Z Post job cleanup.
2026-02-21T12:03:11.6518651Z ##[command]/usr/bin/docker exec  e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T12:03:11.8465899Z [command]/usr/bin/git version
2026-02-21T12:03:11.8507248Z git version 2.43.0
2026-02-21T12:03:11.8545039Z Temporarily overriding HOME='/__w/_temp/2dc684a3-4221-43d4-a334-506a17a1fef5' before making global git config changes
2026-02-21T12:03:11.8546251Z Adding repository directory to the temporary git global config as a safe directory
2026-02-21T12:03:11.8549867Z [command]/usr/bin/git config --global --add safe.directory /__w/helion/helion
2026-02-21T12:03:11.8584231Z Removing SSH command configuration
2026-02-21T12:03:11.8589400Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2026-02-21T12:03:11.8623315Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2026-02-21T12:03:11.8922025Z Removing HTTP extra header
2026-02-21T12:03:11.8925758Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2026-02-21T12:03:11.8957686Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2026-02-21T12:03:11.9242188Z Removing includeIf entries pointing to credentials config files
2026-02-21T12:03:11.9246960Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir:
2026-02-21T12:03:11.9272105Z includeif.gitdir:/__w/helion/helion/.git.path
2026-02-21T12:03:11.9272481Z includeif.gitdir:/__w/helion/helion/.git/worktrees/*.path
2026-02-21T12:03:11.9272852Z includeif.gitdir:/github/workspace/.git.path
2026-02-21T12:03:11.9273207Z includeif.gitdir:/github/workspace/.git/worktrees/*.path
2026-02-21T12:03:11.9279802Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/__w/helion/helion/.git.path
2026-02-21T12:03:11.9303466Z /__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9311759Z [command]/usr/bin/git config --local --unset includeif.gitdir:/__w/helion/helion/.git.path /__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9346408Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/__w/helion/helion/.git/worktrees/*.path
2026-02-21T12:03:11.9369886Z /__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9377817Z [command]/usr/bin/git config --local --unset includeif.gitdir:/__w/helion/helion/.git/worktrees/*.path /__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9411174Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/github/workspace/.git.path
2026-02-21T12:03:11.9434377Z /github/runner_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9441357Z [command]/usr/bin/git config --local --unset includeif.gitdir:/github/workspace/.git.path /github/runner_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9473192Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/github/workspace/.git/worktrees/*.path
2026-02-21T12:03:11.9499389Z /github/runner_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9507514Z [command]/usr/bin/git config --local --unset includeif.gitdir:/github/workspace/.git/worktrees/*.path /github/runner_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config
2026-02-21T12:03:11.9541686Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url
2026-02-21T12:03:11.9820496Z Removing credentials config '/__w/_temp/git-credentials-e467fee8-8bca-47bd-a87b-1dc6506e52e1.config'
2026-02-21T12:03:11.9973760Z Stop and remove container: 53d02b317a0649e583e7c3d6a8c97e40_nvidiacuda1281develubuntu2404_da14a8
2026-02-21T12:03:11.9978153Z ##[command]/usr/bin/docker rm --force e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7
2026-02-21T12:03:25.1523895Z e3cd93a09502244b4dc9974c494b141995697caa6b2c11f0c2f5d48751bc6cd7
2026-02-21T12:03:25.1564478Z Remove container network: github_network_92f0144b3e914f56b98fc7f95480154a
2026-02-21T12:03:25.1569155Z ##[command]/usr/bin/docker network rm github_network_92f0144b3e914f56b98fc7f95480154a
2026-02-21T12:03:26.5667353Z github_network_92f0144b3e914f56b98fc7f95480154a
2026-02-21T12:03:26.5731918Z Evaluate and set job outputs
2026-02-21T12:03:26.5737459Z Set output 'benchmark-metadata'
2026-02-21T12:03:26.5739437Z Set output 'runners-info'
2026-02-21T12:03:26.5739982Z Set output 'dependencies'
2026-02-21T12:03:26.5740612Z Cleaning up orphan processes