2026-02-21T08:04:42.6013659Z Current runner version: '2.331.0'
2026-02-21T08:04:42.6019262Z Runner name: 'i-094f68f2a7449fe73-1004'
2026-02-21T08:04:42.6020030Z Runner group name: 'default'
2026-02-21T08:04:42.6020734Z Machine name: 'e272d9468361'
2026-02-21T08:04:42.6023086Z ##[group]GITHUB_TOKEN Permissions
2026-02-21T08:04:42.6025259Z Contents: read
2026-02-21T08:04:42.6025777Z Metadata: read
2026-02-21T08:04:42.6026243Z ##[endgroup]
2026-02-21T08:04:42.6028185Z Secret source: Actions
2026-02-21T08:04:42.6028837Z Prepare workflow directory
2026-02-21T08:04:42.6558969Z Prepare all required actions
2026-02-21T08:04:42.6592902Z Getting action download info
2026-02-21T08:04:42.9763631Z Download action repository 'actions/checkout@v6' (SHA:de0fac2e4500dabe0009e67214ff5f5447ce83dd)
2026-02-21T08:04:43.2965527Z Download action repository 'actions/setup-python@v6' (SHA:a309ff8b426b58ec0e2a45f0f869d46889d02405)
2026-02-21T08:04:43.6366742Z Download action repository 'astral-sh/setup-uv@v7' (SHA:eac588ad8def6316056a12d4907a9d4d84ff7a3b)
2026-02-21T08:04:43.9989833Z Download action repository 'pytorch/test-infra@main' (SHA:bb8f04ff3961233c844fde6533c7c6c5f0857909)
2026-02-21T08:04:46.5908087Z Download action repository 'actions/upload-artifact@v6' (SHA:b7c566a772e6b6bfb58ed0dc250532a479d7789f)
2026-02-21T08:04:47.2641776Z Getting action download info
2026-02-21T08:04:47.4191352Z Uses: pytorch/helion/.github/workflows/benchmark.yml@refs/heads/main (874a7d0cadab18218a84ad3579d329dc95c51820)
2026-02-21T08:04:47.4195844Z ##[group] Inputs
2026-02-21T08:04:47.4196199Z   runner: linux.aws.h100
2026-02-21T08:04:47.4196550Z   python-version: 3.12
2026-02-21T08:04:47.4196929Z   image: nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:04:47.4197258Z   runtime-version: cu128
2026-02-21T08:04:47.4197641Z   container-options: --gpus all
2026-02-21T08:04:47.4197996Z   alias: h100
2026-02-21T08:04:47.4198222Z   kernels: softmax
2026-02-21T08:04:47.4198528Z   env-vars: 
2026-02-21T08:04:47.4198791Z   custom-args: 
2026-02-21T08:04:47.4199469Z   run_h100: true
2026-02-21T08:04:47.4199707Z   run_b200: true
2026-02-21T08:04:47.4200090Z   run_mi325x: true
2026-02-21T08:04:47.4200326Z ##[endgroup]
2026-02-21T08:04:47.4200703Z Complete job name: run-h100 (softmax) / benchmark-cu128-softmax-py3.12-h100
2026-02-21T08:04:47.4578780Z ##[group]Checking docker version
2026-02-21T08:04:47.4590822Z ##[command]/usr/bin/docker version --format '{{.Server.APIVersion}}'
2026-02-21T08:04:47.4800272Z '1.53'
2026-02-21T08:04:47.4819771Z Docker daemon API version: '1.53'
2026-02-21T08:04:47.4820216Z ##[command]/usr/bin/docker version --format '{{.Client.APIVersion}}'
2026-02-21T08:04:47.5015747Z '1.52'
2026-02-21T08:04:47.5033140Z Docker client API version: '1.52'
2026-02-21T08:04:47.5038089Z ##[endgroup]
2026-02-21T08:04:47.5040561Z ##[group]Clean up resources from previous jobs
2026-02-21T08:04:47.5045164Z ##[command]/usr/bin/docker ps --all --quiet --no-trunc --filter "label=7c8d1a"
2026-02-21T08:04:47.5181056Z ##[command]/usr/bin/docker network prune --force --filter "label=7c8d1a"
2026-02-21T08:04:47.5299922Z ##[endgroup]
2026-02-21T08:04:47.5300169Z ##[group]Create local container network
2026-02-21T08:04:47.5309069Z ##[command]/usr/bin/docker network create --label 7c8d1a github_network_9d5d9ac0f22e44959724a92a47e0c2ce
2026-02-21T08:04:47.5793027Z 946b116bdd9495978b06b3fdf1bc16e88005288b9c79f28ad0155fc687313398
2026-02-21T08:04:47.5815949Z ##[endgroup]
2026-02-21T08:04:47.5838346Z ##[group]Starting job container
2026-02-21T08:04:47.5858035Z ##[command]/usr/bin/docker pull nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:04:47.8698916Z 12.8.1-devel-ubuntu24.04: Pulling from nvidia/cuda
2026-02-21T08:04:48.0840710Z 05ec76e31584: Pulling fs layer
2026-02-21T08:04:48.0841040Z 73389fbd088f: Pulling fs layer
2026-02-21T08:04:48.0841310Z abf026459f52: Pulling fs layer
2026-02-21T08:04:48.0841550Z cbb9175a9bc5: Pulling fs layer
2026-02-21T08:04:48.0841802Z 7209097bfb98: Pulling fs layer
2026-02-21T08:04:48.0842046Z 93e2721b7ddd: Pulling fs layer
2026-02-21T08:04:48.0842278Z 5a7813e071bf: Pulling fs layer
2026-02-21T08:04:48.0843047Z 398182656c47: Pulling fs layer
2026-02-21T08:04:48.0843892Z a102f36d092c: Pulling fs layer
2026-02-21T08:04:48.0844414Z 545a3ada5b6b: Pulling fs layer
2026-02-21T08:04:48.0844799Z 3d6ab8c799cd: Pulling fs layer
2026-02-21T08:04:48.3009893Z 545a3ada5b6b: Download complete
2026-02-21T08:04:48.3010698Z 93e2721b7ddd: Download complete
2026-02-21T08:04:48.3012834Z 7209097bfb98: Download complete
2026-02-21T08:04:48.3015265Z 73389fbd088f: Download complete
2026-02-21T08:04:48.3018736Z 398182656c47: Download complete
2026-02-21T08:04:48.4006844Z 3d6ab8c799cd: Download complete
2026-02-21T08:04:48.4010743Z a102f36d092c: Download complete
2026-02-21T08:04:48.5016340Z 5a7813e071bf: Download complete
2026-02-21T08:04:49.9031854Z 5a7813e071bf: Pull complete
2026-02-21T08:04:50.5003004Z 05ec76e31584: Download complete
2026-02-21T08:07:42.0007825Z cbb9175a9bc5: Download complete
2026-02-21T08:08:03.7008821Z abf026459f52: Download complete
2026-02-21T08:08:09.0034694Z a102f36d092c: Pull complete
2026-02-21T08:08:16.8021897Z 05ec76e31584: Pull complete
2026-02-21T08:08:16.9015350Z 73389fbd088f: Pull complete
2026-02-21T08:08:16.9018158Z 398182656c47: Pull complete
2026-02-21T08:10:26.3023681Z cbb9175a9bc5: Pull complete
2026-02-21T08:10:26.4013164Z 3d6ab8c799cd: Pull complete
2026-02-21T08:10:26.5008981Z 545a3ada5b6b: Pull complete
2026-02-21T08:10:26.5016389Z 7209097bfb98: Pull complete
2026-02-21T08:14:35.6006230Z abf026459f52: Pull complete
2026-02-21T08:14:35.6948491Z 93e2721b7ddd: Pull complete
2026-02-21T08:14:35.6950274Z Digest: sha256:520292dbb4f755fd360766059e62956e9379485d9e073bbd2f6e3c20c270ed66
2026-02-21T08:14:35.6950962Z Status: Downloaded newer image for nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:14:35.6977756Z docker.io/nvidia/cuda:12.8.1-devel-ubuntu24.04
2026-02-21T08:14:35.7077024Z ##[command]/usr/bin/docker create --name 5f739eec64c34cfd821ea03384ecf4e3_nvidiacuda1281develubuntu2404_5b52ed --label 7c8d1a --workdir /__w/helion/helion --network github_network_9d5d9ac0f22e44959724a92a47e0c2ce --gpus all -e "HOME=/github/home" -e GITHUB_ACTIONS=true -e CI=true -v "/var/run/docker.sock":"/var/run/docker.sock" -v "/home/david/_work":"/__w" -v "/home/david/externals":"/__e":ro -v "/home/david/_work/_temp":"/__w/_temp" -v "/home/david/_work/_actions":"/__w/_actions" -v "/home/david/_work/_tool":"/__w/_tool" -v "/home/david/_work/_temp/_github_home":"/github/home" -v "/home/david/_work/_temp/_github_workflow":"/github/workflow" --entrypoint "tail" nvidia/cuda:12.8.1-devel-ubuntu24.04 "-f" "/dev/null"
2026-02-21T08:14:35.8173700Z 37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640
2026-02-21T08:14:35.8204438Z ##[command]/usr/bin/docker start 37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640
2026-02-21T08:14:36.2721156Z 37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640
2026-02-21T08:14:36.2747509Z ##[command]/usr/bin/docker ps --all --filter id=37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 --filter status=running --no-trunc --format "{{.ID}} {{.Status}}"
2026-02-21T08:14:36.2909011Z 37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 Up Less than a second
2026-02-21T08:14:36.2933117Z ##[command]/usr/bin/docker inspect --format "{{range .Config.Env}}{{println .}}{{end}}" 37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640
2026-02-21T08:14:36.3057677Z GITHUB_ACTIONS=true
2026-02-21T08:14:36.3057898Z CI=true
2026-02-21T08:14:36.3058092Z HOME=/github/home
2026-02-21T08:14:36.3058416Z PATH=/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T08:14:36.3058797Z NVARCH=x86_64
2026-02-21T08:14:36.3065697Z NVIDIA_REQUIRE_CUDA=cuda>=12.8 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=vapps,driver>=470,driver<471 brand=vpc,driver>=470,driver<471 brand=vcs,driver>=470,driver<471 brand=vws,driver>=470,driver<471 brand=cloudgaming,driver>=470,driver<471 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566
2026-02-21T08:14:36.3073605Z NV_CUDA_CUDART_VERSION=12.8.90-1
2026-02-21T08:14:36.3073822Z CUDA_VERSION=12.8.1
2026-02-21T08:14:36.3074136Z LD_LIBRARY_PATH=/usr/local/cuda/lib64
2026-02-21T08:14:36.3074385Z NVIDIA_VISIBLE_DEVICES=all
2026-02-21T08:14:36.3074625Z NVIDIA_DRIVER_CAPABILITIES=compute,utility
2026-02-21T08:14:36.3074870Z NV_CUDA_LIB_VERSION=12.8.1-1
2026-02-21T08:14:36.3075095Z NV_NVTX_VERSION=12.8.90-1
2026-02-21T08:14:36.3075623Z NV_LIBNPP_VERSION=12.3.3.100-1
2026-02-21T08:14:36.3075928Z NV_LIBNPP_PACKAGE=libnpp-12-8=12.3.3.100-1
2026-02-21T08:14:36.3076164Z NV_LIBCUSPARSE_VERSION=12.5.8.93-1
2026-02-21T08:14:36.3076398Z NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-8
2026-02-21T08:14:36.3076622Z NV_LIBCUBLAS_VERSION=12.8.4.1-1
2026-02-21T08:14:36.3076852Z NV_LIBCUBLAS_PACKAGE=libcublas-12-8=12.8.4.1-1
2026-02-21T08:14:36.3077089Z NV_LIBNCCL_PACKAGE_NAME=libnccl2
2026-02-21T08:14:36.3077296Z NV_LIBNCCL_PACKAGE_VERSION=2.25.1-1
2026-02-21T08:14:36.3077507Z NCCL_VERSION=2.25.1-1
2026-02-21T08:14:36.3077703Z NV_LIBNCCL_PACKAGE=libnccl2=2.25.1-1+cuda12.8
2026-02-21T08:14:36.3077930Z NVIDIA_PRODUCT_NAME=CUDA
2026-02-21T08:14:36.3078110Z NV_CUDA_CUDART_DEV_VERSION=12.8.90-1
2026-02-21T08:14:36.3078322Z NV_NVML_DEV_VERSION=12.8.90-1
2026-02-21T08:14:36.3078523Z NV_LIBCUSPARSE_DEV_VERSION=12.5.8.93-1
2026-02-21T08:14:36.3078741Z NV_LIBNPP_DEV_VERSION=12.3.3.100-1
2026-02-21T08:14:36.3078969Z NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-8=12.3.3.100-1
2026-02-21T08:14:36.3079233Z NV_LIBCUBLAS_DEV_VERSION=12.8.4.1-1
2026-02-21T08:14:36.3079467Z NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-8
2026-02-21T08:14:36.3079883Z NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-8=12.8.4.1-1
2026-02-21T08:14:36.3080168Z NV_CUDA_NSIGHT_COMPUTE_VERSION=12.8.1-1
2026-02-21T08:14:36.3080464Z NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-8=12.8.1-1
2026-02-21T08:14:36.3080767Z NV_NVPROF_VERSION=12.8.90-1
2026-02-21T08:14:36.3080977Z NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-8=12.8.90-1
2026-02-21T08:14:36.3081224Z NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev
2026-02-21T08:14:36.3081446Z NV_LIBNCCL_DEV_PACKAGE_VERSION=2.25.1-1
2026-02-21T08:14:36.3081685Z NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.25.1-1+cuda12.8
2026-02-21T08:14:36.3081946Z LIBRARY_PATH=/usr/local/cuda/lib64/stubs
2026-02-21T08:14:36.3088205Z ##[endgroup]
2026-02-21T08:14:36.3096535Z ##[group]Waiting for all services to be ready
2026-02-21T08:14:36.3097988Z ##[endgroup]
2026-02-21T08:14:36.3275960Z ##[group]Run echo "Detected NVIDIA image"
2026-02-21T08:14:36.3276302Z echo "Detected NVIDIA image"
2026-02-21T08:14:36.3276597Z nvidia-smi || echo "nvidia-smi not found"
2026-02-21T08:14:36.3279751Z shell: bash -l {0}
2026-02-21T08:14:36.3280233Z env:
2026-02-21T08:14:36.3280407Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:36.3280625Z ##[endgroup]
2026-02-21T08:14:36.4524565Z Detected NVIDIA image
2026-02-21T08:14:36.6361927Z Sat Feb 21 08:14:36 2026       
2026-02-21T08:14:36.6362318Z +-----------------------------------------------------------------------------------------+
2026-02-21T08:14:36.6362839Z | NVIDIA-SMI 580.95.05              Driver Version: 580.95.05      CUDA Version: 13.0     |
2026-02-21T08:14:36.6363347Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T08:14:36.6363876Z | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
2026-02-21T08:14:36.6364803Z | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
2026-02-21T08:14:36.6365254Z |                                         |                        |               MIG M. |
2026-02-21T08:14:36.6365607Z |=========================================+========================+======================|
2026-02-21T08:14:36.7518785Z |   0  NVIDIA H100 80GB HBM3          On  |   00000000:86:00.0 Off |                    0 |
2026-02-21T08:14:36.7519310Z | N/A   28C    P0             73W /  500W |       0MiB /  81559MiB |      0%      Default |
2026-02-21T08:14:36.7519741Z |                                         |                        |             Disabled |
2026-02-21T08:14:36.7520188Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T08:14:36.7522578Z 
2026-02-21T08:14:36.7522781Z +-----------------------------------------------------------------------------------------+
2026-02-21T08:14:36.7523518Z | Processes:                                                                              |
2026-02-21T08:14:36.7524312Z |  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
2026-02-21T08:14:36.7547680Z |        ID   ID                                                               Usage      |
2026-02-21T08:14:36.7548056Z |=========================================================================================|
2026-02-21T08:14:36.7548824Z |  No running processes found                                                             |
2026-02-21T08:14:36.7549260Z +-----------------------------------------------------------------------------------------+
2026-02-21T08:14:36.8414740Z ##[group]Run set -x
2026-02-21T08:14:36.8415031Z set -x
2026-02-21T08:14:36.8415216Z apt-get update
2026-02-21T08:14:36.8415455Z apt-get install -y git
2026-02-21T08:14:36.8415802Z shell: bash -l {0}
2026-02-21T08:14:36.8415974Z env:
2026-02-21T08:14:36.8416139Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:36.8416338Z ##[endgroup]
2026-02-21T08:14:36.8906386Z + apt-get update
2026-02-21T08:14:36.9769468Z Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64  InRelease [1581 B]
2026-02-21T08:14:37.1187426Z Get:2 http://security.ubuntu.com/ubuntu noble-security InRelease [126 kB]
2026-02-21T08:14:37.1349864Z Get:3 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64  Packages [1218 kB]
2026-02-21T08:14:37.1414613Z Get:4 http://archive.ubuntu.com/ubuntu noble InRelease [256 kB]
2026-02-21T08:14:37.5838394Z Get:5 http://security.ubuntu.com/ubuntu noble-security/restricted amd64 Packages [3196 kB]
2026-02-21T08:14:37.7425058Z Get:6 http://archive.ubuntu.com/ubuntu noble-updates InRelease [126 kB]
2026-02-21T08:14:37.8955312Z Get:7 http://archive.ubuntu.com/ubuntu noble-backports InRelease [126 kB]
2026-02-21T08:14:38.0496057Z Get:8 http://archive.ubuntu.com/ubuntu noble/universe amd64 Packages [19.3 MB]
2026-02-21T08:14:38.2248964Z Get:9 http://security.ubuntu.com/ubuntu noble-security/main amd64 Packages [1857 kB]
2026-02-21T08:14:38.2622658Z Get:10 http://security.ubuntu.com/ubuntu noble-security/universe amd64 Packages [1207 kB]
2026-02-21T08:14:38.2862882Z Get:11 http://security.ubuntu.com/ubuntu noble-security/multiverse amd64 Packages [34.8 kB]
2026-02-21T08:14:38.9020242Z Get:12 http://archive.ubuntu.com/ubuntu noble/restricted amd64 Packages [117 kB]
2026-02-21T08:14:38.9028881Z Get:13 http://archive.ubuntu.com/ubuntu noble/multiverse amd64 Packages [331 kB]
2026-02-21T08:14:38.9090939Z Get:14 http://archive.ubuntu.com/ubuntu noble/main amd64 Packages [1808 kB]
2026-02-21T08:14:38.9486013Z Get:15 http://archive.ubuntu.com/ubuntu noble-updates/multiverse amd64 Packages [38.1 kB]
2026-02-21T08:14:38.9488944Z Get:16 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 Packages [2240 kB]
2026-02-21T08:14:39.0061193Z Get:17 http://archive.ubuntu.com/ubuntu noble-updates/restricted amd64 Packages [3381 kB]
2026-02-21T08:14:39.0839058Z Get:18 http://archive.ubuntu.com/ubuntu noble-updates/universe amd64 Packages [2016 kB]
2026-02-21T08:14:39.1330774Z Get:19 http://archive.ubuntu.com/ubuntu noble-backports/main amd64 Packages [49.5 kB]
2026-02-21T08:14:39.1334434Z Get:20 http://archive.ubuntu.com/ubuntu noble-backports/universe amd64 Packages [34.6 kB]
2026-02-21T08:14:39.7578732Z Fetched 37.5 MB in 3s (13.3 MB/s)
2026-02-21T08:14:40.5028856Z Reading package lists...
2026-02-21T08:14:40.5190177Z W: https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
2026-02-21T08:14:40.5203506Z + apt-get install -y git
2026-02-21T08:14:41.2823850Z Reading package lists...
2026-02-21T08:14:41.4586796Z Building dependency tree...
2026-02-21T08:14:41.4587222Z Reading state information...
2026-02-21T08:14:41.6006322Z The following additional packages will be installed:
2026-02-21T08:14:41.6006948Z   git-man krb5-locales less libbrotli1 libbsd0 libcbor0.10 libcurl3t64-gnutls
2026-02-21T08:14:41.6007515Z   libedit2 liberror-perl libexpat1 libfido2-1 libgssapi-krb5-2 libk5crypto3
2026-02-21T08:14:41.6009729Z   libkeyutils1 libkrb5-3 libkrb5support0 libnghttp2-14 libpsl5t64 librtmp1
2026-02-21T08:14:41.6011857Z   libssh-4 libx11-6 libx11-data libxau6 libxcb1 libxdmcp6 libxext6 libxmuu1
2026-02-21T08:14:41.6013014Z   openssh-client publicsuffix xauth
2026-02-21T08:14:41.6019180Z Suggested packages:
2026-02-21T08:14:41.6019538Z   gettext-base git-daemon-run | git-daemon-sysvinit git-doc git-email git-gui
2026-02-21T08:14:41.6020786Z   gitk gitweb git-cvs git-mediawiki git-svn krb5-doc krb5-user keychain
2026-02-21T08:14:41.6021224Z   libpam-ssh monkeysphere ssh-askpass
2026-02-21T08:14:41.6631322Z The following NEW packages will be installed:
2026-02-21T08:14:41.6631995Z   git git-man krb5-locales less libbrotli1 libbsd0 libcbor0.10
2026-02-21T08:14:41.6632686Z   libcurl3t64-gnutls libedit2 liberror-perl libexpat1 libfido2-1
2026-02-21T08:14:41.6633461Z   libgssapi-krb5-2 libk5crypto3 libkeyutils1 libkrb5-3 libkrb5support0
2026-02-21T08:14:41.6637228Z   libnghttp2-14 libpsl5t64 librtmp1 libssh-4 libx11-6 libx11-data libxau6
2026-02-21T08:14:41.6640956Z   libxcb1 libxdmcp6 libxext6 libxmuu1 openssh-client publicsuffix xauth
2026-02-21T08:14:41.8802195Z 0 upgraded, 31 newly installed, 0 to remove and 92 not upgraded.
2026-02-21T08:14:41.8802818Z Need to get 8886 kB of archives.
2026-02-21T08:14:41.8803370Z After this operation, 38.0 MB of additional disk space will be used.
2026-02-21T08:14:41.8804772Z Get:1 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 krb5-locales all 1.20.1-6ubuntu2.6 [14.8 kB]
2026-02-21T08:14:42.0706764Z Get:2 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 less amd64 590-2ubuntu2.1 [142 kB]
2026-02-21T08:14:42.3355539Z Get:3 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libbsd0 amd64 0.12.1-1build1.1 [41.2 kB]
2026-02-21T08:14:42.3811931Z Get:4 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libexpat1 amd64 2.6.1-2ubuntu0.4 [88.2 kB]
2026-02-21T08:14:42.4706571Z Get:5 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libkrb5support0 amd64 1.20.1-6ubuntu2.6 [34.4 kB]
2026-02-21T08:14:42.4829289Z Get:6 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libk5crypto3 amd64 1.20.1-6ubuntu2.6 [82.0 kB]
2026-02-21T08:14:42.5132117Z Get:7 http://archive.ubuntu.com/ubuntu noble/main amd64 libkeyutils1 amd64 1.6.3-3build1 [9490 B]
2026-02-21T08:14:42.5186262Z Get:8 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libkrb5-3 amd64 1.20.1-6ubuntu2.6 [348 kB]
2026-02-21T08:14:42.6208677Z Get:9 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libgssapi-krb5-2 amd64 1.20.1-6ubuntu2.6 [143 kB]
2026-02-21T08:14:42.6434640Z Get:10 http://archive.ubuntu.com/ubuntu noble/main amd64 libcbor0.10 amd64 0.10.2-1.2ubuntu2 [25.8 kB]
2026-02-21T08:14:42.6476596Z Get:11 http://archive.ubuntu.com/ubuntu noble/main amd64 libedit2 amd64 3.1-20230828-1build1 [97.6 kB]
2026-02-21T08:14:42.6611490Z Get:12 http://archive.ubuntu.com/ubuntu noble/main amd64 libfido2-1 amd64 1.14.0-1build3 [83.5 kB]
2026-02-21T08:14:42.6725303Z Get:13 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libnghttp2-14 amd64 1.59.0-1ubuntu0.2 [74.3 kB]
2026-02-21T08:14:42.6822244Z Get:14 http://archive.ubuntu.com/ubuntu noble/main amd64 libpsl5t64 amd64 0.21.2-1.1build1 [57.1 kB]
2026-02-21T08:14:42.6887132Z Get:15 http://archive.ubuntu.com/ubuntu noble/main amd64 libxau6 amd64 1:1.0.9-1build6 [7160 B]
2026-02-21T08:14:42.6889751Z Get:16 http://archive.ubuntu.com/ubuntu noble/main amd64 libxdmcp6 amd64 1:1.1.3-0ubuntu6 [10.3 kB]
2026-02-21T08:14:42.6915812Z Get:17 http://archive.ubuntu.com/ubuntu noble/main amd64 libxcb1 amd64 1.15-1ubuntu2 [47.7 kB]
2026-02-21T08:14:42.7162199Z Get:18 http://archive.ubuntu.com/ubuntu noble/main amd64 libx11-data all 2:1.8.7-1build1 [115 kB]
2026-02-21T08:14:42.7389332Z Get:19 http://archive.ubuntu.com/ubuntu noble/main amd64 libx11-6 amd64 2:1.8.7-1build1 [650 kB]
2026-02-21T08:14:42.7828050Z Get:20 http://archive.ubuntu.com/ubuntu noble/main amd64 libxext6 amd64 2:1.3.4-1build2 [30.4 kB]
2026-02-21T08:14:42.7845697Z Get:21 http://archive.ubuntu.com/ubuntu noble/main amd64 libxmuu1 amd64 2:1.1.3-3build2 [8958 B]
2026-02-21T08:14:42.7866359Z Get:22 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 openssh-client amd64 1:9.6p1-3ubuntu13.14 [906 kB]
2026-02-21T08:14:42.8439556Z Get:23 http://archive.ubuntu.com/ubuntu noble/main amd64 publicsuffix all 20231001.0357-0.1 [129 kB]
2026-02-21T08:14:42.8511443Z Get:24 http://archive.ubuntu.com/ubuntu noble/main amd64 xauth amd64 1:1.1.2-1build1 [25.6 kB]
2026-02-21T08:14:42.8515619Z Get:25 http://archive.ubuntu.com/ubuntu noble/main amd64 libbrotli1 amd64 1.1.0-2build2 [331 kB]
2026-02-21T08:14:42.8678029Z Get:26 http://archive.ubuntu.com/ubuntu noble/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build7 [56.3 kB]
2026-02-21T08:14:42.8704596Z Get:27 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libssh-4 amd64 0.10.6-2ubuntu0.3 [190 kB]
2026-02-21T08:14:42.8783609Z Get:28 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 libcurl3t64-gnutls amd64 8.5.0-2ubuntu10.6 [333 kB]
2026-02-21T08:14:42.8910668Z Get:29 http://archive.ubuntu.com/ubuntu noble/main amd64 liberror-perl all 0.17029-2 [25.6 kB]
2026-02-21T08:14:42.8938135Z Get:30 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 git-man all 1:2.43.0-1ubuntu7.3 [1100 kB]
2026-02-21T08:14:42.9241316Z Get:31 http://archive.ubuntu.com/ubuntu noble-updates/main amd64 git amd64 1:2.43.0-1ubuntu7.3 [3680 kB]
2026-02-21T08:14:43.1470529Z debconf: delaying package configuration, since apt-utils is not installed
2026-02-21T08:14:43.1841802Z Fetched 8886 kB in 1s (6704 kB/s)
2026-02-21T08:14:43.2341755Z Selecting previously unselected package krb5-locales.
2026-02-21T08:14:43.2379267Z (Reading database ... 
2026-02-21T08:14:43.2379545Z (Reading database ... 5%
2026-02-21T08:14:43.2379767Z (Reading database ... 10%
2026-02-21T08:14:43.2379991Z (Reading database ... 15%
2026-02-21T08:14:43.2380216Z (Reading database ... 20%
2026-02-21T08:14:43.2380467Z (Reading database ... 25%
2026-02-21T08:14:43.2380677Z (Reading database ... 30%
2026-02-21T08:14:43.2380892Z (Reading database ... 35%
2026-02-21T08:14:43.2381102Z (Reading database ... 40%
2026-02-21T08:14:43.2381325Z (Reading database ... 45%
2026-02-21T08:14:43.2381541Z (Reading database ... 50%
2026-02-21T08:14:43.2381759Z (Reading database ... 55%
2026-02-21T08:14:43.2381976Z (Reading database ... 60%
2026-02-21T08:14:43.2382192Z (Reading database ... 65%
2026-02-21T08:14:43.2398583Z (Reading database ... 70%
2026-02-21T08:14:43.2404822Z (Reading database ... 75%
2026-02-21T08:14:43.2424649Z (Reading database ... 80%
2026-02-21T08:14:43.2431211Z (Reading database ... 85%
2026-02-21T08:14:43.2434970Z (Reading database ... 90%
2026-02-21T08:14:43.2441484Z (Reading database ... 95%
2026-02-21T08:14:43.2441684Z (Reading database ... 100%
2026-02-21T08:14:43.2442000Z (Reading database ... 15165 files and directories currently installed.)
2026-02-21T08:14:43.2446007Z Preparing to unpack .../00-krb5-locales_1.20.1-6ubuntu2.6_all.deb ...
2026-02-21T08:14:43.2539712Z Unpacking krb5-locales (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:43.3388028Z Selecting previously unselected package less.
2026-02-21T08:14:43.3401491Z Preparing to unpack .../01-less_590-2ubuntu2.1_amd64.deb ...
2026-02-21T08:14:43.3510594Z Unpacking less (590-2ubuntu2.1) ...
2026-02-21T08:14:43.4344551Z Selecting previously unselected package libbsd0:amd64.
2026-02-21T08:14:43.4354747Z Preparing to unpack .../02-libbsd0_0.12.1-1build1.1_amd64.deb ...
2026-02-21T08:14:43.4584176Z Unpacking libbsd0:amd64 (0.12.1-1build1.1) ...
2026-02-21T08:14:43.5522226Z Selecting previously unselected package libexpat1:amd64.
2026-02-21T08:14:43.5532282Z Preparing to unpack .../03-libexpat1_2.6.1-2ubuntu0.4_amd64.deb ...
2026-02-21T08:14:43.5648468Z Unpacking libexpat1:amd64 (2.6.1-2ubuntu0.4) ...
2026-02-21T08:14:43.6519311Z Selecting previously unselected package libkrb5support0:amd64.
2026-02-21T08:14:43.6529194Z Preparing to unpack .../04-libkrb5support0_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:43.6613344Z Unpacking libkrb5support0:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:43.7451229Z Selecting previously unselected package libk5crypto3:amd64.
2026-02-21T08:14:43.7462902Z Preparing to unpack .../05-libk5crypto3_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:43.7545916Z Unpacking libk5crypto3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:43.8345575Z Selecting previously unselected package libkeyutils1:amd64.
2026-02-21T08:14:43.8362048Z Preparing to unpack .../06-libkeyutils1_1.6.3-3build1_amd64.deb ...
2026-02-21T08:14:43.8443679Z Unpacking libkeyutils1:amd64 (1.6.3-3build1) ...
2026-02-21T08:14:43.9269614Z Selecting previously unselected package libkrb5-3:amd64.
2026-02-21T08:14:43.9283075Z Preparing to unpack .../07-libkrb5-3_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:43.9430220Z Unpacking libkrb5-3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:44.0458870Z Selecting previously unselected package libgssapi-krb5-2:amd64.
2026-02-21T08:14:44.0469163Z Preparing to unpack .../08-libgssapi-krb5-2_1.20.1-6ubuntu2.6_amd64.deb ...
2026-02-21T08:14:44.0571966Z Unpacking libgssapi-krb5-2:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:44.1362938Z Selecting previously unselected package libcbor0.10:amd64.
2026-02-21T08:14:44.1386615Z Preparing to unpack .../09-libcbor0.10_0.10.2-1.2ubuntu2_amd64.deb ...
2026-02-21T08:14:44.1491559Z Unpacking libcbor0.10:amd64 (0.10.2-1.2ubuntu2) ...
2026-02-21T08:14:44.2308400Z Selecting previously unselected package libedit2:amd64.
2026-02-21T08:14:44.2320509Z Preparing to unpack .../10-libedit2_3.1-20230828-1build1_amd64.deb ...
2026-02-21T08:14:44.2427875Z Unpacking libedit2:amd64 (3.1-20230828-1build1) ...
2026-02-21T08:14:44.3184720Z Selecting previously unselected package libfido2-1:amd64.
2026-02-21T08:14:44.3195860Z Preparing to unpack .../11-libfido2-1_1.14.0-1build3_amd64.deb ...
2026-02-21T08:14:44.3280823Z Unpacking libfido2-1:amd64 (1.14.0-1build3) ...
2026-02-21T08:14:44.4097041Z Selecting previously unselected package libnghttp2-14:amd64.
2026-02-21T08:14:44.4107245Z Preparing to unpack .../12-libnghttp2-14_1.59.0-1ubuntu0.2_amd64.deb ...
2026-02-21T08:14:44.4219185Z Unpacking libnghttp2-14:amd64 (1.59.0-1ubuntu0.2) ...
2026-02-21T08:14:44.5057229Z Selecting previously unselected package libpsl5t64:amd64.
2026-02-21T08:14:44.5068068Z Preparing to unpack .../13-libpsl5t64_0.21.2-1.1build1_amd64.deb ...
2026-02-21T08:14:44.5177369Z Unpacking libpsl5t64:amd64 (0.21.2-1.1build1) ...
2026-02-21T08:14:44.5915642Z Selecting previously unselected package libxau6:amd64.
2026-02-21T08:14:44.5925560Z Preparing to unpack .../14-libxau6_1%3a1.0.9-1build6_amd64.deb ...
2026-02-21T08:14:44.6027195Z Unpacking libxau6:amd64 (1:1.0.9-1build6) ...
2026-02-21T08:14:44.6697138Z Selecting previously unselected package libxdmcp6:amd64.
2026-02-21T08:14:44.6706987Z Preparing to unpack .../15-libxdmcp6_1%3a1.1.3-0ubuntu6_amd64.deb ...
2026-02-21T08:14:44.6808929Z Unpacking libxdmcp6:amd64 (1:1.1.3-0ubuntu6) ...
2026-02-21T08:14:44.7617824Z Selecting previously unselected package libxcb1:amd64.
2026-02-21T08:14:44.7628685Z Preparing to unpack .../16-libxcb1_1.15-1ubuntu2_amd64.deb ...
2026-02-21T08:14:44.7716723Z Unpacking libxcb1:amd64 (1.15-1ubuntu2) ...
2026-02-21T08:14:44.8400900Z Selecting previously unselected package libx11-data.
2026-02-21T08:14:44.8411168Z Preparing to unpack .../17-libx11-data_2%3a1.8.7-1build1_all.deb ...
2026-02-21T08:14:44.8527236Z Unpacking libx11-data (2:1.8.7-1build1) ...
2026-02-21T08:14:45.0276459Z Selecting previously unselected package libx11-6:amd64.
2026-02-21T08:14:45.0289068Z Preparing to unpack .../18-libx11-6_2%3a1.8.7-1build1_amd64.deb ...
2026-02-21T08:14:45.0388590Z Unpacking libx11-6:amd64 (2:1.8.7-1build1) ...
2026-02-21T08:14:45.1385387Z Selecting previously unselected package libxext6:amd64.
2026-02-21T08:14:45.1396585Z Preparing to unpack .../19-libxext6_2%3a1.3.4-1build2_amd64.deb ...
2026-02-21T08:14:45.1523001Z Unpacking libxext6:amd64 (2:1.3.4-1build2) ...
2026-02-21T08:14:45.2285857Z Selecting previously unselected package libxmuu1:amd64.
2026-02-21T08:14:45.2296411Z Preparing to unpack .../20-libxmuu1_2%3a1.1.3-3build2_amd64.deb ...
2026-02-21T08:14:45.2392578Z Unpacking libxmuu1:amd64 (2:1.1.3-3build2) ...
2026-02-21T08:14:45.3267070Z Selecting previously unselected package openssh-client.
2026-02-21T08:14:45.3277496Z Preparing to unpack .../21-openssh-client_1%3a9.6p1-3ubuntu13.14_amd64.deb ...
2026-02-21T08:14:45.3465365Z Unpacking openssh-client (1:9.6p1-3ubuntu13.14) ...
2026-02-21T08:14:45.4615888Z Selecting previously unselected package publicsuffix.
2026-02-21T08:14:45.4632501Z Preparing to unpack .../22-publicsuffix_20231001.0357-0.1_all.deb ...
2026-02-21T08:14:45.4727786Z Unpacking publicsuffix (20231001.0357-0.1) ...
2026-02-21T08:14:45.5408150Z Selecting previously unselected package xauth.
2026-02-21T08:14:45.5419801Z Preparing to unpack .../23-xauth_1%3a1.1.2-1build1_amd64.deb ...
2026-02-21T08:14:45.5519643Z Unpacking xauth (1:1.1.2-1build1) ...
2026-02-21T08:14:45.6289305Z Selecting previously unselected package libbrotli1:amd64.
2026-02-21T08:14:45.6301383Z Preparing to unpack .../24-libbrotli1_1.1.0-2build2_amd64.deb ...
2026-02-21T08:14:45.6409043Z Unpacking libbrotli1:amd64 (1.1.0-2build2) ...
2026-02-21T08:14:45.7269199Z Selecting previously unselected package librtmp1:amd64.
2026-02-21T08:14:45.7279637Z Preparing to unpack .../25-librtmp1_2.4+20151223.gitfa8646d.1-2build7_amd64.deb ...
2026-02-21T08:14:45.7360750Z Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build7) ...
2026-02-21T08:14:45.8101397Z Selecting previously unselected package libssh-4:amd64.
2026-02-21T08:14:45.8111534Z Preparing to unpack .../26-libssh-4_0.10.6-2ubuntu0.3_amd64.deb ...
2026-02-21T08:14:45.8194419Z Unpacking libssh-4:amd64 (0.10.6-2ubuntu0.3) ...
2026-02-21T08:14:45.8966604Z Selecting previously unselected package libcurl3t64-gnutls:amd64.
2026-02-21T08:14:45.8977404Z Preparing to unpack .../27-libcurl3t64-gnutls_8.5.0-2ubuntu10.6_amd64.deb ...
2026-02-21T08:14:45.9083106Z Unpacking libcurl3t64-gnutls:amd64 (8.5.0-2ubuntu10.6) ...
2026-02-21T08:14:45.9796988Z Selecting previously unselected package liberror-perl.
2026-02-21T08:14:45.9806696Z Preparing to unpack .../28-liberror-perl_0.17029-2_all.deb ...
2026-02-21T08:14:45.9913107Z Unpacking liberror-perl (0.17029-2) ...
2026-02-21T08:14:46.0642355Z Selecting previously unselected package git-man.
2026-02-21T08:14:46.0660028Z Preparing to unpack .../29-git-man_1%3a2.43.0-1ubuntu7.3_all.deb ...
2026-02-21T08:14:46.0754136Z Unpacking git-man (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:46.1701899Z Selecting previously unselected package git.
2026-02-21T08:14:46.1716654Z Preparing to unpack .../30-git_1%3a2.43.0-1ubuntu7.3_amd64.deb ...
2026-02-21T08:14:46.1866633Z Unpacking git (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:46.4756526Z Setting up libexpat1:amd64 (2.6.1-2ubuntu0.4) ...
2026-02-21T08:14:46.5013475Z Setting up libxau6:amd64 (1:1.0.9-1build6) ...
2026-02-21T08:14:46.5250132Z Setting up libkeyutils1:amd64 (1.6.3-3build1) ...
2026-02-21T08:14:46.5512740Z Setting up libcbor0.10:amd64 (0.10.2-1.2ubuntu2) ...
2026-02-21T08:14:46.5818349Z Setting up libbrotli1:amd64 (1.1.0-2build2) ...
2026-02-21T08:14:46.6074992Z Setting up libpsl5t64:amd64 (0.21.2-1.1build1) ...
2026-02-21T08:14:46.6304172Z Setting up libnghttp2-14:amd64 (1.59.0-1ubuntu0.2) ...
2026-02-21T08:14:46.6568617Z Setting up less (590-2ubuntu2.1) ...
2026-02-21T08:14:46.7165390Z Setting up krb5-locales (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.7428033Z Setting up libkrb5support0:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.7662240Z Setting up liberror-perl (0.17029-2) ...
2026-02-21T08:14:46.7877179Z Setting up libx11-data (2:1.8.7-1build1) ...
2026-02-21T08:14:46.8034753Z Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build7) ...
2026-02-21T08:14:46.8191708Z Setting up libk5crypto3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.8443163Z Setting up git-man (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:46.8691198Z Setting up libkrb5-3:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:46.8851117Z Setting up libfido2-1:amd64 (1.14.0-1build3) ...
2026-02-21T08:14:46.9096022Z Setting up libbsd0:amd64 (0.12.1-1build1.1) ...
2026-02-21T08:14:46.9365293Z Setting up publicsuffix (20231001.0357-0.1) ...
2026-02-21T08:14:46.9600193Z Setting up libxdmcp6:amd64 (1:1.1.3-0ubuntu6) ...
2026-02-21T08:14:46.9863151Z Setting up libxcb1:amd64 (1.15-1ubuntu2) ...
2026-02-21T08:14:47.0091890Z Setting up libedit2:amd64 (3.1-20230828-1build1) ...
2026-02-21T08:14:47.0290483Z Setting up libgssapi-krb5-2:amd64 (1.20.1-6ubuntu2.6) ...
2026-02-21T08:14:47.0498902Z Setting up libssh-4:amd64 (0.10.6-2ubuntu0.3) ...
2026-02-21T08:14:47.0765957Z Setting up libx11-6:amd64 (2:1.8.7-1build1) ...
2026-02-21T08:14:47.0963225Z Setting up libxmuu1:amd64 (2:1.1.3-3build2) ...
2026-02-21T08:14:47.1157074Z Setting up openssh-client (1:9.6p1-3ubuntu13.14) ...
2026-02-21T08:14:47.2191899Z Setting up libcurl3t64-gnutls:amd64 (8.5.0-2ubuntu10.6) ...
2026-02-21T08:14:47.2352434Z Setting up libxext6:amd64 (2:1.3.4-1build2) ...
2026-02-21T08:14:47.2511955Z Setting up git (1:2.43.0-1ubuntu7.3) ...
2026-02-21T08:14:47.2843293Z Setting up xauth (1:1.1.2-1build1) ...
2026-02-21T08:14:47.3027749Z Processing triggers for libc-bin (2.39-0ubuntu8.4) ...
2026-02-21T08:14:47.3845064Z ##[group]Run actions/checkout@v6
2026-02-21T08:14:47.3845328Z with:
2026-02-21T08:14:47.3845507Z   repository: pytorch/helion
2026-02-21T08:14:47.3845847Z   token: ***
2026-02-21T08:14:47.3846016Z   ssh-strict: true
2026-02-21T08:14:47.3846175Z   ssh-user: git
2026-02-21T08:14:47.3846345Z   persist-credentials: true
2026-02-21T08:14:47.3846540Z   clean: true
2026-02-21T08:14:47.3846719Z   sparse-checkout-cone-mode: true
2026-02-21T08:14:47.3846929Z   fetch-depth: 1
2026-02-21T08:14:47.3847359Z   fetch-tags: false
2026-02-21T08:14:47.3847525Z   show-progress: true
2026-02-21T08:14:47.3847693Z   lfs: false
2026-02-21T08:14:47.3847840Z   submodules: false
2026-02-21T08:14:47.3848009Z   set-safe-directory: true
2026-02-21T08:14:47.3848191Z env:
2026-02-21T08:14:47.3848340Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:47.3848540Z ##[endgroup]
2026-02-21T08:14:47.3887835Z ##[command]/usr/bin/docker exec  37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T08:14:47.5937887Z Syncing repository: pytorch/helion
2026-02-21T08:14:47.5939049Z ##[group]Getting Git version info
2026-02-21T08:14:47.5939330Z Working directory is '/__w/helion/helion'
2026-02-21T08:14:47.5939736Z [command]/usr/bin/git version
2026-02-21T08:14:47.5939955Z git version 2.43.0
2026-02-21T08:14:47.5949464Z ##[endgroup]
2026-02-21T08:14:47.5961822Z Temporarily overriding HOME='/__w/_temp/76bdea30-0895-46a3-be6f-264bee89a076' before making global git config changes
2026-02-21T08:14:47.5962503Z Adding repository directory to the temporary git global config as a safe directory
2026-02-21T08:14:47.5966545Z [command]/usr/bin/git config --global --add safe.directory /__w/helion/helion
2026-02-21T08:14:47.6001779Z Deleting the contents of '/__w/helion/helion'
2026-02-21T08:14:47.6005023Z ##[group]Initializing the repository
2026-02-21T08:14:47.6008417Z [command]/usr/bin/git init /__w/helion/helion
2026-02-21T08:14:47.6048618Z hint: Using 'master' as the name for the initial branch. This default branch name
2026-02-21T08:14:47.6049218Z hint: is subject to change. To configure the initial branch name to use in all
2026-02-21T08:14:47.6049785Z hint: of your new repositories, which will suppress this warning, call:
2026-02-21T08:14:47.6050268Z hint: 
2026-02-21T08:14:47.6050538Z hint: 	git config --global init.defaultBranch <name>
2026-02-21T08:14:47.6050890Z hint: 
2026-02-21T08:14:47.6051182Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2026-02-21T08:14:47.6051680Z hint: 'development'. The just-created branch can be renamed via this command:
2026-02-21T08:14:47.6052057Z hint: 
2026-02-21T08:14:47.6052237Z hint: 	git branch -m <name>
2026-02-21T08:14:47.6065258Z Initialized empty Git repository in /__w/helion/helion/.git/
2026-02-21T08:14:47.6074288Z [command]/usr/bin/git remote add origin https://github.com/pytorch/helion
2026-02-21T08:14:47.6117035Z ##[endgroup]
2026-02-21T08:14:47.6117414Z ##[group]Disabling automatic garbage collection
2026-02-21T08:14:47.6120219Z [command]/usr/bin/git config --local gc.auto 0
2026-02-21T08:14:47.6150575Z ##[endgroup]
2026-02-21T08:14:47.6150921Z ##[group]Setting up auth
2026-02-21T08:14:47.6152229Z Removing SSH command configuration
2026-02-21T08:14:47.6157104Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2026-02-21T08:14:47.6191390Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2026-02-21T08:14:47.6485417Z Removing HTTP extra header
2026-02-21T08:14:47.6488544Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2026-02-21T08:14:47.6518975Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2026-02-21T08:14:47.6797827Z Removing includeIf entries pointing to credentials config files
2026-02-21T08:14:47.6801558Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir:
2026-02-21T08:14:47.6832886Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url
2026-02-21T08:14:47.7118349Z [command]/usr/bin/git config --file /__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config http.https://github.com/.extraheader AUTHORIZATION: basic ***
2026-02-21T08:14:47.7153730Z [command]/usr/bin/git config --local includeIf.gitdir:/__w/helion/helion/.git.path /__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T08:14:47.7185225Z [command]/usr/bin/git config --local includeIf.gitdir:/__w/helion/helion/.git/worktrees/*.path /__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T08:14:47.7216086Z [command]/usr/bin/git config --local includeIf.gitdir:/github/workspace/.git.path /github/runner_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T08:14:47.7246928Z [command]/usr/bin/git config --local includeIf.gitdir:/github/workspace/.git/worktrees/*.path /github/runner_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T08:14:47.7275042Z ##[endgroup]
2026-02-21T08:14:47.7275363Z ##[group]Fetching the repository
2026-02-21T08:14:47.7282392Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --no-recurse-submodules --depth=1 origin +874a7d0cadab18218a84ad3579d329dc95c51820:refs/remotes/origin/main
2026-02-21T08:14:48.1866729Z From https://github.com/pytorch/helion
2026-02-21T08:14:48.1867184Z  * [new ref]         874a7d0cadab18218a84ad3579d329dc95c51820 -> origin/main
2026-02-21T08:14:48.1897642Z [command]/usr/bin/git branch --list --remote origin/main
2026-02-21T08:14:48.1934931Z   origin/main
2026-02-21T08:14:48.1942308Z [command]/usr/bin/git rev-parse refs/remotes/origin/main
2026-02-21T08:14:48.1970202Z 874a7d0cadab18218a84ad3579d329dc95c51820
2026-02-21T08:14:48.1973002Z ##[endgroup]
2026-02-21T08:14:48.1973322Z ##[group]Determining the checkout info
2026-02-21T08:14:48.1974751Z ##[endgroup]
2026-02-21T08:14:48.1978239Z [command]/usr/bin/git sparse-checkout disable
2026-02-21T08:14:48.2026064Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig
2026-02-21T08:14:48.2053774Z ##[group]Checking out the ref
2026-02-21T08:14:48.2057148Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main
2026-02-21T08:14:48.2347289Z Switched to a new branch 'main'
2026-02-21T08:14:48.2347609Z branch 'main' set up to track 'origin/main'.
2026-02-21T08:14:48.2352906Z ##[endgroup]
2026-02-21T08:14:48.2391486Z [command]/usr/bin/git log -1 --format=%H
2026-02-21T08:14:48.2418937Z 874a7d0cadab18218a84ad3579d329dc95c51820
2026-02-21T08:14:48.2612242Z ##[group]Run actions/setup-python@v6
2026-02-21T08:14:48.2612512Z with:
2026-02-21T08:14:48.2612671Z   python-version: 3.12
2026-02-21T08:14:48.2612862Z   check-latest: false
2026-02-21T08:14:48.2613149Z   token: ***
2026-02-21T08:14:48.2613338Z   update-environment: true
2026-02-21T08:14:48.2613540Z   allow-prereleases: false
2026-02-21T08:14:48.2613747Z   freethreaded: false
2026-02-21T08:14:48.2613912Z env:
2026-02-21T08:14:48.2614216Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:48.2614428Z ##[endgroup]
2026-02-21T08:14:48.2633327Z ##[command]/usr/bin/docker exec  37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T08:14:48.6990401Z ##[group]Installed versions
2026-02-21T08:14:48.7001710Z Version 3.12 was not found in the local cache
2026-02-21T08:14:49.1241355Z Version 3.12 is available for downloading
2026-02-21T08:14:49.1242687Z Download from "https://github.com/actions/python-versions/releases/download/3.12.12-18393146713/python-3.12.12-linux-24.04-x64.tar.gz"
2026-02-21T08:14:49.6278280Z Extract downloaded archive
2026-02-21T08:14:49.6417968Z [command]/usr/bin/tar xz --warning=no-unknown-keyword --overwrite -C /__w/_temp/ba766ac1-ea7f-4973-8a81-2f32744ac76b -f /__w/_temp/88dac2f1-8d2a-4d39-a80e-2d338b898129
2026-02-21T08:14:51.8471425Z Execute installation script
2026-02-21T08:14:51.8592423Z Check if Python hostedtoolcache folder exist...
2026-02-21T08:14:51.8592804Z Creating Python hostedtoolcache folder...
2026-02-21T08:14:51.8604989Z Create Python 3.12.12 folder
2026-02-21T08:14:51.8616682Z Copy Python binaries to hostedtoolcache folder
2026-02-21T08:14:52.4589899Z Create additional symlinks (Required for the UsePythonVersion Azure Pipelines task and the setup-python GitHub Action)
2026-02-21T08:14:52.4629339Z Upgrading pip...
2026-02-21T08:14:54.2294241Z Looking in links: /tmp/tmpobays6hj
2026-02-21T08:14:54.2297161Z Requirement already satisfied: pip in /__w/_tool/Python/3.12.12/x64/lib/python3.12/site-packages (25.0.1)
2026-02-21T08:14:54.2354185Z ##[error]WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
2026-02-21T08:14:55.0189900Z ##[error]WARNING: The directory '/github/home/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
2026-02-21T08:14:55.2284287Z Collecting pip
2026-02-21T08:14:55.2836296Z Downloading pip-26.0.1-py3-none-any.whl.metadata (4.7 kB)
2026-02-21T08:14:55.2975597Z Downloading pip-26.0.1-py3-none-any.whl (1.8 MB)
2026-02-21T08:14:55.3569554Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 57.8 MB/s eta 0:00:00
2026-02-21T08:14:55.3569859Z 
2026-02-21T08:14:55.3691366Z Installing collected packages: pip
2026-02-21T08:14:55.3693256Z Attempting uninstall: pip
2026-02-21T08:14:55.3711762Z Found existing installation: pip 25.0.1
2026-02-21T08:14:55.4073608Z Uninstalling pip-25.0.1:
2026-02-21T08:14:55.4131679Z Successfully uninstalled pip-25.0.1
2026-02-21T08:14:56.2295090Z Successfully installed pip-26.0.1
2026-02-21T08:14:56.2828909Z Create complete file
2026-02-21T08:14:56.2870806Z Successfully set up CPython (3.12.12)
2026-02-21T08:14:56.2871275Z ##[endgroup]
2026-02-21T08:14:56.3112522Z ##[group]Run astral-sh/setup-uv@v7
2026-02-21T08:14:56.3112789Z with:
2026-02-21T08:14:56.3112961Z   activate-environment: false
2026-02-21T08:14:56.3113252Z   working-directory: /home/david/_work/helion/helion
2026-02-21T08:14:56.3113661Z   github-token: ***
2026-02-21T08:14:56.3113838Z   enable-cache: auto
2026-02-21T08:14:56.3114502Z   cache-dependency-glob: **/*requirements*.txt
**/*requirements*.in
**/*constraints*.txt
**/*constraints*.in
**/pyproject.toml
**/uv.lock
**/*.py.lock

2026-02-21T08:14:56.3115061Z   restore-cache: true
2026-02-21T08:14:56.3115237Z   save-cache: true
2026-02-21T08:14:56.3115407Z   prune-cache: true
2026-02-21T08:14:56.3115574Z   cache-python: false
2026-02-21T08:14:56.3115759Z   ignore-nothing-to-cache: false
2026-02-21T08:14:56.3115972Z   ignore-empty-workdir: false
2026-02-21T08:14:56.3116179Z   add-problem-matchers: true
2026-02-21T08:14:56.3116379Z   resolution-strategy: highest
2026-02-21T08:14:56.3116569Z env:
2026-02-21T08:14:56.3116753Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:56.3116999Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:56.3117336Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:14:56.3117639Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:56.3117903Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:56.3118162Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:56.3118467Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:14:56.3118765Z ##[endgroup]
2026-02-21T08:14:56.3124302Z ##[command]/usr/bin/docker exec  37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T08:14:56.6343606Z (node:802) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.
2026-02-21T08:14:56.6344671Z (Use `node --trace-deprecation ...` to show where the warning was created)
2026-02-21T08:14:56.6433044Z Trying to find version for uv in: /__w/helion/helion/uv.toml
2026-02-21T08:14:56.6433509Z Could not find file: /__w/helion/helion/uv.toml
2026-02-21T08:14:56.6434589Z Trying to find version for uv in: /__w/helion/helion/pyproject.toml
2026-02-21T08:14:56.6445176Z Could not determine uv version from uv.toml or pyproject.toml. Falling back to latest.
2026-02-21T08:14:56.6446348Z Getting latest version from GitHub API...
2026-02-21T08:14:56.8505714Z manifest-file not provided, reading from local file.
2026-02-21T08:14:56.8547542Z manifest-file does not contain version 0.10.4, arch x86_64, platform unknown-linux-gnu. Falling back to GitHub releases.
2026-02-21T08:14:56.8548615Z Downloading uv from "https://github.com/astral-sh/uv/releases/download/0.10.4/uv-x86_64-unknown-linux-gnu.tar.gz" ...
2026-02-21T08:14:57.0848859Z [command]/usr/bin/tar xz --warning=no-unknown-keyword --overwrite -C /__w/_temp/452165b4-9afc-41d6-ad31-87e0b72743d4 -f /__w/_temp/283dec05-3670-4493-b307-cd84138a433e
2026-02-21T08:14:57.5132715Z Added /github/home/.local/bin to the path
2026-02-21T08:14:57.5135915Z Added /__w/_tool/uv/0.10.4/x86_64 to the path
2026-02-21T08:14:57.5137397Z Set UV_PYTHON_INSTALL_DIR to /github/home/.local/share/uv/python
2026-02-21T08:14:57.5137934Z Added /github/home/.local/share/uv/python to the path
2026-02-21T08:14:57.5146778Z Successfully installed uv version 0.10.4
2026-02-21T08:14:57.6883536Z ##[group]Run uv venv --python 3.12
2026-02-21T08:14:57.6883860Z uv venv --python 3.12
2026-02-21T08:14:57.6884402Z shell: bash -l {0}
2026-02-21T08:14:57.6884573Z env:
2026-02-21T08:14:57.6884727Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:57.6884977Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.6885292Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:14:57.6885618Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.6885887Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.6886155Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.6886495Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:14:57.6886871Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:14:57.6887142Z ##[endgroup]
2026-02-21T08:14:57.8338331Z Using CPython 3.12.12 interpreter at: /__w/_tool/Python/3.12.12/x64/bin/python3.12
2026-02-21T08:14:57.8338870Z Creating virtual environment at: .venv
2026-02-21T08:14:57.8344964Z Activate with: source .venv/bin/activate
2026-02-21T08:14:57.8429604Z ##[group]Run source .venv/bin/activate
2026-02-21T08:14:57.8429927Z source .venv/bin/activate
2026-02-21T08:14:57.8430335Z uv pip install -U "torch==2.9.*" --index-url https://download.pytorch.org/whl/cu128
2026-02-21T08:14:57.8431057Z shell: bash -l {0}
2026-02-21T08:14:57.8431232Z env:
2026-02-21T08:14:57.8431389Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:14:57.8431642Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.8431951Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:14:57.8432248Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.8432536Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.8432790Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:14:57.8433108Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:14:57.8433471Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:14:57.8433775Z ##[endgroup]
2026-02-21T08:14:58.1768361Z Resolved 26 packages in 209ms
2026-02-21T08:14:58.1836769Z Downloading torch (859.1MiB)
2026-02-21T08:14:58.1868261Z Downloading triton (162.6MiB)
2026-02-21T08:14:58.1901604Z Downloading sympy (6.0MiB)
2026-02-21T08:14:58.1915421Z Downloading nvidia-nccl-cu12 (307.4MiB)
2026-02-21T08:14:58.2025911Z Downloading nvidia-cuda-nvrtc-cu12 (84.0MiB)
2026-02-21T08:14:58.2027493Z Downloading networkx (2.0MiB)
2026-02-21T08:14:58.2291387Z Downloading nvidia-cufft-cu12 (184.2MiB)
2026-02-21T08:14:58.2310015Z Downloading nvidia-nvshmem-cu12 (118.9MiB)
2026-02-21T08:14:58.2387451Z Downloading nvidia-cusparse-cu12 (274.9MiB)
2026-02-21T08:14:58.2426211Z Downloading nvidia-cuda-cupti-cu12 (9.8MiB)
2026-02-21T08:14:58.2562980Z Downloading nvidia-cublas-cu12 (566.8MiB)
2026-02-21T08:14:58.2633614Z Downloading nvidia-cufile-cu12 (1.1MiB)
2026-02-21T08:14:58.2737881Z Downloading nvidia-cusolver-cu12 (255.1MiB)
2026-02-21T08:14:58.2778581Z Downloading nvidia-cusparselt-cu12 (273.9MiB)
2026-02-21T08:14:58.2843893Z Downloading nvidia-nvjitlink-cu12 (37.4MiB)
2026-02-21T08:14:58.2916047Z Downloading nvidia-curand-cu12 (60.7MiB)
2026-02-21T08:14:58.2979071Z Downloading nvidia-cudnn-cu12 (674.0MiB)
2026-02-21T08:14:58.5534419Z  Downloaded nvidia-cufile-cu12
2026-02-21T08:14:58.7897801Z  Downloaded networkx
2026-02-21T08:14:59.6493833Z  Downloaded sympy
2026-02-21T08:15:00.2437883Z  Downloaded nvidia-cuda-cupti-cu12
2026-02-21T08:15:01.0419923Z  Downloaded triton
2026-02-21T08:15:02.9224522Z  Downloaded nvidia-nvjitlink-cu12
2026-02-21T08:15:04.5746123Z  Downloaded nvidia-cuda-nvrtc-cu12
2026-02-21T08:15:04.6605284Z  Downloaded nvidia-curand-cu12
2026-02-21T08:15:10.6404171Z  Downloaded nvidia-nvshmem-cu12
2026-02-21T08:15:15.4102050Z  Downloaded nvidia-cufft-cu12
2026-02-21T08:15:15.5783108Z  Downloaded nvidia-nccl-cu12
2026-02-21T08:15:16.2816033Z  Downloaded torch
2026-02-21T08:15:17.7461140Z  Downloaded nvidia-cusparse-cu12
2026-02-21T08:15:18.4179120Z  Downloaded nvidia-cusolver-cu12
2026-02-21T08:15:18.9415794Z  Downloaded nvidia-cusparselt-cu12
2026-02-21T08:15:21.6347388Z  Downloaded nvidia-cublas-cu12
2026-02-21T08:15:23.2213046Z  Downloaded nvidia-cudnn-cu12
2026-02-21T08:15:23.2250384Z Prepared 26 packages in 25.04s
2026-02-21T08:15:23.2300116Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:23.2316304Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:23.2317046Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:27.6370799Z Installed 26 packages in 4.41s
2026-02-21T08:15:27.6371149Z  + filelock==3.20.0
2026-02-21T08:15:27.6371372Z  + fsspec==2025.12.0
2026-02-21T08:15:27.6371584Z  + jinja2==3.1.6
2026-02-21T08:15:27.6371793Z  + markupsafe==3.0.2
2026-02-21T08:15:27.6372000Z  + mpmath==1.3.0
2026-02-21T08:15:27.6372191Z  + networkx==3.6.1
2026-02-21T08:15:27.6373010Z  + nvidia-cublas-cu12==12.8.4.1
2026-02-21T08:15:27.6373337Z  + nvidia-cuda-cupti-cu12==12.8.90
2026-02-21T08:15:27.6373620Z  + nvidia-cuda-nvrtc-cu12==12.8.93
2026-02-21T08:15:27.6373894Z  + nvidia-cuda-runtime-cu12==12.8.90
2026-02-21T08:15:27.6374554Z  + nvidia-cudnn-cu12==9.10.2.21
2026-02-21T08:15:27.6374800Z  + nvidia-cufft-cu12==11.3.3.83
2026-02-21T08:15:27.6375044Z  + nvidia-cufile-cu12==1.13.1.3
2026-02-21T08:15:27.6375286Z  + nvidia-curand-cu12==10.3.9.90
2026-02-21T08:15:27.6375540Z  + nvidia-cusolver-cu12==11.7.3.90
2026-02-21T08:15:27.6375943Z  + nvidia-cusparse-cu12==12.5.8.93
2026-02-21T08:15:27.6378290Z  + nvidia-cusparselt-cu12==0.7.1
2026-02-21T08:15:27.6378674Z  + nvidia-nccl-cu12==2.27.5
2026-02-21T08:15:27.6378983Z  + nvidia-nvjitlink-cu12==12.8.93
2026-02-21T08:15:27.6379299Z  + nvidia-nvshmem-cu12==3.3.20
2026-02-21T08:15:27.6379538Z  + nvidia-nvtx-cu12==12.8.90
2026-02-21T08:15:27.6379772Z  + setuptools==70.2.0
2026-02-21T08:15:27.6379970Z  + sympy==1.14.0
2026-02-21T08:15:27.6380169Z  + torch==2.9.1+cu128
2026-02-21T08:15:27.6380360Z  + triton==3.5.1
2026-02-21T08:15:27.6380563Z  + typing-extensions==4.15.0
2026-02-21T08:15:27.6531324Z ##[group]Run source .venv/bin/activate
2026-02-21T08:15:27.6531658Z source .venv/bin/activate
2026-02-21T08:15:27.6531998Z SETUPTOOLS_SCM_PRETEND_VERSION="0.0.0" uv pip install -e .'[dev]'
2026-02-21T08:15:27.6532391Z python -c "import helion; print(helion.__name__)"
2026-02-21T08:15:27.6532882Z shell: bash -l {0}
2026-02-21T08:15:27.6533041Z env:
2026-02-21T08:15:27.6533196Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:15:27.6533441Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.6534245Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:15:27.6534567Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.6534836Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.6535099Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:27.6535406Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:15:27.6535804Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:15:27.6536069Z ##[endgroup]
2026-02-21T08:15:29.5612210Z Resolved 30 packages in 1.70s
2026-02-21T08:15:29.5623635Z    Building helion @ file:///__w/helion/helion
2026-02-21T08:15:29.5791897Z Downloading numpy (15.8MiB)
2026-02-21T08:15:29.5793397Z Downloading scipy (33.4MiB)
2026-02-21T08:15:29.5795244Z Downloading virtualenv (5.6MiB)
2026-02-21T08:15:29.5796655Z Downloading pygments (1.2MiB)
2026-02-21T08:15:29.5798208Z Downloading scikit-learn (8.5MiB)
2026-02-21T08:15:29.8681058Z  Downloaded pygments
2026-02-21T08:15:29.8834472Z       Built helion @ file:///__w/helion/helion
2026-02-21T08:15:29.9028515Z  Downloaded virtualenv
2026-02-21T08:15:30.3533395Z  Downloaded scikit-learn
2026-02-21T08:15:30.4022184Z  Downloaded numpy
2026-02-21T08:15:30.5802229Z  Downloaded scipy
2026-02-21T08:15:30.6047031Z Prepared 27 packages in 1.04s
2026-02-21T08:15:30.6054948Z Uninstalled 1 package in 0.71ms
2026-02-21T08:15:30.6076940Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:30.6077847Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:30.6078649Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:31.1569508Z Installed 29 packages in 551ms
2026-02-21T08:15:31.1570331Z  + cfgv==3.5.0
2026-02-21T08:15:31.1571185Z  + distlib==0.4.0
2026-02-21T08:15:31.1572062Z  + expecttest==0.3.0
2026-02-21T08:15:31.1572434Z  + filecheck==1.0.3
2026-02-21T08:15:31.1572780Z  - filelock==3.20.0
2026-02-21T08:15:31.1573136Z  + filelock==3.24.3
2026-02-21T08:15:31.1573496Z  + helion==0.0.0 (from file:///__w/helion/helion)
2026-02-21T08:15:31.1573919Z  + hypothesis==6.151.9
2026-02-21T08:15:31.1574503Z  + identify==2.6.16
2026-02-21T08:15:31.1574776Z  + iniconfig==2.3.0
2026-02-21T08:15:31.1575111Z  + joblib==1.5.3
2026-02-21T08:15:31.1575512Z  + markdown-it-py==4.0.0
2026-02-21T08:15:31.1588905Z  + mdurl==0.1.2
2026-02-21T08:15:31.1589179Z  + nodeenv==1.10.0
2026-02-21T08:15:31.1589384Z  + numpy==2.4.2
2026-02-21T08:15:31.1589573Z  + packaging==26.0
2026-02-21T08:15:31.1589786Z  + platformdirs==4.9.2
2026-02-21T08:15:31.1589998Z  + pluggy==1.6.0
2026-02-21T08:15:31.1590197Z  + pre-commit==4.5.1
2026-02-21T08:15:31.1590392Z  + psutil==7.2.2
2026-02-21T08:15:31.1590581Z  + pygments==2.19.2
2026-02-21T08:15:31.1590770Z  + pytest==9.0.2
2026-02-21T08:15:31.1590978Z  + pytest-timeout==2.4.0
2026-02-21T08:15:31.1591205Z  + pyyaml==6.0.3
2026-02-21T08:15:31.1591398Z  + rich==14.3.3
2026-02-21T08:15:31.1591588Z  + scikit-learn==1.8.0
2026-02-21T08:15:31.1591786Z  + scipy==1.17.0
2026-02-21T08:15:31.1591983Z  + sortedcontainers==2.4.0
2026-02-21T08:15:31.1592207Z  + threadpoolctl==3.6.0
2026-02-21T08:15:31.1592398Z  + virtualenv==20.38.0
2026-02-21T08:15:46.4969482Z helion
2026-02-21T08:15:47.4646612Z ##[group]Run set -x
2026-02-21T08:15:47.4646900Z set -x
2026-02-21T08:15:47.4647117Z source .venv/bin/activate
2026-02-21T08:15:47.4647385Z uv pip install pip
2026-02-21T08:15:47.4647666Z uv pip install quack-kernels --no-deps
2026-02-21T08:15:47.4648008Z mkdir -p benchmarks/ && pushd benchmarks/
2026-02-21T08:15:47.4648420Z git clone https://github.com/pytorch-labs/tritonbench/
2026-02-21T08:15:47.4648780Z pushd tritonbench/
2026-02-21T08:15:47.4649047Z git submodule update --init --recursive
2026-02-21T08:15:47.4649632Z uv pip install -r requirements.txt
2026-02-21T08:15:47.4650039Z python install.py --liger
2026-02-21T08:15:47.4650310Z uv pip install -e . --no-deps
2026-02-21T08:15:47.4650563Z popd
2026-02-21T08:15:47.4650744Z popd
2026-02-21T08:15:47.4651067Z shell: bash -l {0}
2026-02-21T08:15:47.4651254Z env:
2026-02-21T08:15:47.4651478Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:15:47.4651761Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.4652134Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:15:47.4652502Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.4652822Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.4653139Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:15:47.4653521Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:15:47.4653908Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:15:47.4654352Z ##[endgroup]
2026-02-21T08:15:47.5380614Z + source .venv/bin/activate
2026-02-21T08:15:47.5380882Z ++ '[' -z '' ']'
2026-02-21T08:15:47.5381060Z ++ '[' -n x ']'
2026-02-21T08:15:47.5381261Z ++ SCRIPT_PATH=.venv/bin/activate
2026-02-21T08:15:47.5381616Z ++ '[' .venv/bin/activate = /__w/_temp/cbc5e94d-a991-4a03-bf80-8f4d3a7d5e01.sh ']'
2026-02-21T08:15:47.5382028Z ++ deactivate nondestructive
2026-02-21T08:15:47.5382244Z ++ unset -f pydoc
2026-02-21T08:15:47.5382425Z ++ '[' -z '' ']'
2026-02-21T08:15:47.5382607Z ++ '[' -z '' ']'
2026-02-21T08:15:47.5382778Z ++ hash -r
2026-02-21T08:15:47.5382951Z ++ '[' -z '' ']'
2026-02-21T08:15:47.5383136Z ++ unset VIRTUAL_ENV
2026-02-21T08:15:47.5383346Z ++ unset VIRTUAL_ENV_PROMPT
2026-02-21T08:15:47.5383596Z ++ '[' '!' nondestructive = nondestructive ']'
2026-02-21T08:15:47.5383895Z ++ VIRTUAL_ENV=/__w/helion/helion/.venv
2026-02-21T08:15:47.5385338Z ++ '[' linux-gnu = cygwin ']'
2026-02-21T08:15:47.5385584Z ++ '[' linux-gnu = msys ']'
2026-02-21T08:15:47.5387193Z ++ export VIRTUAL_ENV
2026-02-21T08:15:47.5387397Z ++ '[' -z '' ']'
2026-02-21T08:15:47.5387591Z ++ unset SCRIPT_PATH
2026-02-21T08:15:47.5388537Z ++ _OLD_VIRTUAL_PATH=/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T08:15:47.5390318Z ++ PATH=/__w/helion/helion/.venv/bin:/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T08:15:47.5391345Z ++ export PATH
2026-02-21T08:15:47.5391541Z ++ '[' xhelion '!=' x ']'
2026-02-21T08:15:47.5391776Z ++ VIRTUAL_ENV_PROMPT=helion
2026-02-21T08:15:47.5392009Z ++ export VIRTUAL_ENV_PROMPT
2026-02-21T08:15:47.5392234Z ++ '[' -z '' ']'
2026-02-21T08:15:47.5392425Z ++ '[' -z '' ']'
2026-02-21T08:15:47.5392608Z ++ _OLD_VIRTUAL_PS1=
2026-02-21T08:15:47.5392821Z ++ PS1='(helion) '
2026-02-21T08:15:47.5393008Z ++ export PS1
2026-02-21T08:15:47.5393187Z ++ alias pydoc
2026-02-21T08:15:47.5393361Z ++ true
2026-02-21T08:15:47.5393529Z ++ hash -r
2026-02-21T08:15:47.5393703Z + uv pip install pip
2026-02-21T08:15:47.6091171Z Resolved 1 package in 60ms
2026-02-21T08:15:47.6186339Z Downloading pip (1.7MiB)
2026-02-21T08:15:47.6841722Z  Downloaded pip
2026-02-21T08:15:47.6870032Z Prepared 1 package in 77ms
2026-02-21T08:15:47.6901924Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:47.6902729Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:47.6903566Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:48.2898246Z Installed 1 package in 602ms
2026-02-21T08:15:48.2898995Z  + pip==26.0.1
2026-02-21T08:15:48.2950055Z + uv pip install quack-kernels --no-deps
2026-02-21T08:15:48.3266788Z Resolved 1 package in 21ms
2026-02-21T08:15:48.5656743Z Prepared 1 package in 238ms
2026-02-21T08:15:48.5688068Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:15:48.5688759Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:15:48.5689451Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:15:48.6450109Z Installed 1 package in 79ms
2026-02-21T08:15:48.6450537Z  + quack-kernels==0.2.10
2026-02-21T08:15:48.6490370Z + mkdir -p benchmarks/
2026-02-21T08:15:48.6503920Z + pushd benchmarks/
2026-02-21T08:15:48.6504505Z + git clone https://github.com/pytorch-labs/tritonbench/
2026-02-21T08:15:48.6504912Z /__w/helion/helion/benchmarks /__w/helion/helion
2026-02-21T08:15:48.6519315Z Cloning into 'tritonbench'...
2026-02-21T08:15:49.9593062Z + pushd tritonbench/
2026-02-21T08:15:49.9593419Z + git submodule update --init --recursive
2026-02-21T08:15:49.9594113Z /__w/helion/helion/benchmarks/tritonbench /__w/helion/helion/benchmarks /__w/helion/helion
2026-02-21T08:15:50.0533125Z Submodule 'submodules/ThunderKittens' (https://github.com/HazyResearch/ThunderKittens.git) registered for path 'submodules/ThunderKittens'
2026-02-21T08:15:50.1573655Z Submodule 'submodules/aiter' (https://github.com/ROCm/aiter.git) registered for path 'submodules/aiter'
2026-02-21T08:15:50.2523212Z Submodule 'submodules/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/cutlass'
2026-02-21T08:15:50.3199511Z Submodule 'submodules/flash-attention' (https://github.com/Dao-AILab/flash-attention.git) registered for path 'submodules/flash-attention'
2026-02-21T08:15:50.3388001Z Submodule 'submodules/generative-recommenders' (https://github.com/facebookresearch/generative-recommenders.git) registered for path 'submodules/generative-recommenders'
2026-02-21T08:15:50.4170281Z Submodule 'submodules/xformers' (https://github.com/facebookresearch/xformers.git) registered for path 'submodules/xformers'
2026-02-21T08:15:50.4202259Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/ThunderKittens'...
2026-02-21T08:15:55.9296404Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/aiter'...
2026-02-21T08:16:27.8207581Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/cutlass'...
2026-02-21T08:16:34.8651860Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/flash-attention'...
2026-02-21T08:16:37.0452227Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/generative-recommenders'...
2026-02-21T08:16:37.8727586Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers'...
2026-02-21T08:16:43.1858040Z Submodule path 'submodules/ThunderKittens': checked out '25f7568450b412a1984a4f619fb28373df06fa1b'
2026-02-21T08:16:44.0510323Z Submodule path 'submodules/aiter': checked out '1f5b378dcc9d9b0bcd9456c8c767b7424a5e8190'
2026-02-21T08:16:44.1733131Z Submodule '3rdparty/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/aiter/3rdparty/composable_kernel'
2026-02-21T08:16:44.1771165Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/aiter/3rdparty/composable_kernel'...
2026-02-21T08:16:54.1656633Z Submodule path 'submodules/aiter/3rdparty/composable_kernel': checked out 'e31a7a4f29b371c32ea9daf9211b6ae1fed2fa40'
2026-02-21T08:16:55.9215029Z Submodule path 'submodules/cutlass': checked out 'ad7b2f5e84fcfa124cb02b91d5bd26d238c0459e'
2026-02-21T08:16:56.0722143Z Submodule path 'submodules/flash-attention': checked out '43375aab2893018dfb7950db1cfa623c14946ad6'
2026-02-21T08:16:56.2538499Z Submodule 'csrc/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/flash-attention/csrc/composable_kernel'
2026-02-21T08:16:56.3806369Z Submodule 'csrc/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/flash-attention/csrc/cutlass'
2026-02-21T08:16:56.3841358Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/flash-attention/csrc/composable_kernel'...
2026-02-21T08:17:07.1276744Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/flash-attention/csrc/cutlass'...
2026-02-21T08:17:17.5160330Z Submodule path 'submodules/flash-attention/csrc/composable_kernel': checked out 'e8709c24f403173ad21a2da907d1347957e324fb'
2026-02-21T08:17:18.7807230Z Submodule path 'submodules/flash-attention/csrc/cutlass': checked out 'b1d6e2c9b334dfa811e4183dfbd02419249e4b52'
2026-02-21T08:17:19.1148501Z Submodule path 'submodules/generative-recommenders': checked out '88512dbd71b053226bc4ef8ec1630e3db53e55e5'
2026-02-21T08:17:19.2623718Z Submodule 'generative_recommenders/ops/cpp/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/generative-recommenders/generative_recommenders/ops/cpp/cutlass'
2026-02-21T08:17:19.2655984Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/generative-recommenders/generative_recommenders/ops/cpp/cutlass'...
2026-02-21T08:17:28.0387071Z Submodule path 'submodules/generative-recommenders/generative_recommenders/ops/cpp/cutlass': checked out 'dc4817921edda44a549197ff3a9dcf5df0636e7b'
2026-02-21T08:17:28.1564222Z Submodule path 'submodules/xformers': checked out '8fc8ec5a4d6498ff81c0c418b89bbaf133ae3a44'
2026-02-21T08:17:28.3799564Z Submodule 'third_party/composable_kernel_tiled' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/xformers/third_party/composable_kernel_tiled'
2026-02-21T08:17:28.3897404Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/xformers/third_party/cutlass'
2026-02-21T08:17:28.4496516Z Submodule 'third_party/flash-attention' (https://github.com/Dao-AILab/flash-attention.git) registered for path 'submodules/xformers/third_party/flash-attention'
2026-02-21T08:17:28.4531207Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/composable_kernel_tiled'...
2026-02-21T08:17:36.7043689Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/cutlass'...
2026-02-21T08:17:42.8148601Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/flash-attention'...
2026-02-21T08:17:46.0767193Z Submodule path 'submodules/xformers/third_party/composable_kernel_tiled': checked out '4f54fa30583704f34da2ac50372d524cae6bad7d'
2026-02-21T08:17:47.1585646Z Submodule path 'submodules/xformers/third_party/cutlass': checked out 'e9627ce55b42fd2599f58cd4396da9380954def0'
2026-02-21T08:17:47.4891971Z Submodule path 'submodules/xformers/third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5'
2026-02-21T08:17:47.5420722Z Submodule 'csrc/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'submodules/xformers/third_party/flash-attention/csrc/composable_kernel'
2026-02-21T08:17:47.6935515Z Submodule 'csrc/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'submodules/xformers/third_party/flash-attention/csrc/cutlass'
2026-02-21T08:17:47.6979235Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/flash-attention/csrc/composable_kernel'...
2026-02-21T08:17:55.8953215Z Cloning into '/__w/helion/helion/benchmarks/tritonbench/submodules/xformers/third_party/flash-attention/csrc/cutlass'...
2026-02-21T08:18:04.8308627Z Submodule path 'submodules/xformers/third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33'
2026-02-21T08:18:05.7206981Z Submodule path 'submodules/xformers/third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420'
2026-02-21T08:18:05.7255315Z + uv pip install -r requirements.txt
2026-02-21T08:18:05.7339055Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:06.3112931Z Resolved 30 packages in 575ms
2026-02-21T08:18:06.3330453Z Downloading pillow (6.7MiB)
2026-02-21T08:18:06.3359493Z Downloading tokenizers (3.0MiB)
2026-02-21T08:18:06.3360233Z Downloading hf-xet (3.2MiB)
2026-02-21T08:18:06.3362869Z Downloading kiwisolver (1.4MiB)
2026-02-21T08:18:06.3371358Z Downloading fonttools (4.7MiB)
2026-02-21T08:18:06.3374541Z Downloading matplotlib (8.3MiB)
2026-02-21T08:18:06.3375959Z Downloading transformers (10.3MiB)
2026-02-21T08:18:06.7561021Z  Downloaded kiwisolver
2026-02-21T08:18:06.8189892Z  Downloaded tokenizers
2026-02-21T08:18:06.8220739Z  Downloaded hf-xet
2026-02-21T08:18:06.9061911Z  Downloaded pillow
2026-02-21T08:18:06.9191515Z  Downloaded fonttools
2026-02-21T08:18:06.9480110Z  Downloaded matplotlib
2026-02-21T08:18:07.4065199Z  Downloaded transformers
2026-02-21T08:18:07.4410494Z Prepared 23 packages in 1.12s
2026-02-21T08:18:07.4464962Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:18:07.4465751Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:18:07.4466501Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:18:08.1739522Z Installed 23 packages in 732ms
2026-02-21T08:18:08.1739882Z  + certifi==2026.1.4
2026-02-21T08:18:08.1740173Z  + charset-normalizer==3.4.4
2026-02-21T08:18:08.1740429Z  + contourpy==1.3.3
2026-02-21T08:18:08.1740669Z  + cycler==0.12.1
2026-02-21T08:18:08.1740906Z  + fonttools==4.61.1
2026-02-21T08:18:08.1741125Z  + hf-xet==1.2.0
2026-02-21T08:18:08.1741314Z  + huggingface-hub==0.36.2
2026-02-21T08:18:08.1741540Z  + idna==3.11
2026-02-21T08:18:08.1741725Z  + kiwisolver==1.4.9
2026-02-21T08:18:08.1741929Z  + matplotlib==3.10.8
2026-02-21T08:18:08.1742150Z  + nvidia-ml-py==13.590.48
2026-02-21T08:18:08.1742367Z  + pillow==12.1.1
2026-02-21T08:18:08.1742576Z  + pyparsing==3.3.2
2026-02-21T08:18:08.1742781Z  + python-dateutil==2.9.0.post0
2026-02-21T08:18:08.1743022Z  + regex==2026.2.19
2026-02-21T08:18:08.1743205Z  + requests==2.32.5
2026-02-21T08:18:08.1743402Z  + safetensors==0.7.0
2026-02-21T08:18:08.1743606Z  + six==1.17.0
2026-02-21T08:18:08.1743829Z  + tabulate==0.9.0
2026-02-21T08:18:08.1744202Z  + tokenizers==0.21.4
2026-02-21T08:18:08.1744405Z  + tqdm==4.67.3
2026-02-21T08:18:08.1744608Z  + transformers==4.53.0
2026-02-21T08:18:08.1744807Z  + urllib3==2.6.3
2026-02-21T08:18:08.1858899Z + python install.py --liger
2026-02-21T08:18:13.8398775Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:13.8440954Z Audited 6 packages in 4ms
2026-02-21T08:18:14.1016152Z INFO:__main__:[tritonbench] installing liger-kernels...
2026-02-21T08:18:14.1093617Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:14.1462569Z Resolved 1 package in 35ms
2026-02-21T08:18:14.2344266Z Prepared 1 package in 88ms
2026-02-21T08:18:14.2378255Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:18:14.2379011Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:18:14.2379755Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:18:14.2576853Z Installed 1 package in 23ms
2026-02-21T08:18:14.2577180Z  + liger-kernel-nightly==0.7.0.dev20260219183429
2026-02-21T08:18:14.2618610Z INFO:__main__:[tritonbench] installation complete!
2026-02-21T08:18:14.6200205Z + uv pip install -e . --no-deps
2026-02-21T08:18:14.6888873Z Using Python 3.12.12 environment at: /__w/helion/helion/.venv
2026-02-21T08:18:14.6922018Z Resolved 1 package in 1ms
2026-02-21T08:18:14.7246536Z    Building tritonbench @ file:///__w/helion/helion/benchmarks/tritonbench
2026-02-21T08:18:16.2543908Z       Built tritonbench @ file:///__w/helion/helion/benchmarks/tritonbench
2026-02-21T08:18:16.2582370Z Prepared 1 package in 1.56s
2026-02-21T08:18:16.2586831Z warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
2026-02-21T08:18:16.2587576Z          If the cache and target directories are on different filesystems, hardlinking may not be supported.
2026-02-21T08:18:16.2588286Z          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
2026-02-21T08:18:16.2793641Z Installed 1 package in 21ms
2026-02-21T08:18:16.2794188Z  + tritonbench==0.0.1 (from file:///__w/helion/helion/benchmarks/tritonbench)
2026-02-21T08:18:16.2939478Z + popd
2026-02-21T08:18:16.2939722Z /__w/helion/helion/benchmarks /__w/helion/helion
2026-02-21T08:18:16.2940029Z /__w/helion/helion
2026-02-21T08:18:16.2940221Z + popd
2026-02-21T08:18:16.3008043Z ##[group]Run rm -rf /tmp/torchinductor_*/ || true
2026-02-21T08:18:16.3008505Z rm -rf /tmp/torchinductor_*/ || true
2026-02-21T08:18:16.3008775Z 
2026-02-21T08:18:16.3008946Z source .venv/bin/activate
2026-02-21T08:18:16.3009149Z 
2026-02-21T08:18:16.3009345Z TEST_REPORTS_DIR=$(pwd)/test/test-reports
2026-02-21T08:18:16.3009611Z mkdir -p "$TEST_REPORTS_DIR"
2026-02-21T08:18:16.3009839Z echo "$TEST_REPORTS_DIR"
2026-02-21T08:18:16.3010106Z 
2026-02-21T08:18:16.3010267Z KERNEL_LIST="softmax"
2026-02-21T08:18:16.3010486Z for kernel in ${KERNEL_LIST//,/ }; do
2026-02-21T08:18:16.3010755Z   echo "=========================================="
2026-02-21T08:18:16.3011087Z   echo "Running benchmark for kernel: $kernel"
2026-02-21T08:18:16.3011361Z   echo "=========================================="
2026-02-21T08:18:16.3011591Z 
2026-02-21T08:18:16.3011859Z   # Get available implementations and baseline for this kernel
2026-02-21T08:18:16.3012379Z   KERNEL_INFO=$(python benchmarks/run.py --list-impls-for-benchmark-ci --op $kernel | grep "^$kernel:")
2026-02-21T08:18:16.3012912Z   IMPLS=$(echo "$KERNEL_INFO" | sed -n 's/.*impls=\([^ ]*\).*/\1/p')
2026-02-21T08:18:16.3013312Z   BASELINE=$(echo "$KERNEL_INFO" | sed -n 's/.*baseline=\([^ ]*\).*/\1/p')
2026-02-21T08:18:16.3013623Z 
2026-02-21T08:18:16.3013775Z   if [[ -z "$IMPLS" ]]; then
2026-02-21T08:18:16.3014306Z     echo "Warning: No implementations found for kernel $kernel, skipping..."
2026-02-21T08:18:16.3014653Z     continue
2026-02-21T08:18:16.3014826Z   fi
2026-02-21T08:18:16.3014997Z   if [[ -z "$BASELINE" ]]; then
2026-02-21T08:18:16.3015309Z     echo "Warning: No baseline found for kernel $kernel, skipping..."
2026-02-21T08:18:16.3015623Z     continue
2026-02-21T08:18:16.3015797Z   fi
2026-02-21T08:18:16.3015967Z   echo "Using baseline: $BASELINE"
2026-02-21T08:18:16.3016277Z   echo "Available implementations for $kernel: $IMPLS"
2026-02-21T08:18:16.3016553Z 
2026-02-21T08:18:16.3016742Z   # Do autotuning but do not record the results
2026-02-21T08:18:16.3017003Z    python benchmarks/run.py \
2026-02-21T08:18:16.3017229Z       --op $kernel \
2026-02-21T08:18:16.3017447Z       --metrics speedup,accuracy \
2026-02-21T08:18:16.3017714Z       --latency-measure-mode triton_do_bench \
2026-02-21T08:18:16.3017972Z       --cudagraph \
2026-02-21T08:18:16.3018161Z       --only $IMPLS \
2026-02-21T08:18:16.3018398Z       --only-match-mode prefix-with-baseline \
2026-02-21T08:18:16.3018650Z       --baseline $BASELINE \
2026-02-21T08:18:16.3018862Z       --atol 1e-2 \
2026-02-21T08:18:16.3019052Z       --rtol 1e-2 \
2026-02-21T08:18:16.3019279Z       --input-sample-mode equally-spaced-k \
2026-02-21T08:18:16.3019531Z       --keep-going \
2026-02-21T08:18:16.3019709Z       
2026-02-21T08:18:16.3020116Z 
2026-02-21T08:18:16.3020264Z   # Relax the GPU
2026-02-21T08:18:16.3020449Z   sleep 2m
2026-02-21T08:18:16.3020607Z 
2026-02-21T08:18:16.3020787Z   # Run again with cache and record results
2026-02-21T08:18:16.3021169Z    HELION_PRINT_OUTPUT_CODE=1 HELION_ASSERT_CACHE_HIT=1 python benchmarks/run.py \
2026-02-21T08:18:16.3021535Z       --op $kernel \
2026-02-21T08:18:16.3021757Z       --metrics speedup,accuracy \
2026-02-21T08:18:16.3022032Z       --latency-measure-mode triton_do_bench \
2026-02-21T08:18:16.3022291Z       --cudagraph \
2026-02-21T08:18:16.3022483Z       --only $IMPLS \
2026-02-21T08:18:16.3022921Z       --only-match-mode prefix-with-baseline \
2026-02-21T08:18:16.3023207Z       --baseline $BASELINE \
2026-02-21T08:18:16.3023424Z       --atol 1e-2 \
2026-02-21T08:18:16.3023609Z       --rtol 1e-2 \
2026-02-21T08:18:16.3023838Z       --input-sample-mode equally-spaced-k \
2026-02-21T08:18:16.3024340Z       --output "$TEST_REPORTS_DIR/helionbench.json" \
2026-02-21T08:18:16.3024618Z       --append-to-output \
2026-02-21T08:18:16.3024843Z       --keep-going \
2026-02-21T08:18:16.3025026Z       
2026-02-21T08:18:16.3025172Z 
2026-02-21T08:18:16.3025382Z   echo "✅ Completed benchmark for kernel: $kernel"
2026-02-21T08:18:16.3025651Z done
2026-02-21T08:18:16.3025802Z 
2026-02-21T08:18:16.3026010Z if [[ ! -s "$TEST_REPORTS_DIR/helionbench.json" ]]; then
2026-02-21T08:18:16.3026334Z   echo "❌ helionbench.json is missing or empty"
2026-02-21T08:18:16.3026588Z   exit 1
2026-02-21T08:18:16.3026762Z fi
2026-02-21T08:18:16.3026944Z cat "$TEST_REPORTS_DIR/helionbench.json"
2026-02-21T08:18:16.3027289Z shell: bash -l {0}
2026-02-21T08:18:16.3027447Z env:
2026-02-21T08:18:16.3027605Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T08:18:16.3027845Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:16.3028139Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T08:18:16.3028435Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:16.3028690Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:16.3028954Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T08:18:16.3029271Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T08:18:16.3029636Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T08:18:16.3029907Z ##[endgroup]
2026-02-21T08:18:16.3814706Z /__w/helion/helion/test/test-reports
2026-02-21T08:18:16.3815010Z ==========================================
2026-02-21T08:18:16.3815271Z Running benchmark for kernel: softmax
2026-02-21T08:18:16.3815528Z ==========================================
2026-02-21T08:18:22.4127275Z Using baseline: naive_softmax
2026-02-21T08:18:22.4127857Z Available implementations for softmax: helion_softmax_tritonbench,torch_compile_softmax,triton_softmax
2026-02-21T08:18:29.5297425Z Using num_inputs=20 for softmax
2026-02-21T08:18:29.7461811Z Running softmax benchmark with Helion implementation...
2026-02-21T08:18:29.7462181Z 
2026-02-21T08:18:30.1952329Z Equally-spaced-k mode: Selected 20 equally spaced inputs (total available: 98)
2026-02-21T08:18:30.1953313Z WARNING:tritonbench.utils.triton_op:Input IDs to run: [0, 5, 10, 15, 20, 26, 31, 36, 41, 46, 51, 56, 61, 66, 71, 77, 82, 87, 92, 97]
2026-02-21T08:18:30.1959565Z 
2026-02-21T08:18:30.1970952Z   0%|          | 0/20 [00:00<?, ?it/s]WARNING:tritonbench.utils.triton_op:Running input ID 0:
2026-02-21T08:18:30.1971446Z (M, N)
2026-02-21T08:18:30.1971648Z -----------
2026-02-21T08:18:30.1971890Z (4096, 256)
2026-02-21T08:18:30.1974872Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T08:18:32.0682892Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T08:18:34.6392216Z INFO:tritonbench.utils.triton_op:Took 174.02ms to get benchmark function for torch_compile_softmax
2026-02-21T08:18:37.3542326Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:18:37.3542699Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:18:37.3542993Z               'dtype': 'torch.float16',
2026-02-21T08:18:37.3543272Z               'shape': (4096, 256),
2026-02-21T08:18:37.3543537Z               'stride': (256, 1)},),
2026-02-21T08:18:37.3543795Z   'kwargs': {}}
2026-02-21T08:18:37.3544617Z INFO:tritonbench.utils.triton_op:Took 0.59ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T08:18:37.8480802Z [0s] Autotune random seed: 2135383793
2026-02-21T08:18:38.3677072Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:19:44.7251339Z [66s] Timeout after 60s compiling Config(block_sizes=[2048, 16], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:19:44.7275092Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.0 configs/s
2026-02-21T08:19:51.1813465Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.6 configs/s
2026-02-21T08:19:51.1828631Z [72s] Adaptive compile timeout: 30s (90% percentile=4.7s, bounds=[30.0s, 60s])
2026-02-21T08:19:52.1588532Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1041.9 configs/s
2026-02-21T08:19:52.2725673Z [73s] Initial random population of 100, 5 starting points: 
2026-02-21T08:19:52.2725994Z error=3
2026-02-21T08:19:52.2726182Z timeout=1
2026-02-21T08:19:52.2726425Z ok=96
2026-02-21T08:19:52.2726605Z min=0.0098
2026-02-21T08:19:52.2726777Z mid=0.0844
2026-02-21T08:19:52.2726955Z max=6.7396
2026-02-21T08:19:52.2727148Z best={'block_sizes': [4, 16],
2026-02-21T08:19:52.2727537Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:19:52.2727931Z  'load_eviction_policies': ['', ''],
2026-02-21T08:19:52.2728176Z  'num_stages': 1,
2026-02-21T08:19:52.2728366Z  'num_warps': 2,
2026-02-21T08:19:52.2728540Z  'pid_type': 'flat',
2026-02-21T08:19:52.2728739Z  'range_flattens': [None, False],
2026-02-21T08:19:52.2728979Z  'range_multi_buffers': [None, None],
2026-02-21T08:19:52.2729215Z  'range_num_stages': [0, 0],
2026-02-21T08:19:52.2729434Z  'range_unroll_factors': [0, 4],
2026-02-21T08:19:52.2729660Z  'range_warp_specializes': []}
2026-02-21T08:19:52.2747032Z [73s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:19:53.7087523Z [75s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T08:20:03.1064475Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 7.7 configs/s
2026-02-21T08:20:09.4836333Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 91/91 14.3 configs/s
2026-02-21T08:20:14.7203367Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 194.7         
2026-02-21T08:20:14.7203872Z                                                                   configs/s     
2026-02-21T08:20:15.2460720Z [96s] Generation 1 complete: 
2026-02-21T08:20:15.2460971Z ok=94
2026-02-21T08:20:15.2461146Z min=0.0082
2026-02-21T08:20:15.2461319Z mid=0.0118
2026-02-21T08:20:15.2461485Z max=0.0408
2026-02-21T08:20:15.2461672Z best={'block_sizes': [2, 64],
2026-02-21T08:20:15.2462010Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:20:15.2462395Z  'load_eviction_policies': ['first', ''],
2026-02-21T08:20:15.2462655Z  'num_stages': 5,
2026-02-21T08:20:15.2462860Z  'num_warps': 1,
2026-02-21T08:20:15.2463077Z  'pid_type': 'flat',
2026-02-21T08:20:15.2463297Z  'range_flattens': [None, False],
2026-02-21T08:20:15.2463552Z  'range_multi_buffers': [None, False],
2026-02-21T08:20:15.2464350Z  'range_num_stages': [0, 4],
2026-02-21T08:20:15.2464591Z  'range_unroll_factors': [0, 3],
2026-02-21T08:20:15.2464838Z  'range_warp_specializes': []}
2026-02-21T08:20:15.2482783Z [96s] Fitting surrogate: 194 points, 194 targets
2026-02-21T08:20:16.5929595Z [98s] Generation 2 starting: 84 neighbors, 5 active search path(s)
2026-02-21T08:20:25.0921358Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 16.0 configs/s
2026-02-21T08:20:30.6607150Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 15.7 configs/s
2026-02-21T08:20:38.5195239Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 134.0         
2026-02-21T08:20:38.5199545Z                                                                   configs/s     
2026-02-21T08:20:39.2806135Z [120s] Generation 2 complete: 
2026-02-21T08:20:39.2806936Z ok=90
2026-02-21T08:20:39.2807129Z min=0.0078
2026-02-21T08:20:39.2807304Z mid=0.0094
2026-02-21T08:20:39.2807483Z max=0.0187
2026-02-21T08:20:39.2807668Z best={'block_sizes': [32, 256],
2026-02-21T08:20:39.2807996Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:20:39.2808338Z  'load_eviction_policies': ['', 'first'],
2026-02-21T08:20:39.2808637Z  'num_stages': 1,
2026-02-21T08:20:39.2808837Z  'num_warps': 32,
2026-02-21T08:20:39.2809038Z  'pid_type': 'flat',
2026-02-21T08:20:39.2809263Z  'range_flattens': [None, None],
2026-02-21T08:20:39.2809518Z  'range_multi_buffers': [None, None],
2026-02-21T08:20:39.2809889Z  'range_num_stages': [0, 0],
2026-02-21T08:20:39.2810148Z  'range_unroll_factors': [0, 0],
2026-02-21T08:20:39.2810409Z  'range_warp_specializes': []}
2026-02-21T08:20:39.2826500Z [120s] Fitting surrogate: 284 points, 284 targets
2026-02-21T08:20:40.4714318Z [122s] Generation 3 starting: 69 neighbors, 5 active search path(s)
2026-02-21T08:20:47.5386859Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 38.0 configs/s
2026-02-21T08:20:52.7902183Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 13.6 configs/s
2026-02-21T08:20:58.0293657Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 194.7         
2026-02-21T08:20:58.0294541Z                                                                   configs/s     
2026-02-21T08:20:58.5577354Z [140s] Generation 3 complete: 
2026-02-21T08:20:58.5577627Z ok=74
2026-02-21T08:20:58.5577810Z min=0.0072
2026-02-21T08:20:58.5577983Z mid=0.0092
2026-02-21T08:20:58.5578162Z max=0.0239
2026-02-21T08:20:58.5578360Z best={'block_sizes': [32, 256],
2026-02-21T08:20:58.5578704Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:20:58.5579072Z  'load_eviction_policies': ['', ''],
2026-02-21T08:20:58.5579323Z  'num_stages': 1,
2026-02-21T08:20:58.5579519Z  'num_warps': 32,
2026-02-21T08:20:58.5579710Z  'pid_type': 'flat',
2026-02-21T08:20:58.5579919Z  'range_flattens': [None, None],
2026-02-21T08:20:58.5580199Z  'range_multi_buffers': [None, False],
2026-02-21T08:20:58.5580464Z  'range_num_stages': [0, 0],
2026-02-21T08:20:58.5580693Z  'range_unroll_factors': [0, 4],
2026-02-21T08:20:58.5580951Z  'range_warp_specializes': []}
2026-02-21T08:20:58.5604227Z [140s] Fitting surrogate: 358 points, 358 targets
2026-02-21T08:20:59.5342167Z [141s] Generation 4 starting: 60 neighbors, 5 active search path(s)
2026-02-21T08:21:06.1509275Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 36.4 configs/s
2026-02-21T08:21:10.3554805Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 14.9 configs/s
2026-02-21T08:21:16.0595943Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 178.8         
2026-02-21T08:21:16.0596495Z                                                                   configs/s     
2026-02-21T08:21:16.6516372Z [158s] Generation 4 complete: 
2026-02-21T08:21:16.6516821Z ok=65
2026-02-21T08:21:16.6517130Z min=0.0073
2026-02-21T08:21:16.6517445Z mid=0.0083
2026-02-21T08:21:16.6517720Z max=0.0405
2026-02-21T08:21:16.6518015Z best={'block_sizes': [32, 256],
2026-02-21T08:21:16.6518489Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:21:16.7107090Z  'load_eviction_policies': ['', ''],
2026-02-21T08:21:16.7107358Z  'num_stages': 1,
2026-02-21T08:21:16.7107558Z  'num_warps': 32,
2026-02-21T08:21:16.7107766Z  'pid_type': 'flat',
2026-02-21T08:21:16.7107984Z  'range_flattens': [None, None],
2026-02-21T08:21:16.7108237Z  'range_multi_buffers': [None, False],
2026-02-21T08:21:16.7108510Z  'range_num_stages': [0, 0],
2026-02-21T08:21:16.7108742Z  'range_unroll_factors': [0, 3],
2026-02-21T08:21:16.7108986Z  'range_warp_specializes': []}
2026-02-21T08:21:16.7109263Z [158s] Fitting surrogate: 423 points, 423 targets
2026-02-21T08:21:17.6785096Z [159s] Generation 5 starting: 61 neighbors, 5 active search path(s)
2026-02-21T08:21:23.8894880Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 28.9 configs/s
2026-02-21T08:21:28.8477365Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 12.6 configs/s
2026-02-21T08:21:34.9238233Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 167.9         
2026-02-21T08:21:34.9238885Z                                                                   configs/s     
2026-02-21T08:21:35.5439351Z [177s] Generation 5 complete: 
2026-02-21T08:21:35.5439594Z ok=66
2026-02-21T08:21:35.5439766Z min=0.0074
2026-02-21T08:21:35.5439928Z mid=0.0080
2026-02-21T08:21:35.5440090Z max=0.0133
2026-02-21T08:21:35.5440273Z best={'block_sizes': [32, 256],
2026-02-21T08:21:35.5440561Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:21:35.5440858Z  'load_eviction_policies': ['', ''],
2026-02-21T08:21:35.5441094Z  'num_stages': 2,
2026-02-21T08:21:35.5441277Z  'num_warps': 32,
2026-02-21T08:21:35.5441455Z  'pid_type': 'flat',
2026-02-21T08:21:35.5441669Z  'range_flattens': [None, None],
2026-02-21T08:21:35.5441910Z  'range_multi_buffers': [None, False],
2026-02-21T08:21:35.5442178Z  'range_num_stages': [0, 0],
2026-02-21T08:21:35.5442400Z  'range_unroll_factors': [0, 3],
2026-02-21T08:21:35.5442637Z  'range_warp_specializes': []}
2026-02-21T08:21:35.5454874Z [177s] Fitting surrogate: 489 points, 489 targets
2026-02-21T08:21:36.6146428Z [178s] Generation 6 starting: 62 neighbors, 5 active search path(s)
2026-02-21T08:21:45.0602081Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 21.6 configs/s
2026-02-21T08:21:49.8960194Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 12.9 configs/s
2026-02-21T08:21:56.3523267Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 158.1         
2026-02-21T08:21:56.3523776Z                                                                   configs/s     
2026-02-21T08:21:57.0104777Z [198s] Generation 6 complete: 
2026-02-21T08:21:57.0105036Z ok=67
2026-02-21T08:21:57.0105202Z min=0.0073
2026-02-21T08:21:57.0105376Z mid=0.0078
2026-02-21T08:21:57.0105537Z max=0.0102
2026-02-21T08:21:57.0105749Z best={'block_sizes': [32, 256],
2026-02-21T08:21:57.0106028Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:21:57.0106349Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:21:57.0106638Z  'num_stages': 2,
2026-02-21T08:21:57.0106830Z  'num_warps': 32,
2026-02-21T08:21:57.0107026Z  'pid_type': 'flat',
2026-02-21T08:21:57.0107238Z  'range_flattens': [None, None],
2026-02-21T08:21:57.0107493Z  'range_multi_buffers': [None, False],
2026-02-21T08:21:57.0107749Z  'range_num_stages': [0, 0],
2026-02-21T08:21:57.0107986Z  'range_unroll_factors': [0, 0],
2026-02-21T08:21:57.0108225Z  'range_warp_specializes': []}
2026-02-21T08:21:57.0136980Z [198s] Fitting surrogate: 556 points, 556 targets
2026-02-21T08:21:57.9419159Z [199s] Generation 7 starting: 53 neighbors, 5 active search path(s)
2026-02-21T08:22:03.3715151Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 25.9 configs/s
2026-02-21T08:22:07.5954943Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 12.6 configs/s
2026-02-21T08:22:12.7938773Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 196.3         
2026-02-21T08:22:12.7939320Z                                                                   configs/s     
2026-02-21T08:22:13.3225787Z [214s] Generation 7 complete: 
2026-02-21T08:22:13.3226074Z ok=58
2026-02-21T08:22:13.3226248Z min=0.0070
2026-02-21T08:22:13.3226433Z mid=0.0078
2026-02-21T08:22:13.3226595Z max=0.0146
2026-02-21T08:22:13.3226779Z best={'block_sizes': [32, 256],
2026-02-21T08:22:13.3227056Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:22:13.3227384Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:22:13.3227655Z  'num_stages': 2,
2026-02-21T08:22:13.3227854Z  'num_warps': 32,
2026-02-21T08:22:13.3228050Z  'pid_type': 'flat',
2026-02-21T08:22:13.3228262Z  'range_flattens': [None, None],
2026-02-21T08:22:13.3228520Z  'range_multi_buffers': [None, False],
2026-02-21T08:22:13.3228781Z  'range_num_stages': [0, 0],
2026-02-21T08:22:13.3229521Z  'range_unroll_factors': [0, 0],
2026-02-21T08:22:13.3229791Z  'range_warp_specializes': []}
2026-02-21T08:22:13.3254810Z [214s] Fitting surrogate: 614 points, 614 targets
2026-02-21T08:22:14.0809560Z [215s] Generation 8 starting: 44 neighbors, 3 active search path(s)
2026-02-21T08:22:18.6135081Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 26.9 configs/s
2026-02-21T08:22:21.4913485Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 15.5 configs/s
2026-02-21T08:22:26.0981136Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 235.3         
2026-02-21T08:22:26.0981628Z                                                                   configs/s     
2026-02-21T08:22:26.5397831Z [228s] Generation 8 complete: 
2026-02-21T08:22:26.5398311Z ok=48
2026-02-21T08:22:26.5398620Z min=0.0072
2026-02-21T08:22:26.5398911Z mid=0.0079
2026-02-21T08:22:26.5399180Z max=0.0106
2026-02-21T08:22:26.5399488Z best={'block_sizes': [32, 256],
2026-02-21T08:22:26.5400020Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:22:26.5400575Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:22:26.5400959Z  'num_stages': 2,
2026-02-21T08:22:26.5401163Z  'num_warps': 32,
2026-02-21T08:22:26.5401425Z  'pid_type': 'flat',
2026-02-21T08:22:26.5401663Z  'range_flattens': [None, None],
2026-02-21T08:22:26.5401939Z  'range_multi_buffers': [None, False],
2026-02-21T08:22:26.5402214Z  'range_num_stages': [0, 0],
2026-02-21T08:22:26.5402461Z  'range_unroll_factors': [0, 0],
2026-02-21T08:22:26.5402712Z  'range_warp_specializes': []}
2026-02-21T08:22:26.5426240Z [228s] Fitting surrogate: 662 points, 662 targets
2026-02-21T08:22:27.3132058Z [228s] Generation 9 starting: 43 neighbors, 3 active search path(s)
2026-02-21T08:22:31.6027845Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 35.1 configs/s
2026-02-21T08:22:34.2881502Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 16.3 configs/s
2026-02-21T08:22:38.3204763Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 252.7         
2026-02-21T08:22:38.3205317Z                                                                   configs/s     
2026-02-21T08:22:38.7380194Z [240s] Generation 9 complete: 
2026-02-21T08:22:38.7380978Z ok=47
2026-02-21T08:22:38.7381162Z min=0.0071
2026-02-21T08:22:38.7381330Z mid=0.0078
2026-02-21T08:22:38.7381507Z max=0.0143
2026-02-21T08:22:38.7381688Z best={'block_sizes': [32, 256],
2026-02-21T08:22:38.7381969Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:22:38.7382285Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:22:38.7382563Z  'num_stages': 2,
2026-02-21T08:22:38.7382751Z  'num_warps': 32,
2026-02-21T08:22:38.7382946Z  'pid_type': 'flat',
2026-02-21T08:22:38.7383178Z  'range_flattens': [None, None],
2026-02-21T08:22:38.7383426Z  'range_multi_buffers': [None, False],
2026-02-21T08:22:38.7383692Z  'range_num_stages': [0, 0],
2026-02-21T08:22:38.7383925Z  'range_unroll_factors': [0, 0],
2026-02-21T08:22:38.7384515Z  'range_warp_specializes': []}
2026-02-21T08:22:38.7412940Z [240s] Fitting surrogate: 709 points, 709 targets
2026-02-21T08:22:39.5143807Z [241s] Generation 10 starting: 45 neighbors, 3 active search path(s)
2026-02-21T08:22:45.1047837Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 25.5 configs/s
2026-02-21T08:22:49.0141020Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 46/46 11.8 configs/s
2026-02-21T08:22:53.1615578Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 245.8         
2026-02-21T08:22:53.1616091Z                                                                   configs/s     
2026-02-21T08:22:53.5878617Z [255s] Generation 10 complete: 
2026-02-21T08:22:53.5879126Z ok=49
2026-02-21T08:22:53.5879451Z min=0.0072
2026-02-21T08:22:53.5879729Z mid=0.0082
2026-02-21T08:22:53.5879885Z max=0.0155
2026-02-21T08:22:53.5880064Z best={'block_sizes': [32, 256],
2026-02-21T08:22:53.5880331Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:22:53.5880667Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:22:53.5880936Z  'num_stages': 2,
2026-02-21T08:22:53.5881119Z  'num_warps': 32,
2026-02-21T08:22:53.5881298Z  'pid_type': 'flat',
2026-02-21T08:22:53.5881516Z  'range_flattens': [None, None],
2026-02-21T08:22:53.5881766Z  'range_multi_buffers': [None, False],
2026-02-21T08:22:53.5882033Z  'range_num_stages': [0, 0],
2026-02-21T08:22:53.5882258Z  'range_unroll_factors': [0, 0],
2026-02-21T08:22:53.5882485Z  'range_warp_specializes': []}
2026-02-21T08:22:53.5913086Z [255s] Fitting surrogate: 758 points, 758 targets
2026-02-21T08:22:54.3608707Z [255s] Generation 11 starting: 44 neighbors, 3 active search path(s)
2026-02-21T08:22:58.9206781Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 18.9 configs/s
2026-02-21T08:23:01.8772268Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 45/45 15.4 configs/s
2026-02-21T08:23:06.0117517Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 265.1         
2026-02-21T08:23:06.0118129Z                                                                   configs/s     
2026-02-21T08:23:06.4078003Z [268s] Generation 11 complete: 
2026-02-21T08:23:06.4078316Z ok=48
2026-02-21T08:23:06.4078510Z min=0.0073
2026-02-21T08:23:06.4078687Z mid=0.0081
2026-02-21T08:23:06.4078842Z max=0.0144
2026-02-21T08:23:06.4079021Z best={'block_sizes': [32, 256],
2026-02-21T08:23:06.4079297Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:23:06.4079597Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:23:06.4079852Z  'num_stages': 2,
2026-02-21T08:23:06.4080028Z  'num_warps': 32,
2026-02-21T08:23:06.4080213Z  'pid_type': 'flat',
2026-02-21T08:23:06.4080410Z  'range_flattens': [None, None],
2026-02-21T08:23:06.4080665Z  'range_multi_buffers': [None, False],
2026-02-21T08:23:06.4080913Z  'range_num_stages': [0, 0],
2026-02-21T08:23:06.4081140Z  'range_unroll_factors': [0, 0],
2026-02-21T08:23:06.4081379Z  'range_warp_specializes': []}
2026-02-21T08:23:06.4109401Z [268s] Fitting surrogate: 806 points, 806 targets
2026-02-21T08:23:06.9979977Z [268s] Generation 12 starting: 30 neighbors, 2 active search path(s)
2026-02-21T08:23:10.6729017Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 17.4 configs/s
2026-02-21T08:23:12.8909549Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 13.7 configs/s
2026-02-21T08:23:15.9493523Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 333.0         
2026-02-21T08:23:15.9494389Z                                                                   configs/s     
2026-02-21T08:23:16.2611353Z [277s] Generation 12 complete: 
2026-02-21T08:23:16.2611653Z ok=33
2026-02-21T08:23:16.2611839Z min=0.0071
2026-02-21T08:23:16.2612012Z mid=0.0076
2026-02-21T08:23:16.2612206Z max=0.0108
2026-02-21T08:23:16.2612389Z best={'block_sizes': [32, 256],
2026-02-21T08:23:16.2612684Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:23:16.2613017Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:23:16.2613299Z  'num_stages': 2,
2026-02-21T08:23:16.2614210Z  'num_warps': 32,
2026-02-21T08:23:16.2614492Z  'pid_type': 'flat',
2026-02-21T08:23:16.2614765Z  'range_flattens': [None, None],
2026-02-21T08:23:16.2615067Z  'range_multi_buffers': [None, False],
2026-02-21T08:23:16.2615350Z  'range_num_stages': [0, 0],
2026-02-21T08:23:16.2615585Z  'range_unroll_factors': [0, 0],
2026-02-21T08:23:16.2615834Z  'range_warp_specializes': []}
2026-02-21T08:23:16.2647303Z [277s] Fitting surrogate: 839 points, 839 targets
2026-02-21T08:23:16.8815636Z [278s] Generation 13 starting: 32 neighbors, 2 active search path(s)
2026-02-21T08:23:20.2085280Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 40.4 configs/s
2026-02-21T08:23:23.2002933Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 11.1 configs/s
2026-02-21T08:23:26.4756142Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 342.7         
2026-02-21T08:23:26.4756666Z                                                                   configs/s     
2026-02-21T08:23:26.7906608Z [288s] Generation 13 complete: 
2026-02-21T08:23:26.7906900Z ok=35
2026-02-21T08:23:26.7907075Z min=0.0073
2026-02-21T08:23:26.7907245Z mid=0.0080
2026-02-21T08:23:26.7907437Z max=0.0147
2026-02-21T08:23:26.7907614Z best={'block_sizes': [32, 256],
2026-02-21T08:23:26.7907899Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:23:26.7908218Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:23:26.7908487Z  'num_stages': 2,
2026-02-21T08:23:26.7908683Z  'num_warps': 32,
2026-02-21T08:23:26.7908866Z  'pid_type': 'flat',
2026-02-21T08:23:26.7909081Z  'range_flattens': [None, None],
2026-02-21T08:23:26.7909328Z  'range_multi_buffers': [None, False],
2026-02-21T08:23:26.7909591Z  'range_num_stages': [0, 0],
2026-02-21T08:23:26.7909842Z  'range_unroll_factors': [0, 0],
2026-02-21T08:23:26.7910089Z  'range_warp_specializes': []}
2026-02-21T08:23:26.7939159Z [288s] Fitting surrogate: 874 points, 874 targets
2026-02-21T08:23:27.4611486Z [289s] Generation 14 starting: 36 neighbors, 2 active search path(s)
2026-02-21T08:23:32.4709289Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 17.9 configs/s
2026-02-21T08:23:34.7545152Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 36/36 16.0 configs/s
2026-02-21T08:23:38.1147421Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 304.2         
2026-02-21T08:23:38.1147932Z                                                                   configs/s     
2026-02-21T08:23:38.4689238Z [300s] Generation 14 complete: 
2026-02-21T08:23:38.4689536Z ok=39
2026-02-21T08:23:38.4689745Z min=0.0073
2026-02-21T08:23:38.4690018Z mid=0.0079
2026-02-21T08:23:38.4690206Z max=0.0138
2026-02-21T08:23:38.4690393Z best={'block_sizes': [32, 256],
2026-02-21T08:23:38.4690688Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:23:38.4691017Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:23:38.4691289Z  'num_stages': 2,
2026-02-21T08:23:38.4691488Z  'num_warps': 32,
2026-02-21T08:23:38.4691722Z  'pid_type': 'flat',
2026-02-21T08:23:38.4691949Z  'range_flattens': [None, None],
2026-02-21T08:23:38.4692207Z  'range_multi_buffers': [None, False],
2026-02-21T08:23:38.4692480Z  'range_num_stages': [0, 0],
2026-02-21T08:23:38.4693541Z  'range_unroll_factors': [0, 0],
2026-02-21T08:23:38.4693799Z  'range_warp_specializes': []}
2026-02-21T08:23:38.4728765Z [300s] Fitting surrogate: 913 points, 913 targets
2026-02-21T08:23:38.8764365Z [300s] Generation 15 starting: 18 neighbors, 1 active search path(s)
2026-02-21T08:23:41.6245123Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 10.4 configs/s
2026-02-21T08:23:43.8820118Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 7.9 configs/s
2026-02-21T08:23:45.7935530Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 534.4         
2026-02-21T08:23:45.7936045Z                                                                   configs/s     
2026-02-21T08:23:46.0014660Z [307s] Generation 15 complete: 
2026-02-21T08:23:46.0015610Z ok=20
2026-02-21T08:23:46.0015837Z min=0.0070
2026-02-21T08:23:46.0016008Z mid=0.0079
2026-02-21T08:23:46.0016175Z max=0.0094
2026-02-21T08:23:46.0016352Z best={'block_sizes': [32, 256],
2026-02-21T08:23:46.0016651Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:23:46.0016967Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:23:46.0017236Z  'num_stages': 2,
2026-02-21T08:23:46.0017427Z  'num_warps': 32,
2026-02-21T08:23:46.0017611Z  'pid_type': 'flat',
2026-02-21T08:23:46.0017822Z  'range_flattens': [None, None],
2026-02-21T08:23:46.0018066Z  'range_multi_buffers': [None, False],
2026-02-21T08:23:46.0018322Z  'range_num_stages': [0, 0],
2026-02-21T08:23:46.0018546Z  'range_unroll_factors': [0, 0],
2026-02-21T08:23:46.0018791Z  'range_warp_specializes': []}
2026-02-21T08:23:46.0052744Z [307s] Fitting surrogate: 933 points, 933 targets
2026-02-21T08:23:46.4026061Z [308s] Generation 16 starting: 18 neighbors, 1 active search path(s)
2026-02-21T08:23:49.8963185Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 7.7 configs/s
2026-02-21T08:23:51.3437239Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 12.6 configs/s
2026-02-21T08:23:53.1605167Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 562.6         
2026-02-21T08:23:53.1605716Z                                                                   configs/s     
2026-02-21T08:23:53.3606979Z [314s] Generation 16 complete: 
2026-02-21T08:23:53.3607445Z ok=20
2026-02-21T08:23:53.3607735Z min=0.0072
2026-02-21T08:23:53.3608016Z mid=0.0079
2026-02-21T08:23:53.3608303Z max=0.0101
2026-02-21T08:23:53.3608618Z best={'block_sizes': [32, 256],
2026-02-21T08:23:53.3609117Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:23:53.3609668Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:23:53.3610252Z  'num_stages': 2,
2026-02-21T08:23:53.3610607Z  'num_warps': 32,
2026-02-21T08:23:53.3610956Z  'pid_type': 'flat',
2026-02-21T08:23:53.3611321Z  'range_flattens': [None, None],
2026-02-21T08:23:53.3611558Z  'range_multi_buffers': [None, False],
2026-02-21T08:23:53.3611809Z  'range_num_stages': [0, 0],
2026-02-21T08:23:53.3612027Z  'range_unroll_factors': [0, 0],
2026-02-21T08:23:53.3612834Z  'range_warp_specializes': []}
2026-02-21T08:23:53.3645399Z [314s] Fitting surrogate: 953 points, 953 targets
2026-02-21T08:23:54.1007216Z [315s] Generation 17 starting: 19 neighbors, 1 active search path(s)
2026-02-21T08:23:57.7280220Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 7.9 configs/s
2026-02-21T08:23:58.9075221Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.7 configs/s
2026-02-21T08:24:00.7140570Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 563.8         
2026-02-21T08:24:00.7141059Z                                                                   configs/s     
2026-02-21T08:24:00.9024836Z [322s] Generation 17 complete: 
2026-02-21T08:24:00.9025090Z ok=21
2026-02-21T08:24:00.9025253Z min=0.0070
2026-02-21T08:24:00.9025890Z mid=0.0076
2026-02-21T08:24:00.9026107Z max=0.0108
2026-02-21T08:24:00.9026346Z best={'block_sizes': [32, 256],
2026-02-21T08:24:00.9026684Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:24:00.9027092Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:24:00.9027374Z  'num_stages': 2,
2026-02-21T08:24:00.9027575Z  'num_warps': 32,
2026-02-21T08:24:00.9027771Z  'pid_type': 'flat',
2026-02-21T08:24:00.9028008Z  'range_flattens': [None, None],
2026-02-21T08:24:00.9028293Z  'range_multi_buffers': [None, False],
2026-02-21T08:24:00.9028570Z  'range_num_stages': [0, 0],
2026-02-21T08:24:00.9028829Z  'range_unroll_factors': [0, 0],
2026-02-21T08:24:00.9029087Z  'range_warp_specializes': []}
2026-02-21T08:24:00.9063551Z [322s] Fitting surrogate: 974 points, 974 targets
2026-02-21T08:24:01.2370194Z [322s] Generation 18 starting: 14 neighbors, 1 active search path(s)
2026-02-21T08:24:04.7958386Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 6.9 configs/s
2026-02-21T08:24:06.3201537Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 14/14 9.1 configs/s
2026-02-21T08:24:07.7473829Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 716.0         
2026-02-21T08:24:07.7474628Z                                                                   configs/s     
2026-02-21T08:24:07.9034461Z [329s] Generation 18 complete: 
2026-02-21T08:24:07.9034921Z ok=16
2026-02-21T08:24:07.9035219Z min=0.0073
2026-02-21T08:24:07.9035515Z mid=0.0076
2026-02-21T08:24:07.9035784Z max=0.0106
2026-02-21T08:24:07.9036093Z best={'block_sizes': [32, 256],
2026-02-21T08:24:07.9036567Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:24:07.9037110Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:24:07.9037563Z  'num_stages': 2,
2026-02-21T08:24:07.9037881Z  'num_warps': 32,
2026-02-21T08:24:07.9038190Z  'pid_type': 'flat',
2026-02-21T08:24:07.9038578Z  'range_flattens': [None, None],
2026-02-21T08:24:07.9038993Z  'range_multi_buffers': [None, False],
2026-02-21T08:24:07.9039459Z  'range_num_stages': [0, 0],
2026-02-21T08:24:07.9039846Z  'range_unroll_factors': [0, 0],
2026-02-21T08:24:07.9040244Z  'range_warp_specializes': []}
2026-02-21T08:24:07.9076759Z [329s] Fitting surrogate: 990 points, 990 targets
2026-02-21T08:24:08.0738006Z [329s] Autotuning complete in 329.7s after searching 933 configs.
2026-02-21T08:24:08.0738531Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:24:08.0740007Z     @helion.kernel(config=helion.Config(block_sizes=[32, 256], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'last'], num_stages=2, num_warps=32, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 0], range_warp_specializes=[]), static_shapes=True)
2026-02-21T08:24:08.0741397Z 
2026-02-21T08:24:08.0741803Z [329s] Code of selected kernel: /tmp/torchinductor_root/ky/ckyexbwyqofhs3eug2ufohoqnvufdv2b7uosvrf4ge6my7sl6vie.py
2026-02-21T08:24:09.0017419Z WARNING:tritonbench.utils.triton_op:Completed input ID 0:
2026-02-21T08:24:09.0018001Z (M, N)
2026-02-21T08:24:09.0018305Z -----------
2026-02-21T08:24:09.0018592Z (4096, 256)
2026-02-21T08:24:09.0019341Z 
2026-02-21T08:24:09.0032603Z   5%|▌         | 1/20 [05:38<1:47:17, 338.81s/it]WARNING:tritonbench.utils.triton_op:Running input ID 5:
2026-02-21T08:24:09.0033022Z (M, N)
2026-02-21T08:24:09.0033181Z -----------
2026-02-21T08:24:09.0033339Z (4096, 896)
2026-02-21T08:24:09.0035675Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T08:24:10.8210973Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T08:24:13.4847491Z INFO:tritonbench.utils.triton_op:Took 3.31ms to get benchmark function for torch_compile_softmax
2026-02-21T08:24:17.5343504Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:24:17.5343863Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:24:17.5344934Z               'dtype': 'torch.float16',
2026-02-21T08:24:17.5345220Z               'shape': (4096, 896),
2026-02-21T08:24:17.5345460Z               'stride': (896, 1)},),
2026-02-21T08:24:17.5345704Z   'kwargs': {}}
2026-02-21T08:24:17.5381326Z INFO:tritonbench.utils.triton_op:Took 4.23ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T08:24:17.8261123Z [0s] Autotune random seed: 2135383793
2026-02-21T08:24:18.2976542Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:24:53.2930019Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:24:54.2704855Z [35s] Timeout after 30s compiling Config(block_sizes=[128, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=4, num_warps=8, pid_type='persistent_interleaved', range_flattens=[None, False], range_multi_buffers=[False, True], range_num_stages=[1, 4], range_unroll_factors=[3, 4], range_warp_specializes=[])
2026-02-21T08:24:54.6231852Z [36s] Timeout after 30s compiling Config(block_sizes=[1024, 16], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', ''], maxnreg=256, num_sm_multiplier=128, num_stages=4, num_warps=4, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[False, False], range_num_stages=[1, 4], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T08:24:54.8836311Z [36s] Timeout after 30s compiling Config(block_sizes=[2048, 128], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', ''], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T08:24:55.5328248Z [37s] Timeout after 30s compiling Config(block_sizes=[2048, 16], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'last'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:24:55.5348248Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 3.3 configs/s
2026-02-21T08:25:03.8893487Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.0 configs/s
2026-02-21T08:25:03.8907795Z [45s] Adaptive compile timeout: 30s (90% percentile=13.7s, bounds=[30.0s, 30s])
2026-02-21T08:25:04.9142540Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 992.4 configs/s
2026-02-21T08:25:05.0294356Z [46s] Initial random population of 100, 5 starting points: 
2026-02-21T08:25:05.0294776Z error=4
2026-02-21T08:25:05.0294963Z timeout=5
2026-02-21T08:25:05.0295133Z ok=91
2026-02-21T08:25:05.0295307Z min=0.0123
2026-02-21T08:25:05.0295476Z mid=0.1118
2026-02-21T08:25:05.0296264Z max=3.8326
2026-02-21T08:25:05.0296454Z best={'block_sizes': [2, 512],
2026-02-21T08:25:05.0296791Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:25:05.0297164Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:25:05.0297456Z  'num_stages': 5,
2026-02-21T08:25:05.0297656Z  'num_warps': 1,
2026-02-21T08:25:05.0297847Z  'pid_type': 'flat',
2026-02-21T08:25:05.0298072Z  'range_flattens': [None, True],
2026-02-21T08:25:05.0298341Z  'range_multi_buffers': [None, None],
2026-02-21T08:25:05.0298613Z  'range_num_stages': [0, 0],
2026-02-21T08:25:05.0298852Z  'range_unroll_factors': [0, 2],
2026-02-21T08:25:05.0299107Z  'range_warp_specializes': []}
2026-02-21T08:25:05.0313060Z [46s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:25:06.7438437Z [48s] Generation 1 starting: 86 neighbors, 5 active search path(s)
2026-02-21T08:25:18.0788664Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 17.4 configs/s
2026-02-21T08:25:24.3186642Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 14.5 configs/s
2026-02-21T08:25:29.2898043Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 204.7         
2026-02-21T08:25:29.2898518Z                                                                   configs/s     
2026-02-21T08:25:29.7719504Z [71s] Generation 1 complete: 
2026-02-21T08:25:29.7719938Z ok=91
2026-02-21T08:25:29.7720222Z min=0.0102
2026-02-21T08:25:29.7720505Z mid=0.0147
2026-02-21T08:25:29.7720760Z max=0.1103
2026-02-21T08:25:29.7721078Z best={'block_sizes': [2, 1024],
2026-02-21T08:25:29.7721597Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:25:29.7722161Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:25:29.7722624Z  'num_stages': 5,
2026-02-21T08:25:29.7722932Z  'num_warps': 2,
2026-02-21T08:25:29.7723285Z  'pid_type': 'flat',
2026-02-21T08:25:29.7723638Z  'range_flattens': [None, True],
2026-02-21T08:25:29.7724462Z  'range_multi_buffers': [None, None],
2026-02-21T08:25:29.7724948Z  'range_num_stages': [0, 1],
2026-02-21T08:25:29.7725339Z  'range_unroll_factors': [0, 2],
2026-02-21T08:25:29.7725742Z  'range_warp_specializes': []}
2026-02-21T08:25:29.7739781Z [71s] Fitting surrogate: 191 points, 191 targets
2026-02-21T08:25:30.7752605Z [72s] Generation 2 starting: 64 neighbors, 5 active search path(s)
2026-02-21T08:25:42.7227813Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 6.1 configs/s
2026-02-21T08:25:48.4905474Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 11.8 configs/s
2026-02-21T08:25:54.6199726Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 166.0         
2026-02-21T08:25:54.6200269Z                                                                   configs/s     
2026-02-21T08:25:55.2179218Z [96s] Generation 2 complete: 
2026-02-21T08:25:55.2179492Z ok=70
2026-02-21T08:25:55.2179669Z min=0.0099
2026-02-21T08:25:55.2179839Z mid=0.0123
2026-02-21T08:25:55.2180011Z max=0.0995
2026-02-21T08:25:55.2180217Z best={'block_sizes': [1, 1024],
2026-02-21T08:25:55.2180581Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:25:55.2180991Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:25:55.2181267Z  'num_stages': 5,
2026-02-21T08:25:55.2181463Z  'num_warps': 2,
2026-02-21T08:25:55.2181663Z  'pid_type': 'flat',
2026-02-21T08:25:55.2181885Z  'range_flattens': [None, True],
2026-02-21T08:25:55.2182136Z  'range_multi_buffers': [None, None],
2026-02-21T08:25:55.2182416Z  'range_num_stages': [0, 1],
2026-02-21T08:25:55.2182657Z  'range_unroll_factors': [0, 2],
2026-02-21T08:25:55.2182900Z  'range_warp_specializes': []}
2026-02-21T08:25:55.2198722Z [96s] Fitting surrogate: 261 points, 261 targets
2026-02-21T08:25:56.1334845Z [97s] Generation 3 starting: 59 neighbors, 5 active search path(s)
2026-02-21T08:26:04.4252042Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 14.3 configs/s
2026-02-21T08:26:08.9383561Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 14.1 configs/s
2026-02-21T08:26:14.1238121Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 196.3         
2026-02-21T08:26:14.1238685Z                                                                   configs/s     
2026-02-21T08:26:14.6352075Z [116s] Generation 3 complete: 
2026-02-21T08:26:14.6352405Z ok=65
2026-02-21T08:26:14.6352619Z min=0.0099
2026-02-21T08:26:14.6352807Z mid=0.0111
2026-02-21T08:26:14.6352977Z max=0.0532
2026-02-21T08:26:14.6353173Z best={'block_sizes': [1, 1024],
2026-02-21T08:26:14.6353537Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:26:14.6353947Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:26:14.6354733Z  'num_stages': 5,
2026-02-21T08:26:14.6354930Z  'num_warps': 2,
2026-02-21T08:26:14.8234245Z  'pid_type': 'flat',
2026-02-21T08:26:14.8234646Z  'range_flattens': [None, True],
2026-02-21T08:26:14.8234939Z  'range_multi_buffers': [None, None],
2026-02-21T08:26:14.8235222Z  'range_num_stages': [0, 1],
2026-02-21T08:26:14.8235496Z  'range_unroll_factors': [0, 1],
2026-02-21T08:26:14.8235753Z  'range_warp_specializes': []}
2026-02-21T08:26:14.8236078Z [116s] Fitting surrogate: 326 points, 326 targets
2026-02-21T08:26:15.4820429Z [117s] Generation 4 starting: 54 neighbors, 5 active search path(s)
2026-02-21T08:26:22.0047436Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 29.7 configs/s
2026-02-21T08:26:27.3158845Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 10.8 configs/s
2026-02-21T08:26:32.6895725Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 201.0         
2026-02-21T08:26:32.6896231Z                                                                   configs/s     
2026-02-21T08:26:33.1887862Z [134s] Generation 4 complete: 
2026-02-21T08:26:33.1888133Z ok=59
2026-02-21T08:26:33.1888336Z min=0.0098
2026-02-21T08:26:33.1888512Z mid=0.0104
2026-02-21T08:26:33.1888682Z max=0.0328
2026-02-21T08:26:33.1888870Z best={'block_sizes': [1, 1024],
2026-02-21T08:26:33.1889258Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:26:33.1889669Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:26:33.1890007Z  'num_stages': 5,
2026-02-21T08:26:33.1890231Z  'num_warps': 1,
2026-02-21T08:26:33.1890436Z  'pid_type': 'flat',
2026-02-21T08:26:33.1890667Z  'range_flattens': [None, True],
2026-02-21T08:26:33.1890926Z  'range_multi_buffers': [None, False],
2026-02-21T08:26:33.1891202Z  'range_num_stages': [0, 1],
2026-02-21T08:26:33.1891464Z  'range_unroll_factors': [0, 1],
2026-02-21T08:26:33.1891752Z  'range_warp_specializes': []}
2026-02-21T08:26:33.1911918Z [134s] Fitting surrogate: 385 points, 385 targets
2026-02-21T08:26:34.0416474Z [135s] Generation 5 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:26:40.0964892Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 14.1 configs/s
2026-02-21T08:26:44.5125758Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 12.1 configs/s
2026-02-21T08:26:49.8906489Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 201.2         
2026-02-21T08:26:49.8907987Z                                                                   configs/s     
2026-02-21T08:26:50.3895114Z [152s] Generation 5 complete: 
2026-02-21T08:26:50.3895395Z ok=57
2026-02-21T08:26:50.3895571Z min=0.0097
2026-02-21T08:26:50.3895753Z mid=0.0101
2026-02-21T08:26:50.3895922Z max=0.0597
2026-02-21T08:26:50.3896121Z best={'block_sizes': [1, 1024],
2026-02-21T08:26:50.3896451Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:26:50.3896788Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:26:50.3897076Z  'num_stages': 6,
2026-02-21T08:26:50.3897272Z  'num_warps': 1,
2026-02-21T08:26:50.3897477Z  'pid_type': 'flat',
2026-02-21T08:26:50.3897717Z  'range_flattens': [None, True],
2026-02-21T08:26:50.3897990Z  'range_multi_buffers': [None, None],
2026-02-21T08:26:50.3898269Z  'range_num_stages': [0, 1],
2026-02-21T08:26:50.3898516Z  'range_unroll_factors': [0, 4],
2026-02-21T08:26:50.3899206Z  'range_warp_specializes': []}
2026-02-21T08:26:50.3920559Z [152s] Fitting surrogate: 442 points, 442 targets
2026-02-21T08:26:51.1370835Z [152s] Generation 6 starting: 46 neighbors, 5 active search path(s)
2026-02-21T08:26:56.2658023Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 15.1 configs/s
2026-02-21T08:27:00.3027460Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 12.2 configs/s
2026-02-21T08:27:04.1701110Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 262.9         
2026-02-21T08:27:04.1701636Z                                                                   configs/s     
2026-02-21T08:27:04.5545330Z [166s] Generation 6 complete: 
2026-02-21T08:27:04.5545585Z ok=51
2026-02-21T08:27:04.5545748Z min=0.0097
2026-02-21T08:27:04.5937291Z mid=0.0105
2026-02-21T08:27:04.5937525Z max=0.1254
2026-02-21T08:27:04.5937729Z best={'block_sizes': [1, 1024],
2026-02-21T08:27:04.5938066Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:27:04.5938463Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:27:04.5938755Z  'num_stages': 5,
2026-02-21T08:27:04.5938966Z  'num_warps': 1,
2026-02-21T08:27:04.5939164Z  'pid_type': 'flat',
2026-02-21T08:27:04.5939396Z  'range_flattens': [None, True],
2026-02-21T08:27:04.5939660Z  'range_multi_buffers': [None, False],
2026-02-21T08:27:04.5939939Z  'range_num_stages': [0, 2],
2026-02-21T08:27:04.5940193Z  'range_unroll_factors': [0, 1],
2026-02-21T08:27:04.5940445Z  'range_warp_specializes': []}
2026-02-21T08:27:04.5940734Z [166s] Fitting surrogate: 493 points, 493 targets
2026-02-21T08:27:05.2465425Z [166s] Generation 7 starting: 41 neighbors, 4 active search path(s)
2026-02-21T08:27:10.7106534Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 10.1 configs/s
2026-02-21T08:27:13.6215423Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 15.1 configs/s
2026-02-21T08:27:17.5330555Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 284.0         
2026-02-21T08:27:17.5331826Z                                                                   configs/s     
2026-02-21T08:27:17.8923523Z [179s] Generation 7 complete: 
2026-02-21T08:27:17.8923785Z ok=45
2026-02-21T08:27:17.8923958Z min=0.0095
2026-02-21T08:27:17.8924316Z mid=0.0107
2026-02-21T08:27:17.8924491Z max=0.0332
2026-02-21T08:27:17.8924680Z best={'block_sizes': [1, 1024],
2026-02-21T08:27:17.8925015Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:27:17.8925383Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:27:17.8925655Z  'num_stages': 7,
2026-02-21T08:27:17.8925853Z  'num_warps': 1,
2026-02-21T08:27:17.8926063Z  'pid_type': 'flat',
2026-02-21T08:27:17.8926278Z  'range_flattens': [None, True],
2026-02-21T08:27:17.8926572Z  'range_multi_buffers': [None, None],
2026-02-21T08:27:17.8926852Z  'range_num_stages': [0, 1],
2026-02-21T08:27:17.8927119Z  'range_unroll_factors': [0, 4],
2026-02-21T08:27:17.8927372Z  'range_warp_specializes': []}
2026-02-21T08:27:17.8951153Z [179s] Fitting surrogate: 538 points, 538 targets
2026-02-21T08:27:18.5090761Z [180s] Generation 8 starting: 36 neighbors, 3 active search path(s)
2026-02-21T08:27:23.9679988Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 13.2 configs/s
2026-02-21T08:27:26.3918291Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 39/39 16.4 configs/s
2026-02-21T08:27:29.3760074Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 339.2         
2026-02-21T08:27:29.3760604Z                                                                   configs/s     
2026-02-21T08:27:29.6978043Z [191s] Generation 8 complete: 
2026-02-21T08:27:29.6978330Z ok=40
2026-02-21T08:27:29.6978505Z min=0.0096
2026-02-21T08:27:29.6978691Z mid=0.0124
2026-02-21T08:27:29.6978857Z max=0.0264
2026-02-21T08:27:29.6979615Z best={'block_sizes': [1, 1024],
2026-02-21T08:27:29.6979965Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:27:29.6980330Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:27:29.6980665Z  'num_stages': 7,
2026-02-21T08:27:29.6980914Z  'num_warps': 1,
2026-02-21T08:27:29.6981140Z  'pid_type': 'flat',
2026-02-21T08:27:29.6981356Z  'range_flattens': [None, True],
2026-02-21T08:27:29.6981610Z  'range_multi_buffers': [None, None],
2026-02-21T08:27:29.6981867Z  'range_num_stages': [0, 2],
2026-02-21T08:27:29.6982104Z  'range_unroll_factors': [0, 4],
2026-02-21T08:27:29.6982348Z  'range_warp_specializes': []}
2026-02-21T08:27:29.7008869Z [191s] Fitting surrogate: 578 points, 578 targets
2026-02-21T08:27:30.2946302Z [191s] Generation 9 starting: 34 neighbors, 3 active search path(s)
2026-02-21T08:27:33.2224741Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 24.8 configs/s
2026-02-21T08:27:35.4264713Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 35/35 16.2 configs/s
2026-02-21T08:27:38.5138265Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 328.2         
2026-02-21T08:27:38.5138759Z                                                                   configs/s     
2026-02-21T08:27:38.8259521Z [200s] Generation 9 complete: 
2026-02-21T08:27:38.8259784Z ok=37
2026-02-21T08:27:38.8259948Z min=0.0098
2026-02-21T08:27:38.8260132Z mid=0.0118
2026-02-21T08:27:38.8260293Z max=0.0709
2026-02-21T08:27:38.8260475Z best={'block_sizes': [1, 1024],
2026-02-21T08:27:38.8260777Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:27:38.8261115Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:27:38.8261386Z  'num_stages': 7,
2026-02-21T08:27:38.8261571Z  'num_warps': 1,
2026-02-21T08:27:38.8261762Z  'pid_type': 'flat',
2026-02-21T08:27:38.8261974Z  'range_flattens': [None, True],
2026-02-21T08:27:38.8262228Z  'range_multi_buffers': [None, None],
2026-02-21T08:27:38.8262499Z  'range_num_stages': [0, 2],
2026-02-21T08:27:38.8262745Z  'range_unroll_factors': [0, 4],
2026-02-21T08:27:38.8262993Z  'range_warp_specializes': []}
2026-02-21T08:27:38.8293491Z [200s] Fitting surrogate: 615 points, 615 targets
2026-02-21T08:27:39.3258238Z [201s] Generation 10 starting: 27 neighbors, 3 active search path(s)
2026-02-21T08:27:42.5892514Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 8.2 configs/s
2026-02-21T08:27:44.3474288Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 28/28 16.3 configs/s
2026-02-21T08:27:47.2229338Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 352.5         
2026-02-21T08:27:47.2229865Z                                                                   configs/s     
2026-02-21T08:27:47.5175915Z [209s] Generation 10 complete: 
2026-02-21T08:27:47.5176184Z ok=31
2026-02-21T08:27:47.5176376Z min=0.0097
2026-02-21T08:27:47.5176556Z mid=0.0105
2026-02-21T08:27:47.5176731Z max=0.0235
2026-02-21T08:27:47.5176914Z best={'block_sizes': [1, 1024],
2026-02-21T08:27:47.5177236Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:27:47.5177563Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:27:47.5177858Z  'num_stages': 7,
2026-02-21T08:27:47.5178514Z  'num_warps': 1,
2026-02-21T08:27:47.5178721Z  'pid_type': 'flat',
2026-02-21T08:27:47.5178956Z  'range_flattens': [None, None],
2026-02-21T08:27:47.5179216Z  'range_multi_buffers': [None, None],
2026-02-21T08:27:47.5179497Z  'range_num_stages': [0, 2],
2026-02-21T08:27:47.5179739Z  'range_unroll_factors': [0, 4],
2026-02-21T08:27:47.5179999Z  'range_warp_specializes': []}
2026-02-21T08:27:47.5209006Z [209s] Fitting surrogate: 646 points, 646 targets
2026-02-21T08:27:47.9675670Z [209s] Generation 11 starting: 22 neighbors, 2 active search path(s)
2026-02-21T08:27:49.8949323Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 22.9 configs/s
2026-02-21T08:27:51.2730755Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 16.5 configs/s
2026-02-21T08:27:53.6303613Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 429.7         
2026-02-21T08:27:53.6304481Z                                                                   configs/s     
2026-02-21T08:27:53.8757527Z [215s] Generation 11 complete: 
2026-02-21T08:27:53.8757989Z ok=24
2026-02-21T08:27:53.8758293Z min=0.0096
2026-02-21T08:27:53.8758591Z mid=0.0100
2026-02-21T08:27:53.8758859Z max=0.0135
2026-02-21T08:27:53.8759159Z best={'block_sizes': [1, 1024],
2026-02-21T08:27:53.8759627Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:27:53.8775394Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:27:53.8775744Z  'num_stages': 7,
2026-02-21T08:27:53.8775967Z  'num_warps': 1,
2026-02-21T08:27:53.8776178Z  'pid_type': 'flat',
2026-02-21T08:27:53.8776420Z  'range_flattens': [None, None],
2026-02-21T08:27:53.8776698Z  'range_multi_buffers': [None, None],
2026-02-21T08:27:53.8776988Z  'range_num_stages': [0, 1],
2026-02-21T08:27:53.8777240Z  'range_unroll_factors': [0, 4],
2026-02-21T08:27:53.8777522Z  'range_warp_specializes': []}
2026-02-21T08:27:53.8789834Z [215s] Fitting surrogate: 670 points, 670 targets
2026-02-21T08:27:54.3201909Z [216s] Generation 12 starting: 21 neighbors, 2 active search path(s)
2026-02-21T08:27:56.1739232Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 27.5 configs/s
2026-02-21T08:27:57.4761304Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 16.7 configs/s
2026-02-21T08:27:59.5351523Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 491.6         
2026-02-21T08:27:59.5352120Z                                                                   configs/s     
2026-02-21T08:27:59.7522449Z [221s] Generation 12 complete: 
2026-02-21T08:27:59.7522864Z ok=23
2026-02-21T08:27:59.7523142Z min=0.0098
2026-02-21T08:27:59.7523424Z mid=0.0100
2026-02-21T08:27:59.7523708Z max=0.0176
2026-02-21T08:27:59.7524518Z best={'block_sizes': [1, 1024],
2026-02-21T08:27:59.7525088Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:27:59.7525696Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:27:59.7526143Z  'num_stages': 7,
2026-02-21T08:27:59.7526465Z  'num_warps': 1,
2026-02-21T08:27:59.7526816Z  'pid_type': 'flat',
2026-02-21T08:27:59.7527199Z  'range_flattens': [None, None],
2026-02-21T08:27:59.7527631Z  'range_multi_buffers': [None, None],
2026-02-21T08:27:59.7528060Z  'range_num_stages': [0, 1],
2026-02-21T08:27:59.7528447Z  'range_unroll_factors': [0, 4],
2026-02-21T08:27:59.7528862Z  'range_warp_specializes': []}
2026-02-21T08:27:59.7556453Z [221s] Fitting surrogate: 693 points, 693 targets
2026-02-21T08:28:00.1613584Z [221s] Generation 13 starting: 18 neighbors, 2 active search path(s)
2026-02-21T08:28:02.1525436Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 26.0 configs/s
2026-02-21T08:28:03.2668070Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 16.8 configs/s
2026-02-21T08:28:05.0335333Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 570.5         
2026-02-21T08:28:05.0335893Z                                                                   configs/s     
2026-02-21T08:28:05.2213450Z [226s] Generation 13 complete: 
2026-02-21T08:28:05.2214906Z ok=20
2026-02-21T08:28:05.2215197Z min=0.0098
2026-02-21T08:28:05.2215526Z mid=0.0104
2026-02-21T08:28:05.2215854Z max=0.0172
2026-02-21T08:28:05.2216206Z best={'block_sizes': [1, 1024],
2026-02-21T08:28:05.2216577Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:28:05.2216970Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:28:05.2217244Z  'num_stages': 7,
2026-02-21T08:28:05.2217438Z  'num_warps': 1,
2026-02-21T08:28:05.2217628Z  'pid_type': 'flat',
2026-02-21T08:28:05.2217849Z  'range_flattens': [None, None],
2026-02-21T08:28:05.2218099Z  'range_multi_buffers': [None, None],
2026-02-21T08:28:05.2218363Z  'range_num_stages': [0, 1],
2026-02-21T08:28:05.2218596Z  'range_unroll_factors': [0, 4],
2026-02-21T08:28:05.2219120Z  'range_warp_specializes': []}
2026-02-21T08:28:05.2246433Z [226s] Fitting surrogate: 713 points, 713 targets
2026-02-21T08:28:05.6354760Z [227s] Generation 14 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:28:07.6296889Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 4.5 configs/s
2026-02-21T08:28:08.8442132Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.1 configs/s
2026-02-21T08:28:10.9019819Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 492.4         
2026-02-21T08:28:10.9020677Z                                                                   configs/s     
2026-02-21T08:28:11.1163847Z [232s] Generation 14 complete: 
2026-02-21T08:28:11.1164537Z ok=22
2026-02-21T08:28:11.1164829Z min=0.0096
2026-02-21T08:28:11.1165119Z mid=0.0098
2026-02-21T08:28:11.1165385Z max=0.0172
2026-02-21T08:28:11.1165687Z best={'block_sizes': [1, 1024],
2026-02-21T08:28:11.1166271Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:28:11.1166945Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:28:11.1167397Z  'num_stages': 7,
2026-02-21T08:28:11.1167709Z  'num_warps': 1,
2026-02-21T08:28:11.1168050Z  'pid_type': 'flat',
2026-02-21T08:28:11.1168440Z  'range_flattens': [None, None],
2026-02-21T08:28:11.1168887Z  'range_multi_buffers': [None, None],
2026-02-21T08:28:11.1169328Z  'range_num_stages': [0, 2],
2026-02-21T08:28:11.1169764Z  'range_unroll_factors': [0, 4],
2026-02-21T08:28:11.1170356Z  'range_warp_specializes': []}
2026-02-21T08:28:11.1197626Z [232s] Fitting surrogate: 735 points, 735 targets
2026-02-21T08:28:11.5454938Z [233s] Generation 15 starting: 19 neighbors, 2 active search path(s)
2026-02-21T08:28:13.2738963Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 17.0 configs/s
2026-02-21T08:28:14.4402150Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.9 configs/s
2026-02-21T08:28:16.5004781Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 490.6         
2026-02-21T08:28:16.5005349Z                                                                   configs/s     
2026-02-21T08:28:16.7182516Z [238s] Generation 15 complete: 
2026-02-21T08:28:16.7182750Z ok=21
2026-02-21T08:28:16.7183439Z min=0.0096
2026-02-21T08:28:16.7183638Z mid=0.0099
2026-02-21T08:28:16.7183842Z max=0.0135
2026-02-21T08:28:16.7184591Z best={'block_sizes': [1, 1024],
2026-02-21T08:28:16.7184981Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:28:16.7185386Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:28:16.7185681Z  'num_stages': 7,
2026-02-21T08:28:16.7185894Z  'num_warps': 1,
2026-02-21T08:28:16.7186096Z  'pid_type': 'flat',
2026-02-21T08:28:16.7186325Z  'range_flattens': [None, None],
2026-02-21T08:28:16.7186589Z  'range_multi_buffers': [None, None],
2026-02-21T08:28:16.7186867Z  'range_num_stages': [0, 2],
2026-02-21T08:28:16.7187139Z  'range_unroll_factors': [0, 4],
2026-02-21T08:28:16.7187403Z  'range_warp_specializes': []}
2026-02-21T08:28:16.7217951Z [238s] Fitting surrogate: 756 points, 756 targets
2026-02-21T08:28:16.9591475Z [238s] Generation 16 starting: 5 neighbors, 1 active search path(s)
2026-02-21T08:28:17.7691036Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5/5 14.6 configs/s
2026-02-21T08:28:18.0927856Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 5/5 18.1 configs/s
2026-02-21T08:28:18.7655913Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 1476.8        
2026-02-21T08:28:18.7656402Z                                                                   configs/s     
2026-02-21T08:28:18.8519493Z [240s] Generation 16 complete: 
2026-02-21T08:28:18.8519956Z ok=7
2026-02-21T08:28:18.8520243Z min=0.0096
2026-02-21T08:28:18.8520534Z mid=0.0096
2026-02-21T08:28:18.8520806Z max=0.0133
2026-02-21T08:28:18.8521108Z best={'block_sizes': [1, 1024],
2026-02-21T08:28:18.8521664Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:28:18.8522319Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:28:18.8522763Z  'num_stages': 3,
2026-02-21T08:28:18.8523089Z  'num_warps': 1,
2026-02-21T08:28:18.8523408Z  'pid_type': 'flat',
2026-02-21T08:28:18.8523752Z  'range_flattens': [None, True],
2026-02-21T08:28:18.8524691Z  'range_multi_buffers': [None, None],
2026-02-21T08:28:18.8525206Z  'range_num_stages': [0, 4],
2026-02-21T08:28:18.8525679Z  'range_unroll_factors': [0, 1],
2026-02-21T08:28:18.8525962Z  'range_warp_specializes': []}
2026-02-21T08:28:18.8554694Z [240s] Fitting surrogate: 763 points, 763 targets
2026-02-21T08:28:19.1338797Z [240s] Generation 17 starting: 8 neighbors, 1 active search path(s)
2026-02-21T08:28:20.0635133Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 19.2 configs/s
2026-02-21T08:28:20.5720176Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 17.2 configs/s
2026-02-21T08:28:21.4383178Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 1148.3        
2026-02-21T08:28:21.4383735Z                                                                   configs/s     
2026-02-21T08:28:21.5422452Z [243s] Generation 17 complete: 
2026-02-21T08:28:21.5422715Z ok=9
2026-02-21T08:28:21.5422879Z min=0.0096
2026-02-21T08:28:21.5423080Z mid=0.0096
2026-02-21T08:28:21.5423246Z max=0.0103
2026-02-21T08:28:21.5423444Z best={'block_sizes': [1, 1024],
2026-02-21T08:28:21.5423780Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:28:21.5424417Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T08:28:21.5424686Z  'num_stages': 3,
2026-02-21T08:28:21.5424880Z  'num_warps': 1,
2026-02-21T08:28:21.5425067Z  'pid_type': 'flat',
2026-02-21T08:28:21.5425285Z  'range_flattens': [None, True],
2026-02-21T08:28:21.5425540Z  'range_multi_buffers': [None, None],
2026-02-21T08:28:21.5425797Z  'range_num_stages': [0, 4],
2026-02-21T08:28:21.5426037Z  'range_unroll_factors': [0, 1],
2026-02-21T08:28:21.5426275Z  'range_warp_specializes': []}
2026-02-21T08:28:21.5459362Z [243s] Fitting surrogate: 772 points, 772 targets
2026-02-21T08:28:21.6980295Z [243s] Autotuning complete in 243.4s after searching 733 configs.
2026-02-21T08:28:21.6980790Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:28:21.6982752Z     @helion.kernel(config=helion.Config(block_sizes=[1, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'last'], num_stages=3, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 4], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T08:28:21.6984438Z 
2026-02-21T08:28:21.6984863Z [243s] Code of selected kernel: /tmp/torchinductor_root/jw/cjwuwso2gnisqk5vqgqp4msecw6kqs2ge2at4f3v3dqk7y6msqzb.py
2026-02-21T08:28:22.5975809Z WARNING:tritonbench.utils.triton_op:Completed input ID 5:
2026-02-21T08:28:22.5976428Z (M, N)
2026-02-21T08:28:22.5976713Z -----------
2026-02-21T08:28:22.5976996Z (4096, 896)
2026-02-21T08:28:22.5977168Z 
2026-02-21T08:28:22.5988612Z  10%|█         | 2/20 [09:52<1:26:36, 288.68s/it]WARNING:tritonbench.utils.triton_op:Running input ID 10:
2026-02-21T08:28:22.5989055Z (M, N)
2026-02-21T08:28:22.5989208Z ------------
2026-02-21T08:28:22.5989387Z (4096, 1536)
2026-02-21T08:28:22.5991240Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T08:28:24.3185113Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T08:28:26.0969983Z INFO:tritonbench.utils.triton_op:Took 3.24ms to get benchmark function for torch_compile_softmax
2026-02-21T08:28:29.5963808Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:28:29.5964802Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:28:29.5965251Z               'dtype': 'torch.float16',
2026-02-21T08:28:29.5965686Z               'shape': (4096, 1536),
2026-02-21T08:28:29.5966122Z               'stride': (1536, 1)},),
2026-02-21T08:28:29.5966530Z   'kwargs': {}}
2026-02-21T08:28:29.5999577Z INFO:tritonbench.utils.triton_op:Took 3.90ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T08:28:29.8852190Z [0s] Autotune random seed: 2135383793
2026-02-21T08:28:30.0652675Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:29:04.4581453Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:29:07.5939427Z [37s] Timeout after 30s compiling Config(block_sizes=[1024, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', ''], maxnreg=64, num_sm_multiplier=4, num_stages=8, num_warps=16, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T08:29:08.0661242Z [38s] Timeout after 30s compiling Config(block_sizes=[1024, 128], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'last'], num_sm_multiplier=16, num_stages=5, num_warps=32, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[4, 4], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T08:29:08.0684780Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T08:29:14.0833206Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.7 configs/s
2026-02-21T08:29:14.0847006Z [44s] Adaptive compile timeout: 30s (90% percentile=4.9s, bounds=[30.0s, 30s])
2026-02-21T08:29:15.5356681Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 696.0 configs/s
2026-02-21T08:29:15.6810781Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T08:29:15.6811136Z error=2
2026-02-21T08:29:15.6811308Z timeout=3
2026-02-21T08:29:15.6811469Z ok=95
2026-02-21T08:29:15.6811632Z min=0.0207
2026-02-21T08:29:15.6812326Z mid=0.1676
2026-02-21T08:29:15.6812492Z max=6.5601
2026-02-21T08:29:15.6812672Z best={'block_sizes': [2, 128],
2026-02-21T08:29:15.6813010Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:29:15.6813386Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:29:15.6813656Z  'num_sm_multiplier': 128,
2026-02-21T08:29:15.6813872Z  'num_stages': 8,
2026-02-21T08:29:15.6814348Z  'num_warps': 2,
2026-02-21T08:29:15.6814562Z  'pid_type': 'persistent_interleaved',
2026-02-21T08:29:15.6814832Z  'range_flattens': [None, None],
2026-02-21T08:29:15.6815091Z  'range_multi_buffers': [False, None],
2026-02-21T08:29:15.6815353Z  'range_num_stages': [4, 2],
2026-02-21T08:29:15.6815588Z  'range_unroll_factors': [2, 2],
2026-02-21T08:29:15.6815828Z  'range_warp_specializes': []}
2026-02-21T08:29:15.6829491Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:29:17.3314557Z [47s] Generation 1 starting: 102 neighbors, 5 active search path(s)
2026-02-21T08:29:30.6725087Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 105/105 3.8 configs/s
2026-02-21T08:29:37.2492914Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━ 105/105 16.1 configs/s
2026-02-21T08:29:44.0862196Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 157.3         
2026-02-21T08:29:44.0862701Z                                                                   configs/s     
2026-02-21T08:29:44.6770957Z [74s] Generation 1 complete: 
2026-02-21T08:29:44.6771375Z ok=108
2026-02-21T08:29:44.6771643Z min=0.0164
2026-02-21T08:29:44.6771916Z mid=0.0236
2026-02-21T08:29:44.6772157Z max=0.1072
2026-02-21T08:29:44.6772432Z best={'block_sizes': [4, 512],
2026-02-21T08:29:44.6772917Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:29:44.6773501Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:29:44.6773908Z  'num_stages': 2,
2026-02-21T08:29:44.6774505Z  'num_warps': 4,
2026-02-21T08:29:44.6774858Z  'pid_type': 'flat',
2026-02-21T08:29:44.6775204Z  'range_flattens': [None, True],
2026-02-21T08:29:44.6775458Z  'range_multi_buffers': [None, None],
2026-02-21T08:29:44.6775724Z  'range_num_stages': [0, 4],
2026-02-21T08:29:44.6775956Z  'range_unroll_factors': [0, 3],
2026-02-21T08:29:44.6776197Z  'range_warp_specializes': []}
2026-02-21T08:29:44.6791874Z [74s] Fitting surrogate: 208 points, 208 targets
2026-02-21T08:29:46.2814942Z [76s] Generation 2 starting: 90 neighbors, 5 active search path(s)
2026-02-21T08:29:55.4979248Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 9.3 configs/s
2026-02-21T08:30:01.3170697Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 16.1 configs/s
2026-02-21T08:30:11.2282606Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.8         
2026-02-21T08:30:11.2283158Z                                                                   configs/s     
2026-02-21T08:30:12.0911856Z [102s] Generation 2 complete: 
2026-02-21T08:30:12.0912179Z ok=95
2026-02-21T08:30:12.0912359Z min=0.0156
2026-02-21T08:30:12.0912583Z mid=0.0189
2026-02-21T08:30:12.0912748Z max=0.0516
2026-02-21T08:30:12.0912945Z best={'block_sizes': [4, 512],
2026-02-21T08:30:12.0913298Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:30:12.0913694Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:30:12.0914373Z  'maxnreg': 128,
2026-02-21T08:30:12.0914609Z  'num_sm_multiplier': 8,
2026-02-21T08:30:12.0914834Z  'num_stages': 5,
2026-02-21T08:30:12.0915031Z  'num_warps': 1,
2026-02-21T08:30:12.0915256Z  'pid_type': 'persistent_interleaved',
2026-02-21T08:30:12.0915554Z  'range_flattens': [False, True],
2026-02-21T08:30:12.0915817Z  'range_multi_buffers': [True, None],
2026-02-21T08:30:12.0916086Z  'range_num_stages': [3, 3],
2026-02-21T08:30:12.0916330Z  'range_unroll_factors': [0, 0],
2026-02-21T08:30:12.0916592Z  'range_warp_specializes': []}
2026-02-21T08:30:12.0936176Z [102s] Fitting surrogate: 303 points, 303 targets
2026-02-21T08:30:13.4295137Z [103s] Generation 3 starting: 84 neighbors, 5 active search path(s)
2026-02-21T08:30:22.0872185Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 8.1 configs/s
2026-02-21T08:30:27.4603321Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.1 configs/s
2026-02-21T08:30:34.9249676Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 143.3         
2026-02-21T08:30:34.9255009Z                                                                   configs/s     
2026-02-21T08:30:35.5863219Z [125s] Generation 3 complete: 
2026-02-21T08:30:35.5863499Z ok=89
2026-02-21T08:30:35.5863678Z min=0.0154
2026-02-21T08:30:35.5863862Z mid=0.0175
2026-02-21T08:30:35.5864405Z max=0.4799
2026-02-21T08:30:35.5864610Z best={'block_sizes': [2, 512],
2026-02-21T08:30:35.5865446Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:30:35.5865852Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:30:35.5866142Z  'num_stages': 2,
2026-02-21T08:30:35.5866352Z  'num_warps': 1,
2026-02-21T08:30:35.5866578Z  'pid_type': 'flat',
2026-02-21T08:30:35.5866818Z  'range_flattens': [None, True],
2026-02-21T08:30:35.5867099Z  'range_multi_buffers': [None, None],
2026-02-21T08:30:35.5867378Z  'range_num_stages': [0, 4],
2026-02-21T08:30:35.5867642Z  'range_unroll_factors': [0, 4],
2026-02-21T08:30:35.5867915Z  'range_warp_specializes': []}
2026-02-21T08:30:35.5891434Z [125s] Fitting surrogate: 392 points, 392 targets
2026-02-21T08:30:36.7695868Z [126s] Generation 4 starting: 72 neighbors, 5 active search path(s)
2026-02-21T08:30:43.8892600Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73/73 6.8 configs/s
2026-02-21T08:30:48.4384971Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 73/73 16.2 configs/s
2026-02-21T08:30:55.7356217Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 146.9         
2026-02-21T08:30:55.7356745Z                                                                   configs/s     
2026-02-21T08:30:56.3795152Z [146s] Generation 4 complete: 
2026-02-21T08:30:56.3795523Z ok=77
2026-02-21T08:30:56.3795709Z min=0.0135
2026-02-21T08:30:56.3795892Z mid=0.0162
2026-02-21T08:30:56.3796061Z max=0.0436
2026-02-21T08:30:56.3796254Z best={'block_sizes': [2, 2048],
2026-02-21T08:30:56.3796576Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:30:56.3796972Z  'load_eviction_policies': ['', ''],
2026-02-21T08:30:56.3797247Z  'num_stages': 2,
2026-02-21T08:30:56.3797444Z  'num_warps': 1,
2026-02-21T08:30:56.3797651Z  'pid_type': 'flat',
2026-02-21T08:30:56.3797874Z  'range_flattens': [None, True],
2026-02-21T08:30:56.3798144Z  'range_multi_buffers': [None, None],
2026-02-21T08:30:56.3798420Z  'range_num_stages': [0, 4],
2026-02-21T08:30:56.3798668Z  'range_unroll_factors': [0, 4],
2026-02-21T08:30:56.3798935Z  'range_warp_specializes': []}
2026-02-21T08:30:56.3821610Z [146s] Fitting surrogate: 469 points, 469 targets
2026-02-21T08:30:57.2849655Z [147s] Generation 5 starting: 55 neighbors, 4 active search path(s)
2026-02-21T08:31:03.3512883Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 7.9 configs/s
2026-02-21T08:31:06.8480285Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 16.2 configs/s
2026-02-21T08:31:12.2600103Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 187.5         
2026-02-21T08:31:12.2600669Z                                                                   configs/s     
2026-02-21T08:31:12.7762507Z [162s] Generation 5 complete: 
2026-02-21T08:31:12.7762826Z ok=59
2026-02-21T08:31:12.7763027Z min=0.0126
2026-02-21T08:31:12.7763217Z mid=0.0158
2026-02-21T08:31:12.7763390Z max=0.0728
2026-02-21T08:31:12.7763586Z best={'block_sizes': [1, 2048],
2026-02-21T08:31:12.7763916Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:31:12.7764707Z  'load_eviction_policies': ['', ''],
2026-02-21T08:31:12.7765606Z  'num_stages': 2,
2026-02-21T08:31:12.7765922Z  'num_warps': 1,
2026-02-21T08:31:12.7766175Z  'pid_type': 'flat',
2026-02-21T08:31:12.7766428Z  'range_flattens': [None, True],
2026-02-21T08:31:12.7766763Z  'range_multi_buffers': [None, None],
2026-02-21T08:31:12.7767068Z  'range_num_stages': [0, 3],
2026-02-21T08:31:12.7767347Z  'range_unroll_factors': [0, 4],
2026-02-21T08:31:12.7767637Z  'range_warp_specializes': []}
2026-02-21T08:31:12.7795847Z [162s] Fitting surrogate: 528 points, 528 targets
2026-02-21T08:31:13.6899990Z [163s] Generation 6 starting: 52 neighbors, 4 active search path(s)
2026-02-21T08:31:18.8579349Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 15.0 configs/s
2026-02-21T08:31:22.5756587Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 14.4 configs/s
2026-02-21T08:31:27.3341623Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 213.5         
2026-02-21T08:31:27.3342182Z                                                                   configs/s     
2026-02-21T08:31:27.7830840Z [177s] Generation 6 complete: 
2026-02-21T08:31:27.7831163Z ok=56
2026-02-21T08:31:27.7831352Z min=0.0125
2026-02-21T08:31:27.7831575Z mid=0.0150
2026-02-21T08:31:27.7831753Z max=0.0365
2026-02-21T08:31:27.7831970Z best={'block_sizes': [1, 2048],
2026-02-21T08:31:27.7832302Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:31:27.7832670Z  'load_eviction_policies': ['', ''],
2026-02-21T08:31:27.7832933Z  'num_stages': 2,
2026-02-21T08:31:27.7833140Z  'num_warps': 1,
2026-02-21T08:31:27.7833336Z  'pid_type': 'flat',
2026-02-21T08:31:27.7833568Z  'range_flattens': [None, True],
2026-02-21T08:31:27.7833823Z  'range_multi_buffers': [None, None],
2026-02-21T08:31:27.7834520Z  'range_num_stages': [0, 3],
2026-02-21T08:31:27.7834761Z  'range_unroll_factors': [0, 4],
2026-02-21T08:31:27.7835017Z  'range_warp_specializes': []}
2026-02-21T08:31:27.7861755Z [177s] Fitting surrogate: 584 points, 584 targets
2026-02-21T08:31:28.5704516Z [178s] Generation 7 starting: 46 neighbors, 4 active search path(s)
2026-02-21T08:31:33.1991757Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 23.3 configs/s
2026-02-21T08:31:36.1535172Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.1 configs/s
2026-02-21T08:31:40.3863537Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 239.9         
2026-02-21T08:31:40.3864384Z                                                                   configs/s     
2026-02-21T08:31:40.7968986Z [190s] Generation 7 complete: 
2026-02-21T08:31:40.7969291Z ok=51
2026-02-21T08:31:40.7969481Z min=0.0124
2026-02-21T08:31:40.7969664Z mid=0.0150
2026-02-21T08:31:40.7969843Z max=0.0297
2026-02-21T08:31:40.7970035Z best={'block_sizes': [1, 2048],
2026-02-21T08:31:40.7970520Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:31:40.7970960Z  'load_eviction_policies': ['', ''],
2026-02-21T08:31:40.7971215Z  'num_stages': 7,
2026-02-21T08:31:40.7971458Z  'num_warps': 1,
2026-02-21T08:31:40.7971652Z  'pid_type': 'flat',
2026-02-21T08:31:40.7971879Z  'range_flattens': [None, None],
2026-02-21T08:31:40.7972133Z  'range_multi_buffers': [None, False],
2026-02-21T08:31:40.7973086Z  'range_num_stages': [0, 3],
2026-02-21T08:31:40.7973322Z  'range_unroll_factors': [0, 2],
2026-02-21T08:31:40.7973604Z  'range_warp_specializes': []}
2026-02-21T08:31:40.8005222Z [190s] Fitting surrogate: 635 points, 635 targets
2026-02-21T08:31:41.5951125Z [191s] Generation 8 starting: 47 neighbors, 4 active search path(s)
2026-02-21T08:31:46.8568850Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 17.0 configs/s
2026-02-21T08:31:49.9318489Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.2 configs/s
2026-02-21T08:31:53.8365605Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 259.9         
2026-02-21T08:31:53.8366052Z                                                                   configs/s     
2026-02-21T08:31:54.2137460Z [204s] Generation 8 complete: 
2026-02-21T08:31:54.2137735Z ok=51
2026-02-21T08:31:54.2137902Z min=0.0125
2026-02-21T08:31:54.2138079Z mid=0.0146
2026-02-21T08:31:54.2138245Z max=0.0958
2026-02-21T08:31:54.2138452Z best={'block_sizes': [1, 2048],
2026-02-21T08:31:54.2138826Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:31:54.2139232Z  'load_eviction_policies': ['', ''],
2026-02-21T08:31:54.2139489Z  'num_stages': 7,
2026-02-21T08:31:54.2139673Z  'num_warps': 1,
2026-02-21T08:31:54.2139864Z  'pid_type': 'flat',
2026-02-21T08:31:54.2140070Z  'range_flattens': [None, None],
2026-02-21T08:31:54.2140335Z  'range_multi_buffers': [None, False],
2026-02-21T08:31:54.2140595Z  'range_num_stages': [0, 3],
2026-02-21T08:31:54.2140826Z  'range_unroll_factors': [0, 2],
2026-02-21T08:31:54.2141071Z  'range_warp_specializes': []}
2026-02-21T08:31:54.2177590Z [204s] Fitting surrogate: 686 points, 686 targets
2026-02-21T08:31:54.9845702Z [204s] Generation 9 starting: 45 neighbors, 4 active search path(s)
2026-02-21T08:32:00.5126385Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 6.1 configs/s
2026-02-21T08:32:03.5167705Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.2 configs/s
2026-02-21T08:32:07.6250196Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 246.9         
2026-02-21T08:32:07.6250731Z                                                                   configs/s     
2026-02-21T08:32:08.0220543Z [217s] Generation 9 complete: 
2026-02-21T08:32:08.0220796Z ok=50
2026-02-21T08:32:08.0220969Z min=0.0124
2026-02-21T08:32:08.0221137Z mid=0.0143
2026-02-21T08:32:08.0221304Z max=0.0538
2026-02-21T08:32:08.0221482Z best={'block_sizes': [1, 2048],
2026-02-21T08:32:08.0221872Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:32:08.0222284Z  'load_eviction_policies': ['', ''],
2026-02-21T08:32:08.0222544Z  'num_stages': 2,
2026-02-21T08:32:08.0222730Z  'num_warps': 1,
2026-02-21T08:32:08.0222951Z  'pid_type': 'flat',
2026-02-21T08:32:08.0223161Z  'range_flattens': [None, True],
2026-02-21T08:32:08.0223419Z  'range_multi_buffers': [None, False],
2026-02-21T08:32:08.0223695Z  'range_num_stages': [0, 4],
2026-02-21T08:32:08.0223925Z  'range_unroll_factors': [0, 3],
2026-02-21T08:32:08.0224542Z  'range_warp_specializes': []}
2026-02-21T08:32:08.0262461Z [217s] Fitting surrogate: 736 points, 736 targets
2026-02-21T08:32:08.7582890Z [218s] Generation 10 starting: 44 neighbors, 4 active search path(s)
2026-02-21T08:32:14.0398243Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 14.8 configs/s
2026-02-21T08:32:17.0572185Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 48/48 16.1 configs/s
2026-02-21T08:32:21.8666440Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 211.2         
2026-02-21T08:32:21.8666968Z                                                                   configs/s     
2026-02-21T08:32:22.3301468Z [232s] Generation 10 complete: 
2026-02-21T08:32:22.3301729Z ok=49
2026-02-21T08:32:22.3301911Z min=0.0127
2026-02-21T08:32:22.3302083Z mid=0.0135
2026-02-21T08:32:22.3302246Z max=0.0211
2026-02-21T08:32:22.3302813Z best={'block_sizes': [1, 2048],
2026-02-21T08:32:22.3303195Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:32:22.3303601Z  'load_eviction_policies': ['', ''],
2026-02-21T08:32:22.3303857Z  'num_stages': 2,
2026-02-21T08:32:22.3304280Z  'num_warps': 1,
2026-02-21T08:32:22.3304523Z  'pid_type': 'flat',
2026-02-21T08:32:22.3304800Z  'range_flattens': [None, True],
2026-02-21T08:32:22.3305091Z  'range_multi_buffers': [None, False],
2026-02-21T08:32:22.3305367Z  'range_num_stages': [0, 4],
2026-02-21T08:32:22.3305619Z  'range_unroll_factors': [0, 3],
2026-02-21T08:32:22.3305874Z  'range_warp_specializes': []}
2026-02-21T08:32:22.3342325Z [232s] Fitting surrogate: 785 points, 785 targets
2026-02-21T08:32:22.8616684Z [232s] Generation 11 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:32:26.5254508Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 9.6 configs/s
2026-02-21T08:32:28.4577248Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.4 configs/s
2026-02-21T08:32:31.7237041Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 310.3         
2026-02-21T08:32:31.7237507Z                                                                   configs/s     
2026-02-21T08:32:32.0481394Z [241s] Generation 11 complete: 
2026-02-21T08:32:32.0481843Z ok=33
2026-02-21T08:32:32.0482131Z min=0.0125
2026-02-21T08:32:32.0482414Z mid=0.0128
2026-02-21T08:32:32.0482691Z max=0.0242
2026-02-21T08:32:32.0482990Z best={'block_sizes': [2, 2048],
2026-02-21T08:32:32.0483543Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:32:32.0484700Z  'load_eviction_policies': ['', ''],
2026-02-21T08:32:32.0485151Z  'num_stages': 7,
2026-02-21T08:32:32.0485473Z  'num_warps': 2,
2026-02-21T08:32:32.0485789Z  'pid_type': 'flat',
2026-02-21T08:32:32.0486181Z  'range_flattens': [None, None],
2026-02-21T08:32:32.0486589Z  'range_multi_buffers': [None, False],
2026-02-21T08:32:32.0487029Z  'range_num_stages': [0, 3],
2026-02-21T08:32:32.0487428Z  'range_unroll_factors': [0, 1],
2026-02-21T08:32:32.0487825Z  'range_warp_specializes': []}
2026-02-21T08:32:32.0521480Z [241s] Fitting surrogate: 818 points, 818 targets
2026-02-21T08:32:32.6916625Z [242s] Generation 12 starting: 36 neighbors, 3 active search path(s)
2026-02-21T08:32:36.4680723Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 16.5 configs/s
2026-02-21T08:32:39.1944400Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 13.7 configs/s
2026-02-21T08:32:42.9753618Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 268.4         
2026-02-21T08:32:42.9754449Z                                                                   configs/s     
2026-02-21T08:32:43.3452314Z [253s] Generation 12 complete: 
2026-02-21T08:32:43.3452660Z ok=39
2026-02-21T08:32:43.3452875Z min=0.0126
2026-02-21T08:32:43.3453063Z mid=0.0129
2026-02-21T08:32:43.3453225Z max=0.0295
2026-02-21T08:32:43.3453417Z best={'block_sizes': [2, 2048],
2026-02-21T08:32:43.3453794Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:32:43.3454706Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T08:32:43.3454992Z  'num_stages': 4,
2026-02-21T08:32:43.3455196Z  'num_warps': 2,
2026-02-21T08:32:43.3455400Z  'pid_type': 'flat',
2026-02-21T08:32:43.3455647Z  'range_flattens': [None, None],
2026-02-21T08:32:43.3455912Z  'range_multi_buffers': [None, True],
2026-02-21T08:32:43.3456177Z  'range_num_stages': [0, 2],
2026-02-21T08:32:43.3456422Z  'range_unroll_factors': [0, 2],
2026-02-21T08:32:43.3456668Z  'range_warp_specializes': []}
2026-02-21T08:32:43.3497578Z [253s] Fitting surrogate: 857 points, 857 targets
2026-02-21T08:32:43.9333704Z [253s] Generation 13 starting: 32 neighbors, 3 active search path(s)
2026-02-21T08:32:48.7270939Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 3.0 configs/s
2026-02-21T08:32:50.7848501Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.4 configs/s
2026-02-21T08:32:54.0276872Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 312.7         
2026-02-21T08:32:54.0277407Z                                                                   configs/s     
2026-02-21T08:32:54.3480552Z [264s] Generation 13 complete: 
2026-02-21T08:32:54.3480866Z ok=35
2026-02-21T08:32:54.3481045Z min=0.0127
2026-02-21T08:32:54.3481243Z mid=0.0130
2026-02-21T08:32:54.3481415Z max=0.0233
2026-02-21T08:32:54.3481603Z best={'block_sizes': [1, 2048],
2026-02-21T08:32:54.3482005Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:32:54.3482427Z  'load_eviction_policies': ['', ''],
2026-02-21T08:32:54.3482681Z  'num_stages': 6,
2026-02-21T08:32:54.3482885Z  'num_warps': 1,
2026-02-21T08:32:54.3483085Z  'pid_type': 'flat',
2026-02-21T08:32:54.3484264Z  'range_flattens': [None, True],
2026-02-21T08:32:54.3484624Z  'range_multi_buffers': [None, False],
2026-02-21T08:32:54.3484915Z  'range_num_stages': [0, 3],
2026-02-21T08:32:54.3485171Z  'range_unroll_factors': [0, 1],
2026-02-21T08:32:54.3485440Z  'range_warp_specializes': []}
2026-02-21T08:32:54.3522484Z [264s] Fitting surrogate: 892 points, 892 targets
2026-02-21T08:32:54.8827417Z [264s] Generation 14 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:32:59.5248180Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 2.8 configs/s
2026-02-21T08:33:01.3887078Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 16.5 configs/s
2026-02-21T08:33:04.8702397Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 333.2         
2026-02-21T08:33:04.8702914Z                                                                   configs/s     
2026-02-21T08:33:05.1722790Z [275s] Generation 14 complete: 
2026-02-21T08:33:05.1723102Z ok=32
2026-02-21T08:33:05.1723325Z min=0.0124
2026-02-21T08:33:05.1723516Z mid=0.0126
2026-02-21T08:33:05.1723691Z max=0.0210
2026-02-21T08:33:05.1723883Z best={'block_sizes': [1, 2048],
2026-02-21T08:33:05.1724718Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:33:05.1725199Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T08:33:05.1725510Z  'num_stages': 7,
2026-02-21T08:33:05.1725720Z  'num_warps': 1,
2026-02-21T08:33:05.1725918Z  'pid_type': 'flat',
2026-02-21T08:33:05.1726151Z  'range_flattens': [None, False],
2026-02-21T08:33:05.1726419Z  'range_multi_buffers': [None, True],
2026-02-21T08:33:05.1726695Z  'range_num_stages': [0, 2],
2026-02-21T08:33:05.1726941Z  'range_unroll_factors': [0, 2],
2026-02-21T08:33:05.1727202Z  'range_warp_specializes': []}
2026-02-21T08:33:05.1760378Z [275s] Fitting surrogate: 924 points, 924 targets
2026-02-21T08:33:05.6656438Z [275s] Generation 15 starting: 25 neighbors, 3 active search path(s)
2026-02-21T08:33:08.4168246Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 11.9 configs/s
2026-02-21T08:33:09.9573579Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 16.7 configs/s
2026-02-21T08:33:12.7919360Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 356.9         
2026-02-21T08:33:12.7919884Z                                                                   configs/s     
2026-02-21T08:33:13.0735912Z [283s] Generation 15 complete: 
2026-02-21T08:33:13.0736244Z ok=28
2026-02-21T08:33:13.0736432Z min=0.0124
2026-02-21T08:33:13.0736618Z mid=0.0126
2026-02-21T08:33:13.0736786Z max=0.0153
2026-02-21T08:33:13.0736979Z best={'block_sizes': [1, 2048],
2026-02-21T08:33:13.0737346Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:33:13.0737769Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T08:33:13.0738061Z  'num_stages': 2,
2026-02-21T08:33:13.0738256Z  'num_warps': 1,
2026-02-21T08:33:13.0738458Z  'pid_type': 'flat',
2026-02-21T08:33:13.0739382Z  'range_flattens': [None, True],
2026-02-21T08:33:13.0739698Z  'range_multi_buffers': [None, True],
2026-02-21T08:33:13.0739959Z  'range_num_stages': [0, 2],
2026-02-21T08:33:13.0740207Z  'range_unroll_factors': [0, 2],
2026-02-21T08:33:13.0740488Z  'range_warp_specializes': []}
2026-02-21T08:33:13.0779121Z [283s] Fitting surrogate: 952 points, 952 targets
2026-02-21T08:33:13.5018455Z [283s] Generation 16 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:33:15.8115510Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 11.2 configs/s
2026-02-21T08:33:17.0647830Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.5 configs/s
2026-02-21T08:33:19.2865866Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 454.3         
2026-02-21T08:33:19.2866376Z                                                                   configs/s     
2026-02-21T08:33:19.5137580Z [289s] Generation 16 complete: 
2026-02-21T08:33:19.5137871Z ok=22
2026-02-21T08:33:19.5138054Z min=0.0124
2026-02-21T08:33:19.5138255Z mid=0.0126
2026-02-21T08:33:19.5138425Z max=0.0152
2026-02-21T08:33:19.5138619Z best={'block_sizes': [1, 2048],
2026-02-21T08:33:19.5138961Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:33:19.5139368Z  'load_eviction_policies': ['', ''],
2026-02-21T08:33:19.5139617Z  'num_stages': 6,
2026-02-21T08:33:19.5139810Z  'num_warps': 1,
2026-02-21T08:33:19.5139999Z  'pid_type': 'flat',
2026-02-21T08:33:19.5140216Z  'range_flattens': [None, True],
2026-02-21T08:33:19.5140468Z  'range_multi_buffers': [None, None],
2026-02-21T08:33:19.5140738Z  'range_num_stages': [0, 4],
2026-02-21T08:33:19.5140977Z  'range_unroll_factors': [0, 1],
2026-02-21T08:33:19.5141224Z  'range_warp_specializes': []}
2026-02-21T08:33:19.5181924Z [289s] Fitting surrogate: 974 points, 974 targets
2026-02-21T08:33:19.9467787Z [289s] Generation 17 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:33:22.2271887Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 9.9 configs/s
2026-02-21T08:33:23.4634667Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.8 configs/s
2026-02-21T08:33:25.6856558Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 454.3         
2026-02-21T08:33:25.6857093Z                                                                   configs/s     
2026-02-21T08:33:25.9119598Z [295s] Generation 17 complete: 
2026-02-21T08:33:25.9119887Z ok=22
2026-02-21T08:33:25.9120063Z min=0.0124
2026-02-21T08:33:25.9120244Z mid=0.0126
2026-02-21T08:33:25.9120424Z max=0.0149
2026-02-21T08:33:25.9120619Z best={'block_sizes': [1, 2048],
2026-02-21T08:33:25.9121006Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:33:25.9121431Z  'load_eviction_policies': ['', ''],
2026-02-21T08:33:25.9121687Z  'num_stages': 6,
2026-02-21T08:33:25.9121887Z  'num_warps': 1,
2026-02-21T08:33:25.9122084Z  'pid_type': 'flat',
2026-02-21T08:33:25.9122312Z  'range_flattens': [None, True],
2026-02-21T08:33:25.9122598Z  'range_multi_buffers': [None, None],
2026-02-21T08:33:25.9122867Z  'range_num_stages': [0, 4],
2026-02-21T08:33:25.9123107Z  'range_unroll_factors': [0, 1],
2026-02-21T08:33:25.9123354Z  'range_warp_specializes': []}
2026-02-21T08:33:25.9164702Z [295s] Fitting surrogate: 996 points, 996 targets
2026-02-21T08:33:26.3243277Z [296s] Generation 18 starting: 18 neighbors, 2 active search path(s)
2026-02-21T08:33:29.0658902Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 4.9 configs/s
2026-02-21T08:33:30.1632212Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 17.1 configs/s
2026-02-21T08:33:31.9771870Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 555.1         
2026-02-21T08:33:31.9772360Z                                                                   configs/s     
2026-02-21T08:33:32.1663254Z [302s] Generation 18 complete: 
2026-02-21T08:33:32.1663529Z ok=20
2026-02-21T08:33:32.1663712Z min=0.0123
2026-02-21T08:33:32.1663889Z mid=0.0127
2026-02-21T08:33:32.1664798Z max=0.0194
2026-02-21T08:33:32.1665007Z best={'block_sizes': [1, 2048],
2026-02-21T08:33:32.1665355Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:33:32.1665739Z  'load_eviction_policies': ['', ''],
2026-02-21T08:33:32.1665998Z  'num_stages': 6,
2026-02-21T08:33:32.1666193Z  'num_warps': 1,
2026-02-21T08:33:32.1666379Z  'pid_type': 'flat',
2026-02-21T08:33:32.1666601Z  'range_flattens': [None, True],
2026-02-21T08:33:32.1666853Z  'range_multi_buffers': [None, None],
2026-02-21T08:33:32.1667112Z  'range_num_stages': [0, 4],
2026-02-21T08:33:32.1667341Z  'range_unroll_factors': [0, 1],
2026-02-21T08:33:32.1667585Z  'range_warp_specializes': []}
2026-02-21T08:33:32.1708750Z [302s] Fitting surrogate: 1016 points, 1016 targets
2026-02-21T08:33:32.5872651Z [302s] Generation 19 starting: 19 neighbors, 2 active search path(s)
2026-02-21T08:33:34.7871924Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 18.7 configs/s
2026-02-21T08:33:36.0222313Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.8 configs/s
2026-02-21T08:33:38.4689471Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 499.6         
2026-02-21T08:33:38.4702431Z                                                                   configs/s     
2026-02-21T08:33:38.6796171Z [308s] Generation 19 complete: 
2026-02-21T08:33:38.6796614Z ok=21
2026-02-21T08:33:38.6796903Z min=0.0126
2026-02-21T08:33:38.6797191Z mid=0.0130
2026-02-21T08:33:38.6797476Z max=0.0195
2026-02-21T08:33:38.6797788Z best={'block_sizes': [1, 2048],
2026-02-21T08:33:38.6798344Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:33:38.6798976Z  'load_eviction_policies': ['', ''],
2026-02-21T08:33:38.6799394Z  'num_stages': 6,
2026-02-21T08:33:38.6799712Z  'num_warps': 1,
2026-02-21T08:33:38.6800025Z  'pid_type': 'flat',
2026-02-21T08:33:38.6800404Z  'range_flattens': [None, True],
2026-02-21T08:33:38.6800818Z  'range_multi_buffers': [None, True],
2026-02-21T08:33:38.6801283Z  'range_num_stages': [0, 4],
2026-02-21T08:33:38.6801661Z  'range_unroll_factors': [0, 1],
2026-02-21T08:33:38.6802087Z  'range_warp_specializes': []}
2026-02-21T08:33:38.6836185Z [308s] Fitting surrogate: 1037 points, 1037 targets
2026-02-21T08:33:39.1123274Z [309s] Generation 20 starting: 18 neighbors, 2 active search path(s)
2026-02-21T08:33:41.9348020Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 5.2 configs/s
2026-02-21T08:33:43.1166661Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.7 configs/s
2026-02-21T08:33:45.0319309Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 526.6         
2026-02-21T08:33:45.0319840Z                                                                   configs/s     
2026-02-21T08:33:45.2317916Z [315s] Generation 20 complete: 
2026-02-21T08:33:45.2318333Z ok=20
2026-02-21T08:33:45.2318624Z min=0.0124
2026-02-21T08:33:45.2318929Z mid=0.0126
2026-02-21T08:33:45.2319204Z max=0.0190
2026-02-21T08:33:45.2319530Z best={'block_sizes': [1, 2048],
2026-02-21T08:33:45.2320079Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:33:45.2320636Z  'load_eviction_policies': ['', ''],
2026-02-21T08:33:45.2321981Z  'num_stages': 6,
2026-02-21T08:33:45.2322240Z  'num_warps': 1,
2026-02-21T08:33:45.2322470Z  'pid_type': 'flat',
2026-02-21T08:33:45.2322727Z  'range_flattens': [None, True],
2026-02-21T08:33:45.2323036Z  'range_multi_buffers': [None, True],
2026-02-21T08:33:45.2323364Z  'range_num_stages': [0, 4],
2026-02-21T08:33:45.2323638Z  'range_unroll_factors': [0, 1],
2026-02-21T08:33:45.2323935Z  'range_warp_specializes': []}
2026-02-21T08:33:45.2365897Z [315s] Fitting surrogate: 1057 points, 1057 targets
2026-02-21T08:33:45.4000036Z [315s] Autotuning complete in 315.3s after searching 1008 configs.
2026-02-21T08:33:45.4000573Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:33:45.4002717Z     @helion.kernel(config=helion.Config(block_sizes=[1, 2048], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=6, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 4], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T08:33:45.4004525Z 
2026-02-21T08:33:45.4004969Z [315s] Code of selected kernel: /tmp/torchinductor_root/pn/cpn4miys4ibxu4i2si55ri47hu4x64kctz6d3ruwqkgyjp2gmpcm.py
2026-02-21T08:33:46.3077796Z WARNING:tritonbench.utils.triton_op:Completed input ID 10:
2026-02-21T08:33:46.3078390Z (M, N)
2026-02-21T08:33:46.3078678Z ------------
2026-02-21T08:33:46.3078971Z (4096, 1536)
2026-02-21T08:33:46.3079160Z 
2026-02-21T08:33:46.3092648Z  15%|█▌        | 3/20 [15:16<1:26:19, 304.68s/it]WARNING:tritonbench.utils.triton_op:Running input ID 15:
2026-02-21T08:33:46.3093111Z (M, N)
2026-02-21T08:33:46.3093271Z ------------
2026-02-21T08:33:46.3093438Z (4096, 2176)
2026-02-21T08:33:46.3095313Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T08:33:47.9306690Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T08:33:49.6460349Z INFO:tritonbench.utils.triton_op:Took 3.16ms to get benchmark function for torch_compile_softmax
2026-02-21T08:33:53.7773022Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:33:53.7773338Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:33:53.7773576Z               'dtype': 'torch.float16',
2026-02-21T08:33:53.7773808Z               'shape': (4096, 2176),
2026-02-21T08:33:53.7774354Z               'stride': (2176, 1)},),
2026-02-21T08:33:53.7774568Z   'kwargs': {}}
2026-02-21T08:33:53.7808488Z INFO:tritonbench.utils.triton_op:Took 3.89ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T08:33:54.0618103Z [0s] Autotune random seed: 2135383793
2026-02-21T08:33:54.2409384Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:34:27.9442053Z [33s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T08:34:28.7339323Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:34:30.9519122Z [36s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T08:34:32.4280174Z [38s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T08:34:33.0755112Z [38s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T08:34:33.0777725Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T08:34:39.3908791Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.9 configs/s
2026-02-21T08:34:39.3925144Z [45s] Adaptive compile timeout: 30s (90% percentile=8.5s, bounds=[30.0s, 30s])
2026-02-21T08:34:39.7088186Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 2975.3 configs/s
2026-02-21T08:34:39.7620182Z [45s] Initial random population of 100, 5 starting points: 
2026-02-21T08:34:39.7622500Z error=3
2026-02-21T08:34:39.7622746Z timeout=5
2026-02-21T08:34:39.7622927Z ok=92
2026-02-21T08:34:39.7623114Z min=0.0211
2026-02-21T08:34:39.7623298Z mid=0.2106
2026-02-21T08:34:39.7623484Z max=42.6046
2026-02-21T08:34:39.7623688Z best={'block_sizes': [1, 256],
2026-02-21T08:34:39.7624499Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:34:39.7624983Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:34:39.7625267Z  'num_stages': 2,
2026-02-21T08:34:39.7625497Z  'num_warps': 1,
2026-02-21T08:34:39.7625706Z  'pid_type': 'flat',
2026-02-21T08:34:39.7625945Z  'range_flattens': [None, True],
2026-02-21T08:34:39.7626214Z  'range_multi_buffers': [None, None],
2026-02-21T08:34:39.7626516Z  'range_num_stages': [0, 3],
2026-02-21T08:34:39.7626771Z  'range_unroll_factors': [0, 2],
2026-02-21T08:34:39.7627055Z  'range_warp_specializes': []}
2026-02-21T08:34:39.7638815Z [45s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:34:41.4421995Z [47s] Generation 1 starting: 93 neighbors, 5 active search path(s)
2026-02-21T08:35:07.6434736Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97/97 0.5 configs/s
2026-02-21T08:35:14.2006703Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 97/97 14.9 configs/s
2026-02-21T08:35:19.6668643Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 185.3         
2026-02-21T08:35:19.6669151Z                                                                   configs/s     
2026-02-21T08:35:20.1436837Z [85s] Generation 1 complete: 
2026-02-21T08:35:20.1437293Z ok=99
2026-02-21T08:35:20.1437573Z min=0.0202
2026-02-21T08:35:20.1437870Z mid=0.0307
2026-02-21T08:35:20.1438141Z max=0.2785
2026-02-21T08:35:20.1438851Z best={'block_sizes': [1, 512],
2026-02-21T08:35:20.1439227Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:35:20.1439636Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:35:20.1439909Z  'num_stages': 2,
2026-02-21T08:35:20.1440124Z  'num_warps': 1,
2026-02-21T08:35:20.1440333Z  'pid_type': 'flat',
2026-02-21T08:35:20.1440552Z  'range_flattens': [None, None],
2026-02-21T08:35:20.1440818Z  'range_multi_buffers': [None, None],
2026-02-21T08:35:20.1441085Z  'range_num_stages': [0, 3],
2026-02-21T08:35:20.1441342Z  'range_unroll_factors': [0, 2],
2026-02-21T08:35:20.1441605Z  'range_warp_specializes': []}
2026-02-21T08:35:20.1456081Z [85s] Fitting surrogate: 199 points, 199 targets
2026-02-21T08:35:21.5724662Z [87s] Generation 2 starting: 88 neighbors, 5 active search path(s)
2026-02-21T08:35:32.3223224Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 6.8 configs/s
2026-02-21T08:35:38.0065513Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 91/91 16.1 configs/s
2026-02-21T08:35:47.0209944Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.7         
2026-02-21T08:35:47.0215347Z                                                                   configs/s     
2026-02-21T08:35:47.7863954Z [113s] Generation 2 complete: 
2026-02-21T08:35:47.7864477Z ok=94
2026-02-21T08:35:47.7864645Z min=0.0183
2026-02-21T08:35:47.7864821Z mid=0.0239
2026-02-21T08:35:47.7864986Z max=0.0891
2026-02-21T08:35:47.7865182Z best={'block_sizes': [2, 4096],
2026-02-21T08:35:47.7865495Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:35:47.7865844Z  'load_eviction_policies': ['', ''],
2026-02-21T08:35:47.7866093Z  'num_stages': 6,
2026-02-21T08:35:47.7866294Z  'num_warps': 2,
2026-02-21T08:35:47.7866504Z  'pid_type': 'flat',
2026-02-21T08:35:47.7866855Z  'range_flattens': [None, None],
2026-02-21T08:35:47.7867372Z  'range_multi_buffers': [None, None],
2026-02-21T08:35:47.7867861Z  'range_num_stages': [0, 2],
2026-02-21T08:35:47.7868287Z  'range_unroll_factors': [0, 3],
2026-02-21T08:35:47.7868682Z  'range_warp_specializes': []}
2026-02-21T08:35:47.7886618Z [113s] Fitting surrogate: 293 points, 293 targets
2026-02-21T08:35:48.8414911Z [114s] Generation 3 starting: 68 neighbors, 5 active search path(s)
2026-02-21T08:35:57.2139212Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73/73 15.6 configs/s
2026-02-21T08:36:01.7677785Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 73/73 16.2 configs/s
2026-02-21T08:36:08.1194854Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 173.1         
2026-02-21T08:36:08.1198734Z                                                                   configs/s     
2026-02-21T08:36:08.6526975Z [134s] Generation 3 complete: 
2026-02-21T08:36:08.6527441Z ok=74
2026-02-21T08:36:08.6527731Z min=0.0164
2026-02-21T08:36:08.6528008Z mid=0.0210
2026-02-21T08:36:08.6528276Z max=0.0902
2026-02-21T08:36:08.6528566Z best={'block_sizes': [1, 4096],
2026-02-21T08:36:08.6529079Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:36:08.6529607Z  'load_eviction_policies': ['', ''],
2026-02-21T08:36:08.6530137Z  'num_stages': 6,
2026-02-21T08:36:08.6530465Z  'num_warps': 2,
2026-02-21T08:36:08.6530779Z  'pid_type': 'flat',
2026-02-21T08:36:08.6531164Z  'range_flattens': [None, None],
2026-02-21T08:36:08.6531624Z  'range_multi_buffers': [None, None],
2026-02-21T08:36:08.6531958Z  'range_num_stages': [0, 2],
2026-02-21T08:36:08.6532171Z  'range_unroll_factors': [0, 2],
2026-02-21T08:36:08.6532402Z  'range_warp_specializes': []}
2026-02-21T08:36:08.6553786Z [134s] Fitting surrogate: 367 points, 367 targets
2026-02-21T08:36:09.6173781Z [135s] Generation 4 starting: 59 neighbors, 5 active search path(s)
2026-02-21T08:36:19.4623513Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 3.0 configs/s
2026-02-21T08:36:23.3229354Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 16.2 configs/s
2026-02-21T08:36:28.8173528Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 184.5         
2026-02-21T08:36:28.8175425Z                                                                   configs/s     
2026-02-21T08:36:29.3209256Z [155s] Generation 4 complete: 
2026-02-21T08:36:29.3209499Z ok=65
2026-02-21T08:36:29.3209656Z min=0.0163
2026-02-21T08:36:29.3209824Z mid=0.0203
2026-02-21T08:36:29.3210031Z max=0.0900
2026-02-21T08:36:29.3210209Z best={'block_sizes': [1, 4096],
2026-02-21T08:36:29.3210472Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:36:29.3210763Z  'load_eviction_policies': ['', ''],
2026-02-21T08:36:29.3211001Z  'num_stages': 6,
2026-02-21T08:36:29.3211179Z  'num_warps': 2,
2026-02-21T08:36:29.3211367Z  'pid_type': 'flat',
2026-02-21T08:36:29.3211572Z  'range_flattens': [None, None],
2026-02-21T08:36:29.3212192Z  'range_multi_buffers': [None, None],
2026-02-21T08:36:29.3212574Z  'range_num_stages': [0, 2],
2026-02-21T08:36:29.3212819Z  'range_unroll_factors': [0, 2],
2026-02-21T08:36:29.3213138Z  'range_warp_specializes': []}
2026-02-21T08:36:29.3237182Z [155s] Fitting surrogate: 432 points, 432 targets
2026-02-21T08:36:30.3063928Z [156s] Generation 5 starting: 63 neighbors, 5 active search path(s)
2026-02-21T08:36:38.1568961Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 7.1 configs/s
2026-02-21T08:36:42.2429044Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.3 configs/s
2026-02-21T08:36:49.1897831Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 156.4         
2026-02-21T08:36:49.1898403Z                                                                   configs/s     
2026-02-21T08:36:49.7862359Z [175s] Generation 5 complete: 
2026-02-21T08:36:49.7862654Z ok=69
2026-02-21T08:36:49.7862852Z min=0.0165
2026-02-21T08:36:49.7863067Z mid=0.0204
2026-02-21T08:36:49.7863283Z max=0.0926
2026-02-21T08:36:49.7863501Z best={'block_sizes': [1, 4096],
2026-02-21T08:36:49.7863827Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:36:49.7864568Z  'load_eviction_policies': ['', ''],
2026-02-21T08:36:49.7864872Z  'num_stages': 6,
2026-02-21T08:36:49.7865094Z  'num_warps': 2,
2026-02-21T08:36:49.7865323Z  'pid_type': 'flat',
2026-02-21T08:36:49.7865576Z  'range_flattens': [None, None],
2026-02-21T08:36:49.7865888Z  'range_multi_buffers': [None, None],
2026-02-21T08:36:49.7866206Z  'range_num_stages': [0, 2],
2026-02-21T08:36:49.7866487Z  'range_unroll_factors': [0, 2],
2026-02-21T08:36:49.7866782Z  'range_warp_specializes': []}
2026-02-21T08:36:49.7893041Z [175s] Fitting surrogate: 501 points, 501 targets
2026-02-21T08:36:50.7947856Z [176s] Generation 6 starting: 61 neighbors, 5 active search path(s)
2026-02-21T08:36:58.5390153Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 11.2 configs/s
2026-02-21T08:37:02.4245853Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 16.1 configs/s
2026-02-21T08:37:08.7847724Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 159.4         
2026-02-21T08:37:08.7848300Z                                                                   configs/s     
2026-02-21T08:37:09.3658374Z [195s] Generation 6 complete: 
2026-02-21T08:37:09.3658649Z ok=67
2026-02-21T08:37:09.3658835Z min=0.0163
2026-02-21T08:37:09.3659010Z mid=0.0201
2026-02-21T08:37:09.3659181Z max=0.0568
2026-02-21T08:37:09.3659367Z best={'block_sizes': [1, 4096],
2026-02-21T08:37:09.3659698Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:37:09.3660069Z  'load_eviction_policies': ['', ''],
2026-02-21T08:37:09.3660344Z  'num_stages': 6,
2026-02-21T08:37:09.3660541Z  'num_warps': 2,
2026-02-21T08:37:09.3660754Z  'pid_type': 'flat',
2026-02-21T08:37:09.3660987Z  'range_flattens': [None, True],
2026-02-21T08:37:09.3661255Z  'range_multi_buffers': [None, None],
2026-02-21T08:37:09.3661544Z  'range_num_stages': [0, 2],
2026-02-21T08:37:09.3661790Z  'range_unroll_factors': [0, 1],
2026-02-21T08:37:09.3662053Z  'range_warp_specializes': []}
2026-02-21T08:37:09.3690824Z [195s] Fitting surrogate: 568 points, 568 targets
2026-02-21T08:37:10.2540244Z [196s] Generation 7 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:37:17.7008389Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 5.7 configs/s
2026-02-21T08:37:21.6945451Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 14.1 configs/s
2026-02-21T08:37:26.4117860Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 214.8         
2026-02-21T08:37:26.4118416Z                                                                   configs/s     
2026-02-21T08:37:26.8378229Z [212s] Generation 7 complete: 
2026-02-21T08:37:26.8378485Z ok=58
2026-02-21T08:37:26.8378656Z min=0.0164
2026-02-21T08:37:26.8378831Z mid=0.0208
2026-02-21T08:37:26.8379001Z max=0.0521
2026-02-21T08:37:26.8379190Z best={'block_sizes': [1, 4096],
2026-02-21T08:37:26.8379970Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:37:26.8380346Z  'load_eviction_policies': ['', ''],
2026-02-21T08:37:26.8380606Z  'num_stages': 5,
2026-02-21T08:37:26.8380808Z  'num_warps': 2,
2026-02-21T08:37:26.8381002Z  'pid_type': 'flat',
2026-02-21T08:37:26.8381214Z  'range_flattens': [None, None],
2026-02-21T08:37:26.8381474Z  'range_multi_buffers': [None, False],
2026-02-21T08:37:26.8381731Z  'range_num_stages': [0, 1],
2026-02-21T08:37:26.8381962Z  'range_unroll_factors': [0, 1],
2026-02-21T08:37:26.8382207Z  'range_warp_specializes': []}
2026-02-21T08:37:26.8411016Z [212s] Fitting surrogate: 626 points, 626 targets
2026-02-21T08:37:27.5690846Z [213s] Generation 8 starting: 45 neighbors, 4 active search path(s)
2026-02-21T08:37:33.3586356Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 12.8 configs/s
2026-02-21T08:37:36.3696320Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.2 configs/s
2026-02-21T08:37:40.0644995Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 273.9         
2026-02-21T08:37:40.0645616Z                                                                   configs/s     
2026-02-21T08:37:40.4075913Z [226s] Generation 8 complete: 
2026-02-21T08:37:40.4076393Z ok=50
2026-02-21T08:37:40.4076707Z min=0.0162
2026-02-21T08:37:40.4077003Z mid=0.0238
2026-02-21T08:37:40.4077273Z max=0.0489
2026-02-21T08:37:40.4077573Z best={'block_sizes': [1, 4096],
2026-02-21T08:37:40.4078095Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:37:40.4078697Z  'load_eviction_policies': ['', ''],
2026-02-21T08:37:40.4079106Z  'num_stages': 6,
2026-02-21T08:37:40.4079419Z  'num_warps': 1,
2026-02-21T08:37:40.4079730Z  'pid_type': 'flat',
2026-02-21T08:37:40.4080083Z  'range_flattens': [None, False],
2026-02-21T08:37:40.4080493Z  'range_multi_buffers': [None, None],
2026-02-21T08:37:40.4080921Z  'range_num_stages': [0, 3],
2026-02-21T08:37:40.4081311Z  'range_unroll_factors': [0, 1],
2026-02-21T08:37:40.4081731Z  'range_warp_specializes': []}
2026-02-21T08:37:40.4112727Z [226s] Fitting surrogate: 676 points, 676 targets
2026-02-21T08:37:41.1767783Z [226s] Generation 9 starting: 47 neighbors, 4 active search path(s)
2026-02-21T08:37:48.4137160Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 5.5 configs/s
2026-02-21T08:37:51.5384634Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 16.2 configs/s
2026-02-21T08:37:54.8775636Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 359.9         
2026-02-21T08:37:54.8776135Z                                                                   configs/s     
2026-02-21T08:37:55.1444252Z [240s] Generation 9 complete: 
2026-02-21T08:37:55.1444724Z ok=51
2026-02-21T08:37:55.1445011Z min=0.0166
2026-02-21T08:37:55.1445296Z mid=0.0240
2026-02-21T08:37:55.1445568Z max=0.0566
2026-02-21T08:37:55.1445871Z best={'block_sizes': [1, 4096],
2026-02-21T08:37:55.1446419Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:37:55.1446993Z  'load_eviction_policies': ['', ''],
2026-02-21T08:37:55.1447411Z  'num_stages': 6,
2026-02-21T08:37:55.1447723Z  'num_warps': 2,
2026-02-21T08:37:55.1448603Z  'pid_type': 'flat',
2026-02-21T08:37:55.1448966Z  'range_flattens': [None, False],
2026-02-21T08:37:55.1449390Z  'range_multi_buffers': [None, None],
2026-02-21T08:37:55.1449813Z  'range_num_stages': [0, 2],
2026-02-21T08:37:55.1450317Z  'range_unroll_factors': [0, 1],
2026-02-21T08:37:55.1450724Z  'range_warp_specializes': []}
2026-02-21T08:37:55.1477316Z [240s] Fitting surrogate: 727 points, 727 targets
2026-02-21T08:37:55.9130437Z [241s] Generation 10 starting: 46 neighbors, 4 active search path(s)
2026-02-21T08:38:02.6428723Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 6.4 configs/s
2026-02-21T08:38:05.7088237Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 49/49 16.2 configs/s
2026-02-21T08:38:09.1505354Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 295.1         
2026-02-21T08:38:09.1505931Z                                                                   configs/s     
2026-02-21T08:38:09.4742592Z [255s] Generation 10 complete: 
2026-02-21T08:38:09.4742858Z ok=50
2026-02-21T08:38:09.4743036Z min=0.0161
2026-02-21T08:38:09.4743206Z mid=0.0222
2026-02-21T08:38:09.4743363Z max=0.0623
2026-02-21T08:38:09.4743544Z best={'block_sizes': [1, 4096],
2026-02-21T08:38:09.4743854Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:38:09.4744511Z  'load_eviction_policies': ['', ''],
2026-02-21T08:38:09.4744822Z  'num_stages': 6,
2026-02-21T08:38:09.4745055Z  'num_warps': 1,
2026-02-21T08:38:09.4745281Z  'pid_type': 'flat',
2026-02-21T08:38:09.4745543Z  'range_flattens': [None, False],
2026-02-21T08:38:09.4745828Z  'range_multi_buffers': [None, False],
2026-02-21T08:38:09.4746093Z  'range_num_stages': [0, 2],
2026-02-21T08:38:09.4746332Z  'range_unroll_factors': [0, 1],
2026-02-21T08:38:09.4746597Z  'range_warp_specializes': []}
2026-02-21T08:38:09.4790731Z [255s] Fitting surrogate: 777 points, 777 targets
2026-02-21T08:38:10.1930936Z [255s] Generation 11 starting: 43 neighbors, 4 active search path(s)
2026-02-21T08:38:17.1466493Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 4.6 configs/s
2026-02-21T08:38:20.1058447Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 47/47 16.1 configs/s
2026-02-21T08:38:24.2510043Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 244.5         
2026-02-21T08:38:24.2510600Z                                                                   configs/s     
2026-02-21T08:38:24.6396605Z [270s] Generation 11 complete: 
2026-02-21T08:38:24.6396912Z ok=48
2026-02-21T08:38:24.6397091Z min=0.0166
2026-02-21T08:38:24.6397275Z mid=0.0174
2026-02-21T08:38:24.6397439Z max=0.0360
2026-02-21T08:38:24.6397631Z best={'block_sizes': [1, 4096],
2026-02-21T08:38:24.6397956Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:38:24.6398337Z  'load_eviction_policies': ['', ''],
2026-02-21T08:38:24.6398613Z  'num_stages': 6,
2026-02-21T08:38:24.6398805Z  'num_warps': 2,
2026-02-21T08:38:24.6399008Z  'pid_type': 'flat',
2026-02-21T08:38:24.6399232Z  'range_flattens': [None, False],
2026-02-21T08:38:24.6400099Z  'range_multi_buffers': [None, False],
2026-02-21T08:38:24.6400381Z  'range_num_stages': [0, 3],
2026-02-21T08:38:24.6400637Z  'range_unroll_factors': [0, 1],
2026-02-21T08:38:24.6400897Z  'range_warp_specializes': []}
2026-02-21T08:38:24.6439110Z [270s] Fitting surrogate: 825 points, 825 targets
2026-02-21T08:38:25.3326654Z [271s] Generation 12 starting: 42 neighbors, 4 active search path(s)
2026-02-21T08:38:31.1972168Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 12.4 configs/s
2026-02-21T08:38:33.8630748Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 43/43 16.4 configs/s
2026-02-21T08:38:38.2981715Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 228.6         
2026-02-21T08:38:38.2982754Z                                                                   configs/s     
2026-02-21T08:38:38.7186513Z [284s] Generation 12 complete: 
2026-02-21T08:38:38.7186793Z ok=46
2026-02-21T08:38:38.7186979Z min=0.0160
2026-02-21T08:38:38.7187185Z mid=0.0164
2026-02-21T08:38:38.7187359Z max=0.0328
2026-02-21T08:38:38.7187546Z best={'block_sizes': [1, 4096],
2026-02-21T08:38:38.7187898Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:38:38.7188257Z  'load_eviction_policies': ['', ''],
2026-02-21T08:38:38.7188519Z  'num_stages': 7,
2026-02-21T08:38:38.7188724Z  'num_warps': 2,
2026-02-21T08:38:38.7188936Z  'pid_type': 'flat',
2026-02-21T08:38:38.7189164Z  'range_flattens': [None, False],
2026-02-21T08:38:38.7189428Z  'range_multi_buffers': [None, None],
2026-02-21T08:38:38.7189706Z  'range_num_stages': [0, 2],
2026-02-21T08:38:38.7189948Z  'range_unroll_factors': [0, 2],
2026-02-21T08:38:38.7190207Z  'range_warp_specializes': []}
2026-02-21T08:38:38.7229301Z [284s] Fitting surrogate: 871 points, 871 targets
2026-02-21T08:38:39.3385359Z [285s] Generation 13 starting: 34 neighbors, 3 active search path(s)
2026-02-21T08:38:45.2877976Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 3.5 configs/s
2026-02-21T08:38:47.5541605Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.6 configs/s
2026-02-21T08:38:50.7094350Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 320.6         
2026-02-21T08:38:50.7094905Z                                                                   configs/s     
2026-02-21T08:38:51.0122870Z [296s] Generation 13 complete: 
2026-02-21T08:38:51.0123304Z ok=38
2026-02-21T08:38:51.0123601Z min=0.0161
2026-02-21T08:38:51.0123881Z mid=0.0164
2026-02-21T08:38:51.0124603Z max=0.0489
2026-02-21T08:38:51.0124911Z best={'block_sizes': [1, 4096],
2026-02-21T08:38:51.0125442Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:38:51.0126035Z  'load_eviction_policies': ['', ''],
2026-02-21T08:38:51.0126454Z  'num_stages': 7,
2026-02-21T08:38:51.0126852Z  'num_warps': 1,
2026-02-21T08:38:51.0127180Z  'pid_type': 'flat',
2026-02-21T08:38:51.0127562Z  'range_flattens': [None, False],
2026-02-21T08:38:51.0127986Z  'range_multi_buffers': [None, None],
2026-02-21T08:38:51.0128438Z  'range_num_stages': [0, 1],
2026-02-21T08:38:51.0128835Z  'range_unroll_factors': [0, 2],
2026-02-21T08:38:51.0129247Z  'range_warp_specializes': []}
2026-02-21T08:38:51.0166207Z [296s] Fitting surrogate: 909 points, 909 targets
2026-02-21T08:38:51.5576795Z [297s] Generation 14 starting: 30 neighbors, 3 active search path(s)
2026-02-21T08:38:56.0190679Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 9.6 configs/s
2026-02-21T08:38:58.0111766Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 16.4 configs/s
2026-02-21T08:39:00.7578075Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 367.7         
2026-02-21T08:39:00.7578590Z                                                                   configs/s     
2026-02-21T08:39:01.0261231Z [306s] Generation 14 complete: 
2026-02-21T08:39:01.0261534Z ok=34
2026-02-21T08:39:01.0261704Z min=0.0166
2026-02-21T08:39:01.0261892Z mid=0.0171
2026-02-21T08:39:01.0262055Z max=0.0501
2026-02-21T08:39:01.0262928Z best={'block_sizes': [1, 4096],
2026-02-21T08:39:01.0263247Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:39:01.0263589Z  'load_eviction_policies': ['', ''],
2026-02-21T08:39:01.0263836Z  'num_stages': 2,
2026-02-21T08:39:01.0264261Z  'num_warps': 2,
2026-02-21T08:39:01.0264454Z  'pid_type': 'flat',
2026-02-21T08:39:01.0264680Z  'range_flattens': [None, False],
2026-02-21T08:39:01.0264937Z  'range_multi_buffers': [None, None],
2026-02-21T08:39:01.0265191Z  'range_num_stages': [0, 4],
2026-02-21T08:39:01.0265431Z  'range_unroll_factors': [0, 1],
2026-02-21T08:39:01.0265671Z  'range_warp_specializes': []}
2026-02-21T08:39:01.0304919Z [306s] Fitting surrogate: 943 points, 943 targets
2026-02-21T08:39:01.8051564Z [307s] Generation 15 starting: 41 neighbors, 3 active search path(s)
2026-02-21T08:39:09.9478648Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 4.6 configs/s
2026-02-21T08:39:12.7063930Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 44/44 16.2 configs/s
2026-02-21T08:39:16.0245381Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 305.2         
2026-02-21T08:39:16.0245892Z                                                                   configs/s     
2026-02-21T08:39:16.3353146Z [322s] Generation 15 complete: 
2026-02-21T08:39:16.3353601Z ok=45
2026-02-21T08:39:16.3353884Z min=0.0164
2026-02-21T08:39:16.3354435Z mid=0.0211
2026-02-21T08:39:16.3354700Z max=0.0465
2026-02-21T08:39:16.3355001Z best={'block_sizes': [1, 4096],
2026-02-21T08:39:16.3355505Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:39:16.3356090Z  'load_eviction_policies': ['', ''],
2026-02-21T08:39:16.3356511Z  'num_stages': 8,
2026-02-21T08:39:16.3356824Z  'num_warps': 2,
2026-02-21T08:39:16.3357167Z  'pid_type': 'flat',
2026-02-21T08:39:16.3357515Z  'range_flattens': [None, False],
2026-02-21T08:39:16.3357936Z  'range_multi_buffers': [None, False],
2026-02-21T08:39:16.3358359Z  'range_num_stages': [0, 1],
2026-02-21T08:39:16.3358769Z  'range_unroll_factors': [0, 2],
2026-02-21T08:39:16.3359167Z  'range_warp_specializes': []}
2026-02-21T08:39:16.3399354Z [322s] Fitting surrogate: 988 points, 988 targets
2026-02-21T08:39:16.9978132Z [322s] Generation 16 starting: 37 neighbors, 3 active search path(s)
2026-02-21T08:39:23.7035207Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 5.0 configs/s
2026-02-21T08:39:26.0915996Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 38/38 16.2 configs/s
2026-02-21T08:39:29.2835603Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 317.0         
2026-02-21T08:39:29.2836300Z                                                                   configs/s     
2026-02-21T08:39:29.5897490Z [335s] Generation 16 complete: 
2026-02-21T08:39:29.5898007Z ok=40
2026-02-21T08:39:29.5898289Z min=0.0163
2026-02-21T08:39:29.5898573Z mid=0.0198
2026-02-21T08:39:29.5898846Z max=0.0624
2026-02-21T08:39:29.5899132Z best={'block_sizes': [1, 4096],
2026-02-21T08:39:29.5899746Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:39:29.5900500Z  'load_eviction_policies': ['', ''],
2026-02-21T08:39:29.5900984Z  'num_stages': 2,
2026-02-21T08:39:29.5901173Z  'num_warps': 1,
2026-02-21T08:39:29.5901364Z  'pid_type': 'flat',
2026-02-21T08:39:29.5901579Z  'range_flattens': [None, False],
2026-02-21T08:39:29.5901839Z  'range_multi_buffers': [None, None],
2026-02-21T08:39:29.5902106Z  'range_num_stages': [0, 3],
2026-02-21T08:39:29.5902345Z  'range_unroll_factors': [0, 1],
2026-02-21T08:39:29.5902606Z  'range_warp_specializes': []}
2026-02-21T08:39:29.5946991Z [335s] Fitting surrogate: 1028 points, 1028 targets
2026-02-21T08:39:30.2695894Z [336s] Generation 17 starting: 37 neighbors, 3 active search path(s)
2026-02-21T08:39:36.2967658Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 6.3 configs/s
2026-02-21T08:39:38.7155421Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 39/39 16.4 configs/s
2026-02-21T08:39:41.5663780Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 354.6         
2026-02-21T08:39:41.5664412Z                                                                   configs/s     
2026-02-21T08:39:41.8435670Z [347s] Generation 17 complete: 
2026-02-21T08:39:41.8436096Z ok=40
2026-02-21T08:39:41.8436372Z min=0.0164
2026-02-21T08:39:41.8436656Z mid=0.0196
2026-02-21T08:39:41.8436920Z max=0.0473
2026-02-21T08:39:41.8437213Z best={'block_sizes': [1, 4096],
2026-02-21T08:39:41.8437723Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:39:41.8438331Z  'load_eviction_policies': ['', ''],
2026-02-21T08:39:41.8438774Z  'num_stages': 8,
2026-02-21T08:39:41.8439121Z  'num_warps': 2,
2026-02-21T08:39:41.8439438Z  'pid_type': 'flat',
2026-02-21T08:39:41.8439998Z  'range_flattens': [None, False],
2026-02-21T08:39:41.8440267Z  'range_multi_buffers': [None, False],
2026-02-21T08:39:41.8440509Z  'range_num_stages': [0, 3],
2026-02-21T08:39:41.8440732Z  'range_unroll_factors': [0, 2],
2026-02-21T08:39:41.8440968Z  'range_warp_specializes': []}
2026-02-21T08:39:41.8484710Z [347s] Fitting surrogate: 1068 points, 1068 targets
2026-02-21T08:39:42.5571407Z [348s] Generation 18 starting: 39 neighbors, 3 active search path(s)
2026-02-21T08:39:49.8831860Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 3.8 configs/s
2026-02-21T08:39:52.4472992Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 41/41 16.3 configs/s
2026-02-21T08:39:55.4359568Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 338.3         
2026-02-21T08:39:55.4360083Z                                                                   configs/s     
2026-02-21T08:39:55.7209208Z [361s] Generation 18 complete: 
2026-02-21T08:39:55.7209511Z ok=42
2026-02-21T08:39:55.7212363Z min=0.0165
2026-02-21T08:39:55.7212703Z mid=0.0213
2026-02-21T08:39:55.7212911Z max=0.0560
2026-02-21T08:39:55.7213131Z best={'block_sizes': [1, 4096],
2026-02-21T08:39:55.7213553Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:39:55.7216186Z  'load_eviction_policies': ['', ''],
2026-02-21T08:39:55.7216487Z  'num_stages': 8,
2026-02-21T08:39:55.7216696Z  'num_warps': 2,
2026-02-21T08:39:55.7216900Z  'pid_type': 'flat',
2026-02-21T08:39:55.7217136Z  'range_flattens': [None, False],
2026-02-21T08:39:55.7217405Z  'range_multi_buffers': [None, False],
2026-02-21T08:39:55.7217675Z  'range_num_stages': [0, 4],
2026-02-21T08:39:55.7217925Z  'range_unroll_factors': [0, 2],
2026-02-21T08:39:55.7218182Z  'range_warp_specializes': []}
2026-02-21T08:39:55.7258916Z [361s] Fitting surrogate: 1110 points, 1110 targets
2026-02-21T08:39:56.4527723Z [362s] Generation 19 starting: 39 neighbors, 3 active search path(s)
2026-02-21T08:40:07.2829991Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 1.5 configs/s
2026-02-21T08:40:09.8378680Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 41/41 16.3 configs/s
2026-02-21T08:40:13.2480614Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 296.7         
2026-02-21T08:40:13.2481677Z                                                                   configs/s     
2026-02-21T08:40:13.5743285Z [379s] Generation 19 complete: 
2026-02-21T08:40:13.5743548Z ok=42
2026-02-21T08:40:13.5743720Z min=0.0161
2026-02-21T08:40:13.5743906Z mid=0.0206
2026-02-21T08:40:13.5744383Z max=0.0555
2026-02-21T08:40:13.5744586Z best={'block_sizes': [1, 4096],
2026-02-21T08:40:13.5744948Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:40:13.5745372Z  'load_eviction_policies': ['', ''],
2026-02-21T08:40:13.5745647Z  'num_stages': 3,
2026-02-21T08:40:13.5745850Z  'num_warps': 1,
2026-02-21T08:40:13.5746061Z  'pid_type': 'flat',
2026-02-21T08:40:13.5746287Z  'range_flattens': [None, False],
2026-02-21T08:40:13.5746876Z  'range_multi_buffers': [None, None],
2026-02-21T08:40:13.5747167Z  'range_num_stages': [0, 2],
2026-02-21T08:40:13.5747424Z  'range_unroll_factors': [0, 1],
2026-02-21T08:40:13.5747687Z  'range_warp_specializes': []}
2026-02-21T08:40:13.5799361Z [379s] Fitting surrogate: 1152 points, 1152 targets
2026-02-21T08:40:14.1404319Z [379s] Generation 20 starting: 30 neighbors, 3 active search path(s)
2026-02-21T08:40:19.3969320Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 4.1 configs/s
2026-02-21T08:40:21.3040873Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.6 configs/s
2026-02-21T08:40:23.9324808Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 384.2         
2026-02-21T08:40:23.9325269Z                                                                   configs/s     
2026-02-21T08:40:24.1884286Z [389s] Generation 20 complete: 
2026-02-21T08:40:24.1884757Z ok=33
2026-02-21T08:40:24.1885047Z min=0.0165
2026-02-21T08:40:24.1885322Z mid=0.0170
2026-02-21T08:40:24.1885628Z max=0.0641
2026-02-21T08:40:24.1885926Z best={'block_sizes': [1, 4096],
2026-02-21T08:40:24.1886449Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:40:24.1887025Z  'load_eviction_policies': ['', ''],
2026-02-21T08:40:24.1887456Z  'num_stages': 8,
2026-02-21T08:40:24.1887772Z  'num_warps': 2,
2026-02-21T08:40:24.1888089Z  'pid_type': 'flat',
2026-02-21T08:40:24.1888457Z  'range_flattens': [None, False],
2026-02-21T08:40:24.1888937Z  'range_multi_buffers': [None, False],
2026-02-21T08:40:24.1889360Z  'range_num_stages': [0, 4],
2026-02-21T08:40:24.1889575Z  'range_unroll_factors': [0, 2],
2026-02-21T08:40:24.1889815Z  'range_warp_specializes': []}
2026-02-21T08:40:24.1936388Z [389s] Fitting surrogate: 1185 points, 1185 targets
2026-02-21T08:40:24.3631619Z [390s] Autotuning complete in 390.1s after searching 1142 configs.
2026-02-21T08:40:24.3632130Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:40:24.3633672Z     @helion.kernel(config=helion.Config(block_sizes=[1, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=8, num_warps=2, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 4], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T08:40:24.3635393Z 
2026-02-21T08:40:24.3635826Z [390s] Code of selected kernel: /tmp/torchinductor_root/wk/cwkdmjhh4ae5nng7srpxxexjuajhdgeiwf77cfktl7w2n4tzzb5y.py
2026-02-21T08:40:25.3166509Z WARNING:tritonbench.utils.triton_op:Completed input ID 15:
2026-02-21T08:40:25.3167111Z (M, N)
2026-02-21T08:40:25.3167406Z ------------
2026-02-21T08:40:25.3167728Z (4096, 2176)
2026-02-21T08:40:25.3167929Z 
2026-02-21T08:40:25.3184238Z  20%|██        | 4/20 [21:55<1:31:10, 341.92s/it]WARNING:tritonbench.utils.triton_op:Running input ID 20:
2026-02-21T08:40:25.3184700Z (M, N)
2026-02-21T08:40:25.3184865Z ------------
2026-02-21T08:40:25.3185045Z (4096, 2816)
2026-02-21T08:40:25.3187636Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T08:40:26.9380689Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T08:40:28.7098451Z INFO:tritonbench.utils.triton_op:Took 3.39ms to get benchmark function for torch_compile_softmax
2026-02-21T08:40:32.8609048Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:40:32.8609373Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:40:32.8609607Z               'dtype': 'torch.float16',
2026-02-21T08:40:32.8609846Z               'shape': (4096, 2816),
2026-02-21T08:40:32.8610064Z               'stride': (2816, 1)},),
2026-02-21T08:40:32.8610356Z   'kwargs': {}}
2026-02-21T08:40:32.8653494Z INFO:tritonbench.utils.triton_op:Took 4.85ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T08:40:33.1505546Z [0s] Autotune random seed: 2135383793
2026-02-21T08:40:33.3304371Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:41:07.9801067Z [34s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T08:41:09.1049750Z [35s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:41:12.2070165Z [38s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T08:41:14.1823391Z [40s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T08:41:14.7417611Z [41s] Timeout after 30s compiling Config(block_sizes=[4096, 1], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=1, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T08:41:15.0585228Z [41s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T08:41:15.0607163Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T08:41:21.1572127Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.5 configs/s
2026-02-21T08:41:21.1587961Z [47s] Adaptive compile timeout: 30s (90% percentile=9.6s, bounds=[30.0s, 30s])
2026-02-21T08:41:21.6110527Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 2146.4 configs/s
2026-02-21T08:41:21.6774695Z [48s] Initial random population of 100, 5 starting points: 
2026-02-21T08:41:21.6775280Z error=3
2026-02-21T08:41:21.6775609Z timeout=6
2026-02-21T08:41:21.6775872Z ok=91
2026-02-21T08:41:21.6776140Z min=0.0263
2026-02-21T08:41:21.6776419Z mid=0.2567
2026-02-21T08:41:21.6776688Z max=12.3576
2026-02-21T08:41:21.6777564Z best={'block_sizes': [1, 256],
2026-02-21T08:41:21.6778258Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:41:21.6779158Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:41:21.6779490Z  'num_stages': 2,
2026-02-21T08:41:21.6779698Z  'num_warps': 1,
2026-02-21T08:41:21.6779904Z  'pid_type': 'flat',
2026-02-21T08:41:21.6780139Z  'range_flattens': [None, True],
2026-02-21T08:41:21.6780434Z  'range_multi_buffers': [None, None],
2026-02-21T08:41:21.6780722Z  'range_num_stages': [0, 3],
2026-02-21T08:41:21.6780985Z  'range_unroll_factors': [0, 2],
2026-02-21T08:41:21.6781250Z  'range_warp_specializes': []}
2026-02-21T08:41:21.6793108Z [48s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:41:23.3727164Z [50s] Generation 1 starting: 93 neighbors, 5 active search path(s)
2026-02-21T08:41:45.0032370Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97/97 0.8 configs/s
2026-02-21T08:41:51.0399226Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 97/97 16.2 configs/s
2026-02-21T08:41:56.0958846Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 200.2         
2026-02-21T08:41:56.0961202Z                                                                   configs/s     
2026-02-21T08:41:56.5271322Z [83s] Generation 1 complete: 
2026-02-21T08:41:56.5271596Z ok=99
2026-02-21T08:41:56.5271763Z min=0.0233
2026-02-21T08:41:56.5271952Z mid=0.0376
2026-02-21T08:41:56.5272191Z max=0.3307
2026-02-21T08:41:56.5272577Z best={'block_sizes': [1, 1024],
2026-02-21T08:41:56.5273295Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:41:56.5274465Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:41:56.5274937Z  'num_stages': 2,
2026-02-21T08:41:56.5275252Z  'num_warps': 1,
2026-02-21T08:41:56.5275613Z  'pid_type': 'flat',
2026-02-21T08:41:56.5275965Z  'range_flattens': [None, True],
2026-02-21T08:41:56.5276393Z  'range_multi_buffers': [None, None],
2026-02-21T08:41:56.5276852Z  'range_num_stages': [0, 3],
2026-02-21T08:41:56.5277247Z  'range_unroll_factors': [0, 2],
2026-02-21T08:41:56.5277643Z  'range_warp_specializes': []}
2026-02-21T08:41:56.5293893Z [83s] Fitting surrogate: 199 points, 199 targets
2026-02-21T08:41:58.1138800Z [84s] Generation 2 starting: 86 neighbors, 5 active search path(s)
2026-02-21T08:42:14.2055281Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 2.7 configs/s
2026-02-21T08:42:19.6921134Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 16.2 configs/s
2026-02-21T08:42:26.7379855Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 143.9         
2026-02-21T08:42:26.7381779Z                                                                   configs/s     
2026-02-21T08:42:27.3421455Z [114s] Generation 2 complete: 
2026-02-21T08:42:27.3421735Z ok=91
2026-02-21T08:42:27.3421912Z min=0.0197
2026-02-21T08:42:27.3422089Z mid=0.0273
2026-02-21T08:42:27.3422252Z max=0.3304
2026-02-21T08:42:27.3422445Z best={'block_sizes': [2, 4096],
2026-02-21T08:42:27.3422778Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:42:27.3423129Z  'load_eviction_policies': ['', ''],
2026-02-21T08:42:27.3423392Z  'num_stages': 6,
2026-02-21T08:42:27.3423728Z  'num_warps': 4,
2026-02-21T08:42:27.3424383Z  'pid_type': 'flat',
2026-02-21T08:42:27.3424783Z  'range_flattens': [None, None],
2026-02-21T08:42:27.3425199Z  'range_multi_buffers': [None, None],
2026-02-21T08:42:27.3425682Z  'range_num_stages': [0, 2],
2026-02-21T08:42:27.3426072Z  'range_unroll_factors': [0, 2],
2026-02-21T08:42:27.3426471Z  'range_warp_specializes': []}
2026-02-21T08:42:27.3449144Z [114s] Fitting surrogate: 290 points, 290 targets
2026-02-21T08:42:28.4129250Z [115s] Generation 3 starting: 69 neighbors, 5 active search path(s)
2026-02-21T08:42:39.4071180Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74/74 6.8 configs/s
2026-02-21T08:42:44.0436652Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 74/74 16.1 configs/s
2026-02-21T08:42:50.5341985Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 171.2         
2026-02-21T08:42:50.5342469Z                                                                   configs/s     
2026-02-21T08:42:51.0597491Z [137s] Generation 3 complete: 
2026-02-21T08:42:51.0597928Z ok=75
2026-02-21T08:42:51.0598213Z min=0.0195
2026-02-21T08:42:51.0598499Z mid=0.0243
2026-02-21T08:42:51.0598760Z max=0.0895
2026-02-21T08:42:51.0599062Z best={'block_sizes': [1, 4096],
2026-02-21T08:42:51.0599565Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:42:51.0600127Z  'load_eviction_policies': ['', ''],
2026-02-21T08:42:51.0600535Z  'num_stages': 5,
2026-02-21T08:42:51.0600873Z  'num_warps': 4,
2026-02-21T08:42:51.0601210Z  'pid_type': 'flat',
2026-02-21T08:42:51.0602173Z  'range_flattens': [None, None],
2026-02-21T08:42:51.0602625Z  'range_multi_buffers': [None, None],
2026-02-21T08:42:51.0603046Z  'range_num_stages': [0, 2],
2026-02-21T08:42:51.0603433Z  'range_unroll_factors': [0, 2],
2026-02-21T08:42:51.0603869Z  'range_warp_specializes': []}
2026-02-21T08:42:51.0622511Z [137s] Fitting surrogate: 365 points, 365 targets
2026-02-21T08:42:52.1238736Z [138s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T08:43:02.9428091Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 4.8 configs/s
2026-02-21T08:43:07.1591868Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 16.3 configs/s
2026-02-21T08:43:12.9553562Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 174.9         
2026-02-21T08:43:12.9554441Z                                                                   configs/s     
2026-02-21T08:43:13.4679946Z [160s] Generation 4 complete: 
2026-02-21T08:43:13.4680383Z ok=70
2026-02-21T08:43:13.4680665Z min=0.0193
2026-02-21T08:43:13.4680999Z mid=0.0239
2026-02-21T08:43:13.4681267Z max=0.1447
2026-02-21T08:43:13.4681572Z best={'block_sizes': [2, 4096],
2026-02-21T08:43:13.4682090Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:43:13.4682691Z  'load_eviction_policies': ['', ''],
2026-02-21T08:43:13.4683106Z  'num_stages': 5,
2026-02-21T08:43:13.4683422Z  'num_warps': 4,
2026-02-21T08:43:13.4683742Z  'pid_type': 'flat',
2026-02-21T08:43:13.4684600Z  'range_flattens': [None, None],
2026-02-21T08:43:13.4685064Z  'range_multi_buffers': [None, None],
2026-02-21T08:43:13.4685544Z  'range_num_stages': [0, 2],
2026-02-21T08:43:13.4685986Z  'range_unroll_factors': [0, 2],
2026-02-21T08:43:13.4686264Z  'range_warp_specializes': []}
2026-02-21T08:43:13.4710441Z [160s] Fitting surrogate: 435 points, 435 targets
2026-02-21T08:43:14.5206154Z [161s] Generation 5 starting: 67 neighbors, 5 active search path(s)
2026-02-21T08:43:26.8030744Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70/70 2.8 configs/s
2026-02-21T08:43:31.1528016Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 70/70 16.2 configs/s
2026-02-21T08:43:36.9016475Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 195.2         
2026-02-21T08:43:36.9020569Z                                                                   configs/s     
2026-02-21T08:43:37.3692274Z [184s] Generation 5 complete: 
2026-02-21T08:43:37.3692722Z ok=72
2026-02-21T08:43:37.3692918Z min=0.0193
2026-02-21T08:43:37.3693069Z mid=0.0241
2026-02-21T08:43:37.3693218Z max=0.2288
2026-02-21T08:43:37.3693390Z best={'block_sizes': [2, 4096],
2026-02-21T08:43:37.3693675Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:43:37.3693969Z  'load_eviction_policies': ['', ''],
2026-02-21T08:43:37.3694514Z  'num_stages': 5,
2026-02-21T08:43:37.3694680Z  'num_warps': 4,
2026-02-21T08:43:37.3694866Z  'pid_type': 'flat',
2026-02-21T08:43:37.3695058Z  'range_flattens': [None, None],
2026-02-21T08:43:37.3695290Z  'range_multi_buffers': [None, None],
2026-02-21T08:43:37.3695521Z  'range_num_stages': [0, 1],
2026-02-21T08:43:37.3695720Z  'range_unroll_factors': [0, 2],
2026-02-21T08:43:37.3695938Z  'range_warp_specializes': []}
2026-02-21T08:43:37.3723795Z [184s] Fitting surrogate: 507 points, 507 targets
2026-02-21T08:43:38.5371588Z [185s] Generation 6 starting: 70 neighbors, 5 active search path(s)
2026-02-21T08:43:49.3957138Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 5.4 configs/s
2026-02-21T08:43:53.7956867Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 16.3 configs/s
2026-02-21T08:43:59.8431643Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 167.6         
2026-02-21T08:43:59.8432165Z                                                                   configs/s     
2026-02-21T08:44:00.3753843Z [207s] Generation 6 complete: 
2026-02-21T08:44:00.3754566Z ok=75
2026-02-21T08:44:00.3754842Z min=0.0225
2026-02-21T08:44:00.3755130Z mid=0.0237
2026-02-21T08:44:00.3755420Z max=0.0993
2026-02-21T08:44:00.3756321Z best={'block_sizes': [1, 4096],
2026-02-21T08:44:00.3756911Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:44:00.3757581Z  'load_eviction_policies': ['', ''],
2026-02-21T08:44:00.3758072Z  'num_stages': 8,
2026-02-21T08:44:00.3758422Z  'num_warps': 4,
2026-02-21T08:44:00.3758660Z  'pid_type': 'flat',
2026-02-21T08:44:00.3758859Z  'range_flattens': [None, False],
2026-02-21T08:44:00.3759102Z  'range_multi_buffers': [None, True],
2026-02-21T08:44:00.3759343Z  'range_num_stages': [0, 3],
2026-02-21T08:44:00.3759560Z  'range_unroll_factors': [0, 2],
2026-02-21T08:44:00.3759798Z  'range_warp_specializes': []}
2026-02-21T08:44:00.3790134Z [207s] Fitting surrogate: 582 points, 582 targets
2026-02-21T08:44:01.3618029Z [208s] Generation 7 starting: 59 neighbors, 5 active search path(s)
2026-02-21T08:44:10.5765244Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 10.8 configs/s
2026-02-21T08:44:14.4616250Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 16.4 configs/s
2026-02-21T08:44:19.7820189Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 212.8         
2026-02-21T08:44:19.7820696Z                                                                   configs/s     
2026-02-21T08:44:20.2121228Z [226s] Generation 7 complete: 
2026-02-21T08:44:20.2121656Z ok=65
2026-02-21T08:44:20.2121938Z min=0.0194
2026-02-21T08:44:20.2122214Z mid=0.0253
2026-02-21T08:44:20.2122484Z max=0.3053
2026-02-21T08:44:20.2122781Z best={'block_sizes': [1, 4096],
2026-02-21T08:44:20.2123405Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:44:20.2124592Z  'load_eviction_policies': ['', ''],
2026-02-21T08:44:20.2125034Z  'num_stages': 6,
2026-02-21T08:44:20.2125348Z  'num_warps': 4,
2026-02-21T08:44:20.2125661Z  'pid_type': 'flat',
2026-02-21T08:44:20.2126034Z  'range_flattens': [None, True],
2026-02-21T08:44:20.2126451Z  'range_multi_buffers': [None, False],
2026-02-21T08:44:20.2126916Z  'range_num_stages': [0, 1],
2026-02-21T08:44:20.2127293Z  'range_unroll_factors': [0, 1],
2026-02-21T08:44:20.2127693Z  'range_warp_specializes': []}
2026-02-21T08:44:20.2155877Z [226s] Fitting surrogate: 647 points, 647 targets
2026-02-21T08:44:21.3281969Z [227s] Generation 8 starting: 69 neighbors, 5 active search path(s)
2026-02-21T08:44:31.7558795Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70/70 7.8 configs/s
2026-02-21T08:44:36.1316792Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 70/70 16.1 configs/s
2026-02-21T08:44:42.7258331Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 153.8         
2026-02-21T08:44:42.7261824Z                                                                   configs/s     
2026-02-21T08:44:43.3393757Z [250s] Generation 8 complete: 
2026-02-21T08:44:43.3394431Z ok=74
2026-02-21T08:44:43.3394719Z min=0.0191
2026-02-21T08:44:43.3394995Z mid=0.0199
2026-02-21T08:44:43.3395271Z max=0.0681
2026-02-21T08:44:43.3396205Z best={'block_sizes': [1, 4096],
2026-02-21T08:44:43.3396844Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:44:43.3397470Z  'load_eviction_policies': ['', ''],
2026-02-21T08:44:43.3397959Z  'num_stages': 5,
2026-02-21T08:44:43.3398310Z  'num_warps': 4,
2026-02-21T08:44:43.3398638Z  'pid_type': 'flat',
2026-02-21T08:44:43.3398844Z  'range_flattens': [None, None],
2026-02-21T08:44:43.3399080Z  'range_multi_buffers': [None, None],
2026-02-21T08:44:43.3399333Z  'range_num_stages': [0, 1],
2026-02-21T08:44:43.3399561Z  'range_unroll_factors': [0, 3],
2026-02-21T08:44:43.3399797Z  'range_warp_specializes': []}
2026-02-21T08:44:43.3435943Z [250s] Fitting surrogate: 721 points, 721 targets
2026-02-21T08:44:44.3995965Z [251s] Generation 9 starting: 65 neighbors, 5 active search path(s)
2026-02-21T08:44:54.3154900Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 5.3 configs/s
2026-02-21T08:44:58.4102750Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.3 configs/s
2026-02-21T08:45:05.5227620Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 156.6         
2026-02-21T08:45:05.5228113Z                                                                   configs/s     
2026-02-21T08:45:06.1089929Z [272s] Generation 9 complete: 
2026-02-21T08:45:06.1090207Z ok=70
2026-02-21T08:45:06.1090387Z min=0.0190
2026-02-21T08:45:06.1090569Z mid=0.0197
2026-02-21T08:45:06.1090733Z max=0.0418
2026-02-21T08:45:06.1090922Z best={'block_sizes': [1, 4096],
2026-02-21T08:45:06.1091244Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:45:06.1091594Z  'load_eviction_policies': ['', ''],
2026-02-21T08:45:06.1091861Z  'num_stages': 2,
2026-02-21T08:45:06.1092065Z  'num_warps': 4,
2026-02-21T08:45:06.1092277Z  'pid_type': 'flat',
2026-02-21T08:45:06.1092496Z  'range_flattens': [None, True],
2026-02-21T08:45:06.1092761Z  'range_multi_buffers': [None, None],
2026-02-21T08:45:06.1093032Z  'range_num_stages': [0, 2],
2026-02-21T08:45:06.1093290Z  'range_unroll_factors': [0, 1],
2026-02-21T08:45:06.1093571Z  'range_warp_specializes': []}
2026-02-21T08:45:06.1129549Z [272s] Fitting surrogate: 791 points, 791 targets
2026-02-21T08:45:06.8686555Z [273s] Generation 10 starting: 43 neighbors, 4 active search path(s)
2026-02-21T08:45:19.5864232Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 0.9 configs/s
2026-02-21T08:45:22.2937934Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 44/44 16.5 configs/s
2026-02-21T08:45:27.1120208Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 210.3         
2026-02-21T08:45:27.1122600Z                                                                   configs/s     
2026-02-21T08:45:27.5514215Z [294s] Generation 10 complete: 
2026-02-21T08:45:27.5514708Z ok=47
2026-02-21T08:45:27.5515005Z min=0.0190
2026-02-21T08:45:27.5515295Z mid=0.0196
2026-02-21T08:45:27.5515590Z max=0.0860
2026-02-21T08:45:27.5515889Z best={'block_sizes': [1, 4096],
2026-02-21T08:45:27.5516528Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:45:27.5517154Z  'load_eviction_policies': ['', ''],
2026-02-21T08:45:27.5517572Z  'num_stages': 4,
2026-02-21T08:45:27.5517885Z  'num_warps': 4,
2026-02-21T08:45:27.5518990Z  'pid_type': 'flat',
2026-02-21T08:45:27.5519386Z  'range_flattens': [None, True],
2026-02-21T08:45:27.5519638Z  'range_multi_buffers': [None, False],
2026-02-21T08:45:27.5519906Z  'range_num_stages': [0, 1],
2026-02-21T08:45:27.5520137Z  'range_unroll_factors': [0, 1],
2026-02-21T08:45:27.5520381Z  'range_warp_specializes': []}
2026-02-21T08:45:27.5557822Z [294s] Fitting surrogate: 838 points, 838 targets
2026-02-21T08:45:28.3732705Z [295s] Generation 11 starting: 49 neighbors, 4 active search path(s)
2026-02-21T08:45:36.4196953Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 6.6 configs/s
2026-02-21T08:45:39.4879591Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 50/50 16.5 configs/s
2026-02-21T08:45:45.4748428Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 188.3         
2026-02-21T08:45:45.4748944Z                                                                   configs/s     
2026-02-21T08:45:45.9617380Z [312s] Generation 11 complete: 
2026-02-21T08:45:45.9617717Z ok=53
2026-02-21T08:45:45.9617908Z min=0.0191
2026-02-21T08:45:45.9618079Z mid=0.0218
2026-02-21T08:45:45.9618253Z max=0.0956
2026-02-21T08:45:45.9618437Z best={'block_sizes': [1, 4096],
2026-02-21T08:45:45.9618797Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:45:45.9619184Z  'load_eviction_policies': ['', ''],
2026-02-21T08:45:45.9619434Z  'num_stages': 2,
2026-02-21T08:45:45.9619640Z  'num_warps': 4,
2026-02-21T08:45:45.9619840Z  'pid_type': 'flat',
2026-02-21T08:45:45.9620063Z  'range_flattens': [None, True],
2026-02-21T08:45:45.9620329Z  'range_multi_buffers': [None, True],
2026-02-21T08:45:45.9620602Z  'range_num_stages': [0, 3],
2026-02-21T08:45:45.9620846Z  'range_unroll_factors': [0, 1],
2026-02-21T08:45:45.9621112Z  'range_warp_specializes': []}
2026-02-21T08:45:45.9658466Z [312s] Fitting surrogate: 891 points, 891 targets
2026-02-21T08:45:46.8060584Z [313s] Generation 12 starting: 48 neighbors, 4 active search path(s)
2026-02-21T08:45:56.5817146Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 1.8 configs/s
2026-02-21T08:45:59.5708085Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 49/49 16.6 configs/s
2026-02-21T08:46:04.8010205Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 193.9         
2026-02-21T08:46:04.8010737Z                                                                   configs/s     
2026-02-21T08:46:05.2775553Z [331s] Generation 12 complete: 
2026-02-21T08:46:05.2775825Z ok=52
2026-02-21T08:46:05.2775994Z min=0.0192
2026-02-21T08:46:05.2776166Z mid=0.0196
2026-02-21T08:46:05.2776331Z max=0.1022
2026-02-21T08:46:05.2776514Z best={'block_sizes': [1, 4096],
2026-02-21T08:46:05.2776849Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:46:05.2777241Z  'load_eviction_policies': ['', ''],
2026-02-21T08:46:05.2777499Z  'num_stages': 8,
2026-02-21T08:46:05.2777686Z  'num_warps': 4,
2026-02-21T08:46:05.2777881Z  'pid_type': 'flat',
2026-02-21T08:46:05.2778106Z  'range_flattens': [None, None],
2026-02-21T08:46:05.2778364Z  'range_multi_buffers': [None, False],
2026-02-21T08:46:05.2778619Z  'range_num_stages': [0, 3],
2026-02-21T08:46:05.2778856Z  'range_unroll_factors': [0, 2],
2026-02-21T08:46:05.2779101Z  'range_warp_specializes': []}
2026-02-21T08:46:05.2822710Z [331s] Fitting surrogate: 943 points, 943 targets
2026-02-21T08:46:06.0991209Z [332s] Generation 13 starting: 49 neighbors, 4 active search path(s)
2026-02-21T08:46:13.3295486Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 9.1 configs/s
2026-02-21T08:46:16.3621156Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 49/49 16.4 configs/s
2026-02-21T08:46:22.0447820Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 178.4         
2026-02-21T08:46:22.0448367Z                                                                   configs/s     
2026-02-21T08:46:22.5576997Z [349s] Generation 13 complete: 
2026-02-21T08:46:22.5577821Z ok=53
2026-02-21T08:46:22.5578016Z min=0.0190
2026-02-21T08:46:22.5578194Z mid=0.0196
2026-02-21T08:46:22.5578370Z max=0.0292
2026-02-21T08:46:22.5578558Z best={'block_sizes': [1, 4096],
2026-02-21T08:46:22.5578930Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:46:22.5579341Z  'load_eviction_policies': ['', ''],
2026-02-21T08:46:22.5579619Z  'num_stages': 4,
2026-02-21T08:46:22.5579817Z  'num_warps': 4,
2026-02-21T08:46:22.5580035Z  'pid_type': 'flat',
2026-02-21T08:46:22.5580266Z  'range_flattens': [None, True],
2026-02-21T08:46:22.5580542Z  'range_multi_buffers': [None, None],
2026-02-21T08:46:22.5580824Z  'range_num_stages': [0, 2],
2026-02-21T08:46:22.5581073Z  'range_unroll_factors': [0, 2],
2026-02-21T08:46:22.5581341Z  'range_warp_specializes': []}
2026-02-21T08:46:22.5631269Z [349s] Fitting surrogate: 996 points, 996 targets
2026-02-21T08:46:23.2261653Z [349s] Generation 14 starting: 37 neighbors, 3 active search path(s)
2026-02-21T08:46:28.9754544Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 7.7 configs/s
2026-02-21T08:46:31.8894223Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 12.8 configs/s
2026-02-21T08:46:36.0451159Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 243.7         
2026-02-21T08:46:36.0451711Z                                                                   configs/s     
2026-02-21T08:46:36.4258108Z [363s] Generation 14 complete: 
2026-02-21T08:46:36.4258378Z ok=40
2026-02-21T08:46:36.4258560Z min=0.0194
2026-02-21T08:46:36.4258746Z mid=0.0198
2026-02-21T08:46:36.4258932Z max=0.0316
2026-02-21T08:46:36.4259129Z best={'block_sizes': [1, 4096],
2026-02-21T08:46:36.4259515Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:46:36.4259923Z  'load_eviction_policies': ['', ''],
2026-02-21T08:46:36.4260220Z  'num_stages': 4,
2026-02-21T08:46:36.4260423Z  'num_warps': 4,
2026-02-21T08:46:36.4260632Z  'pid_type': 'flat',
2026-02-21T08:46:36.4260857Z  'range_flattens': [None, None],
2026-02-21T08:46:36.4261151Z  'range_multi_buffers': [None, None],
2026-02-21T08:46:36.4261446Z  'range_num_stages': [0, 2],
2026-02-21T08:46:36.4261697Z  'range_unroll_factors': [0, 2],
2026-02-21T08:46:36.4261966Z  'range_warp_specializes': []}
2026-02-21T08:46:36.4302108Z [363s] Fitting surrogate: 1036 points, 1036 targets
2026-02-21T08:46:36.9985414Z [363s] Generation 15 starting: 30 neighbors, 3 active search path(s)
2026-02-21T08:46:41.9030976Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 4.8 configs/s
2026-02-21T08:46:43.8702888Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 16.6 configs/s
2026-02-21T08:46:47.5592597Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 273.9         
2026-02-21T08:46:47.5593080Z                                                                   configs/s     
2026-02-21T08:46:47.8915804Z [374s] Generation 15 complete: 
2026-02-21T08:46:47.8916056Z ok=34
2026-02-21T08:46:47.8916227Z min=0.0226
2026-02-21T08:46:47.8916845Z mid=0.0228
2026-02-21T08:46:47.8917006Z max=0.0288
2026-02-21T08:46:47.8917201Z best={'block_sizes': [1, 4096],
2026-02-21T08:46:47.8917582Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:46:47.8918003Z  'load_eviction_policies': ['', ''],
2026-02-21T08:46:47.8918253Z  'num_stages': 2,
2026-02-21T08:46:47.8918444Z  'num_warps': 4,
2026-02-21T08:46:47.8918637Z  'pid_type': 'flat',
2026-02-21T08:46:47.8918852Z  'range_flattens': [None, True],
2026-02-21T08:46:47.8919107Z  'range_multi_buffers': [None, False],
2026-02-21T08:46:47.8919364Z  'range_num_stages': [0, 1],
2026-02-21T08:46:47.8919613Z  'range_unroll_factors': [0, 2],
2026-02-21T08:46:47.8919858Z  'range_warp_specializes': []}
2026-02-21T08:46:47.8966345Z [374s] Fitting surrogate: 1070 points, 1070 targets
2026-02-21T08:46:48.5458839Z [375s] Generation 16 starting: 37 neighbors, 3 active search path(s)
2026-02-21T08:46:58.1492324Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 1.0 configs/s
2026-02-21T08:47:00.5341135Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 39/39 16.7 configs/s
2026-02-21T08:47:04.7024896Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 242.7         
2026-02-21T08:47:04.7025414Z                                                                   configs/s     
2026-02-21T08:47:05.0835421Z [391s] Generation 16 complete: 
2026-02-21T08:47:05.0835754Z ok=41
2026-02-21T08:47:05.0835938Z min=0.0192
2026-02-21T08:47:05.0836130Z mid=0.0215
2026-02-21T08:47:05.0836299Z max=0.1142
2026-02-21T08:47:05.0836494Z best={'block_sizes': [1, 4096],
2026-02-21T08:47:05.0836870Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:47:05.0837273Z  'load_eviction_policies': ['', ''],
2026-02-21T08:47:05.0837573Z  'num_stages': 2,
2026-02-21T08:47:05.0837784Z  'num_warps': 4,
2026-02-21T08:47:05.0837986Z  'pid_type': 'flat',
2026-02-21T08:47:05.0838202Z  'range_flattens': [None, True],
2026-02-21T08:47:05.0838483Z  'range_multi_buffers': [None, False],
2026-02-21T08:47:05.0838746Z  'range_num_stages': [0, 1],
2026-02-21T08:47:05.0838982Z  'range_unroll_factors': [0, 2],
2026-02-21T08:47:05.0839221Z  'range_warp_specializes': []}
2026-02-21T08:47:05.0886427Z [391s] Fitting surrogate: 1111 points, 1111 targets
2026-02-21T08:47:05.7563824Z [392s] Generation 17 starting: 34 neighbors, 3 active search path(s)
2026-02-21T08:47:10.9056763Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 6.5 configs/s
2026-02-21T08:47:13.0087227Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 16.5 configs/s
2026-02-21T08:47:17.5219065Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 258.3         
2026-02-21T08:47:17.5219600Z                                                                   configs/s     
2026-02-21T08:47:17.8841998Z [404s] Generation 17 complete: 
2026-02-21T08:47:17.8842340Z ok=37
2026-02-21T08:47:17.8842516Z min=0.0192
2026-02-21T08:47:17.8842694Z mid=0.0195
2026-02-21T08:47:17.8842910Z max=0.0313
2026-02-21T08:47:17.8843109Z best={'block_sizes': [1, 4096],
2026-02-21T08:47:17.8843434Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:47:17.8843784Z  'load_eviction_policies': ['', ''],
2026-02-21T08:47:17.8844244Z  'num_stages': 2,
2026-02-21T08:47:17.8844452Z  'num_warps': 4,
2026-02-21T08:47:17.8844654Z  'pid_type': 'flat',
2026-02-21T08:47:17.8844884Z  'range_flattens': [None, True],
2026-02-21T08:47:17.8845166Z  'range_multi_buffers': [None, False],
2026-02-21T08:47:17.8845481Z  'range_num_stages': [0, 2],
2026-02-21T08:47:17.8845734Z  'range_unroll_factors': [0, 2],
2026-02-21T08:47:17.8845963Z  'range_warp_specializes': []}
2026-02-21T08:47:17.8889035Z [404s] Fitting surrogate: 1148 points, 1148 targets
2026-02-21T08:47:18.5936980Z [405s] Generation 18 starting: 37 neighbors, 3 active search path(s)
2026-02-21T08:47:24.3401118Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 7.2 configs/s
2026-02-21T08:47:26.6000960Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.7 configs/s
2026-02-21T08:47:30.9388926Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 233.4         
2026-02-21T08:47:30.9389472Z                                                                   configs/s     
2026-02-21T08:47:31.3299510Z [417s] Generation 18 complete: 
2026-02-21T08:47:31.3299798Z ok=40
2026-02-21T08:47:31.3299974Z min=0.0226
2026-02-21T08:47:31.3300152Z mid=0.0228
2026-02-21T08:47:31.3300318Z max=0.0306
2026-02-21T08:47:31.3300497Z best={'block_sizes': [1, 4096],
2026-02-21T08:47:31.3300813Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:47:31.3301146Z  'load_eviction_policies': ['', ''],
2026-02-21T08:47:31.3301402Z  'num_stages': 2,
2026-02-21T08:47:31.3301592Z  'num_warps': 4,
2026-02-21T08:47:31.3302382Z  'pid_type': 'flat',
2026-02-21T08:47:31.3302618Z  'range_flattens': [None, True],
2026-02-21T08:47:31.3302869Z  'range_multi_buffers': [None, False],
2026-02-21T08:47:31.3303163Z  'range_num_stages': [0, 3],
2026-02-21T08:47:31.3303394Z  'range_unroll_factors': [0, 2],
2026-02-21T08:47:31.3303642Z  'range_warp_specializes': []}
2026-02-21T08:47:31.3353039Z [418s] Fitting surrogate: 1188 points, 1188 targets
2026-02-21T08:47:31.9689376Z [418s] Generation 19 starting: 35 neighbors, 3 active search path(s)
2026-02-21T08:47:37.8149046Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 9.3 configs/s
2026-02-21T08:47:40.1481550Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 38/38 16.6 configs/s
2026-02-21T08:47:44.2036867Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 249.7         
2026-02-21T08:47:44.2037393Z                                                                   configs/s     
2026-02-21T08:47:44.5742457Z [431s] Generation 19 complete: 
2026-02-21T08:47:44.5742787Z ok=39
2026-02-21T08:47:44.5742958Z min=0.0191
2026-02-21T08:47:44.5743137Z mid=0.0196
2026-02-21T08:47:44.5743303Z max=0.0441
2026-02-21T08:47:44.5743488Z best={'block_sizes': [1, 4096],
2026-02-21T08:47:44.5743892Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:47:44.5744807Z  'load_eviction_policies': ['', ''],
2026-02-21T08:47:44.5745131Z  'num_stages': 4,
2026-02-21T08:47:44.5745332Z  'num_warps': 4,
2026-02-21T08:47:44.5745548Z  'pid_type': 'flat',
2026-02-21T08:47:44.5745772Z  'range_flattens': [None, None],
2026-02-21T08:47:44.5746042Z  'range_multi_buffers': [None, None],
2026-02-21T08:47:44.5746312Z  'range_num_stages': [0, 2],
2026-02-21T08:47:44.5746558Z  'range_unroll_factors': [0, 3],
2026-02-21T08:47:44.5746811Z  'range_warp_specializes': []}
2026-02-21T08:47:44.5797459Z [431s] Fitting surrogate: 1227 points, 1227 targets
2026-02-21T08:47:45.0379591Z [431s] Generation 20 starting: 23 neighbors, 2 active search path(s)
2026-02-21T08:47:50.6258453Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 2.2 configs/s
2026-02-21T08:47:52.0250661Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 17.0 configs/s
2026-02-21T08:47:54.5392944Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 400.9         
2026-02-21T08:47:54.5393471Z                                                                   configs/s     
2026-02-21T08:47:54.7814922Z [441s] Generation 20 complete: 
2026-02-21T08:47:54.7815245Z ok=25
2026-02-21T08:47:54.7815435Z min=0.0192
2026-02-21T08:47:54.7815606Z mid=0.0194
2026-02-21T08:47:54.7815778Z max=0.1013
2026-02-21T08:47:54.7815965Z best={'block_sizes': [1, 4096],
2026-02-21T08:47:54.7816319Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:47:54.7816707Z  'load_eviction_policies': ['', ''],
2026-02-21T08:47:54.7816980Z  'num_stages': 4,
2026-02-21T08:47:54.7817181Z  'num_warps': 4,
2026-02-21T08:47:54.7817374Z  'pid_type': 'flat',
2026-02-21T08:47:54.7817644Z  'range_flattens': [None, None],
2026-02-21T08:47:54.7817905Z  'range_multi_buffers': [None, None],
2026-02-21T08:47:54.7818171Z  'range_num_stages': [0, 3],
2026-02-21T08:47:54.7819112Z  'range_unroll_factors': [0, 3],
2026-02-21T08:47:54.7819363Z  'range_warp_specializes': []}
2026-02-21T08:47:54.7870028Z [441s] Fitting surrogate: 1252 points, 1252 targets
2026-02-21T08:47:54.9521082Z [441s] Autotuning complete in 441.6s after searching 1193 configs.
2026-02-21T08:47:54.9521609Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:47:54.9523125Z     @helion.kernel(config=helion.Config(block_sizes=[1, 4096], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=4, num_warps=4, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T08:47:54.9524645Z 
2026-02-21T08:47:54.9525592Z [441s] Code of selected kernel: /tmp/torchinductor_root/qb/cqb4piqmasripvprtb437zptak2yrpubbnzmxlfps4ld3nwl55cm.py
2026-02-21T08:47:55.8908769Z WARNING:tritonbench.utils.triton_op:Completed input ID 20:
2026-02-21T08:47:55.8909147Z (M, N)
2026-02-21T08:47:55.8909316Z ------------
2026-02-21T08:47:55.8909491Z (4096, 2816)
2026-02-21T08:47:55.8909765Z 
2026-02-21T08:47:55.8933346Z  25%|██▌       | 5/20 [29:25<1:35:16, 381.10s/it]WARNING:tritonbench.utils.triton_op:Running input ID 26:
2026-02-21T08:47:55.8933812Z (M, N)
2026-02-21T08:47:55.8934326Z ------------
2026-02-21T08:47:55.8934521Z (4096, 3584)
2026-02-21T08:47:55.8936679Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T08:47:57.4849991Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T08:47:59.2345294Z INFO:tritonbench.utils.triton_op:Took 3.24ms to get benchmark function for torch_compile_softmax
2026-02-21T08:48:03.5873702Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:48:03.5874433Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:48:03.5874731Z               'dtype': 'torch.float16',
2026-02-21T08:48:03.5875012Z               'shape': (4096, 3584),
2026-02-21T08:48:03.5875286Z               'stride': (3584, 1)},),
2026-02-21T08:48:03.5875530Z   'kwargs': {}}
2026-02-21T08:48:03.5903764Z INFO:tritonbench.utils.triton_op:Took 3.34ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T08:48:03.8761228Z [0s] Autotune random seed: 2135383793
2026-02-21T08:48:04.0573336Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:48:38.3892047Z [34s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T08:48:39.7805855Z [35s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:48:43.5369290Z [39s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T08:48:45.9215419Z [41s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T08:48:47.0280080Z [42s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T08:48:47.0303210Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T08:48:53.9159300Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.6 configs/s
2026-02-21T08:48:53.9174275Z [49s] Adaptive compile timeout: 30s (90% percentile=11.7s, bounds=[30.0s, 30s])
2026-02-21T08:48:54.4008844Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1982.9 configs/s
2026-02-21T08:48:54.4677380Z [50s] Initial random population of 100, 5 starting points: 
2026-02-21T08:48:54.4677966Z error=3
2026-02-21T08:48:54.4678247Z timeout=5
2026-02-21T08:48:54.4678509Z ok=92
2026-02-21T08:48:54.4678778Z min=0.0336
2026-02-21T08:48:54.4679053Z mid=0.3656
2026-02-21T08:48:54.4679337Z max=73.1948
2026-02-21T08:48:54.4679847Z best={'block_sizes': [1, 256],
2026-02-21T08:48:54.4680581Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:48:54.4681377Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:48:54.4681878Z  'num_stages': 2,
2026-02-21T08:48:54.4682257Z  'num_warps': 1,
2026-02-21T08:48:54.4682638Z  'pid_type': 'flat',
2026-02-21T08:48:54.4683033Z  'range_flattens': [None, True],
2026-02-21T08:48:54.4683407Z  'range_multi_buffers': [None, None],
2026-02-21T08:48:54.4683650Z  'range_num_stages': [0, 3],
2026-02-21T08:48:54.4683868Z  'range_unroll_factors': [0, 2],
2026-02-21T08:48:54.4684279Z  'range_warp_specializes': []}
2026-02-21T08:48:54.4698835Z [50s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:48:55.9146389Z [51s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T08:49:16.4779137Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 1.4 configs/s
2026-02-21T08:49:22.2597923Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 16.2 configs/s
2026-02-21T08:49:29.0412426Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 149.2         
2026-02-21T08:49:29.0417277Z                                                                   configs/s     
2026-02-21T08:49:29.5780061Z [85s] Generation 1 complete: 
2026-02-21T08:49:29.5780340Z ok=94
2026-02-21T08:49:29.5780517Z min=0.0306
2026-02-21T08:49:29.5780684Z mid=0.0455
2026-02-21T08:49:29.5780852Z max=0.1308
2026-02-21T08:49:29.5781038Z best={'block_sizes': [1, 1024],
2026-02-21T08:49:29.5781464Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:49:29.5781880Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:49:29.5782134Z  'num_stages': 2,
2026-02-21T08:49:29.5782335Z  'num_warps': 1,
2026-02-21T08:49:29.5783101Z  'pid_type': 'flat',
2026-02-21T08:49:29.5783324Z  'range_flattens': [None, False],
2026-02-21T08:49:29.5783584Z  'range_multi_buffers': [None, None],
2026-02-21T08:49:29.5783850Z  'range_num_stages': [0, 3],
2026-02-21T08:49:29.5784514Z  'range_unroll_factors': [0, 2],
2026-02-21T08:49:29.5784785Z  'range_warp_specializes': []}
2026-02-21T08:49:29.5801910Z [85s] Fitting surrogate: 194 points, 194 targets
2026-02-21T08:49:30.9204641Z [86s] Generation 2 starting: 82 neighbors, 5 active search path(s)
2026-02-21T08:49:56.0930982Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84/84 1.0 configs/s
2026-02-21T08:50:01.3562289Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 84/84 16.1 configs/s
2026-02-21T08:50:10.1716787Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 114.9         
2026-02-21T08:50:10.1718250Z                                                                   configs/s     
2026-02-21T08:50:10.8910629Z [126s] Generation 2 complete: 
2026-02-21T08:50:10.8911131Z ok=88
2026-02-21T08:50:10.8911430Z min=0.0251
2026-02-21T08:50:10.8911719Z mid=0.0336
2026-02-21T08:50:10.8912008Z max=0.1530
2026-02-21T08:50:10.8912301Z best={'block_sizes': [2, 4096],
2026-02-21T08:50:10.8912828Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:50:10.8913399Z  'load_eviction_policies': ['', ''],
2026-02-21T08:50:10.8913822Z  'num_stages': 7,
2026-02-21T08:50:10.8914604Z  'num_warps': 4,
2026-02-21T08:50:10.8914946Z  'pid_type': 'flat',
2026-02-21T08:50:10.8915336Z  'range_flattens': [None, None],
2026-02-21T08:50:10.8915752Z  'range_multi_buffers': [None, None],
2026-02-21T08:50:10.8916218Z  'range_num_stages': [0, 2],
2026-02-21T08:50:10.8916681Z  'range_unroll_factors': [0, 2],
2026-02-21T08:50:10.8917116Z  'range_warp_specializes': []}
2026-02-21T08:50:10.8936479Z [126s] Fitting surrogate: 282 points, 282 targets
2026-02-21T08:50:12.0254241Z [127s] Generation 3 starting: 71 neighbors, 5 active search path(s)
2026-02-21T08:50:25.1873821Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 4.2 configs/s
2026-02-21T08:50:29.6840947Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 16.2 configs/s
2026-02-21T08:50:38.1904332Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 129.0         
2026-02-21T08:50:38.1904856Z                                                                   configs/s     
2026-02-21T08:50:38.8555035Z [154s] Generation 3 complete: 
2026-02-21T08:50:38.8555525Z ok=76
2026-02-21T08:50:38.8555811Z min=0.0229
2026-02-21T08:50:38.8556109Z mid=0.0295
2026-02-21T08:50:38.8556377Z max=0.0573
2026-02-21T08:50:38.8556690Z best={'block_sizes': [1, 4096],
2026-02-21T08:50:38.8557197Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:50:38.8557807Z  'load_eviction_policies': ['', ''],
2026-02-21T08:50:38.8558209Z  'num_stages': 7,
2026-02-21T08:50:38.8558529Z  'num_warps': 2,
2026-02-21T08:50:38.8558845Z  'pid_type': 'flat',
2026-02-21T08:50:38.8559247Z  'range_flattens': [None, None],
2026-02-21T08:50:38.8559690Z  'range_multi_buffers': [None, False],
2026-02-21T08:50:38.8560161Z  'range_num_stages': [0, 2],
2026-02-21T08:50:38.8560560Z  'range_unroll_factors': [0, 2],
2026-02-21T08:50:38.8560961Z  'range_warp_specializes': []}
2026-02-21T08:50:38.8581087Z [154s] Fitting surrogate: 358 points, 358 targets
2026-02-21T08:50:39.7791700Z [155s] Generation 4 starting: 57 neighbors, 5 active search path(s)
2026-02-21T08:50:50.1757142Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 4.8 configs/s
2026-02-21T08:50:53.7590769Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 16.4 configs/s
2026-02-21T08:51:00.1390706Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 158.8         
2026-02-21T08:51:00.1393105Z                                                                   configs/s     
2026-02-21T08:51:00.6911381Z [176s] Generation 4 complete: 
2026-02-21T08:51:00.6911743Z ok=63
2026-02-21T08:51:00.6912575Z min=0.0229
2026-02-21T08:51:00.6912758Z mid=0.0266
2026-02-21T08:51:00.6912929Z max=0.2026
2026-02-21T08:51:00.6913117Z best={'block_sizes': [1, 4096],
2026-02-21T08:51:00.6913488Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:51:00.6913876Z  'load_eviction_policies': ['', ''],
2026-02-21T08:51:00.6914646Z  'num_stages': 6,
2026-02-21T08:51:00.6914854Z  'num_warps': 4,
2026-02-21T08:51:00.6915071Z  'pid_type': 'flat',
2026-02-21T08:51:00.6915309Z  'range_flattens': [None, None],
2026-02-21T08:51:00.6915571Z  'range_multi_buffers': [None, None],
2026-02-21T08:51:00.6915836Z  'range_num_stages': [0, 2],
2026-02-21T08:51:00.6916081Z  'range_unroll_factors': [0, 2],
2026-02-21T08:51:00.6916330Z  'range_warp_specializes': []}
2026-02-21T08:51:00.6947239Z [176s] Fitting surrogate: 421 points, 421 targets
2026-02-21T08:51:01.6012614Z [177s] Generation 5 starting: 56 neighbors, 5 active search path(s)
2026-02-21T08:51:11.2366964Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 7.4 configs/s
2026-02-21T08:51:14.8793800Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 16.4 configs/s
2026-02-21T08:51:22.6135106Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 144.3         
2026-02-21T08:51:22.6137128Z                                                                   configs/s     
2026-02-21T08:51:23.2196486Z [199s] Generation 5 complete: 
2026-02-21T08:51:23.2196803Z ok=61
2026-02-21T08:51:23.2196998Z min=0.0262
2026-02-21T08:51:23.2197184Z mid=0.0266
2026-02-21T08:51:23.2197369Z max=0.0313
2026-02-21T08:51:23.2197579Z best={'block_sizes': [1, 4096],
2026-02-21T08:51:23.2197968Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:51:23.2198406Z  'load_eviction_policies': ['', ''],
2026-02-21T08:51:23.2198708Z  'num_stages': 2,
2026-02-21T08:51:23.2198914Z  'num_warps': 2,
2026-02-21T08:51:23.2199122Z  'pid_type': 'flat',
2026-02-21T08:51:23.2199381Z  'range_flattens': [None, False],
2026-02-21T08:51:23.2199668Z  'range_multi_buffers': [None, None],
2026-02-21T08:51:23.2199944Z  'range_num_stages': [0, 4],
2026-02-21T08:51:23.2200186Z  'range_unroll_factors': [0, 2],
2026-02-21T08:51:23.2200447Z  'range_warp_specializes': []}
2026-02-21T08:51:23.2225238Z [199s] Fitting surrogate: 482 points, 482 targets
2026-02-21T08:51:24.1015458Z [200s] Generation 6 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:51:35.1517233Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 3.0 configs/s
2026-02-21T08:51:38.6555585Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 16.5 configs/s
2026-02-21T08:51:44.1451229Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 184.6         
2026-02-21T08:51:44.1453128Z                                                                   configs/s     
2026-02-21T08:51:44.6270136Z [220s] Generation 6 complete: 
2026-02-21T08:51:44.6270440Z ok=58
2026-02-21T08:51:44.6270613Z min=0.0233
2026-02-21T08:51:44.6270794Z mid=0.0257
2026-02-21T08:51:44.6270995Z max=0.2668
2026-02-21T08:51:44.6271179Z best={'block_sizes': [1, 4096],
2026-02-21T08:51:44.6271518Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:51:44.6271906Z  'load_eviction_policies': ['', ''],
2026-02-21T08:51:44.6272157Z  'num_stages': 2,
2026-02-21T08:51:44.6272351Z  'num_warps': 2,
2026-02-21T08:51:44.6272540Z  'pid_type': 'flat',
2026-02-21T08:51:44.6272754Z  'range_flattens': [None, False],
2026-02-21T08:51:44.6272998Z  'range_multi_buffers': [None, None],
2026-02-21T08:51:44.6273237Z  'range_num_stages': [0, 4],
2026-02-21T08:51:44.6273463Z  'range_unroll_factors': [0, 2],
2026-02-21T08:51:44.6273690Z  'range_warp_specializes': []}
2026-02-21T08:51:44.6305136Z [220s] Fitting surrogate: 540 points, 540 targets
2026-02-21T08:51:45.5054264Z [221s] Generation 7 starting: 51 neighbors, 5 active search path(s)
2026-02-21T08:51:54.1953506Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 11.4 configs/s
2026-02-21T08:51:57.4326662Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 16.6 configs/s
2026-02-21T08:52:03.8671744Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 157.5         
2026-02-21T08:52:03.8672671Z                                                                   configs/s     
2026-02-21T08:52:04.4187169Z [240s] Generation 7 complete: 
2026-02-21T08:52:04.4187487Z ok=57
2026-02-21T08:52:04.4187692Z min=0.0263
2026-02-21T08:52:04.4187887Z mid=0.0266
2026-02-21T08:52:04.4188067Z max=0.0847
2026-02-21T08:52:04.4188253Z best={'block_sizes': [1, 4096],
2026-02-21T08:52:04.4188624Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:52:04.4189024Z  'load_eviction_policies': ['', ''],
2026-02-21T08:52:04.4189289Z  'num_stages': 6,
2026-02-21T08:52:04.4190126Z  'num_warps': 2,
2026-02-21T08:52:04.4190370Z  'pid_type': 'flat',
2026-02-21T08:52:04.4190606Z  'range_flattens': [None, None],
2026-02-21T08:52:04.4190870Z  'range_multi_buffers': [None, False],
2026-02-21T08:52:04.4191160Z  'range_num_stages': [0, 4],
2026-02-21T08:52:04.4191396Z  'range_unroll_factors': [0, 2],
2026-02-21T08:52:04.4191647Z  'range_warp_specializes': []}
2026-02-21T08:52:04.4227173Z [240s] Fitting surrogate: 597 points, 597 targets
2026-02-21T08:52:05.2937226Z [241s] Generation 8 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:52:18.1428856Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 1.3 configs/s
2026-02-21T08:52:21.5743525Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 16.5 configs/s
2026-02-21T08:52:27.1287558Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 182.4         
2026-02-21T08:52:27.1290115Z                                                                   configs/s     
2026-02-21T08:52:27.6169553Z [263s] Generation 8 complete: 
2026-02-21T08:52:27.6169884Z ok=58
2026-02-21T08:52:27.6170184Z min=0.0230
2026-02-21T08:52:27.6170361Z mid=0.0252
2026-02-21T08:52:27.6170531Z max=0.2018
2026-02-21T08:52:27.6170744Z best={'block_sizes': [1, 4096],
2026-02-21T08:52:27.6171104Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:52:27.6171516Z  'load_eviction_policies': ['', ''],
2026-02-21T08:52:27.6171768Z  'num_stages': 5,
2026-02-21T08:52:27.6171936Z  'num_warps': 2,
2026-02-21T08:52:27.6172102Z  'pid_type': 'flat',
2026-02-21T08:52:27.6172293Z  'range_flattens': [None, None],
2026-02-21T08:52:27.6172518Z  'range_multi_buffers': [None, True],
2026-02-21T08:52:27.6172753Z  'range_num_stages': [0, 3],
2026-02-21T08:52:27.6172963Z  'range_unroll_factors': [0, 1],
2026-02-21T08:52:27.6173176Z  'range_warp_specializes': []}
2026-02-21T08:52:27.6208829Z [263s] Fitting surrogate: 655 points, 655 targets
2026-02-21T08:52:28.4775355Z [264s] Generation 9 starting: 52 neighbors, 5 active search path(s)
2026-02-21T08:52:37.2099262Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 9.2 configs/s
2026-02-21T08:52:40.4149798Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 16.4 configs/s
2026-02-21T08:52:46.9498317Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 155.1         
2026-02-21T08:52:46.9498826Z                                                                   configs/s     
2026-02-21T08:52:47.5179674Z [283s] Generation 9 complete: 
2026-02-21T08:52:47.5179955Z ok=57
2026-02-21T08:52:47.5180133Z min=0.0262
2026-02-21T08:52:47.5180304Z mid=0.0266
2026-02-21T08:52:47.5180479Z max=0.0289
2026-02-21T08:52:47.5180659Z best={'block_sizes': [1, 4096],
2026-02-21T08:52:47.5180966Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:52:47.5181307Z  'load_eviction_policies': ['', ''],
2026-02-21T08:52:47.5181553Z  'num_stages': 2,
2026-02-21T08:52:47.5181743Z  'num_warps': 2,
2026-02-21T08:52:47.5181930Z  'pid_type': 'flat',
2026-02-21T08:52:47.5182186Z  'range_flattens': [None, None],
2026-02-21T08:52:47.5182439Z  'range_multi_buffers': [None, True],
2026-02-21T08:52:47.5182694Z  'range_num_stages': [0, 3],
2026-02-21T08:52:47.5183572Z  'range_unroll_factors': [0, 2],
2026-02-21T08:52:47.5183815Z  'range_warp_specializes': []}
2026-02-21T08:52:47.5220987Z [283s] Fitting surrogate: 712 points, 712 targets
2026-02-21T08:52:48.2707006Z [284s] Generation 10 starting: 42 neighbors, 4 active search path(s)
2026-02-21T08:52:56.2864563Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 8.4 configs/s
2026-02-21T08:52:59.0795885Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 46/46 16.7 configs/s
2026-02-21T08:53:04.4738560Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 214.3         
2026-02-21T08:53:04.4739054Z                                                                   configs/s     
2026-02-21T08:53:04.8929275Z [300s] Generation 10 complete: 
2026-02-21T08:53:04.8929595Z ok=47
2026-02-21T08:53:04.8930576Z min=0.0227
2026-02-21T08:53:04.8930797Z mid=0.0237
2026-02-21T08:53:04.8930969Z max=0.2674
2026-02-21T08:53:04.8931162Z best={'block_sizes': [1, 4096],
2026-02-21T08:53:04.8931523Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:53:04.8931873Z  'load_eviction_policies': ['', ''],
2026-02-21T08:53:04.8932133Z  'num_stages': 2,
2026-02-21T08:53:04.8932340Z  'num_warps': 2,
2026-02-21T08:53:04.8932538Z  'pid_type': 'flat',
2026-02-21T08:53:04.8932770Z  'range_flattens': [None, None],
2026-02-21T08:53:04.8933031Z  'range_multi_buffers': [None, True],
2026-02-21T08:53:04.8933307Z  'range_num_stages': [0, 4],
2026-02-21T08:53:04.8933564Z  'range_unroll_factors': [0, 2],
2026-02-21T08:53:04.8933810Z  'range_warp_specializes': []}
2026-02-21T08:53:04.8964950Z [300s] Fitting surrogate: 759 points, 759 targets
2026-02-21T08:53:05.6523079Z [301s] Generation 11 starting: 45 neighbors, 4 active search path(s)
2026-02-21T08:53:13.3804572Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 4.4 configs/s
2026-02-21T08:53:16.0955235Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 45/45 16.8 configs/s
2026-02-21T08:53:21.5947748Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 184.2         
2026-02-21T08:53:21.5948289Z                                                                   configs/s     
2026-02-21T08:53:22.0830249Z [318s] Generation 11 complete: 
2026-02-21T08:53:22.0830601Z ok=49
2026-02-21T08:53:22.0830790Z min=0.0234
2026-02-21T08:53:22.0830972Z mid=0.0235
2026-02-21T08:53:22.0831141Z max=0.0323
2026-02-21T08:53:22.0831340Z best={'block_sizes': [1, 4096],
2026-02-21T08:53:22.0831702Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T08:53:22.0832103Z  'load_eviction_policies': ['', ''],
2026-02-21T08:53:22.0832364Z  'num_stages': 2,
2026-02-21T08:53:22.0832560Z  'num_warps': 4,
2026-02-21T08:53:22.0832767Z  'pid_type': 'flat',
2026-02-21T08:53:22.0832991Z  'range_flattens': [None, None],
2026-02-21T08:53:22.0833299Z  'range_multi_buffers': [None, False],
2026-02-21T08:53:22.0833584Z  'range_num_stages': [0, 4],
2026-02-21T08:53:22.0833832Z  'range_unroll_factors': [0, 2],
2026-02-21T08:53:22.0835161Z  'range_warp_specializes': []}
2026-02-21T08:53:22.0874662Z [318s] Fitting surrogate: 808 points, 808 targets
2026-02-21T08:53:22.8363016Z [318s] Generation 12 starting: 43 neighbors, 4 active search path(s)
2026-02-21T08:53:30.1954899Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 6.5 configs/s
2026-02-21T08:53:32.7859911Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 43/43 16.9 configs/s
2026-02-21T08:53:38.0621884Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 191.8         
2026-02-21T08:53:38.0622401Z                                                                   configs/s     
2026-02-21T08:53:38.5237107Z [334s] Generation 12 complete: 
2026-02-21T08:53:38.5237408Z ok=47
2026-02-21T08:53:38.5237597Z min=0.0261
2026-02-21T08:53:38.5238427Z mid=0.0265
2026-02-21T08:53:38.5238634Z max=0.0364
2026-02-21T08:53:38.5238837Z best={'block_sizes': [1, 4096],
2026-02-21T08:53:38.5239143Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:53:38.5239499Z  'load_eviction_policies': ['', ''],
2026-02-21T08:53:38.5239768Z  'num_stages': 7,
2026-02-21T08:53:38.5239978Z  'num_warps': 2,
2026-02-21T08:53:38.5240181Z  'pid_type': 'flat',
2026-02-21T08:53:38.5240415Z  'range_flattens': [None, False],
2026-02-21T08:53:38.5240704Z  'range_multi_buffers': [None, False],
2026-02-21T08:53:38.5241031Z  'range_num_stages': [0, 4],
2026-02-21T08:53:38.5241303Z  'range_unroll_factors': [0, 2],
2026-02-21T08:53:38.5241544Z  'range_warp_specializes': []}
2026-02-21T08:53:38.5282113Z [334s] Fitting surrogate: 855 points, 855 targets
2026-02-21T08:53:39.2848407Z [335s] Generation 13 starting: 43 neighbors, 4 active search path(s)
2026-02-21T08:53:48.3659449Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 1.8 configs/s
2026-02-21T08:53:51.9236601Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 46/46 13.0 configs/s
2026-02-21T08:53:56.6874819Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 212.5         
2026-02-21T08:53:56.6875394Z                                                                   configs/s     
2026-02-21T08:53:57.1113603Z [353s] Generation 13 complete: 
2026-02-21T08:53:57.1113909Z ok=48
2026-02-21T08:53:57.1114311Z min=0.0228
2026-02-21T08:53:57.1114505Z mid=0.0235
2026-02-21T08:53:57.1114675Z max=0.0504
2026-02-21T08:53:57.1114865Z best={'block_sizes': [1, 4096],
2026-02-21T08:53:57.1115193Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:53:57.1115565Z  'load_eviction_policies': ['', ''],
2026-02-21T08:53:57.1115825Z  'num_stages': 2,
2026-02-21T08:53:57.1116033Z  'num_warps': 2,
2026-02-21T08:53:57.1116244Z  'pid_type': 'flat',
2026-02-21T08:53:57.1116470Z  'range_flattens': [None, None],
2026-02-21T08:53:57.1116729Z  'range_multi_buffers': [None, False],
2026-02-21T08:53:57.1117037Z  'range_num_stages': [0, 4],
2026-02-21T08:53:57.1117298Z  'range_unroll_factors': [0, 3],
2026-02-21T08:53:57.1117549Z  'range_warp_specializes': []}
2026-02-21T08:53:57.1157409Z [353s] Fitting surrogate: 903 points, 903 targets
2026-02-21T08:53:57.8545615Z [353s] Generation 14 starting: 42 neighbors, 4 active search path(s)
2026-02-21T08:54:04.7199134Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 18.1 configs/s
2026-02-21T08:54:07.2462472Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 42/42 16.9 configs/s
2026-02-21T08:54:12.3820749Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 197.1         
2026-02-21T08:54:12.3821529Z                                                                   configs/s     
2026-02-21T08:54:12.8313460Z [368s] Generation 14 complete: 
2026-02-21T08:54:12.8313785Z ok=46
2026-02-21T08:54:12.8314149Z min=0.0261
2026-02-21T08:54:12.8314363Z mid=0.0263
2026-02-21T08:54:12.8314543Z max=0.0363
2026-02-21T08:54:12.8314779Z best={'block_sizes': [1, 4096],
2026-02-21T08:54:12.8315119Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:54:12.8315489Z  'load_eviction_policies': ['', ''],
2026-02-21T08:54:12.8316468Z  'num_stages': 2,
2026-02-21T08:54:12.8316673Z  'num_warps': 2,
2026-02-21T08:54:12.8316890Z  'pid_type': 'flat',
2026-02-21T08:54:12.8317127Z  'range_flattens': [None, None],
2026-02-21T08:54:12.8317396Z  'range_multi_buffers': [None, False],
2026-02-21T08:54:12.8317668Z  'range_num_stages': [0, 3],
2026-02-21T08:54:12.8317917Z  'range_unroll_factors': [0, 3],
2026-02-21T08:54:12.8318169Z  'range_warp_specializes': []}
2026-02-21T08:54:12.8360594Z [368s] Fitting surrogate: 949 points, 949 targets
2026-02-21T08:54:13.5343509Z [369s] Generation 15 starting: 37 neighbors, 4 active search path(s)
2026-02-21T08:54:20.5865819Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 8.2 configs/s
2026-02-21T08:54:23.0881762Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 41/41 16.7 configs/s
2026-02-21T08:54:27.0267436Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 256.9         
2026-02-21T08:54:27.0268462Z                                                                   configs/s     
2026-02-21T08:54:27.3855144Z [383s] Generation 15 complete: 
2026-02-21T08:54:27.3855416Z ok=42
2026-02-21T08:54:27.3855590Z min=0.0228
2026-02-21T08:54:27.3855761Z mid=0.0234
2026-02-21T08:54:27.3855934Z max=0.0629
2026-02-21T08:54:27.3856114Z best={'block_sizes': [1, 4096],
2026-02-21T08:54:27.3856394Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:54:27.3856701Z  'load_eviction_policies': ['', ''],
2026-02-21T08:54:27.3856959Z  'num_stages': 7,
2026-02-21T08:54:27.3857151Z  'num_warps': 2,
2026-02-21T08:54:27.3857357Z  'pid_type': 'flat',
2026-02-21T08:54:27.3857576Z  'range_flattens': [None, None],
2026-02-21T08:54:27.3857829Z  'range_multi_buffers': [None, False],
2026-02-21T08:54:27.3858097Z  'range_num_stages': [0, 3],
2026-02-21T08:54:27.3858353Z  'range_unroll_factors': [0, 1],
2026-02-21T08:54:27.3858603Z  'range_warp_specializes': []}
2026-02-21T08:54:27.3903267Z [383s] Fitting surrogate: 991 points, 991 targets
2026-02-21T08:54:27.9479512Z [383s] Generation 16 starting: 29 neighbors, 3 active search path(s)
2026-02-21T08:54:33.0066577Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 5.7 configs/s
2026-02-21T08:54:34.7669019Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 16.9 configs/s
2026-02-21T08:54:39.0901544Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 280.6         
2026-02-21T08:54:39.0902065Z                                                                   configs/s     
2026-02-21T08:54:39.4164518Z [395s] Generation 16 complete: 
2026-02-21T08:54:39.4164812Z ok=32
2026-02-21T08:54:39.4165003Z min=0.0231
2026-02-21T08:54:39.4165188Z mid=0.0235
2026-02-21T08:54:39.4165354Z max=0.0325
2026-02-21T08:54:39.4165549Z best={'block_sizes': [1, 4096],
2026-02-21T08:54:39.4165915Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:54:39.4166290Z  'load_eviction_policies': ['', ''],
2026-02-21T08:54:39.4166552Z  'num_stages': 8,
2026-02-21T08:54:39.4166758Z  'num_warps': 2,
2026-02-21T08:54:39.4166992Z  'pid_type': 'flat',
2026-02-21T08:54:39.4167245Z  'range_flattens': [None, True],
2026-02-21T08:54:39.4167512Z  'range_multi_buffers': [None, False],
2026-02-21T08:54:39.4167792Z  'range_num_stages': [0, 1],
2026-02-21T08:54:39.4168037Z  'range_unroll_factors': [0, 2],
2026-02-21T08:54:39.4168287Z  'range_warp_specializes': []}
2026-02-21T08:54:39.4208393Z [395s] Fitting surrogate: 1023 points, 1023 targets
2026-02-21T08:54:40.0091414Z [395s] Generation 17 starting: 31 neighbors, 3 active search path(s)
2026-02-21T08:54:45.4359614Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 6.1 configs/s
2026-02-21T08:54:47.2940066Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 17.1 configs/s
2026-02-21T08:54:50.9642828Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 275.1         
2026-02-21T08:54:50.9643363Z                                                                   configs/s     
2026-02-21T08:54:51.2917790Z [407s] Generation 17 complete: 
2026-02-21T08:54:51.2918801Z ok=34
2026-02-21T08:54:51.2918988Z min=0.0262
2026-02-21T08:54:51.2919163Z mid=0.0266
2026-02-21T08:54:51.2919334Z max=0.0345
2026-02-21T08:54:51.2919522Z best={'block_sizes': [1, 4096],
2026-02-21T08:54:51.2919857Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T08:54:51.2920216Z  'load_eviction_policies': ['', ''],
2026-02-21T08:54:51.2920481Z  'num_stages': 8,
2026-02-21T08:54:51.2920687Z  'num_warps': 2,
2026-02-21T08:54:51.2920892Z  'pid_type': 'flat',
2026-02-21T08:54:51.2921120Z  'range_flattens': [None, True],
2026-02-21T08:54:51.2921392Z  'range_multi_buffers': [None, False],
2026-02-21T08:54:51.2921681Z  'range_num_stages': [0, 1],
2026-02-21T08:54:51.2921894Z  'range_unroll_factors': [0, 2],
2026-02-21T08:54:51.2922367Z  'range_warp_specializes': []}
2026-02-21T08:54:51.2966677Z [407s] Fitting surrogate: 1057 points, 1057 targets
2026-02-21T08:54:51.7280655Z [407s] Generation 18 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:54:59.3445605Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 0.8 configs/s
2026-02-21T08:55:00.6553083Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.4 configs/s
2026-02-21T08:55:02.9321791Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 441.8         
2026-02-21T08:55:02.9322465Z                                                                   configs/s     
2026-02-21T08:55:03.1432509Z [419s] Generation 18 complete: 
2026-02-21T08:55:03.1432804Z ok=23
2026-02-21T08:55:03.1432995Z min=0.0261
2026-02-21T08:55:03.1433179Z mid=0.0266
2026-02-21T08:55:03.1433356Z max=0.2019
2026-02-21T08:55:03.1433546Z best={'block_sizes': [1, 4096],
2026-02-21T08:55:03.1433878Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T08:55:03.1434561Z  'load_eviction_policies': ['', ''],
2026-02-21T08:55:03.1434838Z  'num_stages': 4,
2026-02-21T08:55:03.1435039Z  'num_warps': 2,
2026-02-21T08:55:03.1435244Z  'pid_type': 'flat',
2026-02-21T08:55:03.1435486Z  'range_flattens': [None, None],
2026-02-21T08:55:03.1435757Z  'range_multi_buffers': [None, None],
2026-02-21T08:55:03.1436035Z  'range_num_stages': [0, 2],
2026-02-21T08:55:03.1436277Z  'range_unroll_factors': [0, 2],
2026-02-21T08:55:03.1436535Z  'range_warp_specializes': []}
2026-02-21T08:55:03.1485754Z [419s] Fitting surrogate: 1080 points, 1080 targets
2026-02-21T08:55:03.5850248Z [419s] Generation 19 starting: 20 neighbors, 2 active search path(s)
2026-02-21T08:55:12.2089321Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 1.2 configs/s
2026-02-21T08:55:13.5800777Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 16.6 configs/s
2026-02-21T08:55:15.7196202Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 469.9         
2026-02-21T08:55:15.7196749Z                                                                   configs/s     
2026-02-21T08:55:15.9215047Z [431s] Generation 19 complete: 
2026-02-21T08:55:15.9215334Z ok=23
2026-02-21T08:55:15.9216077Z min=0.0230
2026-02-21T08:55:15.9216259Z mid=0.0251
2026-02-21T08:55:15.9216433Z max=0.3158
2026-02-21T08:55:15.9216632Z best={'block_sizes': [1, 4096],
2026-02-21T08:55:15.9216960Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:55:15.9217301Z  'load_eviction_policies': ['', ''],
2026-02-21T08:55:15.9217565Z  'num_stages': 7,
2026-02-21T08:55:15.9217763Z  'num_warps': 2,
2026-02-21T08:55:15.9218001Z  'pid_type': 'flat',
2026-02-21T08:55:15.9218220Z  'range_flattens': [None, None],
2026-02-21T08:55:15.9218502Z  'range_multi_buffers': [None, False],
2026-02-21T08:55:15.9218821Z  'range_num_stages': [0, 2],
2026-02-21T08:55:15.9219106Z  'range_unroll_factors': [0, 0],
2026-02-21T08:55:15.9219349Z  'range_warp_specializes': []}
2026-02-21T08:55:15.9265324Z [431s] Fitting surrogate: 1103 points, 1103 targets
2026-02-21T08:55:16.3933000Z [432s] Generation 20 starting: 23 neighbors, 2 active search path(s)
2026-02-21T08:55:21.4025501Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 3.2 configs/s
2026-02-21T08:55:22.8368090Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.5 configs/s
2026-02-21T08:55:25.7135843Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 350.3         
2026-02-21T08:55:25.7136345Z                                                                   configs/s     
2026-02-21T08:55:25.9730494Z [441s] Generation 20 complete: 
2026-02-21T08:55:25.9730805Z ok=25
2026-02-21T08:55:25.9730992Z min=0.0262
2026-02-21T08:55:25.9731175Z mid=0.0265
2026-02-21T08:55:25.9731350Z max=0.0333
2026-02-21T08:55:25.9731539Z best={'block_sizes': [1, 4096],
2026-02-21T08:55:25.9731869Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T08:55:25.9732220Z  'load_eviction_policies': ['', ''],
2026-02-21T08:55:25.9732511Z  'num_stages': 7,
2026-02-21T08:55:25.9732709Z  'num_warps': 2,
2026-02-21T08:55:25.9732901Z  'pid_type': 'flat',
2026-02-21T08:55:25.9733129Z  'range_flattens': [None, False],
2026-02-21T08:55:25.9733427Z  'range_multi_buffers': [None, False],
2026-02-21T08:55:25.9733698Z  'range_num_stages': [0, 2],
2026-02-21T08:55:25.9733933Z  'range_unroll_factors': [0, 0],
2026-02-21T08:55:25.9734627Z  'range_warp_specializes': []}
2026-02-21T08:55:25.9781957Z [441s] Fitting surrogate: 1128 points, 1128 targets
2026-02-21T08:55:26.1431609Z [442s] Autotuning complete in 442.1s after searching 1069 configs.
2026-02-21T08:55:26.1432110Z One can hardcode the best config and skip autotuning with:
2026-02-21T08:55:26.1433596Z     @helion.kernel(config=helion.Config(block_sizes=[1, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=7, num_warps=2, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[0, 0], range_warp_specializes=[]), static_shapes=True)
2026-02-21T08:55:26.1435395Z 
2026-02-21T08:55:26.1435885Z [442s] Code of selected kernel: /tmp/torchinductor_root/pu/cpuf3f63yqdxtdxyomnvgqekpl2adkzp6bw4xrmov7kr5oeydz66.py
2026-02-21T08:55:26.9736434Z WARNING:tritonbench.utils.triton_op:Completed input ID 26:
2026-02-21T08:55:26.9736853Z (M, N)
2026-02-21T08:55:26.9737028Z ------------
2026-02-21T08:55:26.9737204Z (4096, 3584)
2026-02-21T08:55:26.9737644Z 
2026-02-21T08:55:26.9761305Z  30%|███       | 6/20 [36:56<1:34:28, 404.89s/it]WARNING:tritonbench.utils.triton_op:Running input ID 31:
2026-02-21T08:55:26.9761726Z (M, N)
2026-02-21T08:55:26.9761885Z ------------
2026-02-21T08:55:26.9762052Z (4096, 4224)
2026-02-21T08:55:26.9764231Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T08:55:28.5373782Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T08:55:30.2617196Z INFO:tritonbench.utils.triton_op:Took 3.35ms to get benchmark function for torch_compile_softmax
2026-02-21T08:55:34.3820408Z WARNING:__main__:Input tensor metadata:
2026-02-21T08:55:34.3820776Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T08:55:34.3821678Z               'dtype': 'torch.float16',
2026-02-21T08:55:34.3821958Z               'shape': (4096, 4224),
2026-02-21T08:55:34.3822214Z               'stride': (4224, 1)},),
2026-02-21T08:55:34.3822450Z   'kwargs': {}}
2026-02-21T08:55:34.3871060Z INFO:tritonbench.utils.triton_op:Took 5.42ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T08:55:34.6789109Z [0s] Autotune random seed: 2135383793
2026-02-21T08:55:34.8614986Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T08:56:09.7087225Z [34s] Timeout after 30s compiling Config(block_sizes=[128, 1024], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first'], maxnreg=32, num_sm_multiplier=32, num_stages=8, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, False], range_multi_buffers=[True, True], range_num_stages=[1, 2], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:56:10.2371926Z [35s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T08:56:10.9083608Z [36s] Timeout after 30s compiling Config(block_sizes=[8, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T08:56:11.8666387Z [37s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T08:56:19.1832566Z [44s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T08:56:19.8675760Z [45s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T08:56:20.4599516Z [45s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T08:56:20.4620366Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T08:56:27.4179847Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.4 configs/s
2026-02-21T08:56:27.4195589Z [52s] Adaptive compile timeout: 30s (90% percentile=16.3s, bounds=[30.0s, 30s])
2026-02-21T08:56:28.2247348Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1212.0 configs/s
2026-02-21T08:56:28.3127815Z [53s] Initial random population of 100, 5 starting points: 
2026-02-21T08:56:28.3130416Z error=1
2026-02-21T08:56:28.3130650Z timeout=7
2026-02-21T08:56:28.3131506Z ok=92
2026-02-21T08:56:28.3131698Z min=0.0430
2026-02-21T08:56:28.3131870Z mid=0.3397
2026-02-21T08:56:28.3132043Z max=88.4401
2026-02-21T08:56:28.3132240Z best={'block_sizes': [1, 256],
2026-02-21T08:56:28.3132649Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:56:28.3133071Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:56:28.3133341Z  'num_stages': 2,
2026-02-21T08:56:28.3133539Z  'num_warps': 1,
2026-02-21T08:56:28.3133746Z  'pid_type': 'flat',
2026-02-21T08:56:28.3134210Z  'range_flattens': [None, True],
2026-02-21T08:56:28.3134477Z  'range_multi_buffers': [None, None],
2026-02-21T08:56:28.3134756Z  'range_num_stages': [0, 3],
2026-02-21T08:56:28.3134998Z  'range_unroll_factors': [0, 2],
2026-02-21T08:56:28.3135564Z  'range_warp_specializes': []}
2026-02-21T08:56:28.3146318Z [53s] Fitting surrogate: 100 points, 100 targets
2026-02-21T08:56:29.7216262Z [54s] Generation 1 starting: 87 neighbors, 5 active search path(s)
2026-02-21T08:57:02.4189093Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 0.5 configs/s
2026-02-21T08:57:07.9966170Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 16.3 configs/s
2026-02-21T08:57:15.7968056Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 129.6         
2026-02-21T08:57:15.7970474Z                                                                   configs/s     
2026-02-21T08:57:16.3790338Z [101s] Generation 1 complete: 
2026-02-21T08:57:16.3790633Z ok=93
2026-02-21T08:57:16.3790808Z min=0.0364
2026-02-21T08:57:16.3790977Z mid=0.0511
2026-02-21T08:57:16.3791147Z max=0.3916
2026-02-21T08:57:16.3791327Z best={'block_sizes': [1, 1024],
2026-02-21T08:57:16.3791715Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:57:16.3792158Z  'load_eviction_policies': ['', 'last'],
2026-02-21T08:57:16.3792421Z  'num_stages': 2,
2026-02-21T08:57:16.3792605Z  'num_warps': 1,
2026-02-21T08:57:16.3792800Z  'pid_type': 'flat',
2026-02-21T08:57:16.3793031Z  'range_flattens': [None, False],
2026-02-21T08:57:16.3793293Z  'range_multi_buffers': [None, None],
2026-02-21T08:57:16.3793553Z  'range_num_stages': [0, 3],
2026-02-21T08:57:16.3793784Z  'range_unroll_factors': [0, 2],
2026-02-21T08:57:16.3794431Z  'range_warp_specializes': []}
2026-02-21T08:57:16.3812517Z [101s] Fitting surrogate: 193 points, 193 targets
2026-02-21T08:57:17.5985264Z [102s] Generation 2 starting: 75 neighbors, 5 active search path(s)
2026-02-21T08:57:32.4289615Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76/76 6.1 configs/s
2026-02-21T08:57:37.1367193Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 76/76 16.3 configs/s
2026-02-21T08:57:45.8186263Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 127.3         
2026-02-21T08:57:45.8186842Z                                                                   configs/s     
2026-02-21T08:57:46.4089064Z [131s] Generation 2 complete: 
2026-02-21T08:57:46.4089363Z ok=80
2026-02-21T08:57:46.4089593Z min=0.0334
2026-02-21T08:57:46.4089765Z mid=0.0432
2026-02-21T08:57:46.4090065Z max=0.1236
2026-02-21T08:57:46.4090254Z best={'block_sizes': [1, 1024],
2026-02-21T08:57:46.4090646Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:57:46.4091092Z  'load_eviction_policies': ['', 'first'],
2026-02-21T08:57:46.4091362Z  'num_stages': 2,
2026-02-21T08:57:46.4091562Z  'num_warps': 1,
2026-02-21T08:57:46.4091763Z  'pid_type': 'flat',
2026-02-21T08:57:46.4091994Z  'range_flattens': [None, False],
2026-02-21T08:57:46.4092257Z  'range_multi_buffers': [None, None],
2026-02-21T08:57:46.4092540Z  'range_num_stages': [0, 3],
2026-02-21T08:57:46.4092782Z  'range_unroll_factors': [0, 2],
2026-02-21T08:57:46.4093056Z  'range_warp_specializes': []}
2026-02-21T08:57:46.4113055Z [131s] Fitting surrogate: 273 points, 273 targets
2026-02-21T08:57:47.3401560Z [132s] Generation 3 starting: 58 neighbors, 5 active search path(s)
2026-02-21T08:58:05.1619036Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 1.1 configs/s
2026-02-21T08:58:08.9347135Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.3 configs/s
2026-02-21T08:58:16.0978179Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.2         
2026-02-21T08:58:16.0979224Z                                                                   configs/s     
2026-02-21T08:58:16.6583340Z [161s] Generation 3 complete: 
2026-02-21T08:58:16.6583653Z ok=63
2026-02-21T08:58:16.6583836Z min=0.0335
2026-02-21T08:58:16.6584720Z mid=0.0394
2026-02-21T08:58:16.6584918Z max=0.1520
2026-02-21T08:58:16.6585122Z best={'block_sizes': [1, 1024],
2026-02-21T08:58:16.6585530Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T08:58:16.6586619Z  'load_eviction_policies': ['', 'first'],
2026-02-21T08:58:16.6586897Z  'num_stages': 2,
2026-02-21T08:58:16.6587088Z  'num_warps': 1,
2026-02-21T08:58:16.6587277Z  'pid_type': 'flat',
2026-02-21T08:58:16.6587539Z  'range_flattens': [None, False],
2026-02-21T08:58:16.6587798Z  'range_multi_buffers': [None, None],
2026-02-21T08:58:16.6588054Z  'range_num_stages': [0, 2],
2026-02-21T08:58:16.6588289Z  'range_unroll_factors': [0, 2],
2026-02-21T08:58:16.6588532Z  'range_warp_specializes': []}
2026-02-21T08:58:16.6612488Z [161s] Fitting surrogate: 336 points, 336 targets
2026-02-21T08:58:17.6095325Z [162s] Generation 4 starting: 59 neighbors, 5 active search path(s)
2026-02-21T08:58:28.4112990Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 8.2 configs/s
2026-02-21T08:58:32.1034670Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.4 configs/s
2026-02-21T08:58:40.5304938Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 132.1         
2026-02-21T08:58:40.5305672Z                                                                   configs/s     
2026-02-21T08:58:41.1299030Z [186s] Generation 4 complete: 
2026-02-21T08:58:41.1299292Z ok=64
2026-02-21T08:58:41.1299513Z min=0.0334
2026-02-21T08:58:41.1299687Z mid=0.0373
2026-02-21T08:58:41.1299856Z max=0.0659
2026-02-21T08:58:41.1300038Z best={'block_sizes': [1, 1024],
2026-02-21T08:58:41.1300398Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:58:41.1300784Z  'load_eviction_policies': ['', 'first'],
2026-02-21T08:58:41.1301061Z  'num_stages': 2,
2026-02-21T08:58:41.1301262Z  'num_warps': 1,
2026-02-21T08:58:41.1313051Z  'pid_type': 'flat',
2026-02-21T08:58:41.1313290Z  'range_flattens': [None, False],
2026-02-21T08:58:41.1313529Z  'range_multi_buffers': [None, None],
2026-02-21T08:58:41.1313773Z  'range_num_stages': [0, 2],
2026-02-21T08:58:41.1314189Z  'range_unroll_factors': [0, 2],
2026-02-21T08:58:41.1314433Z  'range_warp_specializes': []}
2026-02-21T08:58:41.1327496Z [186s] Fitting surrogate: 400 points, 400 targets
2026-02-21T08:58:42.1072155Z [187s] Generation 5 starting: 57 neighbors, 5 active search path(s)
2026-02-21T08:58:53.3458984Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 4.8 configs/s
2026-02-21T08:58:56.9720178Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 16.5 configs/s
2026-02-21T08:59:03.2861819Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 160.3         
2026-02-21T08:59:03.2862335Z                                                                   configs/s     
2026-02-21T08:59:03.8038962Z [208s] Generation 5 complete: 
2026-02-21T08:59:03.8039247Z ok=63
2026-02-21T08:59:03.8039445Z min=0.0270
2026-02-21T08:59:03.8039625Z mid=0.0359
2026-02-21T08:59:03.8039799Z max=0.0669
2026-02-21T08:59:03.8039985Z best={'block_sizes': [1, 8192],
2026-02-21T08:59:03.8040306Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:59:03.8040633Z  'load_eviction_policies': ['', ''],
2026-02-21T08:59:03.8040903Z  'num_stages': 6,
2026-02-21T08:59:03.8041139Z  'num_warps': 4,
2026-02-21T08:59:03.8041340Z  'pid_type': 'flat',
2026-02-21T08:59:03.8041571Z  'range_flattens': [None, None],
2026-02-21T08:59:03.8042264Z  'range_multi_buffers': [None, None],
2026-02-21T08:59:03.8042561Z  'range_num_stages': [0, 2],
2026-02-21T08:59:03.8042809Z  'range_unroll_factors': [0, 3],
2026-02-21T08:59:03.8043064Z  'range_warp_specializes': []}
2026-02-21T08:59:03.8076149Z [208s] Fitting surrogate: 463 points, 463 targets
2026-02-21T08:59:04.7772094Z [209s] Generation 6 starting: 58 neighbors, 5 active search path(s)
2026-02-21T08:59:15.5541324Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 8.8 configs/s
2026-02-21T08:59:19.1777756Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 16.5 configs/s
2026-02-21T08:59:25.0100146Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 173.5         
2026-02-21T08:59:25.0101831Z                                                                   configs/s     
2026-02-21T08:59:25.4931636Z [230s] Generation 6 complete: 
2026-02-21T08:59:25.4932101Z ok=63
2026-02-21T08:59:25.4932408Z min=0.0271
2026-02-21T08:59:25.4932711Z mid=0.0355
2026-02-21T08:59:25.4933019Z max=0.1499
2026-02-21T08:59:25.4933314Z best={'block_sizes': [1, 8192],
2026-02-21T08:59:25.4933907Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T08:59:25.4934699Z  'load_eviction_policies': ['', ''],
2026-02-21T08:59:25.4934967Z  'num_stages': 7,
2026-02-21T08:59:25.4935161Z  'num_warps': 2,
2026-02-21T08:59:25.4935368Z  'pid_type': 'flat',
2026-02-21T08:59:25.4935605Z  'range_flattens': [None, None],
2026-02-21T08:59:25.4935881Z  'range_multi_buffers': [None, False],
2026-02-21T08:59:25.4936167Z  'range_num_stages': [0, 2],
2026-02-21T08:59:25.4936403Z  'range_unroll_factors': [0, 3],
2026-02-21T08:59:25.4936658Z  'range_warp_specializes': []}
2026-02-21T08:59:25.4967718Z [230s] Fitting surrogate: 526 points, 526 targets
2026-02-21T08:59:26.3039981Z [231s] Generation 7 starting: 43 neighbors, 5 active search path(s)
2026-02-21T08:59:37.6327796Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 1.5 configs/s
2026-02-21T08:59:40.3314526Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.6 configs/s
2026-02-21T08:59:45.3923698Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 199.9         
2026-02-21T08:59:45.3924398Z                                                                   configs/s     
2026-02-21T08:59:45.8129184Z [250s] Generation 7 complete: 
2026-02-21T08:59:45.8129613Z ok=48
2026-02-21T08:59:45.8129889Z min=0.0271
2026-02-21T08:59:45.8130339Z mid=0.0336
2026-02-21T08:59:45.8130656Z max=0.0587
2026-02-21T08:59:45.8130957Z best={'block_sizes': [1, 8192],
2026-02-21T08:59:45.8131430Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T08:59:45.8131943Z  'load_eviction_policies': ['', ''],
2026-02-21T08:59:45.8132358Z  'num_stages': 6,
2026-02-21T08:59:45.8132665Z  'num_warps': 2,
2026-02-21T08:59:45.8133021Z  'pid_type': 'flat',
2026-02-21T08:59:45.8133378Z  'range_flattens': [None, None],
2026-02-21T08:59:45.8133825Z  'range_multi_buffers': [None, None],
2026-02-21T08:59:45.8134801Z  'range_num_stages': [0, 1],
2026-02-21T08:59:45.8135758Z  'range_unroll_factors': [0, 3],
2026-02-21T08:59:45.8136176Z  'range_warp_specializes': []}
2026-02-21T08:59:45.8164266Z [250s] Fitting surrogate: 574 points, 574 targets
2026-02-21T08:59:46.5282249Z [251s] Generation 8 starting: 42 neighbors, 4 active search path(s)
2026-02-21T08:59:57.8468135Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 0.8 configs/s
2026-02-21T09:00:00.5041629Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 16.4 configs/s
2026-02-21T09:00:05.0017262Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 224.6         
2026-02-21T09:00:05.0017787Z                                                                   configs/s     
2026-02-21T09:00:05.3780414Z [270s] Generation 8 complete: 
2026-02-21T09:00:05.3781770Z ok=46
2026-02-21T09:00:05.3782003Z min=0.0270
2026-02-21T09:00:05.3782198Z mid=0.0363
2026-02-21T09:00:05.3782378Z max=0.0536
2026-02-21T09:00:05.3782579Z best={'block_sizes': [1, 8192],
2026-02-21T09:00:05.3782922Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:00:05.3783259Z  'load_eviction_policies': ['', ''],
2026-02-21T09:00:05.3783535Z  'num_stages': 6,
2026-02-21T09:00:05.3783735Z  'num_warps': 4,
2026-02-21T09:00:05.3783951Z  'pid_type': 'flat',
2026-02-21T09:00:05.3784523Z  'range_flattens': [None, False],
2026-02-21T09:00:05.3784815Z  'range_multi_buffers': [None, None],
2026-02-21T09:00:05.3785109Z  'range_num_stages': [0, 1],
2026-02-21T09:00:05.3785371Z  'range_unroll_factors': [0, 3],
2026-02-21T09:00:05.3785636Z  'range_warp_specializes': []}
2026-02-21T09:00:05.3818171Z [270s] Fitting surrogate: 620 points, 620 targets
2026-02-21T09:00:05.9528364Z [271s] Generation 9 starting: 29 neighbors, 3 active search path(s)
2026-02-21T09:00:12.4216970Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 6.4 configs/s
2026-02-21T09:00:14.3376732Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 31/31 16.5 configs/s
2026-02-21T09:00:17.0002759Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 377.5         
2026-02-21T09:00:17.0003841Z                                                                   configs/s     
2026-02-21T09:00:17.2322956Z [282s] Generation 9 complete: 
2026-02-21T09:00:17.2323300Z ok=32
2026-02-21T09:00:17.2323489Z min=0.0271
2026-02-21T09:00:17.2323676Z mid=0.0362
2026-02-21T09:00:17.2323846Z max=0.0592
2026-02-21T09:00:17.2324439Z best={'block_sizes': [1, 8192],
2026-02-21T09:00:17.2324761Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:00:17.2325084Z  'load_eviction_policies': ['', ''],
2026-02-21T09:00:17.2325343Z  'num_stages': 5,
2026-02-21T09:00:17.2325561Z  'num_warps': 2,
2026-02-21T09:00:17.2325766Z  'pid_type': 'flat',
2026-02-21T09:00:17.2326000Z  'range_flattens': [None, False],
2026-02-21T09:00:17.2326318Z  'range_multi_buffers': [None, None],
2026-02-21T09:00:17.2326587Z  'range_num_stages': [0, 1],
2026-02-21T09:00:17.2326835Z  'range_unroll_factors': [0, 3],
2026-02-21T09:00:17.2327112Z  'range_warp_specializes': []}
2026-02-21T09:00:17.2361980Z [282s] Fitting surrogate: 652 points, 652 targets
2026-02-21T09:00:17.6923089Z [282s] Generation 10 starting: 21 neighbors, 2 active search path(s)
2026-02-21T09:00:25.5517739Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 1.4 configs/s
2026-02-21T09:00:26.9839013Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.6 configs/s
2026-02-21T09:00:28.9803758Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 502.0         
2026-02-21T09:00:28.9804501Z                                                                   configs/s     
2026-02-21T09:00:29.1629231Z [294s] Generation 10 complete: 
2026-02-21T09:00:29.1629684Z ok=24
2026-02-21T09:00:29.1629963Z min=0.0270
2026-02-21T09:00:29.1630248Z mid=0.0304
2026-02-21T09:00:29.1630580Z max=0.0933
2026-02-21T09:00:29.1630879Z best={'block_sizes': [1, 8192],
2026-02-21T09:00:29.1631373Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:00:29.1632632Z  'load_eviction_policies': ['', ''],
2026-02-21T09:00:29.1633063Z  'num_stages': 6,
2026-02-21T09:00:29.1633376Z  'num_warps': 4,
2026-02-21T09:00:29.1633710Z  'pid_type': 'flat',
2026-02-21T09:00:29.1634360Z  'range_flattens': [None, False],
2026-02-21T09:00:29.1634809Z  'range_multi_buffers': [None, False],
2026-02-21T09:00:29.1635245Z  'range_num_stages': [0, 1],
2026-02-21T09:00:29.1635669Z  'range_unroll_factors': [0, 3],
2026-02-21T09:00:29.1636074Z  'range_warp_specializes': []}
2026-02-21T09:00:29.1664705Z [294s] Fitting surrogate: 676 points, 676 targets
2026-02-21T09:00:29.6307055Z [294s] Generation 11 starting: 22 neighbors, 2 active search path(s)
2026-02-21T09:00:36.9354541Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 1.6 configs/s
2026-02-21T09:00:38.3453855Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.8 configs/s
2026-02-21T09:00:41.5002815Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 419.9         
2026-02-21T09:00:41.5003364Z                                                                   configs/s     
2026-02-21T09:00:41.7128584Z [306s] Generation 11 complete: 
2026-02-21T09:00:41.7129030Z ok=24
2026-02-21T09:00:41.7129312Z min=0.0269
2026-02-21T09:00:41.7129587Z mid=0.0362
2026-02-21T09:00:41.7129861Z max=0.0762
2026-02-21T09:00:41.7130301Z best={'block_sizes': [1, 8192],
2026-02-21T09:00:41.7130782Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:00:41.7131288Z  'load_eviction_policies': ['', ''],
2026-02-21T09:00:41.7131694Z  'num_stages': 6,
2026-02-21T09:00:41.7132009Z  'num_warps': 4,
2026-02-21T09:00:41.7132335Z  'pid_type': 'flat',
2026-02-21T09:00:41.7132712Z  'range_flattens': [None, False],
2026-02-21T09:00:41.7133131Z  'range_multi_buffers': [None, False],
2026-02-21T09:00:41.7133588Z  'range_num_stages': [0, 1],
2026-02-21T09:00:41.7133965Z  'range_unroll_factors': [0, 3],
2026-02-21T09:00:41.7134923Z  'range_warp_specializes': []}
2026-02-21T09:00:41.7160461Z [306s] Fitting surrogate: 700 points, 700 targets
2026-02-21T09:00:42.1423365Z [307s] Generation 12 starting: 19 neighbors, 2 active search path(s)
2026-02-21T09:00:46.6846762Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 5.7 configs/s
2026-02-21T09:00:47.9257541Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.7 configs/s
2026-02-21T09:00:49.6071292Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 594.7         
2026-02-21T09:00:49.6071804Z                                                                   configs/s     
2026-02-21T09:00:49.7635092Z [314s] Generation 12 complete: 
2026-02-21T09:00:49.7635335Z ok=21
2026-02-21T09:00:49.7635498Z min=0.0270
2026-02-21T09:00:49.7635688Z mid=0.0382
2026-02-21T09:00:49.7635854Z max=0.0935
2026-02-21T09:00:49.7636063Z best={'block_sizes': [1, 8192],
2026-02-21T09:00:49.7636336Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:00:49.7636645Z  'load_eviction_policies': ['', ''],
2026-02-21T09:00:49.7636899Z  'num_stages': 6,
2026-02-21T09:00:49.7637104Z  'num_warps': 4,
2026-02-21T09:00:49.7637294Z  'pid_type': 'flat',
2026-02-21T09:00:49.7637500Z  'range_flattens': [None, False],
2026-02-21T09:00:49.7637767Z  'range_multi_buffers': [None, False],
2026-02-21T09:00:49.7638027Z  'range_num_stages': [0, 1],
2026-02-21T09:00:49.7638265Z  'range_unroll_factors': [0, 3],
2026-02-21T09:00:49.7638507Z  'range_warp_specializes': []}
2026-02-21T09:00:49.7671623Z [314s] Fitting surrogate: 721 points, 721 targets
2026-02-21T09:00:50.0930262Z [315s] Generation 13 starting: 12 neighbors, 1 active search path(s)
2026-02-21T09:00:53.6158791Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 3.6 configs/s
2026-02-21T09:00:54.4331481Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 16.8 configs/s
2026-02-21T09:00:55.5385951Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 896.2         
2026-02-21T09:00:55.5386463Z                                                                   configs/s     
2026-02-21T09:00:55.6508389Z [320s] Generation 13 complete: 
2026-02-21T09:00:55.6508808Z ok=14
2026-02-21T09:00:55.6509083Z min=0.0272
2026-02-21T09:00:55.6509350Z mid=0.0399
2026-02-21T09:00:55.6509650Z max=0.0477
2026-02-21T09:00:55.6509935Z best={'block_sizes': [1, 8192],
2026-02-21T09:00:55.6510400Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:00:55.6510908Z  'load_eviction_policies': ['', ''],
2026-02-21T09:00:55.6511309Z  'num_stages': 6,
2026-02-21T09:00:55.6511617Z  'num_warps': 4,
2026-02-21T09:00:55.6511916Z  'pid_type': 'flat',
2026-02-21T09:00:55.6512272Z  'range_flattens': [None, False],
2026-02-21T09:00:55.6512678Z  'range_multi_buffers': [None, False],
2026-02-21T09:00:55.6513111Z  'range_num_stages': [0, 1],
2026-02-21T09:00:55.6513482Z  'range_unroll_factors': [0, 3],
2026-02-21T09:00:55.6515067Z  'range_warp_specializes': []}
2026-02-21T09:00:55.6544766Z [320s] Fitting surrogate: 735 points, 735 targets
2026-02-21T09:00:55.9487682Z [321s] Generation 14 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:00:59.4657200Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 4.8 configs/s
2026-02-21T09:01:00.1547839Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.1 configs/s
2026-02-21T09:01:01.3757968Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 812.8         
2026-02-21T09:01:01.3758614Z                                                                   configs/s     
2026-02-21T09:01:01.4958201Z [326s] Generation 14 complete: 
2026-02-21T09:01:01.4958657Z ok=12
2026-02-21T09:01:01.4958950Z min=0.0274
2026-02-21T09:01:01.4959232Z mid=0.0392
2026-02-21T09:01:01.4959502Z max=0.0507
2026-02-21T09:01:01.4959796Z best={'block_sizes': [1, 8192],
2026-02-21T09:01:01.4960262Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:01:01.4960825Z  'load_eviction_policies': ['', ''],
2026-02-21T09:01:01.4961121Z  'num_stages': 6,
2026-02-21T09:01:01.4961324Z  'num_warps': 4,
2026-02-21T09:01:01.4961539Z  'pid_type': 'flat',
2026-02-21T09:01:01.4961765Z  'range_flattens': [None, False],
2026-02-21T09:01:01.4962033Z  'range_multi_buffers': [None, False],
2026-02-21T09:01:01.4962310Z  'range_num_stages': [0, 1],
2026-02-21T09:01:01.4962553Z  'range_unroll_factors': [0, 3],
2026-02-21T09:01:01.4962822Z  'range_warp_specializes': []}
2026-02-21T09:01:01.4999409Z [326s] Fitting surrogate: 747 points, 747 targets
2026-02-21T09:01:01.8670127Z [327s] Generation 15 starting: 14 neighbors, 1 active search path(s)
2026-02-21T09:01:05.8783105Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 5.0 configs/s
2026-02-21T09:01:06.8231052Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 16.6 configs/s
2026-02-21T09:01:08.2738241Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 687.1         
2026-02-21T09:01:08.2738739Z                                                                   configs/s     
2026-02-21T09:01:08.4116058Z [333s] Generation 15 complete: 
2026-02-21T09:01:08.4116870Z ok=16
2026-02-21T09:01:08.4117066Z min=0.0274
2026-02-21T09:01:08.4117238Z mid=0.0377
2026-02-21T09:01:08.4117406Z max=0.0501
2026-02-21T09:01:08.4117581Z best={'block_sizes': [1, 8192],
2026-02-21T09:01:08.4117881Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:01:08.4118205Z  'load_eviction_policies': ['', ''],
2026-02-21T09:01:08.4118472Z  'num_stages': 6,
2026-02-21T09:01:08.4118666Z  'num_warps': 4,
2026-02-21T09:01:08.4118878Z  'pid_type': 'flat',
2026-02-21T09:01:08.4119099Z  'range_flattens': [None, False],
2026-02-21T09:01:08.4119372Z  'range_multi_buffers': [None, False],
2026-02-21T09:01:08.4119636Z  'range_num_stages': [0, 1],
2026-02-21T09:01:08.4119886Z  'range_unroll_factors': [0, 3],
2026-02-21T09:01:08.4120137Z  'range_warp_specializes': []}
2026-02-21T09:01:08.4155032Z [333s] Fitting surrogate: 763 points, 763 targets
2026-02-21T09:01:08.7471959Z [333s] Generation 16 starting: 12 neighbors, 1 active search path(s)
2026-02-21T09:01:11.4661747Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 12.9 configs/s
2026-02-21T09:01:12.2173450Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.0 configs/s
2026-02-21T09:01:13.6161345Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 712.6         
2026-02-21T09:01:13.6161860Z                                                                   configs/s     
2026-02-21T09:01:13.7526091Z [338s] Generation 16 complete: 
2026-02-21T09:01:13.7526545Z ok=14
2026-02-21T09:01:13.7526815Z min=0.0273
2026-02-21T09:01:13.7527095Z mid=0.0293
2026-02-21T09:01:13.7527352Z max=0.0588
2026-02-21T09:01:13.7527648Z best={'block_sizes': [1, 8192],
2026-02-21T09:01:13.7528101Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:01:13.7528645Z  'load_eviction_policies': ['', ''],
2026-02-21T09:01:13.7529105Z  'num_stages': 6,
2026-02-21T09:01:13.7529407Z  'num_warps': 4,
2026-02-21T09:01:13.7529613Z  'pid_type': 'flat',
2026-02-21T09:01:13.7529865Z  'range_flattens': [None, False],
2026-02-21T09:01:13.7530253Z  'range_multi_buffers': [None, False],
2026-02-21T09:01:13.7530528Z  'range_num_stages': [0, 1],
2026-02-21T09:01:13.7530767Z  'range_unroll_factors': [0, 3],
2026-02-21T09:01:13.7531031Z  'range_warp_specializes': []}
2026-02-21T09:01:13.7564950Z [338s] Fitting surrogate: 777 points, 777 targets
2026-02-21T09:01:14.0850086Z [339s] Generation 17 starting: 12 neighbors, 1 active search path(s)
2026-02-21T09:01:16.7466897Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 11.0 configs/s
2026-02-21T09:01:17.4933916Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.1 configs/s
2026-02-21T09:01:19.0300322Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 649.6         
2026-02-21T09:01:19.0301354Z                                                                   configs/s     
2026-02-21T09:01:19.1769305Z [344s] Generation 17 complete: 
2026-02-21T09:01:19.1769695Z ok=14
2026-02-21T09:01:19.1770117Z min=0.0306
2026-02-21T09:01:19.1770433Z mid=0.0311
2026-02-21T09:01:19.1770705Z max=0.0406
2026-02-21T09:01:19.1771001Z best={'block_sizes': [1, 8192],
2026-02-21T09:01:19.1771475Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:01:19.1771998Z  'load_eviction_policies': ['', ''],
2026-02-21T09:01:19.1772423Z  'num_stages': 6,
2026-02-21T09:01:19.1772771Z  'num_warps': 4,
2026-02-21T09:01:19.1773119Z  'pid_type': 'flat',
2026-02-21T09:01:19.1773458Z  'range_flattens': [None, False],
2026-02-21T09:01:19.1773697Z  'range_multi_buffers': [None, False],
2026-02-21T09:01:19.1773942Z  'range_num_stages': [0, 1],
2026-02-21T09:01:19.1774464Z  'range_unroll_factors': [0, 3],
2026-02-21T09:01:19.1774696Z  'range_warp_specializes': []}
2026-02-21T09:01:19.1808499Z [344s] Fitting surrogate: 791 points, 791 targets
2026-02-21T09:01:19.4741734Z [344s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:01:22.6667881Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 5.4 configs/s
2026-02-21T09:01:23.4172407Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.0 configs/s
2026-02-21T09:01:24.5906428Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 846.6         
2026-02-21T09:01:24.5907044Z                                                                   configs/s     
2026-02-21T09:01:24.7100811Z [349s] Generation 18 complete: 
2026-02-21T09:01:24.7101064Z ok=13
2026-02-21T09:01:24.7101246Z min=0.0302
2026-02-21T09:01:24.7101417Z mid=0.0310
2026-02-21T09:01:24.7101580Z max=0.0588
2026-02-21T09:01:24.7101767Z best={'block_sizes': [1, 8192],
2026-02-21T09:01:24.7102053Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:01:24.7102366Z  'load_eviction_policies': ['', ''],
2026-02-21T09:01:24.7102615Z  'num_stages': 6,
2026-02-21T09:01:24.7102809Z  'num_warps': 4,
2026-02-21T09:01:24.7103476Z  'pid_type': 'flat',
2026-02-21T09:01:24.7103702Z  'range_flattens': [None, False],
2026-02-21T09:01:24.7104155Z  'range_multi_buffers': [None, False],
2026-02-21T09:01:24.7104448Z  'range_num_stages': [0, 1],
2026-02-21T09:01:24.7104691Z  'range_unroll_factors': [0, 3],
2026-02-21T09:01:24.7104937Z  'range_warp_specializes': []}
2026-02-21T09:01:24.7141957Z [349s] Fitting surrogate: 804 points, 804 targets
2026-02-21T09:01:25.0227145Z [350s] Generation 19 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:01:29.0406704Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.9 configs/s
2026-02-21T09:01:29.7902197Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.0 configs/s
2026-02-21T09:01:31.1017761Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 758.9         
2026-02-21T09:01:31.1018437Z                                                                   configs/s     
2026-02-21T09:01:31.2307772Z [356s] Generation 19 complete: 
2026-02-21T09:01:31.2308042Z ok=13
2026-02-21T09:01:31.2308216Z min=0.0305
2026-02-21T09:01:31.2308390Z mid=0.0328
2026-02-21T09:01:31.2308556Z max=0.0619
2026-02-21T09:01:31.2308740Z best={'block_sizes': [1, 8192],
2026-02-21T09:01:31.2309036Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:01:31.2309345Z  'load_eviction_policies': ['', ''],
2026-02-21T09:01:31.2309595Z  'num_stages': 6,
2026-02-21T09:01:31.2309780Z  'num_warps': 4,
2026-02-21T09:01:31.2309971Z  'pid_type': 'flat',
2026-02-21T09:01:31.2310179Z  'range_flattens': [None, False],
2026-02-21T09:01:31.2310433Z  'range_multi_buffers': [None, False],
2026-02-21T09:01:31.2310688Z  'range_num_stages': [0, 1],
2026-02-21T09:01:31.2310922Z  'range_unroll_factors': [0, 3],
2026-02-21T09:01:31.2311173Z  'range_warp_specializes': []}
2026-02-21T09:01:31.2349023Z [356s] Fitting surrogate: 817 points, 817 targets
2026-02-21T09:01:31.5477937Z [356s] Generation 20 starting: 12 neighbors, 1 active search path(s)
2026-02-21T09:01:35.4113479Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 2.2 configs/s
2026-02-21T09:01:36.2186068Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.0 configs/s
2026-02-21T09:01:37.3933474Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 845.9         
2026-02-21T09:01:37.3933931Z                                                                   configs/s     
2026-02-21T09:01:37.5122530Z [362s] Generation 20 complete: 
2026-02-21T09:01:37.5122979Z ok=14
2026-02-21T09:01:37.5123268Z min=0.0277
2026-02-21T09:01:37.5123557Z mid=0.0347
2026-02-21T09:01:37.5123823Z max=0.0599
2026-02-21T09:01:37.5124396Z best={'block_sizes': [1, 8192],
2026-02-21T09:01:37.5124870Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:01:37.5125404Z  'load_eviction_policies': ['', ''],
2026-02-21T09:01:37.5125869Z  'num_stages': 6,
2026-02-21T09:01:37.5126112Z  'num_warps': 4,
2026-02-21T09:01:37.5126294Z  'pid_type': 'flat',
2026-02-21T09:01:37.5126493Z  'range_flattens': [None, False],
2026-02-21T09:01:37.5126757Z  'range_multi_buffers': [None, False],
2026-02-21T09:01:37.5127013Z  'range_num_stages': [0, 1],
2026-02-21T09:01:37.5127235Z  'range_unroll_factors': [0, 3],
2026-02-21T09:01:37.5127944Z  'range_warp_specializes': []}
2026-02-21T09:01:37.5163308Z [362s] Fitting surrogate: 831 points, 831 targets
2026-02-21T09:01:37.6719535Z [362s] Autotuning complete in 362.8s after searching 782 configs.
2026-02-21T09:01:37.6719981Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:01:37.6721312Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', ''], num_stages=6, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T09:01:37.6722575Z 
2026-02-21T09:01:37.6723352Z [362s] Code of selected kernel: /tmp/torchinductor_root/om/comxama2rkk7zngxwnbeht3dtxrqz4ivas27fv4sdex7kzq6v2eo.py
2026-02-21T09:01:38.6384732Z WARNING:tritonbench.utils.triton_op:Completed input ID 31:
2026-02-21T09:01:38.6385094Z (M, N)
2026-02-21T09:01:38.6385278Z ------------
2026-02-21T09:01:38.6385456Z (4096, 4224)
2026-02-21T09:01:38.6386187Z 
2026-02-21T09:01:38.6406886Z  35%|███▌      | 7/20 [43:08<1:25:22, 394.03s/it]WARNING:tritonbench.utils.triton_op:Running input ID 36:
2026-02-21T09:01:38.6407721Z (M, N)
2026-02-21T09:01:38.6407998Z ------------
2026-02-21T09:01:38.6408303Z (4096, 4864)
2026-02-21T09:01:38.6409524Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T09:01:40.1891242Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T09:01:41.9066959Z INFO:tritonbench.utils.triton_op:Took 3.34ms to get benchmark function for torch_compile_softmax
2026-02-21T09:01:46.0611424Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:01:46.0612031Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:01:46.0612479Z               'dtype': 'torch.float16',
2026-02-21T09:01:46.0612927Z               'shape': (4096, 4864),
2026-02-21T09:01:46.0613333Z               'stride': (4864, 1)},),
2026-02-21T09:01:46.0613766Z   'kwargs': {}}
2026-02-21T09:01:46.0655629Z INFO:tritonbench.utils.triton_op:Took 4.76ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T09:01:46.3558365Z [0s] Autotune random seed: 2135383793
2026-02-21T09:01:46.5383423Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:02:21.6356232Z [35s] Timeout after 30s compiling Config(block_sizes=[128, 1024], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first'], maxnreg=32, num_sm_multiplier=32, num_stages=8, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, False], range_multi_buffers=[True, True], range_num_stages=[1, 2], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:02:22.2579237Z [35s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T09:02:23.0235101Z [36s] Timeout after 30s compiling Config(block_sizes=[8, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T09:02:24.1490298Z [37s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:02:29.3411022Z [42s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T09:02:32.6136699Z [46s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:02:33.3858801Z [46s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T09:02:34.0691061Z [47s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:02:34.0714965Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:02:41.1185429Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.3 configs/s
2026-02-21T09:02:41.1202317Z [54s] Adaptive compile timeout: 30s (90% percentile=16.4s, bounds=[30.0s, 30s])
2026-02-21T09:02:41.9585735Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1163.6 configs/s
2026-02-21T09:02:42.0479986Z [55s] Initial random population of 100, 5 starting points: 
2026-02-21T09:02:42.0480352Z error=1
2026-02-21T09:02:42.0480534Z timeout=8
2026-02-21T09:02:42.0480712Z ok=91
2026-02-21T09:02:42.0480883Z min=0.0487
2026-02-21T09:02:42.0481061Z mid=0.3852
2026-02-21T09:02:42.0481225Z max=98.4929
2026-02-21T09:02:42.0481421Z best={'block_sizes': [1, 256],
2026-02-21T09:02:42.0481824Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:02:42.0482255Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:02:42.0482529Z  'num_stages': 2,
2026-02-21T09:02:42.0482727Z  'num_warps': 1,
2026-02-21T09:02:42.0482930Z  'pid_type': 'flat',
2026-02-21T09:02:42.0483148Z  'range_flattens': [None, True],
2026-02-21T09:02:42.0483430Z  'range_multi_buffers': [None, None],
2026-02-21T09:02:42.0483693Z  'range_num_stages': [0, 3],
2026-02-21T09:02:42.0483934Z  'range_unroll_factors': [0, 2],
2026-02-21T09:02:42.0484373Z  'range_warp_specializes': []}
2026-02-21T09:02:42.0501078Z [55s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:02:43.4586862Z [56s] Generation 1 starting: 87 neighbors, 5 active search path(s)
2026-02-21T09:03:19.2514694Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 0.5 configs/s
2026-02-21T09:03:24.8868060Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 91/91 16.3 configs/s
2026-02-21T09:03:32.8782395Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 126.4         
2026-02-21T09:03:32.8784793Z                                                                   configs/s     
2026-02-21T09:03:33.4563515Z [106s] Generation 1 complete: 
2026-02-21T09:03:33.4563962Z ok=93
2026-02-21T09:03:33.4564738Z min=0.0399
2026-02-21T09:03:33.4565053Z mid=0.0549
2026-02-21T09:03:33.4565326Z max=0.3821
2026-02-21T09:03:33.4565621Z best={'block_sizes': [1, 1024],
2026-02-21T09:03:33.4566251Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:03:33.4567441Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:03:33.4567701Z  'num_stages': 1,
2026-02-21T09:03:33.4567877Z  'num_warps': 1,
2026-02-21T09:03:33.4568061Z  'pid_type': 'flat',
2026-02-21T09:03:33.4568258Z  'range_flattens': [None, False],
2026-02-21T09:03:33.4568500Z  'range_multi_buffers': [None, False],
2026-02-21T09:03:33.4568754Z  'range_num_stages': [0, 0],
2026-02-21T09:03:33.4568982Z  'range_unroll_factors': [0, 1],
2026-02-21T09:03:33.4569217Z  'range_warp_specializes': []}
2026-02-21T09:03:33.4591495Z [106s] Fitting surrogate: 193 points, 193 targets
2026-02-21T09:03:34.7365775Z [108s] Generation 2 starting: 80 neighbors, 5 active search path(s)
2026-02-21T09:04:06.1187643Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 0.6 configs/s
2026-02-21T09:04:11.2059631Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 16.3 configs/s
2026-02-21T09:04:21.4591761Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 107.4         
2026-02-21T09:04:21.4592288Z                                                                   configs/s     
2026-02-21T09:04:22.1505333Z [155s] Generation 2 complete: 
2026-02-21T09:04:22.1505598Z ok=85
2026-02-21T09:04:22.1505765Z min=0.0374
2026-02-21T09:04:22.1505937Z mid=0.0468
2026-02-21T09:04:22.1506097Z max=0.4363
2026-02-21T09:04:22.1506282Z best={'block_sizes': [1, 2048],
2026-02-21T09:04:22.1506620Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:04:22.1506986Z  'load_eviction_policies': ['', ''],
2026-02-21T09:04:22.1507236Z  'num_stages': 2,
2026-02-21T09:04:22.1507423Z  'num_warps': 4,
2026-02-21T09:04:22.1507624Z  'pid_type': 'flat',
2026-02-21T09:04:22.1507835Z  'range_flattens': [None, None],
2026-02-21T09:04:22.1508108Z  'range_multi_buffers': [None, None],
2026-02-21T09:04:22.1508365Z  'range_num_stages': [0, 3],
2026-02-21T09:04:22.1508604Z  'range_unroll_factors': [0, 2],
2026-02-21T09:04:22.1508847Z  'range_warp_specializes': []}
2026-02-21T09:04:22.1531220Z [155s] Fitting surrogate: 278 points, 278 targets
2026-02-21T09:04:23.2680657Z [156s] Generation 3 starting: 63 neighbors, 5 active search path(s)
2026-02-21T09:04:43.6400406Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 1.6 configs/s
2026-02-21T09:04:47.6913534Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 16.2 configs/s
2026-02-21T09:04:54.0913768Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 157.8         
2026-02-21T09:04:54.0917724Z                                                                   configs/s     
2026-02-21T09:04:54.5861837Z [188s] Generation 3 complete: 
2026-02-21T09:04:54.5862257Z ok=68
2026-02-21T09:04:54.5862537Z min=0.0341
2026-02-21T09:04:54.5862828Z mid=0.0449
2026-02-21T09:04:54.5863207Z max=0.5945
2026-02-21T09:04:54.5863566Z best={'block_sizes': [1, 8192],
2026-02-21T09:04:54.5864176Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:04:54.5864915Z  'load_eviction_policies': ['last', ''],
2026-02-21T09:04:54.5865179Z  'num_stages': 2,
2026-02-21T09:04:54.5865367Z  'num_warps': 4,
2026-02-21T09:04:54.5865569Z  'pid_type': 'flat',
2026-02-21T09:04:54.5865780Z  'range_flattens': [None, None],
2026-02-21T09:04:54.5866035Z  'range_multi_buffers': [None, None],
2026-02-21T09:04:54.5866294Z  'range_num_stages': [0, 3],
2026-02-21T09:04:54.5866524Z  'range_unroll_factors': [0, 1],
2026-02-21T09:04:54.5866781Z  'range_warp_specializes': []}
2026-02-21T09:04:54.5896938Z [188s] Fitting surrogate: 346 points, 346 targets
2026-02-21T09:04:55.4621940Z [188s] Generation 4 starting: 48 neighbors, 4 active search path(s)
2026-02-21T09:05:08.1390419Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 1.7 configs/s
2026-02-21T09:05:11.1607820Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.4 configs/s
2026-02-21T09:05:16.8274709Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 178.3         
2026-02-21T09:05:16.8277464Z                                                                   configs/s     
2026-02-21T09:05:17.2703099Z [210s] Generation 4 complete: 
2026-02-21T09:05:17.2703372Z ok=52
2026-02-21T09:05:17.2703535Z min=0.0314
2026-02-21T09:05:17.2703711Z mid=0.0409
2026-02-21T09:05:17.2703873Z max=0.1314
2026-02-21T09:05:17.2704404Z best={'block_sizes': [1, 8192],
2026-02-21T09:05:17.2704717Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:05:17.2705047Z  'load_eviction_policies': ['', ''],
2026-02-21T09:05:17.2705303Z  'num_stages': 7,
2026-02-21T09:05:17.2705488Z  'num_warps': 2,
2026-02-21T09:05:17.2705685Z  'pid_type': 'flat',
2026-02-21T09:05:17.2705901Z  'range_flattens': [None, None],
2026-02-21T09:05:17.2706152Z  'range_multi_buffers': [None, None],
2026-02-21T09:05:17.2706420Z  'range_num_stages': [0, 2],
2026-02-21T09:05:17.2706654Z  'range_unroll_factors': [0, 3],
2026-02-21T09:05:17.2706890Z  'range_warp_specializes': []}
2026-02-21T09:05:17.2733127Z [210s] Fitting surrogate: 398 points, 398 targets
2026-02-21T09:05:18.9664855Z [212s] Generation 5 starting: 46 neighbors, 4 active search path(s)
2026-02-21T09:05:31.0582822Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 1.9 configs/s
2026-02-21T09:05:34.0318526Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.4 configs/s
2026-02-21T09:05:39.1207222Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 198.5         
2026-02-21T09:05:39.1207750Z                                                                   configs/s     
2026-02-21T09:05:39.5355166Z [232s] Generation 5 complete: 
2026-02-21T09:05:39.5355563Z ok=51
2026-02-21T09:05:39.5355844Z min=0.0303
2026-02-21T09:05:39.5356120Z mid=0.0396
2026-02-21T09:05:39.5356388Z max=0.1397
2026-02-21T09:05:39.5356749Z best={'block_sizes': [1, 8192],
2026-02-21T09:05:39.5357328Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:05:39.5357948Z  'load_eviction_policies': ['', ''],
2026-02-21T09:05:39.5358380Z  'num_stages': 2,
2026-02-21T09:05:39.5358696Z  'num_warps': 4,
2026-02-21T09:05:39.5359008Z  'pid_type': 'flat',
2026-02-21T09:05:39.5359361Z  'range_flattens': [None, None],
2026-02-21T09:05:39.5359774Z  'range_multi_buffers': [None, None],
2026-02-21T09:05:39.5360206Z  'range_num_stages': [0, 3],
2026-02-21T09:05:39.5360582Z  'range_unroll_factors': [0, 0],
2026-02-21T09:05:39.5360982Z  'range_warp_specializes': []}
2026-02-21T09:05:39.5394653Z [233s] Fitting surrogate: 449 points, 449 targets
2026-02-21T09:05:40.4431664Z [233s] Generation 6 starting: 50 neighbors, 4 active search path(s)
2026-02-21T09:05:52.0747408Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 4.5 configs/s
2026-02-21T09:05:55.3138809Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 16.6 configs/s
2026-02-21T09:05:59.7123524Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 229.5         
2026-02-21T09:05:59.7124197Z                                                                   configs/s     
2026-02-21T09:06:00.0762072Z [253s] Generation 6 complete: 
2026-02-21T09:06:00.0762540Z ok=55
2026-02-21T09:06:00.0762812Z min=0.0299
2026-02-21T09:06:00.0763103Z mid=0.0372
2026-02-21T09:06:00.0763364Z max=0.7139
2026-02-21T09:06:00.0763674Z best={'block_sizes': [1, 8192],
2026-02-21T09:06:00.0764511Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:06:00.0765086Z  'load_eviction_policies': ['', ''],
2026-02-21T09:06:00.0765504Z  'num_stages': 2,
2026-02-21T09:06:00.0765838Z  'num_warps': 4,
2026-02-21T09:06:00.0766155Z  'pid_type': 'flat',
2026-02-21T09:06:00.0766501Z  'range_flattens': [None, None],
2026-02-21T09:06:00.0766912Z  'range_multi_buffers': [None, None],
2026-02-21T09:06:00.0767335Z  'range_num_stages': [0, 3],
2026-02-21T09:06:00.0768255Z  'range_unroll_factors': [0, 0],
2026-02-21T09:06:00.0768733Z  'range_warp_specializes': []}
2026-02-21T09:06:00.0793100Z [253s] Fitting surrogate: 504 points, 504 targets
2026-02-21T09:06:00.9171931Z [254s] Generation 7 starting: 50 neighbors, 4 active search path(s)
2026-02-21T09:06:12.5568400Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 3.6 configs/s
2026-02-21T09:06:15.6848472Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 51/51 16.5 configs/s
2026-02-21T09:06:20.5562567Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 207.4         
2026-02-21T09:06:20.5563089Z                                                                   configs/s     
2026-02-21T09:06:20.9583191Z [274s] Generation 7 complete: 
2026-02-21T09:06:20.9583475Z ok=54
2026-02-21T09:06:20.9583694Z min=0.0302
2026-02-21T09:06:20.9583909Z mid=0.0365
2026-02-21T09:06:20.9584416Z max=0.2332
2026-02-21T09:06:20.9584622Z best={'block_sizes': [1, 8192],
2026-02-21T09:06:20.9585000Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:06:20.9585363Z  'load_eviction_policies': ['', ''],
2026-02-21T09:06:20.9585633Z  'num_stages': 2,
2026-02-21T09:06:20.9585829Z  'num_warps': 4,
2026-02-21T09:06:20.9586063Z  'pid_type': 'flat',
2026-02-21T09:06:20.9586282Z  'range_flattens': [None, None],
2026-02-21T09:06:20.9586550Z  'range_multi_buffers': [None, None],
2026-02-21T09:06:20.9586819Z  'range_num_stages': [0, 3],
2026-02-21T09:06:20.9587065Z  'range_unroll_factors': [0, 0],
2026-02-21T09:06:20.9587316Z  'range_warp_specializes': []}
2026-02-21T09:06:20.9626648Z [274s] Fitting surrogate: 558 points, 558 targets
2026-02-21T09:06:21.8371112Z [275s] Generation 8 starting: 46 neighbors, 4 active search path(s)
2026-02-21T09:06:33.8448303Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 1.2 configs/s
2026-02-21T09:06:36.7233900Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.6 configs/s
2026-02-21T09:06:40.7029276Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 253.8         
2026-02-21T09:06:40.7029922Z                                                                   configs/s     
2026-02-21T09:06:41.0510663Z [294s] Generation 8 complete: 
2026-02-21T09:06:41.0511033Z ok=50
2026-02-21T09:06:41.0511255Z min=0.0299
2026-02-21T09:06:41.0511489Z mid=0.0319
2026-02-21T09:06:41.0511722Z max=0.1461
2026-02-21T09:06:41.0511968Z best={'block_sizes': [1, 8192],
2026-02-21T09:06:41.0512338Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:06:41.0512764Z  'load_eviction_policies': ['', ''],
2026-02-21T09:06:41.0513105Z  'num_stages': 7,
2026-02-21T09:06:41.0513358Z  'num_warps': 4,
2026-02-21T09:06:41.0513620Z  'pid_type': 'flat',
2026-02-21T09:06:41.0513903Z  'range_flattens': [None, None],
2026-02-21T09:06:41.0514485Z  'range_multi_buffers': [None, None],
2026-02-21T09:06:41.0514839Z  'range_num_stages': [0, 3],
2026-02-21T09:06:41.0515163Z  'range_unroll_factors': [0, 3],
2026-02-21T09:06:41.0515494Z  'range_warp_specializes': []}
2026-02-21T09:06:41.0547779Z [294s] Fitting surrogate: 608 points, 608 targets
2026-02-21T09:06:41.8610177Z [295s] Generation 9 starting: 46 neighbors, 4 active search path(s)
2026-02-21T09:06:52.3155586Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 3.0 configs/s
2026-02-21T09:06:55.2024369Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.5 configs/s
2026-02-21T09:06:59.4588789Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 237.4         
2026-02-21T09:06:59.4589304Z                                                                   configs/s     
2026-02-21T09:06:59.8142942Z [313s] Generation 9 complete: 
2026-02-21T09:06:59.8143231Z ok=50
2026-02-21T09:06:59.8143414Z min=0.0300
2026-02-21T09:06:59.8143607Z mid=0.0372
2026-02-21T09:06:59.8143816Z max=0.1461
2026-02-21T09:06:59.8145364Z best={'block_sizes': [1, 8192],
2026-02-21T09:06:59.8145680Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:06:59.8146016Z  'load_eviction_policies': ['', ''],
2026-02-21T09:06:59.8146796Z  'num_stages': 7,
2026-02-21T09:06:59.8147017Z  'num_warps': 4,
2026-02-21T09:06:59.8147232Z  'pid_type': 'flat',
2026-02-21T09:06:59.8147461Z  'range_flattens': [None, None],
2026-02-21T09:06:59.8147762Z  'range_multi_buffers': [None, None],
2026-02-21T09:06:59.8148050Z  'range_num_stages': [0, 3],
2026-02-21T09:06:59.8148306Z  'range_unroll_factors': [0, 3],
2026-02-21T09:06:59.8148580Z  'range_warp_specializes': []}
2026-02-21T09:06:59.8180666Z [313s] Fitting surrogate: 658 points, 658 targets
2026-02-21T09:07:00.5872568Z [314s] Generation 10 starting: 43 neighbors, 3 active search path(s)
2026-02-21T09:07:10.4178667Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 2.8 configs/s
2026-02-21T09:07:13.0583676Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 43/43 16.6 configs/s
2026-02-21T09:07:16.6949409Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 277.3         
2026-02-21T09:07:16.6949936Z                                                                   configs/s     
2026-02-21T09:07:16.9967810Z [330s] Generation 10 complete: 
2026-02-21T09:07:16.9968219Z ok=47
2026-02-21T09:07:16.9968495Z min=0.0300
2026-02-21T09:07:16.9968819Z mid=0.0385
2026-02-21T09:07:16.9969077Z max=0.1726
2026-02-21T09:07:16.9969384Z best={'block_sizes': [1, 8192],
2026-02-21T09:07:16.9969941Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:07:16.9970706Z  'load_eviction_policies': ['', ''],
2026-02-21T09:07:16.9971124Z  'num_stages': 7,
2026-02-21T09:07:16.9971430Z  'num_warps': 4,
2026-02-21T09:07:16.9971754Z  'pid_type': 'flat',
2026-02-21T09:07:16.9972114Z  'range_flattens': [None, False],
2026-02-21T09:07:16.9972574Z  'range_multi_buffers': [None, True],
2026-02-21T09:07:16.9973059Z  'range_num_stages': [0, 3],
2026-02-21T09:07:16.9973433Z  'range_unroll_factors': [0, 2],
2026-02-21T09:07:16.9973667Z  'range_warp_specializes': []}
2026-02-21T09:07:17.0004725Z [330s] Fitting surrogate: 705 points, 705 targets
2026-02-21T09:07:17.6016742Z [331s] Generation 11 starting: 32 neighbors, 2 active search path(s)
2026-02-21T09:07:25.1182570Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 2.8 configs/s
2026-02-21T09:07:27.1034547Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 16.5 configs/s
2026-02-21T09:07:30.1966503Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 325.5         
2026-02-21T09:07:30.1967002Z                                                                   configs/s     
2026-02-21T09:07:30.4602719Z [343s] Generation 11 complete: 
2026-02-21T09:07:30.4602975Z ok=34
2026-02-21T09:07:30.4603147Z min=0.0305
2026-02-21T09:07:30.4603359Z mid=0.0408
2026-02-21T09:07:30.4603531Z max=0.3276
2026-02-21T09:07:30.4603725Z best={'block_sizes': [1, 8192],
2026-02-21T09:07:30.4604447Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:07:30.4604864Z  'load_eviction_policies': ['', ''],
2026-02-21T09:07:30.4605124Z  'num_stages': 7,
2026-02-21T09:07:30.4605821Z  'num_warps': 4,
2026-02-21T09:07:30.4606039Z  'pid_type': 'flat',
2026-02-21T09:07:30.4606288Z  'range_flattens': [None, False],
2026-02-21T09:07:30.4606569Z  'range_multi_buffers': [None, True],
2026-02-21T09:07:30.4606851Z  'range_num_stages': [0, 3],
2026-02-21T09:07:30.4607104Z  'range_unroll_factors': [0, 3],
2026-02-21T09:07:30.4607359Z  'range_warp_specializes': []}
2026-02-21T09:07:30.4641150Z [343s] Fitting surrogate: 739 points, 739 targets
2026-02-21T09:07:30.7726425Z [344s] Generation 12 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:07:34.0425987Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 4.2 configs/s
2026-02-21T09:07:34.7208071Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.4 configs/s
2026-02-21T09:07:36.8681773Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 751.0         
2026-02-21T09:07:36.8682303Z                                                                   configs/s     
2026-02-21T09:07:36.9979781Z [350s] Generation 12 complete: 
2026-02-21T09:07:36.9980027Z ok=12
2026-02-21T09:07:36.9980223Z min=0.0329
2026-02-21T09:07:36.9980391Z mid=0.0334
2026-02-21T09:07:36.9980581Z max=0.0475
2026-02-21T09:07:36.9980758Z best={'block_sizes': [1, 8192],
2026-02-21T09:07:36.9981106Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:07:36.9981480Z  'load_eviction_policies': ['', ''],
2026-02-21T09:07:36.9981725Z  'num_stages': 7,
2026-02-21T09:07:36.9981918Z  'num_warps': 4,
2026-02-21T09:07:36.9982105Z  'pid_type': 'flat',
2026-02-21T09:07:36.9982318Z  'range_flattens': [None, False],
2026-02-21T09:07:36.9982570Z  'range_multi_buffers': [None, True],
2026-02-21T09:07:36.9982829Z  'range_num_stages': [0, 4],
2026-02-21T09:07:36.9983073Z  'range_unroll_factors': [0, 3],
2026-02-21T09:07:36.9983313Z  'range_warp_specializes': []}
2026-02-21T09:07:37.0009841Z [350s] Fitting surrogate: 751 points, 751 targets
2026-02-21T09:07:37.3035220Z [350s] Generation 13 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:07:40.5287154Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 7.2 configs/s
2026-02-21T09:07:41.2618338Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.5 configs/s
2026-02-21T09:07:42.7128585Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 687.0         
2026-02-21T09:07:42.7129390Z                                                                   configs/s     
2026-02-21T09:07:42.8512148Z [356s] Generation 13 complete: 
2026-02-21T09:07:42.8512428Z ok=13
2026-02-21T09:07:42.8512624Z min=0.0333
2026-02-21T09:07:42.8512802Z mid=0.0352
2026-02-21T09:07:42.8512993Z max=0.0636
2026-02-21T09:07:42.8513178Z best={'block_sizes': [1, 8192],
2026-02-21T09:07:42.8513541Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:07:42.8513916Z  'load_eviction_policies': ['', ''],
2026-02-21T09:07:42.8514337Z  'num_stages': 7,
2026-02-21T09:07:42.8514535Z  'num_warps': 4,
2026-02-21T09:07:42.8514767Z  'pid_type': 'flat',
2026-02-21T09:07:42.8514991Z  'range_flattens': [None, False],
2026-02-21T09:07:42.8515267Z  'range_multi_buffers': [None, False],
2026-02-21T09:07:42.8516050Z  'range_num_stages': [0, 4],
2026-02-21T09:07:42.8516309Z  'range_unroll_factors': [0, 3],
2026-02-21T09:07:42.8516575Z  'range_warp_specializes': []}
2026-02-21T09:07:42.8547485Z [356s] Fitting surrogate: 764 points, 764 targets
2026-02-21T09:07:43.1596600Z [356s] Generation 14 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:07:46.9423041Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 3.2 configs/s
2026-02-21T09:07:47.6707237Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.6 configs/s
2026-02-21T09:07:49.1199858Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 687.7         
2026-02-21T09:07:49.1200391Z                                                                   configs/s     
2026-02-21T09:07:49.2589971Z [362s] Generation 14 complete: 
2026-02-21T09:07:49.2591223Z ok=13
2026-02-21T09:07:49.2591533Z min=0.0335
2026-02-21T09:07:49.2591817Z mid=0.0351
2026-02-21T09:07:49.2592096Z max=0.0510
2026-02-21T09:07:49.2592396Z best={'block_sizes': [1, 8192],
2026-02-21T09:07:49.2593004Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:07:49.2593607Z  'load_eviction_policies': ['', ''],
2026-02-21T09:07:49.2594575Z  'num_stages': 7,
2026-02-21T09:07:49.2594954Z  'num_warps': 4,
2026-02-21T09:07:49.2595296Z  'pid_type': 'flat',
2026-02-21T09:07:49.2595692Z  'range_flattens': [None, None],
2026-02-21T09:07:49.2595963Z  'range_multi_buffers': [None, False],
2026-02-21T09:07:49.2596206Z  'range_num_stages': [0, 3],
2026-02-21T09:07:49.2596424Z  'range_unroll_factors': [0, 3],
2026-02-21T09:07:49.2596650Z  'range_warp_specializes': []}
2026-02-21T09:07:49.2626448Z [362s] Fitting surrogate: 777 points, 777 targets
2026-02-21T09:07:49.5655291Z [363s] Generation 15 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:07:53.3736145Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 3.9 configs/s
2026-02-21T09:07:54.1088634Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.4 configs/s
2026-02-21T09:07:55.7065915Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 624.8         
2026-02-21T09:07:55.7066588Z                                                                   configs/s     
2026-02-21T09:07:55.8544905Z [369s] Generation 15 complete: 
2026-02-21T09:07:55.8545155Z ok=13
2026-02-21T09:07:55.8545352Z min=0.0337
2026-02-21T09:07:55.8545533Z mid=0.0353
2026-02-21T09:07:55.8545710Z max=0.0472
2026-02-21T09:07:55.8545895Z best={'block_sizes': [1, 8192],
2026-02-21T09:07:55.8546242Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:07:55.8546628Z  'load_eviction_policies': ['', ''],
2026-02-21T09:07:55.8546878Z  'num_stages': 7,
2026-02-21T09:07:55.8547073Z  'num_warps': 4,
2026-02-21T09:07:55.8547266Z  'pid_type': 'flat',
2026-02-21T09:07:55.8547516Z  'range_flattens': [None, None],
2026-02-21T09:07:55.8547767Z  'range_multi_buffers': [None, False],
2026-02-21T09:07:55.8548031Z  'range_num_stages': [0, 3],
2026-02-21T09:07:55.8548277Z  'range_unroll_factors': [0, 3],
2026-02-21T09:07:55.8548520Z  'range_warp_specializes': []}
2026-02-21T09:07:55.8581205Z [369s] Fitting surrogate: 790 points, 790 targets
2026-02-21T09:07:56.1480568Z [369s] Generation 16 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:08:00.6033896Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.3 configs/s
2026-02-21T09:08:01.2865370Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.2 configs/s
2026-02-21T09:08:02.4787017Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 832.8         
2026-02-21T09:08:02.4787526Z                                                                   configs/s     
2026-02-21T09:08:02.6079586Z [376s] Generation 16 complete: 
2026-02-21T09:08:02.6080020Z ok=12
2026-02-21T09:08:02.6080341Z min=0.0302
2026-02-21T09:08:02.6080612Z mid=0.0343
2026-02-21T09:08:02.6080884Z max=0.0503
2026-02-21T09:08:02.6081184Z best={'block_sizes': [1, 8192],
2026-02-21T09:08:02.6082369Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:08:02.6082974Z  'load_eviction_policies': ['', ''],
2026-02-21T09:08:02.6083374Z  'num_stages': 7,
2026-02-21T09:08:02.6083688Z  'num_warps': 4,
2026-02-21T09:08:02.6084531Z  'pid_type': 'flat',
2026-02-21T09:08:02.6084966Z  'range_flattens': [None, True],
2026-02-21T09:08:02.6085345Z  'range_multi_buffers': [None, False],
2026-02-21T09:08:02.6085594Z  'range_num_stages': [0, 2],
2026-02-21T09:08:02.6085805Z  'range_unroll_factors': [0, 3],
2026-02-21T09:08:02.6086034Z  'range_warp_specializes': []}
2026-02-21T09:08:02.6121724Z [376s] Fitting surrogate: 802 points, 802 targets
2026-02-21T09:08:02.9135643Z [376s] Generation 17 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:08:05.4983326Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 9.8 configs/s
2026-02-21T09:08:06.1556872Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 18.0 configs/s
2026-02-21T09:08:07.5980938Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 690.6         
2026-02-21T09:08:07.5981457Z                                                                   configs/s     
2026-02-21T09:08:07.7364904Z [381s] Generation 17 complete: 
2026-02-21T09:08:07.7365162Z ok=12
2026-02-21T09:08:07.7365347Z min=0.0333
2026-02-21T09:08:07.7365521Z mid=0.0335
2026-02-21T09:08:07.7365692Z max=0.0422
2026-02-21T09:08:07.7365899Z best={'block_sizes': [1, 8192],
2026-02-21T09:08:07.7366293Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:08:07.7366713Z  'load_eviction_policies': ['', ''],
2026-02-21T09:08:07.7366969Z  'num_stages': 7,
2026-02-21T09:08:07.7367169Z  'num_warps': 4,
2026-02-21T09:08:07.7367366Z  'pid_type': 'flat',
2026-02-21T09:08:07.7367617Z  'range_flattens': [None, True],
2026-02-21T09:08:07.7367877Z  'range_multi_buffers': [None, False],
2026-02-21T09:08:07.7368164Z  'range_num_stages': [0, 2],
2026-02-21T09:08:07.7368407Z  'range_unroll_factors': [0, 3],
2026-02-21T09:08:07.7368679Z  'range_warp_specializes': []}
2026-02-21T09:08:07.7401934Z [381s] Fitting surrogate: 814 points, 814 targets
2026-02-21T09:08:08.0504882Z [381s] Generation 18 starting: 12 neighbors, 1 active search path(s)
2026-02-21T09:08:13.6719668Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 1.3 configs/s
2026-02-21T09:08:14.4695183Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.3 configs/s
2026-02-21T09:08:15.7907916Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 752.7         
2026-02-21T09:08:15.7908435Z                                                                   configs/s     
2026-02-21T09:08:15.9203256Z [389s] Generation 18 complete: 
2026-02-21T09:08:15.9203706Z ok=14
2026-02-21T09:08:15.9204222Z min=0.0301
2026-02-21T09:08:15.9204557Z mid=0.0371
2026-02-21T09:08:15.9204843Z max=0.0887
2026-02-21T09:08:15.9205161Z best={'block_sizes': [1, 8192],
2026-02-21T09:08:15.9205788Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:08:15.9206477Z  'load_eviction_policies': ['', ''],
2026-02-21T09:08:15.9206888Z  'num_stages': 7,
2026-02-21T09:08:15.9207212Z  'num_warps': 4,
2026-02-21T09:08:15.9207539Z  'pid_type': 'flat',
2026-02-21T09:08:15.9207883Z  'range_flattens': [None, False],
2026-02-21T09:08:15.9208304Z  'range_multi_buffers': [None, False],
2026-02-21T09:08:15.9208757Z  'range_num_stages': [0, 2],
2026-02-21T09:08:15.9209143Z  'range_unroll_factors': [0, 3],
2026-02-21T09:08:15.9209564Z  'range_warp_specializes': []}
2026-02-21T09:08:15.9241401Z [389s] Fitting surrogate: 828 points, 828 targets
2026-02-21T09:08:16.2196642Z [389s] Generation 19 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:08:18.8382397Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 10.1 configs/s
2026-02-21T09:08:19.5161378Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.4 configs/s
2026-02-21T09:08:20.9367865Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 701.3         
2026-02-21T09:08:20.9368897Z                                                                   configs/s     
2026-02-21T09:08:21.0749993Z [394s] Generation 19 complete: 
2026-02-21T09:08:21.0750306Z ok=12
2026-02-21T09:08:21.0750497Z min=0.0303
2026-02-21T09:08:21.0750705Z mid=0.0320
2026-02-21T09:08:21.0750898Z max=0.0369
2026-02-21T09:08:21.0751112Z best={'block_sizes': [1, 8192],
2026-02-21T09:08:21.0751536Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:08:21.0752016Z  'load_eviction_policies': ['', ''],
2026-02-21T09:08:21.0752312Z  'num_stages': 7,
2026-02-21T09:08:21.0752535Z  'num_warps': 4,
2026-02-21T09:08:21.0752753Z  'pid_type': 'flat',
2026-02-21T09:08:21.0753003Z  'range_flattens': [None, False],
2026-02-21T09:08:21.0753663Z  'range_multi_buffers': [None, True],
2026-02-21T09:08:21.0754150Z  'range_num_stages': [0, 2],
2026-02-21T09:08:21.0754445Z  'range_unroll_factors': [0, 3],
2026-02-21T09:08:21.0754742Z  'range_warp_specializes': []}
2026-02-21T09:08:21.0789326Z [394s] Fitting surrogate: 840 points, 840 targets
2026-02-21T09:08:21.3824108Z [394s] Generation 20 starting: 12 neighbors, 1 active search path(s)
2026-02-21T09:08:25.2244746Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 1.5 configs/s
2026-02-21T09:08:25.9456408Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.8 configs/s
2026-02-21T09:08:27.5237852Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 632.6         
2026-02-21T09:08:27.5238379Z                                                                   configs/s     
2026-02-21T09:08:27.6713461Z [401s] Generation 20 complete: 
2026-02-21T09:08:27.6713945Z ok=13
2026-02-21T09:08:27.6714485Z min=0.0333
2026-02-21T09:08:27.6714768Z mid=0.0339
2026-02-21T09:08:27.6715071Z max=0.0424
2026-02-21T09:08:27.6715380Z best={'block_sizes': [1, 8192],
2026-02-21T09:08:27.6715989Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:08:27.6716733Z  'load_eviction_policies': ['', ''],
2026-02-21T09:08:27.6717152Z  'num_stages': 7,
2026-02-21T09:08:27.6717461Z  'num_warps': 4,
2026-02-21T09:08:27.6717780Z  'pid_type': 'flat',
2026-02-21T09:08:27.6718129Z  'range_flattens': [None, False],
2026-02-21T09:08:27.6718556Z  'range_multi_buffers': [None, True],
2026-02-21T09:08:27.6718976Z  'range_num_stages': [0, 1],
2026-02-21T09:08:27.6719363Z  'range_unroll_factors': [0, 3],
2026-02-21T09:08:27.6719751Z  'range_warp_specializes': []}
2026-02-21T09:08:27.6753359Z [401s] Fitting surrogate: 853 points, 853 targets
2026-02-21T09:08:27.8344536Z [401s] Autotuning complete in 401.3s after searching 805 configs.
2026-02-21T09:08:27.8345003Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:08:27.8346572Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=7, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, True], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T09:08:27.8348374Z 
2026-02-21T09:08:27.8348789Z [401s] Code of selected kernel: /tmp/torchinductor_root/ej/cejpqycwaeukh37kkjzfld3xpspamwzu2mm6c76rmt4j4uhxxeq4.py
2026-02-21T09:08:28.7983019Z WARNING:tritonbench.utils.triton_op:Completed input ID 36:
2026-02-21T09:08:28.7983563Z (M, N)
2026-02-21T09:08:28.7983730Z ------------
2026-02-21T09:08:28.7983908Z (4096, 4864)
2026-02-21T09:08:28.7984375Z 
2026-02-21T09:08:28.8005954Z  40%|████      | 8/20 [49:58<1:19:49, 399.17s/it]WARNING:tritonbench.utils.triton_op:Running input ID 41:
2026-02-21T09:08:28.8006392Z (M, N)
2026-02-21T09:08:28.8006550Z ------------
2026-02-21T09:08:28.8007137Z (4096, 5504)
2026-02-21T09:08:28.8009002Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T09:08:30.3116240Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T09:08:32.0141213Z INFO:tritonbench.utils.triton_op:Took 3.29ms to get benchmark function for torch_compile_softmax
2026-02-21T09:08:36.2256909Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:08:36.2257487Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:08:36.2258011Z               'dtype': 'torch.float16',
2026-02-21T09:08:36.2258536Z               'shape': (4096, 5504),
2026-02-21T09:08:36.2258806Z               'stride': (5504, 1)},),
2026-02-21T09:08:36.2259050Z   'kwargs': {}}
2026-02-21T09:08:36.2301802Z INFO:tritonbench.utils.triton_op:Took 4.93ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T09:08:36.5226618Z [0s] Autotune random seed: 2135383793
2026-02-21T09:08:36.7051539Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:09:11.9147822Z [35s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T09:09:12.7582627Z [36s] Timeout after 30s compiling Config(block_sizes=[8, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T09:09:13.9609598Z [37s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:09:19.7575459Z [43s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T09:09:23.4430217Z [46s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:09:24.3368964Z [47s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T09:09:25.0811670Z [48s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:09:25.0835324Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T09:09:32.3603488Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.8 configs/s
2026-02-21T09:09:32.3616908Z [55s] Adaptive compile timeout: 30s (90% percentile=18.1s, bounds=[30.0s, 30s])
2026-02-21T09:09:33.4127813Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 932.0 configs/s
2026-02-21T09:09:33.5146474Z [56s] Initial random population of 100, 5 starting points: 
2026-02-21T09:09:33.5146825Z error=2
2026-02-21T09:09:33.5146991Z timeout=7
2026-02-21T09:09:33.5147159Z ok=91
2026-02-21T09:09:33.5147316Z min=0.0555
2026-02-21T09:09:33.5147486Z mid=0.4254
2026-02-21T09:09:33.5147648Z max=115.3149
2026-02-21T09:09:33.5147893Z best={'block_sizes': [1, 256],
2026-02-21T09:09:33.5148348Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:09:33.5148864Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:09:33.5149148Z  'num_stages': 2,
2026-02-21T09:09:33.5149343Z  'num_warps': 1,
2026-02-21T09:09:33.5149585Z  'pid_type': 'flat',
2026-02-21T09:09:33.5149808Z  'range_flattens': [None, True],
2026-02-21T09:09:33.5150077Z  'range_multi_buffers': [None, None],
2026-02-21T09:09:33.5150346Z  'range_num_stages': [0, 3],
2026-02-21T09:09:33.5150628Z  'range_unroll_factors': [0, 2],
2026-02-21T09:09:33.5150891Z  'range_warp_specializes': []}
2026-02-21T09:09:33.5165660Z [56s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:09:34.9037080Z [58s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T09:10:19.9536195Z [103s] Timeout after 30s compiling Config(block_sizes=[8, 2048], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=64, num_sm_multiplier=1, num_stages=6, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, None], range_num_stages=[1, 2], range_unroll_factors=[4, 3], range_warp_specializes=[])
2026-02-21T09:10:19.9557835Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 0.3 configs/s
2026-02-21T09:10:25.5846555Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.5 configs/s
2026-02-21T09:10:34.3955411Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 114.6         
2026-02-21T09:10:34.3955968Z                                                                   configs/s     
2026-02-21T09:10:34.9825355Z [118s] Generation 1 complete: 
2026-02-21T09:10:34.9825656Z timeout=1
2026-02-21T09:10:34.9825832Z ok=93
2026-02-21T09:10:34.9825995Z min=0.0466
2026-02-21T09:10:34.9826163Z mid=0.0648
2026-02-21T09:10:34.9826327Z max=0.4087
2026-02-21T09:10:34.9826503Z best={'block_sizes': [1, 1024],
2026-02-21T09:10:34.9826880Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:10:34.9827312Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:10:34.9827589Z  'num_stages': 1,
2026-02-21T09:10:34.9827774Z  'num_warps': 1,
2026-02-21T09:10:34.9827968Z  'pid_type': 'flat',
2026-02-21T09:10:34.9828214Z  'range_flattens': [None, False],
2026-02-21T09:10:34.9828479Z  'range_multi_buffers': [None, False],
2026-02-21T09:10:34.9828741Z  'range_num_stages': [0, 0],
2026-02-21T09:10:34.9828977Z  'range_unroll_factors': [0, 1],
2026-02-21T09:10:34.9829813Z  'range_warp_specializes': []}
2026-02-21T09:10:34.9846109Z [118s] Fitting surrogate: 194 points, 194 targets
2026-02-21T09:10:36.1574574Z [119s] Generation 2 starting: 74 neighbors, 5 active search path(s)
2026-02-21T09:10:54.5722522Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 4.8 configs/s
2026-02-21T09:10:59.3990650Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 16.3 configs/s
2026-02-21T09:11:08.1027726Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.1         
2026-02-21T09:11:08.1028315Z                                                                   configs/s     
2026-02-21T09:11:08.7301547Z [152s] Generation 2 complete: 
2026-02-21T09:11:08.7301856Z ok=80
2026-02-21T09:11:08.7302036Z min=0.0392
2026-02-21T09:11:08.7302819Z mid=0.0514
2026-02-21T09:11:08.7303009Z max=0.1315
2026-02-21T09:11:08.7303208Z best={'block_sizes': [1, 8192],
2026-02-21T09:11:08.7303586Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:11:08.7304457Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T09:11:08.7304827Z  'maxnreg': 256,
2026-02-21T09:11:08.7305088Z  'num_sm_multiplier': 16,
2026-02-21T09:11:08.7305373Z  'num_stages': 6,
2026-02-21T09:11:08.7305572Z  'num_warps': 2,
2026-02-21T09:11:08.7305802Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:11:08.7306101Z  'range_flattens': [None, None],
2026-02-21T09:11:08.7306377Z  'range_multi_buffers': [False, None],
2026-02-21T09:11:08.7306662Z  'range_num_stages': [1, 2],
2026-02-21T09:11:08.7306915Z  'range_unroll_factors': [1, 1],
2026-02-21T09:11:08.7307188Z  'range_warp_specializes': []}
2026-02-21T09:11:08.7326451Z [152s] Fitting surrogate: 274 points, 274 targets
2026-02-21T09:11:09.8605817Z [153s] Generation 3 starting: 71 neighbors, 5 active search path(s)
2026-02-21T09:11:29.1912669Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73/73 2.7 configs/s
2026-02-21T09:11:34.5847112Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 73/73 13.6 configs/s
2026-02-21T09:11:43.6321695Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 111.8         
2026-02-21T09:11:43.6322232Z                                                                   configs/s     
2026-02-21T09:11:44.3046106Z [187s] Generation 3 complete: 
2026-02-21T09:11:44.3046405Z ok=77
2026-02-21T09:11:44.3046589Z min=0.0351
2026-02-21T09:11:44.3046771Z mid=0.0464
2026-02-21T09:11:44.3046964Z max=0.7740
2026-02-21T09:11:44.3047160Z best={'block_sizes': [1, 8192],
2026-02-21T09:11:44.3047508Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:11:44.3047897Z  'load_eviction_policies': ['', ''],
2026-02-21T09:11:44.3048148Z  'num_stages': 2,
2026-02-21T09:11:44.3048346Z  'num_warps': 2,
2026-02-21T09:11:44.3048582Z  'pid_type': 'flat',
2026-02-21T09:11:44.3048826Z  'range_flattens': [None, False],
2026-02-21T09:11:44.3049137Z  'range_multi_buffers': [None, None],
2026-02-21T09:11:44.3049455Z  'range_num_stages': [0, 2],
2026-02-21T09:11:44.3049700Z  'range_unroll_factors': [0, 2],
2026-02-21T09:11:44.3049948Z  'range_warp_specializes': []}
2026-02-21T09:11:44.3068007Z [187s] Fitting surrogate: 351 points, 351 targets
2026-02-21T09:11:45.3081769Z [188s] Generation 4 starting: 64 neighbors, 5 active search path(s)
2026-02-21T09:12:02.5069006Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 1.7 configs/s
2026-02-21T09:12:06.5946057Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.3 configs/s
2026-02-21T09:12:13.7218050Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.9         
2026-02-21T09:12:13.7218708Z                                                                   configs/s     
2026-02-21T09:12:14.2727161Z [217s] Generation 4 complete: 
2026-02-21T09:12:14.2727613Z ok=69
2026-02-21T09:12:14.2727885Z min=0.0341
2026-02-21T09:12:14.2728119Z mid=0.0414
2026-02-21T09:12:14.2728378Z max=0.7617
2026-02-21T09:12:14.2728617Z best={'block_sizes': [1, 8192],
2026-02-21T09:12:14.2729805Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:12:14.2730363Z  'load_eviction_policies': ['', ''],
2026-02-21T09:12:14.2730622Z  'num_stages': 2,
2026-02-21T09:12:14.2730859Z  'num_warps': 4,
2026-02-21T09:12:14.2731067Z  'pid_type': 'flat',
2026-02-21T09:12:14.2731324Z  'range_flattens': [None, False],
2026-02-21T09:12:14.2731591Z  'range_multi_buffers': [None, None],
2026-02-21T09:12:14.2731885Z  'range_num_stages': [0, 2],
2026-02-21T09:12:14.2732129Z  'range_unroll_factors': [0, 2],
2026-02-21T09:12:14.2732416Z  'range_warp_specializes': []}
2026-02-21T09:12:14.2753924Z [217s] Fitting surrogate: 420 points, 420 targets
2026-02-21T09:12:15.2228193Z [218s] Generation 5 starting: 61 neighbors, 5 active search path(s)
2026-02-21T09:12:29.6801433Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 3.1 configs/s
2026-02-21T09:12:33.4826327Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 16.5 configs/s
2026-02-21T09:12:42.2825618Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 127.1         
2026-02-21T09:12:42.2826294Z                                                                   configs/s     
2026-02-21T09:12:42.9114494Z [246s] Generation 5 complete: 
2026-02-21T09:12:42.9114850Z ok=66
2026-02-21T09:12:42.9115110Z min=0.0338
2026-02-21T09:12:42.9115370Z mid=0.0373
2026-02-21T09:12:42.9115590Z max=0.1558
2026-02-21T09:12:42.9115850Z best={'block_sizes': [1, 8192],
2026-02-21T09:12:42.9116231Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:12:42.9116668Z  'load_eviction_policies': ['', ''],
2026-02-21T09:12:42.9116994Z  'num_stages': 2,
2026-02-21T09:12:42.9117270Z  'num_warps': 4,
2026-02-21T09:12:42.9117518Z  'pid_type': 'flat',
2026-02-21T09:12:42.9117815Z  'range_flattens': [None, False],
2026-02-21T09:12:42.9118168Z  'range_multi_buffers': [None, None],
2026-02-21T09:12:42.9118521Z  'range_num_stages': [0, 1],
2026-02-21T09:12:42.9118852Z  'range_unroll_factors': [0, 2],
2026-02-21T09:12:42.9119180Z  'range_warp_specializes': []}
2026-02-21T09:12:42.9142652Z [246s] Fitting surrogate: 486 points, 486 targets
2026-02-21T09:12:43.8838647Z [247s] Generation 6 starting: 60 neighbors, 5 active search path(s)
2026-02-21T09:12:57.9638114Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 3.5 configs/s
2026-02-21T09:13:01.6235381Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.6 configs/s
2026-02-21T09:13:08.8651010Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 139.7         
2026-02-21T09:13:08.8651967Z                                                                   configs/s     
2026-02-21T09:13:09.4407776Z [272s] Generation 6 complete: 
2026-02-21T09:13:09.4408135Z ok=65
2026-02-21T09:13:09.4408403Z min=0.0336
2026-02-21T09:13:09.4408665Z mid=0.0350
2026-02-21T09:13:09.4408920Z max=0.0615
2026-02-21T09:13:09.4409206Z best={'block_sizes': [1, 8192],
2026-02-21T09:13:09.4409625Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:13:09.4410860Z  'load_eviction_policies': ['', ''],
2026-02-21T09:13:09.4411181Z  'num_stages': 5,
2026-02-21T09:13:09.4411460Z  'num_warps': 4,
2026-02-21T09:13:09.4411715Z  'pid_type': 'flat',
2026-02-21T09:13:09.4436699Z  'range_flattens': [None, None],
2026-02-21T09:13:09.4437035Z  'range_multi_buffers': [None, None],
2026-02-21T09:13:09.4437368Z  'range_num_stages': [0, 3],
2026-02-21T09:13:09.4437627Z  'range_unroll_factors': [0, 3],
2026-02-21T09:13:09.4437936Z  'range_warp_specializes': []}
2026-02-21T09:13:09.4443367Z [272s] Fitting surrogate: 551 points, 551 targets
2026-02-21T09:13:10.2490131Z [273s] Generation 7 starting: 47 neighbors, 5 active search path(s)
2026-02-21T09:13:21.4739588Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 5.8 configs/s
2026-02-21T09:13:24.5252149Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 16.6 configs/s
2026-02-21T09:13:30.3706781Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 173.0         
2026-02-21T09:13:30.3708678Z                                                                   configs/s     
2026-02-21T09:13:30.8411334Z [294s] Generation 7 complete: 
2026-02-21T09:13:30.8411737Z ok=52
2026-02-21T09:13:30.8411976Z min=0.0342
2026-02-21T09:13:30.8412244Z mid=0.0350
2026-02-21T09:13:30.8412466Z max=0.0621
2026-02-21T09:13:30.8412741Z best={'block_sizes': [1, 8192],
2026-02-21T09:13:30.8413137Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:13:30.8413553Z  'load_eviction_policies': ['', ''],
2026-02-21T09:13:30.8413825Z  'num_stages': 3,
2026-02-21T09:13:30.8414497Z  'num_warps': 4,
2026-02-21T09:13:30.8414719Z  'pid_type': 'flat',
2026-02-21T09:13:30.8414986Z  'range_flattens': [None, None],
2026-02-21T09:13:30.8415282Z  'range_multi_buffers': [None, None],
2026-02-21T09:13:30.8415598Z  'range_num_stages': [0, 1],
2026-02-21T09:13:30.8415879Z  'range_unroll_factors': [0, 2],
2026-02-21T09:13:30.8416139Z  'range_warp_specializes': []}
2026-02-21T09:13:30.8449599Z [294s] Fitting surrogate: 603 points, 603 targets
2026-02-21T09:13:31.8232606Z [295s] Generation 8 starting: 61 neighbors, 5 active search path(s)
2026-02-21T09:13:45.7702940Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 5.5 configs/s
2026-02-21T09:13:50.5106740Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 13.2 configs/s
2026-02-21T09:13:57.9070504Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 136.9         
2026-02-21T09:13:57.9071058Z                                                                   configs/s     
2026-02-21T09:13:58.4905443Z [321s] Generation 8 complete: 
2026-02-21T09:13:58.4905739Z ok=66
2026-02-21T09:13:58.4905983Z min=0.0335
2026-02-21T09:13:58.4906226Z mid=0.0348
2026-02-21T09:13:58.4906433Z max=0.1185
2026-02-21T09:13:58.4906728Z best={'block_sizes': [1, 8192],
2026-02-21T09:13:58.4907146Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:13:58.4907633Z  'load_eviction_policies': ['', ''],
2026-02-21T09:13:58.4907952Z  'num_stages': 5,
2026-02-21T09:13:58.4908220Z  'num_warps': 4,
2026-02-21T09:13:58.4908455Z  'pid_type': 'flat',
2026-02-21T09:13:58.4908746Z  'range_flattens': [None, None],
2026-02-21T09:13:58.4909072Z  'range_multi_buffers': [None, None],
2026-02-21T09:13:58.4909385Z  'range_num_stages': [0, 3],
2026-02-21T09:13:58.4909689Z  'range_unroll_factors': [0, 4],
2026-02-21T09:13:58.4909976Z  'range_warp_specializes': []}
2026-02-21T09:13:58.4936228Z [321s] Fitting surrogate: 669 points, 669 targets
2026-02-21T09:13:59.4412035Z [322s] Generation 9 starting: 59 neighbors, 5 active search path(s)
2026-02-21T09:14:13.4749817Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 2.5 configs/s
2026-02-21T09:14:17.0745280Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 16.6 configs/s
2026-02-21T09:14:24.7247899Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 132.2         
2026-02-21T09:14:24.7248530Z                                                                   configs/s     
2026-02-21T09:14:25.3195952Z [348s] Generation 9 complete: 
2026-02-21T09:14:25.3196365Z ok=64
2026-02-21T09:14:25.3196652Z min=0.0371
2026-02-21T09:14:25.3196880Z mid=0.0378
2026-02-21T09:14:25.3197177Z max=0.0879
2026-02-21T09:14:25.3197444Z best={'block_sizes': [1, 8192],
2026-02-21T09:14:25.3197936Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:14:25.3198470Z  'load_eviction_policies': ['', ''],
2026-02-21T09:14:25.3198817Z  'num_stages': 3,
2026-02-21T09:14:25.3199133Z  'num_warps': 4,
2026-02-21T09:14:25.3199411Z  'pid_type': 'flat',
2026-02-21T09:14:25.3199751Z  'range_flattens': [None, True],
2026-02-21T09:14:25.3200102Z  'range_multi_buffers': [None, None],
2026-02-21T09:14:25.3201212Z  'range_num_stages': [0, 1],
2026-02-21T09:14:25.3201545Z  'range_unroll_factors': [0, 2],
2026-02-21T09:14:25.3201897Z  'range_warp_specializes': []}
2026-02-21T09:14:25.3235161Z [348s] Fitting surrogate: 733 points, 733 targets
2026-02-21T09:14:26.1656291Z [349s] Generation 10 starting: 51 neighbors, 5 active search path(s)
2026-02-21T09:14:39.4718292Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 2.3 configs/s
2026-02-21T09:14:42.7777610Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 54/54 16.5 configs/s
2026-02-21T09:14:50.0819280Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 156.7         
2026-02-21T09:14:50.0819842Z                                                                   configs/s     
2026-02-21T09:14:50.5936809Z [373s] Generation 10 complete: 
2026-02-21T09:14:50.5937168Z ok=57
2026-02-21T09:14:50.5937440Z min=0.0337
2026-02-21T09:14:50.5937677Z mid=0.0377
2026-02-21T09:14:50.5937938Z max=0.7615
2026-02-21T09:14:50.5938180Z best={'block_sizes': [1, 8192],
2026-02-21T09:14:50.5938759Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:14:50.5939263Z  'load_eviction_policies': ['', ''],
2026-02-21T09:14:50.5939609Z  'num_stages': 5,
2026-02-21T09:14:50.5939870Z  'num_warps': 4,
2026-02-21T09:14:50.5940109Z  'pid_type': 'flat',
2026-02-21T09:14:50.5940394Z  'range_flattens': [None, None],
2026-02-21T09:14:50.5940696Z  'range_multi_buffers': [None, None],
2026-02-21T09:14:50.5941031Z  'range_num_stages': [0, 3],
2026-02-21T09:14:50.5941308Z  'range_unroll_factors': [0, 4],
2026-02-21T09:14:50.5941629Z  'range_warp_specializes': []}
2026-02-21T09:14:50.5974352Z [373s] Fitting surrogate: 790 points, 790 targets
2026-02-21T09:14:51.2282778Z [374s] Generation 11 starting: 36 neighbors, 3 active search path(s)
2026-02-21T09:15:00.4153716Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 2.9 configs/s
2026-02-21T09:15:02.6116217Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 36/36 16.7 configs/s
2026-02-21T09:15:07.5765145Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 203.5         
2026-02-21T09:15:07.5765734Z                                                                   configs/s     
2026-02-21T09:15:07.9730164Z [391s] Generation 11 complete: 
2026-02-21T09:15:07.9730564Z ok=40
2026-02-21T09:15:07.9730804Z min=0.0372
2026-02-21T09:15:07.9731070Z mid=0.0376
2026-02-21T09:15:07.9731291Z max=0.0723
2026-02-21T09:15:07.9731565Z best={'block_sizes': [1, 8192],
2026-02-21T09:15:07.9732043Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:15:07.9732525Z  'load_eviction_policies': ['', ''],
2026-02-21T09:15:07.9732876Z  'num_stages': 8,
2026-02-21T09:15:07.9733136Z  'num_warps': 4,
2026-02-21T09:15:07.9733436Z  'pid_type': 'flat',
2026-02-21T09:15:07.9733674Z  'range_flattens': [None, None],
2026-02-21T09:15:07.9734488Z  'range_multi_buffers': [None, True],
2026-02-21T09:15:07.9734867Z  'range_num_stages': [0, 3],
2026-02-21T09:15:07.9735194Z  'range_unroll_factors': [0, 2],
2026-02-21T09:15:07.9735534Z  'range_warp_specializes': []}
2026-02-21T09:15:07.9771450Z [391s] Fitting surrogate: 830 points, 830 targets
2026-02-21T09:15:08.4290283Z [391s] Generation 12 starting: 21 neighbors, 2 active search path(s)
2026-02-21T09:15:16.2735131Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 1.5 configs/s
2026-02-21T09:15:17.6676396Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 17.0 configs/s
2026-02-21T09:15:20.4393502Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 362.8         
2026-02-21T09:15:20.4394421Z                                                                   configs/s     
2026-02-21T09:15:20.6707283Z [403s] Generation 12 complete: 
2026-02-21T09:15:20.6707599Z ok=24
2026-02-21T09:15:20.6707857Z min=0.0338
2026-02-21T09:15:20.6708076Z mid=0.0369
2026-02-21T09:15:20.6708315Z max=0.0610
2026-02-21T09:15:20.6708545Z best={'block_sizes': [1, 8192],
2026-02-21T09:15:20.6709456Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:15:20.6709995Z  'load_eviction_policies': ['', ''],
2026-02-21T09:15:20.6710396Z  'num_stages': 8,
2026-02-21T09:15:20.6710704Z  'num_warps': 4,
2026-02-21T09:15:20.6711028Z  'pid_type': 'flat',
2026-02-21T09:15:20.6711338Z  'range_flattens': [None, None],
2026-02-21T09:15:20.6711671Z  'range_multi_buffers': [None, True],
2026-02-21T09:15:20.6712015Z  'range_num_stages': [0, 3],
2026-02-21T09:15:20.6712319Z  'range_unroll_factors': [0, 2],
2026-02-21T09:15:20.6712671Z  'range_warp_specializes': []}
2026-02-21T09:15:20.6746687Z [403s] Fitting surrogate: 854 points, 854 targets
2026-02-21T09:15:21.1459248Z [404s] Generation 13 starting: 24 neighbors, 2 active search path(s)
2026-02-21T09:15:26.5568464Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 7.8 configs/s
2026-02-21T09:15:27.9958958Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 17.2 configs/s
2026-02-21T09:15:31.2665747Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 307.8         
2026-02-21T09:15:31.2666283Z                                                                   configs/s     
2026-02-21T09:15:31.5380945Z [414s] Generation 13 complete: 
2026-02-21T09:15:31.5381235Z ok=26
2026-02-21T09:15:31.5381468Z min=0.0369
2026-02-21T09:15:31.5381683Z mid=0.0375
2026-02-21T09:15:31.5381919Z max=0.0469
2026-02-21T09:15:31.5382175Z best={'block_sizes': [1, 8192],
2026-02-21T09:15:31.5382525Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:15:31.5382936Z  'load_eviction_policies': ['', ''],
2026-02-21T09:15:31.5383229Z  'num_stages': 3,
2026-02-21T09:15:31.5383488Z  'num_warps': 4,
2026-02-21T09:15:31.5383721Z  'pid_type': 'flat',
2026-02-21T09:15:31.5384311Z  'range_flattens': [None, False],
2026-02-21T09:15:31.5384616Z  'range_multi_buffers': [None, None],
2026-02-21T09:15:31.5384946Z  'range_num_stages': [0, 0],
2026-02-21T09:15:31.5385220Z  'range_unroll_factors': [0, 1],
2026-02-21T09:15:31.5385535Z  'range_warp_specializes': []}
2026-02-21T09:15:31.5421771Z [414s] Fitting surrogate: 880 points, 880 targets
2026-02-21T09:15:32.0680103Z [415s] Generation 14 starting: 25 neighbors, 2 active search path(s)
2026-02-21T09:15:52.3836931Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 0.3 configs/s
2026-02-21T09:15:53.9737175Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 16.8 configs/s
2026-02-21T09:15:56.9432198Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 338.8         
2026-02-21T09:15:56.9432785Z                                                                   configs/s     
2026-02-21T09:15:57.1937175Z [440s] Generation 14 complete: 
2026-02-21T09:15:57.1937496Z ok=28
2026-02-21T09:15:57.1937738Z min=0.0338
2026-02-21T09:15:57.1937951Z mid=0.0346
2026-02-21T09:15:57.1938193Z max=0.7961
2026-02-21T09:15:57.1938420Z best={'block_sizes': [1, 8192],
2026-02-21T09:15:57.1938801Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:15:57.1939247Z  'load_eviction_policies': ['', ''],
2026-02-21T09:15:57.1939547Z  'num_stages': 3,
2026-02-21T09:15:57.1939814Z  'num_warps': 4,
2026-02-21T09:15:57.1940050Z  'pid_type': 'flat',
2026-02-21T09:15:57.1940827Z  'range_flattens': [None, False],
2026-02-21T09:15:57.1941131Z  'range_multi_buffers': [None, False],
2026-02-21T09:15:57.1941467Z  'range_num_stages': [0, 0],
2026-02-21T09:15:57.1941748Z  'range_unroll_factors': [0, 1],
2026-02-21T09:15:57.1942067Z  'range_warp_specializes': []}
2026-02-21T09:15:57.1978248Z [440s] Fitting surrogate: 908 points, 908 targets
2026-02-21T09:15:57.6596104Z [440s] Generation 15 starting: 23 neighbors, 2 active search path(s)
2026-02-21T09:16:03.5811089Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 6.1 configs/s
2026-02-21T09:16:05.0097710Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.6 configs/s
2026-02-21T09:16:08.0537697Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 330.4         
2026-02-21T09:16:08.0538998Z                                                                   configs/s     
2026-02-21T09:16:08.3042492Z [451s] Generation 15 complete: 
2026-02-21T09:16:08.3042951Z ok=25
2026-02-21T09:16:08.3043186Z min=0.0368
2026-02-21T09:16:08.3043467Z mid=0.0378
2026-02-21T09:16:08.3043696Z max=0.0517
2026-02-21T09:16:08.3044408Z best={'block_sizes': [1, 8192],
2026-02-21T09:16:08.3044850Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:16:08.3045254Z  'load_eviction_policies': ['', ''],
2026-02-21T09:16:08.3045603Z  'num_stages': 8,
2026-02-21T09:16:08.3045872Z  'num_warps': 4,
2026-02-21T09:16:08.3046157Z  'pid_type': 'flat',
2026-02-21T09:16:08.3046460Z  'range_flattens': [None, None],
2026-02-21T09:16:08.3046821Z  'range_multi_buffers': [None, None],
2026-02-21T09:16:08.3047147Z  'range_num_stages': [0, 2],
2026-02-21T09:16:08.3047472Z  'range_unroll_factors': [0, 2],
2026-02-21T09:16:08.3047805Z  'range_warp_specializes': []}
2026-02-21T09:16:08.3085587Z [451s] Fitting surrogate: 933 points, 933 targets
2026-02-21T09:16:08.7868154Z [452s] Generation 16 starting: 25 neighbors, 2 active search path(s)
2026-02-21T09:16:16.1279785Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 2.3 configs/s
2026-02-21T09:16:17.8173503Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 27/27 16.4 configs/s
2026-02-21T09:16:22.1016832Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 298.7         
2026-02-21T09:16:22.1017720Z                                                                   configs/s     
2026-02-21T09:16:22.3810252Z [465s] Generation 16 complete: 
2026-02-21T09:16:22.3810752Z ok=28
2026-02-21T09:16:22.3811150Z min=0.0337
2026-02-21T09:16:22.3811507Z mid=0.0343
2026-02-21T09:16:22.3811901Z max=0.7779
2026-02-21T09:16:22.3812286Z best={'block_sizes': [1, 8192],
2026-02-21T09:16:22.3812945Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:16:22.3813508Z  'load_eviction_policies': ['', ''],
2026-02-21T09:16:22.3813793Z  'num_stages': 8,
2026-02-21T09:16:22.3814322Z  'num_warps': 4,
2026-02-21T09:16:22.3814539Z  'pid_type': 'flat',
2026-02-21T09:16:22.3814809Z  'range_flattens': [None, None],
2026-02-21T09:16:22.3815534Z  'range_multi_buffers': [None, None],
2026-02-21T09:16:22.3815843Z  'range_num_stages': [0, 2],
2026-02-21T09:16:22.3816095Z  'range_unroll_factors': [0, 2],
2026-02-21T09:16:22.3816384Z  'range_warp_specializes': []}
2026-02-21T09:16:22.3849099Z [465s] Fitting surrogate: 961 points, 961 targets
2026-02-21T09:16:22.6894952Z [465s] Generation 17 starting: 12 neighbors, 1 active search path(s)
2026-02-21T09:16:26.5903525Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 3.5 configs/s
2026-02-21T09:16:27.3385129Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.0 configs/s
2026-02-21T09:16:29.0975758Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 568.0         
2026-02-21T09:16:29.0977087Z                                                                   configs/s     
2026-02-21T09:16:29.2545911Z [472s] Generation 17 complete: 
2026-02-21T09:16:29.2546213Z ok=14
2026-02-21T09:16:29.2546466Z min=0.0370
2026-02-21T09:16:29.2546712Z mid=0.0377
2026-02-21T09:16:29.2546943Z max=0.0488
2026-02-21T09:16:29.2547162Z best={'block_sizes': [1, 8192],
2026-02-21T09:16:29.2547568Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:16:29.2548049Z  'load_eviction_policies': ['', ''],
2026-02-21T09:16:29.2548450Z  'num_stages': 8,
2026-02-21T09:16:29.2548722Z  'num_warps': 4,
2026-02-21T09:16:29.2549006Z  'pid_type': 'flat',
2026-02-21T09:16:29.2549320Z  'range_flattens': [None, None],
2026-02-21T09:16:29.2549638Z  'range_multi_buffers': [None, None],
2026-02-21T09:16:29.2549993Z  'range_num_stages': [0, 2],
2026-02-21T09:16:29.2550289Z  'range_unroll_factors': [0, 2],
2026-02-21T09:16:29.2550635Z  'range_warp_specializes': []}
2026-02-21T09:16:29.2586823Z [472s] Fitting surrogate: 975 points, 975 targets
2026-02-21T09:16:29.5542325Z [472s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:16:33.6245361Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 6.9 configs/s
2026-02-21T09:16:34.3766024Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 16.9 configs/s
2026-02-21T09:16:36.0262966Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 605.0         
2026-02-21T09:16:36.0263491Z                                                                   configs/s     
2026-02-21T09:16:36.1758848Z [479s] Generation 18 complete: 
2026-02-21T09:16:36.1759139Z ok=13
2026-02-21T09:16:36.1759329Z min=0.0372
2026-02-21T09:16:36.1759518Z mid=0.0390
2026-02-21T09:16:36.1759683Z max=0.0500
2026-02-21T09:16:36.1759874Z best={'block_sizes': [1, 8192],
2026-02-21T09:16:36.1760227Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:16:36.1760583Z  'load_eviction_policies': ['', ''],
2026-02-21T09:16:36.1760848Z  'num_stages': 8,
2026-02-21T09:16:36.1761071Z  'num_warps': 4,
2026-02-21T09:16:36.1761274Z  'pid_type': 'flat',
2026-02-21T09:16:36.1761491Z  'range_flattens': [None, None],
2026-02-21T09:16:36.1761773Z  'range_multi_buffers': [None, None],
2026-02-21T09:16:36.1762073Z  'range_num_stages': [0, 2],
2026-02-21T09:16:36.1762348Z  'range_unroll_factors': [0, 2],
2026-02-21T09:16:36.1762670Z  'range_warp_specializes': []}
2026-02-21T09:16:36.1802371Z [479s] Fitting surrogate: 988 points, 988 targets
2026-02-21T09:16:36.4822987Z [479s] Generation 19 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:16:39.9751919Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 8.0 configs/s
2026-02-21T09:16:40.9735155Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 12.3 configs/s
2026-02-21T09:16:42.4800308Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 660.7         
2026-02-21T09:16:42.4802073Z                                                                   configs/s     
2026-02-21T09:16:42.6201935Z [485s] Generation 19 complete: 
2026-02-21T09:16:42.6202314Z ok=13
2026-02-21T09:16:42.6202571Z min=0.0339
2026-02-21T09:16:42.6202805Z mid=0.0383
2026-02-21T09:16:42.6203071Z max=0.0521
2026-02-21T09:16:42.6204185Z best={'block_sizes': [1, 8192],
2026-02-21T09:16:42.6204548Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:16:42.6204983Z  'load_eviction_policies': ['', ''],
2026-02-21T09:16:42.6205294Z  'num_stages': 4,
2026-02-21T09:16:42.6205574Z  'num_warps': 4,
2026-02-21T09:16:42.6205843Z  'pid_type': 'flat',
2026-02-21T09:16:42.6206160Z  'range_flattens': [None, True],
2026-02-21T09:16:42.6206475Z  'range_multi_buffers': [None, True],
2026-02-21T09:16:42.6206839Z  'range_num_stages': [0, 0],
2026-02-21T09:16:42.6207158Z  'range_unroll_factors': [0, 1],
2026-02-21T09:16:42.6207487Z  'range_warp_specializes': []}
2026-02-21T09:16:42.6245177Z [485s] Fitting surrogate: 1001 points, 1001 targets
2026-02-21T09:16:42.9353041Z [486s] Generation 20 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:16:46.8665405Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.8 configs/s
2026-02-21T09:16:47.6341388Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 15.0 configs/s
2026-02-21T09:16:49.1259847Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 667.9         
2026-02-21T09:16:49.1260469Z                                                                   configs/s     
2026-02-21T09:16:49.2648589Z [492s] Generation 20 complete: 
2026-02-21T09:16:49.2649112Z ok=12
2026-02-21T09:16:49.2649520Z min=0.0370
2026-02-21T09:16:49.2649878Z mid=0.0374
2026-02-21T09:16:49.2650446Z max=0.0453
2026-02-21T09:16:49.2650829Z best={'block_sizes': [1, 8192],
2026-02-21T09:16:49.2651446Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:16:49.2652092Z  'load_eviction_policies': ['', ''],
2026-02-21T09:16:49.2652478Z  'num_stages': 4,
2026-02-21T09:16:49.2652733Z  'num_warps': 4,
2026-02-21T09:16:49.2652952Z  'pid_type': 'flat',
2026-02-21T09:16:49.2653238Z  'range_flattens': [None, True],
2026-02-21T09:16:49.2653516Z  'range_multi_buffers': [None, True],
2026-02-21T09:16:49.2653828Z  'range_num_stages': [0, 1],
2026-02-21T09:16:49.2654366Z  'range_unroll_factors': [0, 1],
2026-02-21T09:16:49.2654678Z  'range_warp_specializes': []}
2026-02-21T09:16:49.2692151Z [492s] Fitting surrogate: 1013 points, 1013 targets
2026-02-21T09:16:49.4348903Z [492s] Autotuning complete in 492.7s after searching 954 configs.
2026-02-21T09:16:49.4349469Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:16:49.4350914Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', ''], num_stages=4, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T09:16:49.4352256Z 
2026-02-21T09:16:49.4352697Z [492s] Code of selected kernel: /tmp/torchinductor_root/hj/chjkzxs7rlnwhdlicwzxn3t3xlo3m57df3osyy2wfwmk4a2s77b2.py
2026-02-21T09:16:50.3119178Z WARNING:tritonbench.utils.triton_op:Completed input ID 41:
2026-02-21T09:16:50.3119590Z (M, N)
2026-02-21T09:16:50.3119804Z ------------
2026-02-21T09:16:50.3120017Z (4096, 5504)
2026-02-21T09:16:50.3120141Z 
2026-02-21T09:16:50.3139234Z  45%|████▌     | 9/20 [58:20<1:19:02, 431.16s/it]WARNING:tritonbench.utils.triton_op:Running input ID 46:
2026-02-21T09:16:50.3139738Z (M, N)
2026-02-21T09:16:50.3139937Z ------------
2026-02-21T09:16:50.3140161Z (4096, 6144)
2026-02-21T09:16:50.3141820Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T09:16:51.8101946Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T09:16:53.4916353Z INFO:tritonbench.utils.triton_op:Took 3.17ms to get benchmark function for torch_compile_softmax
2026-02-21T09:16:58.0416252Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:16:58.0416710Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:16:58.0417061Z               'dtype': 'torch.float16',
2026-02-21T09:16:58.0417445Z               'shape': (4096, 6144),
2026-02-21T09:16:58.0434624Z               'stride': (6144, 1)},),
2026-02-21T09:16:58.0434933Z   'kwargs': {}}
2026-02-21T09:16:58.0459763Z INFO:tritonbench.utils.triton_op:Took 4.73ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T09:16:58.3298624Z [0s] Autotune random seed: 2135383793
2026-02-21T09:16:58.5322469Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:17:33.8814395Z [35s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T09:17:34.8488057Z [36s] Timeout after 30s compiling Config(block_sizes=[8, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T09:17:36.1980308Z [37s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:17:47.0355414Z [48s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:17:48.0717731Z [49s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T09:17:48.3099333Z [49s] Timeout after 30s compiling Config(block_sizes=[4096, 1], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=1, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T09:17:48.9604733Z [50s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:17:48.9627666Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:17:55.4371016Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.5 configs/s
2026-02-21T09:17:55.4385113Z [56s] Adaptive compile timeout: 30s (90% percentile=20.5s, bounds=[30.0s, 30s])
2026-02-21T09:17:56.3415094Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1077.8 configs/s
2026-02-21T09:17:56.4339965Z [57s] Initial random population of 100, 5 starting points: 
2026-02-21T09:17:56.4340339Z error=2
2026-02-21T09:17:56.4340504Z timeout=7
2026-02-21T09:17:56.4340794Z ok=91
2026-02-21T09:17:56.4341012Z min=0.0602
2026-02-21T09:17:56.4341177Z mid=0.4405
2026-02-21T09:17:56.4341901Z max=21.2945
2026-02-21T09:17:56.4342086Z best={'block_sizes': [1, 256],
2026-02-21T09:17:56.4342460Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:17:56.4342873Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:17:56.4343135Z  'num_stages': 2,
2026-02-21T09:17:56.4343318Z  'num_warps': 1,
2026-02-21T09:17:56.4343513Z  'pid_type': 'flat',
2026-02-21T09:17:56.4343719Z  'range_flattens': [None, True],
2026-02-21T09:17:56.4344138Z  'range_multi_buffers': [None, None],
2026-02-21T09:17:56.4344421Z  'range_num_stages': [0, 3],
2026-02-21T09:17:56.4344650Z  'range_unroll_factors': [0, 2],
2026-02-21T09:17:56.4344902Z  'range_warp_specializes': []}
2026-02-21T09:17:56.4359158Z [57s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:17:57.9936196Z [59s] Generation 1 starting: 87 neighbors, 5 active search path(s)
2026-02-21T09:18:44.5243436Z [105s] Timeout after 30s compiling Config(block_sizes=[8, 2048], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=64, num_sm_multiplier=1, num_stages=6, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, None], range_num_stages=[1, 2], range_unroll_factors=[4, 3], range_warp_specializes=[])
2026-02-21T09:18:44.5262542Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 0.2 configs/s
2026-02-21T09:18:50.1269279Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.6 configs/s
2026-02-21T09:19:00.5325534Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.5         
2026-02-21T09:19:00.5326009Z                                                                   configs/s     
2026-02-21T09:19:01.1678016Z [122s] Generation 1 complete: 
2026-02-21T09:19:01.1678463Z timeout=1
2026-02-21T09:19:01.1678775Z ok=92
2026-02-21T09:19:01.1679051Z min=0.0521
2026-02-21T09:19:01.1679319Z mid=0.0666
2026-02-21T09:19:01.1679583Z max=0.3200
2026-02-21T09:19:01.1680151Z best={'block_sizes': [2, 1024],
2026-02-21T09:19:01.1680797Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:19:01.1681492Z  'load_eviction_policies': ['', ''],
2026-02-21T09:19:01.1681982Z  'num_stages': 5,
2026-02-21T09:19:01.1682418Z  'num_warps': 8,
2026-02-21T09:19:01.1682877Z  'pid_type': 'flat',
2026-02-21T09:19:01.1683313Z  'range_flattens': [None, None],
2026-02-21T09:19:01.1683877Z  'range_multi_buffers': [None, None],
2026-02-21T09:19:01.1684657Z  'range_num_stages': [0, 2],
2026-02-21T09:19:01.1684929Z  'range_unroll_factors': [0, 3],
2026-02-21T09:19:01.1685183Z  'range_warp_specializes': []}
2026-02-21T09:19:01.1699319Z [122s] Fitting surrogate: 193 points, 193 targets
2026-02-21T09:19:02.6449334Z [124s] Generation 2 starting: 83 neighbors, 5 active search path(s)
2026-02-21T09:19:27.7910362Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 1.5 configs/s
2026-02-21T09:19:33.0190141Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 16.4 configs/s
2026-02-21T09:19:44.1997670Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 90.4 configs/s
2026-02-21T09:19:44.9730425Z [166s] Generation 2 complete: 
2026-02-21T09:19:44.9730979Z ok=88
2026-02-21T09:19:44.9731384Z min=0.0466
2026-02-21T09:19:44.9731745Z mid=0.0550
2026-02-21T09:19:44.9732135Z max=0.4692
2026-02-21T09:19:44.9732509Z best={'block_sizes': [1, 2048],
2026-02-21T09:19:44.9733180Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:19:44.9733846Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:19:44.9734878Z  'num_stages': 8,
2026-02-21T09:19:44.9735108Z  'num_warps': 4,
2026-02-21T09:19:44.9735378Z  'pid_type': 'flat',
2026-02-21T09:19:44.9735634Z  'range_flattens': [None, None],
2026-02-21T09:19:44.9735953Z  'range_multi_buffers': [None, None],
2026-02-21T09:19:44.9736302Z  'range_num_stages': [0, 2],
2026-02-21T09:19:44.9736566Z  'range_unroll_factors': [0, 2],
2026-02-21T09:19:44.9736875Z  'range_warp_specializes': []}
2026-02-21T09:19:44.9760072Z [166s] Fitting surrogate: 281 points, 281 targets
2026-02-21T09:19:46.0966546Z [167s] Generation 3 starting: 71 neighbors, 5 active search path(s)
2026-02-21T09:20:03.0194783Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 7.1 configs/s
2026-02-21T09:20:07.4479709Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 16.4 configs/s
2026-02-21T09:20:17.3580642Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.1         
2026-02-21T09:20:17.3582576Z                                                                   configs/s     
2026-02-21T09:20:18.0671317Z [199s] Generation 3 complete: 
2026-02-21T09:20:18.0671837Z ok=76
2026-02-21T09:20:18.0672248Z min=0.0413
2026-02-21T09:20:18.0672608Z mid=0.0521
2026-02-21T09:20:18.0673014Z max=0.0871
2026-02-21T09:20:18.0673971Z best={'block_sizes': [1, 4096],
2026-02-21T09:20:18.0675224Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:20:18.0675933Z  'load_eviction_policies': ['', 'first'],
2026-02-21T09:20:18.0676528Z  'num_stages': 1,
2026-02-21T09:20:18.0676927Z  'num_warps': 4,
2026-02-21T09:20:18.0677405Z  'pid_type': 'flat',
2026-02-21T09:20:18.0677906Z  'range_flattens': [None, True],
2026-02-21T09:20:18.0678188Z  'range_multi_buffers': [None, None],
2026-02-21T09:20:18.0678500Z  'range_num_stages': [0, 3],
2026-02-21T09:20:18.0678764Z  'range_unroll_factors': [0, 2],
2026-02-21T09:20:18.0679058Z  'range_warp_specializes': []}
2026-02-21T09:20:18.0701205Z [199s] Fitting surrogate: 357 points, 357 targets
2026-02-21T09:20:19.1044841Z [200s] Generation 4 starting: 64 neighbors, 5 active search path(s)
2026-02-21T09:20:35.9683744Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 11.8 configs/s
2026-02-21T09:20:39.9006899Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 16.5 configs/s
2026-02-21T09:20:48.5703661Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.7         
2026-02-21T09:20:48.5705822Z                                                                   configs/s     
2026-02-21T09:20:49.2049357Z [230s] Generation 4 complete: 
2026-02-21T09:20:49.2050022Z ok=69
2026-02-21T09:20:49.2050446Z min=0.0371
2026-02-21T09:20:49.2050808Z mid=0.0473
2026-02-21T09:20:49.2051202Z max=0.1580
2026-02-21T09:20:49.2051583Z best={'block_sizes': [1, 8192],
2026-02-21T09:20:49.2052242Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:20:49.2052882Z  'load_eviction_policies': ['', ''],
2026-02-21T09:20:49.2053445Z  'num_stages': 5,
2026-02-21T09:20:49.2053822Z  'num_warps': 4,
2026-02-21T09:20:49.2054474Z  'pid_type': 'flat',
2026-02-21T09:20:49.2054952Z  'range_flattens': [None, None],
2026-02-21T09:20:49.2055443Z  'range_multi_buffers': [None, None],
2026-02-21T09:20:49.2056012Z  'range_num_stages': [0, 2],
2026-02-21T09:20:49.2056482Z  'range_unroll_factors': [0, 3],
2026-02-21T09:20:49.2056936Z  'range_warp_specializes': []}
2026-02-21T09:20:49.2083028Z [230s] Fitting surrogate: 426 points, 426 targets
2026-02-21T09:20:50.1344522Z [231s] Generation 5 starting: 58 neighbors, 5 active search path(s)
2026-02-21T09:21:04.6017616Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 11.1 configs/s
2026-02-21T09:21:08.2992933Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.4 configs/s
2026-02-21T09:21:15.6725723Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 137.1         
2026-02-21T09:21:15.6727454Z                                                                   configs/s     
2026-02-21T09:21:16.2326532Z [257s] Generation 5 complete: 
2026-02-21T09:21:16.2326971Z ok=64
2026-02-21T09:21:16.2327258Z min=0.0368
2026-02-21T09:21:16.2327582Z mid=0.0428
2026-02-21T09:21:16.2327845Z max=0.0961
2026-02-21T09:21:16.2328145Z best={'block_sizes': [1, 8192],
2026-02-21T09:21:16.2329199Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:21:16.2329916Z  'load_eviction_policies': ['', ''],
2026-02-21T09:21:16.2330328Z  'num_stages': 8,
2026-02-21T09:21:16.2330641Z  'num_warps': 4,
2026-02-21T09:21:16.2330975Z  'pid_type': 'flat',
2026-02-21T09:21:16.2331320Z  'range_flattens': [None, None],
2026-02-21T09:21:16.2331726Z  'range_multi_buffers': [None, None],
2026-02-21T09:21:16.2332152Z  'range_num_stages': [0, 2],
2026-02-21T09:21:16.2332526Z  'range_unroll_factors': [0, 2],
2026-02-21T09:21:16.2332912Z  'range_warp_specializes': []}
2026-02-21T09:21:16.2359238Z [257s] Fitting surrogate: 490 points, 490 targets
2026-02-21T09:21:17.1769912Z [258s] Generation 6 starting: 60 neighbors, 5 active search path(s)
2026-02-21T09:21:31.7015197Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 13.4 configs/s
2026-02-21T09:21:35.4319513Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.5 configs/s
2026-02-21T09:21:43.5178363Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 143.2         
2026-02-21T09:21:43.5180850Z                                                                   configs/s     
2026-02-21T09:21:44.0663642Z [285s] Generation 6 complete: 
2026-02-21T09:21:44.0663925Z ok=65
2026-02-21T09:21:44.0664396Z min=0.0370
2026-02-21T09:21:44.0664571Z mid=0.0394
2026-02-21T09:21:44.0664740Z max=0.5467
2026-02-21T09:21:44.0664922Z best={'block_sizes': [1, 8192],
2026-02-21T09:21:44.0665215Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:21:44.0665522Z  'load_eviction_policies': ['', ''],
2026-02-21T09:21:44.0665775Z  'num_stages': 8,
2026-02-21T09:21:44.0665963Z  'num_warps': 4,
2026-02-21T09:21:44.0666160Z  'pid_type': 'flat',
2026-02-21T09:21:44.0666369Z  'range_flattens': [None, None],
2026-02-21T09:21:44.0666634Z  'range_multi_buffers': [None, None],
2026-02-21T09:21:44.0666894Z  'range_num_stages': [0, 2],
2026-02-21T09:21:44.0667131Z  'range_unroll_factors': [0, 2],
2026-02-21T09:21:44.0667386Z  'range_warp_specializes': []}
2026-02-21T09:21:44.0697222Z [285s] Fitting surrogate: 555 points, 555 targets
2026-02-21T09:21:44.9566336Z [286s] Generation 7 starting: 54 neighbors, 5 active search path(s)
2026-02-21T09:21:59.0576680Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 3.3 configs/s
2026-02-21T09:22:02.5136608Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 16.4 configs/s
2026-02-21T09:22:10.0548733Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 134.2         
2026-02-21T09:22:10.0549240Z                                                                   configs/s     
2026-02-21T09:22:10.6284390Z [312s] Generation 7 complete: 
2026-02-21T09:22:10.6284820Z ok=59
2026-02-21T09:22:10.6285111Z min=0.0403
2026-02-21T09:22:10.6285392Z mid=0.0411
2026-02-21T09:22:10.6285654Z max=0.0656
2026-02-21T09:22:10.6285952Z best={'block_sizes': [1, 8192],
2026-02-21T09:22:10.6286484Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:22:10.6286890Z  'load_eviction_policies': ['', ''],
2026-02-21T09:22:10.6287180Z  'num_stages': 1,
2026-02-21T09:22:10.6287395Z  'num_warps': 4,
2026-02-21T09:22:10.6287592Z  'pid_type': 'flat',
2026-02-21T09:22:10.6287813Z  'range_flattens': [None, None],
2026-02-21T09:22:10.6288604Z  'range_multi_buffers': [None, None],
2026-02-21T09:22:10.6288925Z  'range_num_stages': [0, 3],
2026-02-21T09:22:10.6289255Z  'range_unroll_factors': [0, 3],
2026-02-21T09:22:10.6306032Z  'range_warp_specializes': []}
2026-02-21T09:22:10.6324611Z [312s] Fitting surrogate: 614 points, 614 targets
2026-02-21T09:22:11.5089996Z [312s] Generation 8 starting: 48 neighbors, 4 active search path(s)
2026-02-21T09:22:28.5499742Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 1.1 configs/s
2026-02-21T09:22:31.7839651Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 16.3 configs/s
2026-02-21T09:22:37.4624925Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 178.0         
2026-02-21T09:22:37.4627390Z                                                                   configs/s     
2026-02-21T09:22:37.9028844Z [339s] Generation 8 complete: 
2026-02-21T09:22:37.9029305Z ok=53
2026-02-21T09:22:37.9029622Z min=0.0369
2026-02-21T09:22:37.9029947Z mid=0.0400
2026-02-21T09:22:37.9030227Z max=1.3548
2026-02-21T09:22:37.9030526Z best={'block_sizes': [1, 8192],
2026-02-21T09:22:37.9031040Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:22:37.9031586Z  'load_eviction_policies': ['', ''],
2026-02-21T09:22:37.9032002Z  'num_stages': 5,
2026-02-21T09:22:37.9032308Z  'num_warps': 4,
2026-02-21T09:22:37.9032657Z  'pid_type': 'flat',
2026-02-21T09:22:37.9033007Z  'range_flattens': [None, False],
2026-02-21T09:22:37.9033430Z  'range_multi_buffers': [None, True],
2026-02-21T09:22:37.9033874Z  'range_num_stages': [0, 3],
2026-02-21T09:22:37.9034587Z  'range_unroll_factors': [0, 2],
2026-02-21T09:22:37.9035011Z  'range_warp_specializes': []}
2026-02-21T09:22:37.9074462Z [339s] Fitting surrogate: 667 points, 667 targets
2026-02-21T09:22:38.7771328Z [340s] Generation 9 starting: 47 neighbors, 4 active search path(s)
2026-02-21T09:22:51.0057291Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 2.7 configs/s
2026-02-21T09:22:53.9521775Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.5 configs/s
2026-02-21T09:23:00.4231529Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 156.3         
2026-02-21T09:23:00.4236507Z                                                                   configs/s     
2026-02-21T09:23:00.9222197Z [362s] Generation 9 complete: 
2026-02-21T09:23:00.9222470Z ok=52
2026-02-21T09:23:00.9222640Z min=0.0403
2026-02-21T09:23:00.9222820Z mid=0.0408
2026-02-21T09:23:00.9222985Z max=0.0611
2026-02-21T09:23:00.9223176Z best={'block_sizes': [1, 8192],
2026-02-21T09:23:00.9223490Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:23:00.9223834Z  'load_eviction_policies': ['', ''],
2026-02-21T09:23:00.9224425Z  'num_stages': 4,
2026-02-21T09:23:00.9224653Z  'num_warps': 4,
2026-02-21T09:23:00.9224852Z  'pid_type': 'flat',
2026-02-21T09:23:00.9225072Z  'range_flattens': [None, False],
2026-02-21T09:23:00.9225333Z  'range_multi_buffers': [None, True],
2026-02-21T09:23:00.9225607Z  'range_num_stages': [0, 4],
2026-02-21T09:23:00.9225844Z  'range_unroll_factors': [0, 2],
2026-02-21T09:23:00.9226088Z  'range_warp_specializes': []}
2026-02-21T09:23:00.9263799Z [362s] Fitting surrogate: 719 points, 719 targets
2026-02-21T09:23:01.7854786Z [363s] Generation 10 starting: 47 neighbors, 4 active search path(s)
2026-02-21T09:23:15.7358535Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51/51 4.5 configs/s
2026-02-21T09:23:18.8475048Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 51/51 16.6 configs/s
2026-02-21T09:23:24.6461784Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 174.2         
2026-02-21T09:23:24.6462287Z                                                                   configs/s     
2026-02-21T09:23:25.0983796Z [386s] Generation 10 complete: 
2026-02-21T09:23:25.0984390Z ok=52
2026-02-21T09:23:25.0984573Z min=0.0371
2026-02-21T09:23:25.0984743Z mid=0.0395
2026-02-21T09:23:25.0984915Z max=0.6714
2026-02-21T09:23:25.0985498Z best={'block_sizes': [1, 8192],
2026-02-21T09:23:25.0985856Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:23:25.0986241Z  'load_eviction_policies': ['', ''],
2026-02-21T09:23:25.0986492Z  'num_stages': 5,
2026-02-21T09:23:25.0986696Z  'num_warps': 8,
2026-02-21T09:23:25.0986903Z  'pid_type': 'flat',
2026-02-21T09:23:25.0987120Z  'range_flattens': [None, False],
2026-02-21T09:23:25.0987372Z  'range_multi_buffers': [None, True],
2026-02-21T09:23:25.0987634Z  'range_num_stages': [0, 4],
2026-02-21T09:23:25.0987867Z  'range_unroll_factors': [0, 3],
2026-02-21T09:23:25.0988117Z  'range_warp_specializes': []}
2026-02-21T09:23:25.1026403Z [386s] Fitting surrogate: 771 points, 771 targets
2026-02-21T09:23:25.8788038Z [387s] Generation 11 starting: 46 neighbors, 4 active search path(s)
2026-02-21T09:23:37.6881009Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 3.7 configs/s
2026-02-21T09:23:40.5638204Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 47/47 16.6 configs/s
2026-02-21T09:23:46.8978933Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 159.5         
2026-02-21T09:23:46.8979889Z                                                                   configs/s     
2026-02-21T09:23:47.3883434Z [408s] Generation 11 complete: 
2026-02-21T09:23:47.3886981Z ok=50
2026-02-21T09:23:47.3887329Z min=0.0402
2026-02-21T09:23:47.3887661Z mid=0.0407
2026-02-21T09:23:47.3887978Z max=0.0565
2026-02-21T09:23:47.3888301Z best={'block_sizes': [1, 8192],
2026-02-21T09:23:47.3888894Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:23:47.3889535Z  'load_eviction_policies': ['', ''],
2026-02-21T09:23:47.3890288Z  'num_stages': 5,
2026-02-21T09:23:47.3890657Z  'num_warps': 4,
2026-02-21T09:23:47.3891019Z  'pid_type': 'flat',
2026-02-21T09:23:47.3891387Z  'range_flattens': [None, False],
2026-02-21T09:23:47.3891820Z  'range_multi_buffers': [None, True],
2026-02-21T09:23:47.3892281Z  'range_num_stages': [0, 4],
2026-02-21T09:23:47.3892697Z  'range_unroll_factors': [0, 3],
2026-02-21T09:23:47.3893127Z  'range_warp_specializes': []}
2026-02-21T09:23:47.3927086Z [408s] Fitting surrogate: 821 points, 821 targets
2026-02-21T09:23:47.9917027Z [409s] Generation 12 starting: 30 neighbors, 3 active search path(s)
2026-02-21T09:23:57.5400370Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 2.5 configs/s
2026-02-21T09:23:59.5804729Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.5 configs/s
2026-02-21T09:24:03.3103895Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 270.1         
2026-02-21T09:24:03.3104689Z                                                                   configs/s     
2026-02-21T09:24:03.6077950Z [425s] Generation 12 complete: 
2026-02-21T09:24:03.6078258Z ok=34
2026-02-21T09:24:03.6078454Z min=0.0372
2026-02-21T09:24:03.6078631Z mid=0.0406
2026-02-21T09:24:03.6078805Z max=0.3490
2026-02-21T09:24:03.6078990Z best={'block_sizes': [1, 8192],
2026-02-21T09:24:03.6079793Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:24:03.6080119Z  'load_eviction_policies': ['', ''],
2026-02-21T09:24:03.6080374Z  'num_stages': 2,
2026-02-21T09:24:03.6080582Z  'num_warps': 8,
2026-02-21T09:24:03.6080782Z  'pid_type': 'flat',
2026-02-21T09:24:03.6081025Z  'range_flattens': [None, False],
2026-02-21T09:24:03.6081290Z  'range_multi_buffers': [None, None],
2026-02-21T09:24:03.6081567Z  'range_num_stages': [0, 3],
2026-02-21T09:24:03.6081808Z  'range_unroll_factors': [0, 4],
2026-02-21T09:24:03.6082064Z  'range_warp_specializes': []}
2026-02-21T09:24:03.6122001Z [425s] Fitting surrogate: 855 points, 855 targets
2026-02-21T09:24:04.2549485Z [425s] Generation 13 starting: 34 neighbors, 3 active search path(s)
2026-02-21T09:24:12.8844875Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 8.1 configs/s
2026-02-21T09:24:14.9586635Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 16.7 configs/s
2026-02-21T09:24:19.6470605Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 215.3         
2026-02-21T09:24:19.6471123Z                                                                   configs/s     
2026-02-21T09:24:20.0227410Z [441s] Generation 13 complete: 
2026-02-21T09:24:20.0227681Z ok=37
2026-02-21T09:24:20.0227866Z min=0.0373
2026-02-21T09:24:20.0228048Z mid=0.0377
2026-02-21T09:24:20.0228228Z max=0.0484
2026-02-21T09:24:20.0228425Z best={'block_sizes': [1, 8192],
2026-02-21T09:24:20.0228790Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:24:20.0229176Z  'load_eviction_policies': ['', ''],
2026-02-21T09:24:20.0229447Z  'num_stages': 4,
2026-02-21T09:24:20.0229659Z  'num_warps': 4,
2026-02-21T09:24:20.0229864Z  'pid_type': 'flat',
2026-02-21T09:24:20.0230088Z  'range_flattens': [None, False],
2026-02-21T09:24:20.0230379Z  'range_multi_buffers': [None, False],
2026-02-21T09:24:20.0230661Z  'range_num_stages': [0, 4],
2026-02-21T09:24:20.0230901Z  'range_unroll_factors': [0, 2],
2026-02-21T09:24:20.0231181Z  'range_warp_specializes': []}
2026-02-21T09:24:20.0272990Z [441s] Fitting surrogate: 892 points, 892 targets
2026-02-21T09:24:20.6341089Z [442s] Generation 14 starting: 35 neighbors, 3 active search path(s)
2026-02-21T09:24:29.6474371Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 6.8 configs/s
2026-02-21T09:24:32.7698670Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 11.3 configs/s
2026-02-21T09:24:37.5482232Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 211.3         
2026-02-21T09:24:37.5482753Z                                                                   configs/s     
2026-02-21T09:24:37.9268793Z [459s] Generation 14 complete: 
2026-02-21T09:24:37.9269291Z ok=38
2026-02-21T09:24:37.9269583Z min=0.0403
2026-02-21T09:24:37.9269896Z mid=0.0407
2026-02-21T09:24:37.9270189Z max=0.1614
2026-02-21T09:24:37.9270512Z best={'block_sizes': [1, 8192],
2026-02-21T09:24:37.9270988Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:24:37.9271518Z  'load_eviction_policies': ['', ''],
2026-02-21T09:24:37.9271968Z  'num_stages': 2,
2026-02-21T09:24:37.9272294Z  'num_warps': 4,
2026-02-21T09:24:37.9272620Z  'pid_type': 'flat',
2026-02-21T09:24:37.9272981Z  'range_flattens': [None, None],
2026-02-21T09:24:37.9273403Z  'range_multi_buffers': [None, None],
2026-02-21T09:24:37.9273837Z  'range_num_stages': [0, 3],
2026-02-21T09:24:37.9274740Z  'range_unroll_factors': [0, 4],
2026-02-21T09:24:37.9275148Z  'range_warp_specializes': []}
2026-02-21T09:24:37.9307859Z [459s] Fitting surrogate: 930 points, 930 targets
2026-02-21T09:24:38.3885253Z [459s] Generation 15 starting: 22 neighbors, 2 active search path(s)
2026-02-21T09:24:45.6183758Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 6.2 configs/s
2026-02-21T09:24:47.1926896Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 15.6 configs/s
2026-02-21T09:24:50.3671526Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 317.1         
2026-02-21T09:24:50.3672703Z                                                                   configs/s     
2026-02-21T09:24:50.6302842Z [472s] Generation 15 complete: 
2026-02-21T09:24:50.6303122Z ok=25
2026-02-21T09:24:50.6303300Z min=0.0370
2026-02-21T09:24:50.6303475Z mid=0.0393
2026-02-21T09:24:50.6303647Z max=0.0500
2026-02-21T09:24:50.6303826Z best={'block_sizes': [1, 8192],
2026-02-21T09:24:50.6304531Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:24:50.6304916Z  'load_eviction_policies': ['', ''],
2026-02-21T09:24:50.6305171Z  'num_stages': 5,
2026-02-21T09:24:50.6305356Z  'num_warps': 4,
2026-02-21T09:24:50.6305552Z  'pid_type': 'flat',
2026-02-21T09:24:50.6305760Z  'range_flattens': [None, True],
2026-02-21T09:24:50.6306017Z  'range_multi_buffers': [None, None],
2026-02-21T09:24:50.6306752Z  'range_num_stages': [0, 4],
2026-02-21T09:24:50.6307005Z  'range_unroll_factors': [0, 2],
2026-02-21T09:24:50.6307255Z  'range_warp_specializes': []}
2026-02-21T09:24:50.6349849Z [472s] Fitting surrogate: 955 points, 955 targets
2026-02-21T09:24:51.1685572Z [472s] Generation 16 starting: 25 neighbors, 2 active search path(s)
2026-02-21T09:24:58.4730787Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 2.4 configs/s
2026-02-21T09:24:59.9963387Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 16.9 configs/s
2026-02-21T09:25:03.3375600Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 301.4         
2026-02-21T09:25:03.3376086Z                                                                   configs/s     
2026-02-21T09:25:03.6089199Z [485s] Generation 16 complete: 
2026-02-21T09:25:03.6089772Z ok=27
2026-02-21T09:25:03.6090043Z min=0.0404
2026-02-21T09:25:03.6090316Z mid=0.0407
2026-02-21T09:25:03.6090574Z max=0.0563
2026-02-21T09:25:03.6090903Z best={'block_sizes': [1, 8192],
2026-02-21T09:25:03.6091437Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:25:03.6092043Z  'load_eviction_policies': ['', ''],
2026-02-21T09:25:03.6092467Z  'num_stages': 4,
2026-02-21T09:25:03.6092778Z  'num_warps': 4,
2026-02-21T09:25:03.6093084Z  'pid_type': 'flat',
2026-02-21T09:25:03.6093407Z  'range_flattens': [None, True],
2026-02-21T09:25:03.6093789Z  'range_multi_buffers': [None, False],
2026-02-21T09:25:03.6094674Z  'range_num_stages': [0, 2],
2026-02-21T09:25:03.6095081Z  'range_unroll_factors': [0, 2],
2026-02-21T09:25:03.6095486Z  'range_warp_specializes': []}
2026-02-21T09:25:03.6135296Z [485s] Fitting surrogate: 982 points, 982 targets
2026-02-21T09:25:03.9138573Z [485s] Generation 17 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:25:07.4774665Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 7.1 configs/s
2026-02-21T09:25:08.2199180Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.2 configs/s
2026-02-21T09:25:09.8666203Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 606.1         
2026-02-21T09:25:09.8666699Z                                                                   configs/s     
2026-02-21T09:25:10.0170514Z [491s] Generation 17 complete: 
2026-02-21T09:25:10.0170788Z ok=13
2026-02-21T09:25:10.0170985Z min=0.0372
2026-02-21T09:25:10.0171162Z mid=0.0380
2026-02-21T09:25:10.0171333Z max=0.0477
2026-02-21T09:25:10.0171521Z best={'block_sizes': [1, 8192],
2026-02-21T09:25:10.0171881Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:25:10.0172269Z  'load_eviction_policies': ['', ''],
2026-02-21T09:25:10.0172533Z  'num_stages': 4,
2026-02-21T09:25:10.0172732Z  'num_warps': 4,
2026-02-21T09:25:10.0172927Z  'pid_type': 'flat',
2026-02-21T09:25:10.0173164Z  'range_flattens': [None, True],
2026-02-21T09:25:10.0173428Z  'range_multi_buffers': [None, False],
2026-02-21T09:25:10.0173702Z  'range_num_stages': [0, 2],
2026-02-21T09:25:10.0173958Z  'range_unroll_factors': [0, 2],
2026-02-21T09:25:10.0174567Z  'range_warp_specializes': []}
2026-02-21T09:25:10.0215213Z [491s] Fitting surrogate: 995 points, 995 targets
2026-02-21T09:25:10.3147989Z [491s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:25:13.1929916Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 6.0 configs/s
2026-02-21T09:25:13.8478856Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 18.1 configs/s
2026-02-21T09:25:15.4934301Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 606.0         
2026-02-21T09:25:15.4934816Z                                                                   configs/s     
2026-02-21T09:25:15.6433515Z [497s] Generation 18 complete: 
2026-02-21T09:25:15.6433948Z ok=13
2026-02-21T09:25:15.6434508Z min=0.0403
2026-02-21T09:25:15.6434778Z mid=0.0404
2026-02-21T09:25:15.6435033Z max=0.0407
2026-02-21T09:25:15.6435310Z best={'block_sizes': [1, 8192],
2026-02-21T09:25:15.6436510Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:25:15.6437130Z  'load_eviction_policies': ['', ''],
2026-02-21T09:25:15.6437516Z  'num_stages': 4,
2026-02-21T09:25:15.6437828Z  'num_warps': 4,
2026-02-21T09:25:15.6438123Z  'pid_type': 'flat',
2026-02-21T09:25:15.6438466Z  'range_flattens': [None, True],
2026-02-21T09:25:15.6438854Z  'range_multi_buffers': [None, True],
2026-02-21T09:25:15.6439263Z  'range_num_stages': [0, 2],
2026-02-21T09:25:15.6439611Z  'range_unroll_factors': [0, 2],
2026-02-21T09:25:15.6439993Z  'range_warp_specializes': []}
2026-02-21T09:25:15.6481172Z [497s] Fitting surrogate: 1008 points, 1008 targets
2026-02-21T09:25:15.8131818Z [497s] Autotuning complete in 497.3s after searching 954 configs.
2026-02-21T09:25:15.8132258Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:25:15.8133676Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=4, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T09:25:15.8135305Z 
2026-02-21T09:25:15.8135726Z [497s] Code of selected kernel: /tmp/torchinductor_root/66/c66manifnm4z5mpasqjlfk7inej4yiihfljaqxpkd5kt6q6b22vr.py
2026-02-21T09:25:16.9480979Z WARNING:tritonbench.utils.triton_op:Completed input ID 46:
2026-02-21T09:25:16.9481559Z (M, N)
2026-02-21T09:25:16.9481842Z ------------
2026-02-21T09:25:16.9482131Z (4096, 6144)
2026-02-21T09:25:16.9482444Z 
2026-02-21T09:25:16.9504668Z  50%|█████     | 10/20 [1:06:46<1:15:44, 454.46s/it]WARNING:tritonbench.utils.triton_op:Running input ID 51:
2026-02-21T09:25:16.9505126Z (M, N)
2026-02-21T09:25:16.9505294Z ------------
2026-02-21T09:25:16.9505499Z (4096, 6784)
2026-02-21T09:25:16.9507606Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T09:25:18.3492069Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T09:25:20.0218150Z INFO:tritonbench.utils.triton_op:Took 3.31ms to get benchmark function for torch_compile_softmax
2026-02-21T09:25:24.6413566Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:25:24.6413961Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:25:24.6414746Z               'dtype': 'torch.float16',
2026-02-21T09:25:24.6415048Z               'shape': (4096, 6784),
2026-02-21T09:25:24.6415317Z               'stride': (6784, 1)},),
2026-02-21T09:25:24.6415573Z   'kwargs': {}}
2026-02-21T09:25:24.6460764Z INFO:tritonbench.utils.triton_op:Took 5.14ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T09:25:24.9415857Z [0s] Autotune random seed: 2135383793
2026-02-21T09:25:25.1236011Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:26:01.5950761Z [36s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T09:26:02.6789382Z [37s] Timeout after 30s compiling Config(block_sizes=[8, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T09:26:04.1569097Z [39s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:26:11.0499519Z [45s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T09:26:15.4860606Z [50s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:26:16.5482033Z [51s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T09:26:17.4665752Z [52s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:26:17.4689502Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T09:26:25.3795517Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.7 configs/s
2026-02-21T09:26:25.3809174Z [60s] Adaptive compile timeout: 30s (90% percentile=21.7s, bounds=[30.0s, 30s])
2026-02-21T09:26:26.7178938Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 734.2 configs/s
2026-02-21T09:26:26.8322014Z [61s] Initial random population of 100, 5 starting points: 
2026-02-21T09:26:26.8322366Z error=2
2026-02-21T09:26:26.8322658Z timeout=7
2026-02-21T09:26:26.8322854Z ok=91
2026-02-21T09:26:26.8323044Z min=0.0671
2026-02-21T09:26:26.8323234Z mid=0.5361
2026-02-21T09:26:26.8323427Z max=137.4863
2026-02-21T09:26:26.8323646Z best={'block_sizes': [1, 256],
2026-02-21T09:26:26.8324262Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:26:26.8324973Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:26:26.8325495Z  'num_stages': 2,
2026-02-21T09:26:26.8325884Z  'num_warps': 1,
2026-02-21T09:26:26.8326272Z  'pid_type': 'flat',
2026-02-21T09:26:26.8326696Z  'range_flattens': [None, True],
2026-02-21T09:26:26.8327185Z  'range_multi_buffers': [None, None],
2026-02-21T09:26:26.8327683Z  'range_num_stages': [0, 3],
2026-02-21T09:26:26.8328079Z  'range_unroll_factors': [0, 2],
2026-02-21T09:26:26.8328470Z  'range_warp_specializes': []}
2026-02-21T09:26:26.8341109Z [61s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:26:28.1949356Z [63s] Generation 1 starting: 87 neighbors, 5 active search path(s)
2026-02-21T09:27:05.8119204Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 1.0 configs/s
2026-02-21T09:27:13.3086705Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 11.9 configs/s
2026-02-21T09:27:23.9517297Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 105.2         
2026-02-21T09:27:23.9517837Z                                                                   configs/s     
2026-02-21T09:27:24.5878577Z [119s] Generation 1 complete: 
2026-02-21T09:27:24.5878896Z ok=92
2026-02-21T09:27:24.5879079Z min=0.0577
2026-02-21T09:27:24.5879266Z mid=0.0755
2026-02-21T09:27:24.5880041Z max=0.5041
2026-02-21T09:27:24.5880269Z best={'block_sizes': [2, 1024],
2026-02-21T09:27:24.5880627Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:27:24.5881074Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:27:24.5881358Z  'num_stages': 1,
2026-02-21T09:27:24.5881551Z  'num_warps': 8,
2026-02-21T09:27:24.5881751Z  'pid_type': 'flat',
2026-02-21T09:27:24.5881968Z  'range_flattens': [None, False],
2026-02-21T09:27:24.5882249Z  'range_multi_buffers': [None, False],
2026-02-21T09:27:24.5882517Z  'range_num_stages': [0, 0],
2026-02-21T09:27:24.5882762Z  'range_unroll_factors': [0, 1],
2026-02-21T09:27:24.5883022Z  'range_warp_specializes': []}
2026-02-21T09:27:24.5899572Z [119s] Fitting surrogate: 192 points, 192 targets
2026-02-21T09:27:25.9080666Z [120s] Generation 2 starting: 75 neighbors, 5 active search path(s)
2026-02-21T09:27:52.2810453Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 3.4 configs/s
2026-02-21T09:27:59.3322048Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 11.1 configs/s
2026-02-21T09:28:10.1216614Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.6 configs/s
2026-02-21T09:28:10.8319576Z [165s] Generation 2 complete: 
2026-02-21T09:28:10.8320033Z ok=80
2026-02-21T09:28:10.8320304Z min=0.0525
2026-02-21T09:28:10.8320573Z mid=0.0638
2026-02-21T09:28:10.8320831Z max=0.1410
2026-02-21T09:28:10.8321110Z best={'block_sizes': [2, 4096],
2026-02-21T09:28:10.8321650Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:28:10.8322255Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:28:10.8322699Z  'num_stages': 1,
2026-02-21T09:28:10.8322993Z  'num_warps': 8,
2026-02-21T09:28:10.8323295Z  'pid_type': 'flat',
2026-02-21T09:28:10.8323622Z  'range_flattens': [None, False],
2026-02-21T09:28:10.8324504Z  'range_multi_buffers': [None, False],
2026-02-21T09:28:10.8324923Z  'range_num_stages': [0, 1],
2026-02-21T09:28:10.8325319Z  'range_unroll_factors': [0, 1],
2026-02-21T09:28:10.8325744Z  'range_warp_specializes': []}
2026-02-21T09:28:10.8354594Z [165s] Fitting surrogate: 272 points, 272 targets
2026-02-21T09:28:11.9393269Z [166s] Generation 3 starting: 70 neighbors, 5 active search path(s)
2026-02-21T09:28:39.9945986Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74/74 1.3 configs/s
2026-02-21T09:28:48.4132269Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 74/74 8.8 configs/s
2026-02-21T09:28:56.3959592Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 147.1         
2026-02-21T09:28:56.3960121Z                                                                   configs/s     
2026-02-21T09:28:56.8851210Z [211s] Generation 3 complete: 
2026-02-21T09:28:56.8851480Z ok=75
2026-02-21T09:28:56.8851654Z min=0.0417
2026-02-21T09:28:56.8851833Z mid=0.0605
2026-02-21T09:28:56.8852010Z max=3.1950
2026-02-21T09:28:56.8852194Z best={'block_sizes': [1, 8192],
2026-02-21T09:28:56.9497058Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:28:56.9497551Z  'load_eviction_policies': ['', ''],
2026-02-21T09:28:56.9497789Z  'num_stages': 2,
2026-02-21T09:28:56.9497956Z  'num_warps': 4,
2026-02-21T09:28:56.9498156Z  'pid_type': 'flat',
2026-02-21T09:28:56.9498344Z  'range_flattens': [None, True],
2026-02-21T09:28:56.9498562Z  'range_multi_buffers': [None, False],
2026-02-21T09:28:56.9498788Z  'range_num_stages': [0, 3],
2026-02-21T09:28:56.9499011Z  'range_unroll_factors': [0, 1],
2026-02-21T09:28:56.9499226Z  'range_warp_specializes': []}
2026-02-21T09:28:56.9499460Z [211s] Fitting surrogate: 347 points, 347 targets
2026-02-21T09:28:57.8943618Z [212s] Generation 4 starting: 63 neighbors, 5 active search path(s)
2026-02-21T09:29:17.5081918Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 3.7 configs/s
2026-02-21T09:29:22.0431620Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 14.4 configs/s
2026-02-21T09:29:30.7236084Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.5         
2026-02-21T09:29:30.7237721Z                                                                   configs/s     
2026-02-21T09:29:31.3669786Z [246s] Generation 4 complete: 
2026-02-21T09:29:31.3670114Z ok=69
2026-02-21T09:29:31.3670294Z min=0.0417
2026-02-21T09:29:31.3670470Z mid=0.0503
2026-02-21T09:29:31.3670632Z max=0.9067
2026-02-21T09:29:31.3670813Z best={'block_sizes': [1, 8192],
2026-02-21T09:29:31.3671182Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:29:31.3671593Z  'load_eviction_policies': ['', ''],
2026-02-21T09:29:31.3671858Z  'num_stages': 2,
2026-02-21T09:29:31.3672054Z  'num_warps': 4,
2026-02-21T09:29:31.3672243Z  'pid_type': 'flat',
2026-02-21T09:29:31.3672460Z  'range_flattens': [None, True],
2026-02-21T09:29:31.3672714Z  'range_multi_buffers': [None, False],
2026-02-21T09:29:31.3672989Z  'range_num_stages': [0, 3],
2026-02-21T09:29:31.3673223Z  'range_unroll_factors': [0, 1],
2026-02-21T09:29:31.3673479Z  'range_warp_specializes': []}
2026-02-21T09:29:31.3709519Z [246s] Fitting surrogate: 416 points, 416 targets
2026-02-21T09:29:32.3116312Z [247s] Generation 5 starting: 59 neighbors, 5 active search path(s)
2026-02-21T09:29:51.7275463Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 2.0 configs/s
2026-02-21T09:29:55.8933149Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 15.0 configs/s
2026-02-21T09:30:03.8315595Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 127.3         
2026-02-21T09:30:03.8316129Z                                                                   configs/s     
2026-02-21T09:30:04.4208162Z [279s] Generation 5 complete: 
2026-02-21T09:30:04.4208573Z ok=65
2026-02-21T09:30:04.4208835Z min=0.0417
2026-02-21T09:30:04.4209116Z mid=0.0447
2026-02-21T09:30:04.4209365Z max=1.0501
2026-02-21T09:30:04.4209657Z best={'block_sizes': [1, 8192],
2026-02-21T09:30:04.4210353Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:30:04.4211023Z  'load_eviction_policies': ['', ''],
2026-02-21T09:30:04.4211416Z  'num_stages': 2,
2026-02-21T09:30:04.4211699Z  'num_warps': 4,
2026-02-21T09:30:04.4212002Z  'pid_type': 'flat',
2026-02-21T09:30:04.4212969Z  'range_flattens': [None, None],
2026-02-21T09:30:04.4213378Z  'range_multi_buffers': [None, False],
2026-02-21T09:30:04.4213782Z  'range_num_stages': [0, 2],
2026-02-21T09:30:04.4214597Z  'range_unroll_factors': [0, 0],
2026-02-21T09:30:04.4214983Z  'range_warp_specializes': []}
2026-02-21T09:30:04.4246563Z [279s] Fitting surrogate: 481 points, 481 targets
2026-02-21T09:30:05.2528210Z [280s] Generation 6 starting: 46 neighbors, 4 active search path(s)
2026-02-21T09:30:18.8143410Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 4.4 configs/s
2026-02-21T09:30:22.0405403Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 14.4 configs/s
2026-02-21T09:30:29.7226933Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 153.1         
2026-02-21T09:30:29.7228011Z                                                                   configs/s     
2026-02-21T09:30:30.2321727Z [305s] Generation 6 complete: 
2026-02-21T09:30:30.2322030Z ok=51
2026-02-21T09:30:30.2322210Z min=0.0448
2026-02-21T09:30:30.2322384Z mid=0.0457
2026-02-21T09:30:30.2322555Z max=0.3017
2026-02-21T09:30:30.2322737Z best={'block_sizes': [1, 8192],
2026-02-21T09:30:30.2323147Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:30:30.2323599Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:30:30.2323891Z  'num_stages': 5,
2026-02-21T09:30:30.2324469Z  'num_warps': 16,
2026-02-21T09:30:30.2324674Z  'pid_type': 'flat',
2026-02-21T09:30:30.2324924Z  'range_flattens': [None, None],
2026-02-21T09:30:30.2325200Z  'range_multi_buffers': [None, False],
2026-02-21T09:30:30.2325485Z  'range_num_stages': [0, 3],
2026-02-21T09:30:30.2325727Z  'range_unroll_factors': [0, 1],
2026-02-21T09:30:30.2325995Z  'range_warp_specializes': []}
2026-02-21T09:30:30.2358660Z [305s] Fitting surrogate: 532 points, 532 targets
2026-02-21T09:30:30.9029141Z [305s] Generation 7 starting: 31 neighbors, 3 active search path(s)
2026-02-21T09:30:40.7947907Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 2.1 configs/s
2026-02-21T09:30:42.9067199Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 34/34 16.4 configs/s
2026-02-21T09:30:47.2498601Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 231.9         
2026-02-21T09:30:47.2499129Z                                                                   configs/s     
2026-02-21T09:30:47.5831397Z [322s] Generation 7 complete: 
2026-02-21T09:30:47.5831715Z ok=35
2026-02-21T09:30:47.5831888Z min=0.0412
2026-02-21T09:30:47.5832077Z mid=0.0438
2026-02-21T09:30:47.5832319Z max=0.0944
2026-02-21T09:30:47.5832524Z best={'block_sizes': [1, 8192],
2026-02-21T09:30:47.5832810Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:30:47.5833151Z  'load_eviction_policies': ['', ''],
2026-02-21T09:30:47.5833414Z  'num_stages': 6,
2026-02-21T09:30:47.5833607Z  'num_warps': 4,
2026-02-21T09:30:47.5833815Z  'pid_type': 'flat',
2026-02-21T09:30:47.5834463Z  'range_flattens': [None, None],
2026-02-21T09:30:47.5834763Z  'range_multi_buffers': [None, False],
2026-02-21T09:30:47.5835028Z  'range_num_stages': [0, 2],
2026-02-21T09:30:47.5835279Z  'range_unroll_factors': [0, 4],
2026-02-21T09:30:47.5835526Z  'range_warp_specializes': []}
2026-02-21T09:30:47.5862161Z [322s] Fitting surrogate: 567 points, 567 targets
2026-02-21T09:30:48.1486880Z [323s] Generation 8 starting: 28 neighbors, 3 active search path(s)
2026-02-21T09:30:57.1343091Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 6.0 configs/s
2026-02-21T09:30:59.2230233Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 29/29 14.1 configs/s
2026-02-21T09:31:03.1907710Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 254.0         
2026-02-21T09:31:03.1908316Z                                                                   configs/s     
2026-02-21T09:31:03.5016355Z [338s] Generation 8 complete: 
2026-02-21T09:31:03.5016681Z ok=31
2026-02-21T09:31:03.5016885Z min=0.0411
2026-02-21T09:31:03.5017682Z mid=0.0426
2026-02-21T09:31:03.5017858Z max=0.0995
2026-02-21T09:31:03.5018035Z best={'block_sizes': [1, 8192],
2026-02-21T09:31:03.5018322Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:31:03.5018625Z  'load_eviction_policies': ['', ''],
2026-02-21T09:31:03.5018877Z  'num_stages': 6,
2026-02-21T09:31:03.5019062Z  'num_warps': 4,
2026-02-21T09:31:03.5019254Z  'pid_type': 'flat',
2026-02-21T09:31:03.5019463Z  'range_flattens': [None, None],
2026-02-21T09:31:03.5019718Z  'range_multi_buffers': [None, False],
2026-02-21T09:31:03.5019978Z  'range_num_stages': [0, 3],
2026-02-21T09:31:03.5020213Z  'range_unroll_factors': [0, 4],
2026-02-21T09:31:03.5020458Z  'range_warp_specializes': []}
2026-02-21T09:31:03.5057110Z [338s] Fitting surrogate: 598 points, 598 targets
2026-02-21T09:31:04.0889050Z [338s] Generation 9 starting: 29 neighbors, 3 active search path(s)
2026-02-21T09:31:13.7423037Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 1.5 configs/s
2026-02-21T09:31:15.9756900Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 29/29 13.1 configs/s
2026-02-21T09:31:20.1491359Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 241.3         
2026-02-21T09:31:20.1491891Z                                                                   configs/s     
2026-02-21T09:31:20.4745665Z [355s] Generation 9 complete: 
2026-02-21T09:31:20.4745934Z ok=32
2026-02-21T09:31:20.4746102Z min=0.0446
2026-02-21T09:31:20.4746280Z mid=0.0451
2026-02-21T09:31:20.4746447Z max=0.0619
2026-02-21T09:31:20.4746630Z best={'block_sizes': [1, 8192],
2026-02-21T09:31:20.4746937Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:31:20.4747245Z  'load_eviction_policies': ['', ''],
2026-02-21T09:31:20.4747498Z  'num_stages': 6,
2026-02-21T09:31:20.4747681Z  'num_warps': 4,
2026-02-21T09:31:20.4747905Z  'pid_type': 'flat',
2026-02-21T09:31:20.4748120Z  'range_flattens': [None, None],
2026-02-21T09:31:20.4748376Z  'range_multi_buffers': [None, False],
2026-02-21T09:31:20.4748657Z  'range_num_stages': [0, 3],
2026-02-21T09:31:20.4748895Z  'range_unroll_factors': [0, 4],
2026-02-21T09:31:20.4749138Z  'range_warp_specializes': []}
2026-02-21T09:31:20.4782034Z [355s] Fitting surrogate: 630 points, 630 targets
2026-02-21T09:31:20.8648841Z [355s] Generation 10 starting: 15 neighbors, 2 active search path(s)
2026-02-21T09:31:27.1170205Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 3.5 configs/s
2026-02-21T09:31:28.1961404Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 14.3 configs/s
2026-02-21T09:31:30.2183264Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 493.9         
2026-02-21T09:31:30.2183757Z                                                                   configs/s     
2026-02-21T09:31:30.3890649Z [365s] Generation 10 complete: 
2026-02-21T09:31:30.3890929Z ok=17
2026-02-21T09:31:30.3891110Z min=0.0448
2026-02-21T09:31:30.3891284Z mid=0.0462
2026-02-21T09:31:30.3891459Z max=0.0633
2026-02-21T09:31:30.3892112Z best={'block_sizes': [1, 8192],
2026-02-21T09:31:30.3892446Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T09:31:30.3892790Z  'load_eviction_policies': ['', ''],
2026-02-21T09:31:30.3893050Z  'num_stages': 6,
2026-02-21T09:31:30.3893242Z  'num_warps': 4,
2026-02-21T09:31:30.3893452Z  'pid_type': 'flat',
2026-02-21T09:31:30.3893666Z  'range_flattens': [None, None],
2026-02-21T09:31:30.3893934Z  'range_multi_buffers': [None, False],
2026-02-21T09:31:30.3894552Z  'range_num_stages': [0, 3],
2026-02-21T09:31:30.3894788Z  'range_unroll_factors': [0, 4],
2026-02-21T09:31:30.3895041Z  'range_warp_specializes': []}
2026-02-21T09:31:30.3924147Z [365s] Fitting surrogate: 647 points, 647 targets
2026-02-21T09:31:30.7172882Z [365s] Generation 11 starting: 13 neighbors, 1 active search path(s)
2026-02-21T09:31:36.5330333Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 4.4 configs/s
2026-02-21T09:31:37.3900171Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 17.2 configs/s
2026-02-21T09:31:39.1344608Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 571.4         
2026-02-21T09:31:39.1345115Z                                                                   configs/s     
2026-02-21T09:31:39.2871826Z [374s] Generation 11 complete: 
2026-02-21T09:31:39.2872110Z ok=15
2026-02-21T09:31:39.2872293Z min=0.0415
2026-02-21T09:31:39.2872575Z mid=0.0498
2026-02-21T09:31:39.2872876Z max=0.0898
2026-02-21T09:31:39.2873201Z best={'block_sizes': [1, 8192],
2026-02-21T09:31:39.2873737Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T09:31:39.2874727Z  'load_eviction_policies': ['', ''],
2026-02-21T09:31:39.2875150Z  'num_stages': 6,
2026-02-21T09:31:39.2875446Z  'num_warps': 4,
2026-02-21T09:31:39.2875743Z  'pid_type': 'flat',
2026-02-21T09:31:39.2890656Z  'range_flattens': [None, None],
2026-02-21T09:31:39.2890920Z  'range_multi_buffers': [None, False],
2026-02-21T09:31:39.2891230Z  'range_num_stages': [0, 2],
2026-02-21T09:31:39.2891508Z  'range_unroll_factors': [0, 4],
2026-02-21T09:31:39.2891740Z  'range_warp_specializes': []}
2026-02-21T09:31:39.2905999Z [374s] Fitting surrogate: 662 points, 662 targets
2026-02-21T09:31:39.5909528Z [374s] Generation 12 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:31:43.8330549Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.9 configs/s
2026-02-21T09:31:44.4835173Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 18.3 configs/s
2026-02-21T09:31:46.0693638Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 628.1         
2026-02-21T09:31:46.0694476Z                                                                   configs/s     
2026-02-21T09:31:46.2122327Z [381s] Generation 12 complete: 
2026-02-21T09:31:46.2122754Z ok=12
2026-02-21T09:31:46.2123058Z min=0.0445
2026-02-21T09:31:46.2123327Z mid=0.0448
2026-02-21T09:31:46.2123575Z max=0.0590
2026-02-21T09:31:46.2123855Z best={'block_sizes': [1, 8192],
2026-02-21T09:31:46.2124826Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T09:31:46.2125369Z  'load_eviction_policies': ['', ''],
2026-02-21T09:31:46.2125775Z  'num_stages': 6,
2026-02-21T09:31:46.2126079Z  'num_warps': 16,
2026-02-21T09:31:46.2126397Z  'pid_type': 'flat',
2026-02-21T09:31:46.2126740Z  'range_flattens': [None, None],
2026-02-21T09:31:46.2127159Z  'range_multi_buffers': [None, None],
2026-02-21T09:31:46.2127609Z  'range_num_stages': [0, 2],
2026-02-21T09:31:46.2127906Z  'range_unroll_factors': [0, 4],
2026-02-21T09:31:46.2128134Z  'range_warp_specializes': []}
2026-02-21T09:31:46.2162248Z [381s] Fitting surrogate: 674 points, 674 targets
2026-02-21T09:31:46.5163633Z [381s] Generation 13 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:31:52.0371143Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.1 configs/s
2026-02-21T09:31:52.7123804Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.5 configs/s
2026-02-21T09:31:53.9221773Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 817.5         
2026-02-21T09:31:53.9432051Z                                                                   configs/s     
2026-02-21T09:31:54.0379960Z [388s] Generation 13 complete: 
2026-02-21T09:31:54.0380369Z ok=12
2026-02-21T09:31:54.0380657Z min=0.0411
2026-02-21T09:31:54.0380931Z mid=0.0584
2026-02-21T09:31:54.0381191Z max=0.1816
2026-02-21T09:31:54.0381466Z best={'block_sizes': [1, 8192],
2026-02-21T09:31:54.0381920Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:31:54.0382414Z  'load_eviction_policies': ['', ''],
2026-02-21T09:31:54.0382891Z  'num_stages': 6,
2026-02-21T09:31:54.0383218Z  'num_warps': 4,
2026-02-21T09:31:54.0383428Z  'pid_type': 'flat',
2026-02-21T09:31:54.0383637Z  'range_flattens': [None, None],
2026-02-21T09:31:54.0384546Z  'range_multi_buffers': [None, None],
2026-02-21T09:31:54.0384834Z  'range_num_stages': [0, 2],
2026-02-21T09:31:54.0385081Z  'range_unroll_factors': [0, 4],
2026-02-21T09:31:54.0385340Z  'range_warp_specializes': []}
2026-02-21T09:31:54.0414494Z [388s] Fitting surrogate: 686 points, 686 targets
2026-02-21T09:31:54.3443797Z [389s] Generation 14 starting: 11 neighbors, 1 active search path(s)
2026-02-21T09:32:00.6566253Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.4 configs/s
2026-02-21T09:32:01.5578720Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 12.5 configs/s
2026-02-21T09:32:03.0235860Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 678.0         
2026-02-21T09:32:03.0236331Z                                                                   configs/s     
2026-02-21T09:32:03.1594859Z [398s] Generation 14 complete: 
2026-02-21T09:32:03.1595174Z ok=12
2026-02-21T09:32:03.1595361Z min=0.0446
2026-02-21T09:32:03.1595558Z mid=0.0453
2026-02-21T09:32:03.1595766Z max=0.0639
2026-02-21T09:32:03.1595970Z best={'block_sizes': [1, 8192],
2026-02-21T09:32:03.1596271Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:32:03.1596613Z  'load_eviction_policies': ['', ''],
2026-02-21T09:32:03.1596912Z  'num_stages': 6,
2026-02-21T09:32:03.1597129Z  'num_warps': 16,
2026-02-21T09:32:03.1597331Z  'pid_type': 'flat',
2026-02-21T09:32:03.1597558Z  'range_flattens': [None, None],
2026-02-21T09:32:03.1597824Z  'range_multi_buffers': [None, None],
2026-02-21T09:32:03.1598105Z  'range_num_stages': [0, 1],
2026-02-21T09:32:03.1598347Z  'range_unroll_factors': [0, 4],
2026-02-21T09:32:03.1598601Z  'range_warp_specializes': []}
2026-02-21T09:32:03.1632004Z [398s] Fitting surrogate: 698 points, 698 targets
2026-02-21T09:32:03.4537164Z [398s] Generation 15 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:32:09.3393776Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.3 configs/s
2026-02-21T09:32:10.4296835Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 10.1 configs/s
2026-02-21T09:32:11.6302558Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 823.5         
2026-02-21T09:32:11.6303666Z                                                                   configs/s     
2026-02-21T09:32:11.7451672Z [406s] Generation 15 complete: 
2026-02-21T09:32:11.7451929Z ok=12
2026-02-21T09:32:11.7452090Z min=0.0446
2026-02-21T09:32:11.7452267Z mid=0.0453
2026-02-21T09:32:11.7452421Z max=0.1868
2026-02-21T09:32:11.7452598Z best={'block_sizes': [1, 8192],
2026-02-21T09:32:11.7452865Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:32:11.7453169Z  'load_eviction_policies': ['', ''],
2026-02-21T09:32:11.7453408Z  'num_stages': 6,
2026-02-21T09:32:11.7453598Z  'num_warps': 16,
2026-02-21T09:32:11.7453781Z  'pid_type': 'flat',
2026-02-21T09:32:11.7454355Z  'range_flattens': [None, None],
2026-02-21T09:32:11.7454607Z  'range_multi_buffers': [None, None],
2026-02-21T09:32:11.7454861Z  'range_num_stages': [0, 1],
2026-02-21T09:32:11.7455125Z  'range_unroll_factors': [0, 4],
2026-02-21T09:32:11.7455375Z  'range_warp_specializes': []}
2026-02-21T09:32:11.7487436Z [406s] Fitting surrogate: 710 points, 710 targets
2026-02-21T09:32:11.9587619Z [406s] Autotuning complete in 406.8s after searching 672 configs.
2026-02-21T09:32:11.9588181Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:32:11.9590039Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', ''], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 4], range_warp_specializes=[]), static_shapes=True)
2026-02-21T09:32:11.9591746Z 
2026-02-21T09:32:11.9592309Z [406s] Code of selected kernel: /tmp/torchinductor_root/xu/cxuennnerwna5i74n4uu3ylc6lyhh5w22g2ii27hdldem4sclbkl.py
2026-02-21T09:32:13.0696809Z WARNING:tritonbench.utils.triton_op:Completed input ID 51:
2026-02-21T09:32:13.0697755Z (M, N)
2026-02-21T09:32:13.0697935Z ------------
2026-02-21T09:32:13.0698116Z (4096, 6784)
2026-02-21T09:32:13.0698226Z 
2026-02-21T09:32:13.0720010Z  55%|█████▌    | 11/20 [1:13:42<1:06:24, 442.73s/it]WARNING:tritonbench.utils.triton_op:Running input ID 56:
2026-02-21T09:32:13.0720519Z (M, N)
2026-02-21T09:32:13.0720675Z ------------
2026-02-21T09:32:13.0720843Z (4096, 7424)
2026-02-21T09:32:13.0723060Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T09:32:14.4550710Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T09:32:16.1121782Z INFO:tritonbench.utils.triton_op:Took 3.48ms to get benchmark function for torch_compile_softmax
2026-02-21T09:32:24.9478524Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:32:24.9478892Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:32:24.9479187Z               'dtype': 'torch.float16',
2026-02-21T09:32:24.9479512Z               'shape': (4096, 7424),
2026-02-21T09:32:24.9522327Z               'stride': (7424, 1)},),
2026-02-21T09:32:24.9522618Z   'kwargs': {}}
2026-02-21T09:32:24.9523067Z INFO:tritonbench.utils.triton_op:Took 4.78ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T09:32:25.2395796Z [0s] Autotune random seed: 2135383793
2026-02-21T09:32:28.9405308Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:33:07.8706314Z [39s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T09:33:09.0118831Z [40s] Timeout after 30s compiling Config(block_sizes=[8, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T09:33:10.6119692Z [41s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:33:18.1659806Z [49s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T09:33:22.8362371Z [54s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:33:24.1679855Z [55s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T09:33:24.9419866Z [56s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:33:24.9441623Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T09:33:33.1257728Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.3 configs/s
2026-02-21T09:33:33.1278523Z [64s] Adaptive compile timeout: 30s (90% percentile=23.2s, bounds=[30.0s, 30s])
2026-02-21T09:33:34.3191969Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 820.9 configs/s
2026-02-21T09:33:34.4267387Z [65s] Initial random population of 100, 5 starting points: 
2026-02-21T09:33:34.4267750Z error=2
2026-02-21T09:33:34.4267943Z timeout=7
2026-02-21T09:33:34.4268118Z ok=91
2026-02-21T09:33:34.4268280Z min=0.0727
2026-02-21T09:33:34.4268455Z mid=0.5908
2026-02-21T09:33:34.4268641Z max=151.7453
2026-02-21T09:33:34.4268838Z best={'block_sizes': [1, 256],
2026-02-21T09:33:34.4269222Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:33:34.4269665Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:33:34.4269923Z  'num_stages': 2,
2026-02-21T09:33:34.4270116Z  'num_warps': 1,
2026-02-21T09:33:34.4270303Z  'pid_type': 'flat',
2026-02-21T09:33:34.4270523Z  'range_flattens': [None, True],
2026-02-21T09:33:34.4270785Z  'range_multi_buffers': [None, None],
2026-02-21T09:33:34.4271053Z  'range_num_stages': [0, 3],
2026-02-21T09:33:34.4271288Z  'range_unroll_factors': [0, 2],
2026-02-21T09:33:34.4271532Z  'range_warp_specializes': []}
2026-02-21T09:33:34.4293084Z [65s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:33:35.8595836Z [67s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T09:34:24.2693258Z [115s] Timeout after 30s compiling Config(block_sizes=[32, 1024], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], num_stages=6, num_warps=2, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:34:24.2712869Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 0.4 configs/s
2026-02-21T09:34:31.9263834Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 12.2 configs/s
2026-02-21T09:34:42.6893928Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.7 configs/s
2026-02-21T09:34:43.3488508Z [134s] Generation 1 complete: 
2026-02-21T09:34:43.3488822Z timeout=1
2026-02-21T09:34:43.3489034Z ok=93
2026-02-21T09:34:43.3489251Z min=0.0651
2026-02-21T09:34:43.3489463Z mid=0.0848
2026-02-21T09:34:43.3489674Z max=0.3850
2026-02-21T09:34:43.3489905Z best={'block_sizes': [1, 1024],
2026-02-21T09:34:43.3490444Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:34:43.3491099Z  'load_eviction_policies': ['', ''],
2026-02-21T09:34:43.3491698Z  'num_stages': 2,
2026-02-21T09:34:43.3492091Z  'num_warps': 1,
2026-02-21T09:34:43.3492495Z  'pid_type': 'flat',
2026-02-21T09:34:43.3493541Z  'range_flattens': [None, True],
2026-02-21T09:34:43.3494533Z  'range_multi_buffers': [None, None],
2026-02-21T09:34:43.3495104Z  'range_num_stages': [0, 3],
2026-02-21T09:34:43.3495613Z  'range_unroll_factors': [0, 2],
2026-02-21T09:34:43.3496162Z  'range_warp_specializes': []}
2026-02-21T09:34:43.3513953Z [134s] Fitting surrogate: 194 points, 194 targets
2026-02-21T09:34:44.6553232Z [135s] Generation 2 starting: 74 neighbors, 5 active search path(s)
2026-02-21T09:35:31.2764767Z [182s] Timeout after 30s compiling Config(block_sizes=[1, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:35:32.7582000Z [184s] Timeout after 39s compiling Config(block_sizes=[1, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T09:35:33.1987669Z [184s] Timeout after 40s compiling Config(block_sizes=[1, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', ''], num_stages=2, num_warps=2, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T09:35:33.3083438Z [184s] Timeout after 40s compiling Config(block_sizes=[1, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T09:35:33.6421762Z [184s] Timeout after 40s compiling Config(block_sizes=[1, 1024], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T09:35:34.1205693Z [185s] Timeout after 40s compiling Config(block_sizes=[1, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=1, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T09:35:34.7464148Z [186s] Timeout after 39s compiling Config(block_sizes=[1, 4096], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=2, num_warps=1, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T09:35:35.0287107Z [186s] Timeout after 39s compiling Config(block_sizes=[1, 4096], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'first'], num_stages=1, num_warps=1, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T09:35:35.0575208Z [186s] Timeout after 38s compiling Config(block_sizes=[1, 4096], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'first'], num_stages=1, num_warps=1, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T09:35:35.1698400Z [186s] Timeout after 37s compiling Config(block_sizes=[1, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'last'], num_stages=5, num_warps=1, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T09:35:35.4500347Z [186s] Timeout after 36s compiling Config(block_sizes=[1, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'last'], maxnreg=256, num_sm_multiplier=16, num_stages=4, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[False, False], range_num_stages=[1, 2], range_unroll_factors=[2, 1], range_warp_specializes=[])
2026-02-21T09:35:35.7235201Z [187s] Timeout after 34s compiling Config(block_sizes=[2, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=5, num_warps=1, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T09:35:36.0122571Z [187s] Timeout after 34s compiling Config(block_sizes=[1, 8192], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'last'], maxnreg=256, num_sm_multiplier=16, num_stages=4, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[False, False], range_num_stages=[1, 0], range_unroll_factors=[2, 1], range_warp_specializes=[])
2026-02-21T09:35:36.3951966Z [187s] Timeout after 32s compiling Config(block_sizes=[2, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=6, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:35:36.7379862Z [188s] Timeout after 31s compiling Config(block_sizes=[2, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=5, num_warps=1, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:35:36.9850687Z [188s] Timeout after 30s compiling Config(block_sizes=[8, 512], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], num_sm_multiplier=128, num_stages=8, num_warps=4, pid_type='persistent_interleaved', range_flattens=[None, False], range_multi_buffers=[False, None], range_num_stages=[4, 2], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:35:37.0016420Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77/77 2.7 configs/s
2026-02-21T09:35:40.7627746Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 77/77 20.0 configs/s
2026-02-21T09:35:51.1060005Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 109.7         
2026-02-21T09:35:51.1060502Z                                                                   configs/s     
2026-02-21T09:35:51.7059544Z [202s] Generation 2 complete: 
2026-02-21T09:35:51.7059854Z timeout=16
2026-02-21T09:35:51.7060032Z ok=64
2026-02-21T09:35:51.7060200Z min=0.0512
2026-02-21T09:35:51.7060368Z mid=0.0679
2026-02-21T09:35:51.7060539Z max=0.0909
2026-02-21T09:35:51.7060718Z best={'block_sizes': [1, 4096],
2026-02-21T09:35:51.7061067Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:35:51.7061463Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:35:51.7061744Z  'num_stages': 1,
2026-02-21T09:35:51.7061934Z  'num_warps': 4,
2026-02-21T09:35:51.7062133Z  'pid_type': 'flat',
2026-02-21T09:35:51.7062359Z  'range_flattens': [None, False],
2026-02-21T09:35:51.7062619Z  'range_multi_buffers': [None, False],
2026-02-21T09:35:51.7063312Z  'range_num_stages': [0, 0],
2026-02-21T09:35:51.7063568Z  'range_unroll_factors': [0, 1],
2026-02-21T09:35:51.7063829Z  'range_warp_specializes': []}
2026-02-21T09:35:51.7083164Z [202s] Fitting surrogate: 274 points, 274 targets
2026-02-21T09:35:52.8108198Z [204s] Generation 3 starting: 68 neighbors, 5 active search path(s)
2026-02-21T09:36:14.9379028Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 5.5 configs/s
2026-02-21T09:36:20.2111820Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 13.0 configs/s
2026-02-21T09:36:29.7049898Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.4         
2026-02-21T09:36:29.7050806Z                                                                   configs/s     
2026-02-21T09:36:30.3410851Z [241s] Generation 3 complete: 
2026-02-21T09:36:30.3411140Z ok=73
2026-02-21T09:36:30.3411328Z min=0.0493
2026-02-21T09:36:30.3411509Z mid=0.0648
2026-02-21T09:36:30.3411691Z max=0.1022
2026-02-21T09:36:30.3411880Z best={'block_sizes': [1, 8192],
2026-02-21T09:36:30.3412271Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:36:30.3412679Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:36:30.3412991Z  'num_stages': 1,
2026-02-21T09:36:30.3413194Z  'num_warps': 4,
2026-02-21T09:36:30.3413389Z  'pid_type': 'flat',
2026-02-21T09:36:30.3413610Z  'range_flattens': [None, True],
2026-02-21T09:36:30.3413867Z  'range_multi_buffers': [None, False],
2026-02-21T09:36:30.3414518Z  'range_num_stages': [0, 0],
2026-02-21T09:36:30.3414764Z  'range_unroll_factors': [0, 1],
2026-02-21T09:36:30.3415023Z  'range_warp_specializes': []}
2026-02-21T09:36:30.3447076Z [241s] Fitting surrogate: 347 points, 347 targets
2026-02-21T09:36:31.4481917Z [242s] Generation 4 starting: 64 neighbors, 5 active search path(s)
2026-02-21T09:36:56.5981314Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 3.3 configs/s
2026-02-21T09:37:00.6667092Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.4 configs/s
2026-02-21T09:37:09.6767426Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 112.1         
2026-02-21T09:37:09.6768074Z                                                                   configs/s     
2026-02-21T09:37:10.2953193Z [281s] Generation 4 complete: 
2026-02-21T09:37:10.2953525Z ok=69
2026-02-21T09:37:10.2953714Z min=0.0448
2026-02-21T09:37:10.2953896Z mid=0.0593
2026-02-21T09:37:10.2954825Z max=0.2934
2026-02-21T09:37:10.2955035Z best={'block_sizes': [1, 8192],
2026-02-21T09:37:10.2955372Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:37:10.2955750Z  'load_eviction_policies': ['', ''],
2026-02-21T09:37:10.2956015Z  'num_stages': 6,
2026-02-21T09:37:10.2956227Z  'num_warps': 4,
2026-02-21T09:37:10.2956424Z  'pid_type': 'flat',
2026-02-21T09:37:10.2956652Z  'range_flattens': [None, True],
2026-02-21T09:37:10.2956904Z  'range_multi_buffers': [None, None],
2026-02-21T09:37:10.2957178Z  'range_num_stages': [0, 2],
2026-02-21T09:37:10.2957445Z  'range_unroll_factors': [0, 2],
2026-02-21T09:37:10.2957703Z  'range_warp_specializes': []}
2026-02-21T09:37:10.2992110Z [281s] Fitting surrogate: 416 points, 416 targets
2026-02-21T09:37:11.2709603Z [282s] Generation 5 starting: 61 neighbors, 5 active search path(s)
2026-02-21T09:37:45.4922788Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 0.4 configs/s
2026-02-21T09:37:49.4238822Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 15.9 configs/s
2026-02-21T09:37:58.1931189Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 133.1         
2026-02-21T09:37:58.1931727Z                                                                   configs/s     
2026-02-21T09:37:58.7372448Z [330s] Generation 5 complete: 
2026-02-21T09:37:58.7372780Z ok=66
2026-02-21T09:37:58.7372971Z min=0.0449
2026-02-21T09:37:58.7373148Z mid=0.0541
2026-02-21T09:37:58.7373334Z max=0.3832
2026-02-21T09:37:58.7373523Z best={'block_sizes': [1, 8192],
2026-02-21T09:37:58.8465128Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:37:58.8465741Z  'load_eviction_policies': ['', ''],
2026-02-21T09:37:58.8466021Z  'num_stages': 2,
2026-02-21T09:37:58.8466214Z  'num_warps': 4,
2026-02-21T09:37:58.8466429Z  'pid_type': 'flat',
2026-02-21T09:37:58.8466645Z  'range_flattens': [None, True],
2026-02-21T09:37:58.8466909Z  'range_multi_buffers': [None, True],
2026-02-21T09:37:58.8467234Z  'range_num_stages': [0, 2],
2026-02-21T09:37:58.8467521Z  'range_unroll_factors': [0, 3],
2026-02-21T09:37:58.8467822Z  'range_warp_specializes': []}
2026-02-21T09:37:58.8468167Z [330s] Fitting surrogate: 482 points, 482 targets
2026-02-21T09:37:59.6197371Z [330s] Generation 6 starting: 54 neighbors, 5 active search path(s)
2026-02-21T09:38:16.7426966Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 8.4 configs/s
2026-02-21T09:38:20.4959921Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 14.8 configs/s
2026-02-21T09:38:28.3383445Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.8         
2026-02-21T09:38:28.3386506Z                                                                   configs/s     
2026-02-21T09:38:28.9108923Z [360s] Generation 6 complete: 
2026-02-21T09:38:28.9109304Z ok=59
2026-02-21T09:38:28.9109491Z min=0.0446
2026-02-21T09:38:28.9109681Z mid=0.0493
2026-02-21T09:38:28.9109853Z max=0.0868
2026-02-21T09:38:28.9110061Z best={'block_sizes': [1, 8192],
2026-02-21T09:38:28.9110391Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:38:28.9110756Z  'load_eviction_policies': ['', ''],
2026-02-21T09:38:28.9111022Z  'num_stages': 6,
2026-02-21T09:38:28.9111228Z  'num_warps': 16,
2026-02-21T09:38:28.9111424Z  'pid_type': 'flat',
2026-02-21T09:38:28.9111657Z  'range_flattens': [None, None],
2026-02-21T09:38:28.9111926Z  'range_multi_buffers': [None, None],
2026-02-21T09:38:28.9112212Z  'range_num_stages': [0, 1],
2026-02-21T09:38:28.9112463Z  'range_unroll_factors': [0, 2],
2026-02-21T09:38:28.9112719Z  'range_warp_specializes': []}
2026-02-21T09:38:28.9151318Z [360s] Fitting surrogate: 541 points, 541 targets
2026-02-21T09:38:29.7125165Z [360s] Generation 7 starting: 45 neighbors, 5 active search path(s)
2026-02-21T09:38:46.1514372Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 7.0 configs/s
2026-02-21T09:38:49.7916048Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 12.4 configs/s
2026-02-21T09:38:56.2161644Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 157.1         
2026-02-21T09:38:56.2162302Z                                                                   configs/s     
2026-02-21T09:38:56.6912740Z [387s] Generation 7 complete: 
2026-02-21T09:38:56.6913035Z ok=50
2026-02-21T09:38:56.6913218Z min=0.0444
2026-02-21T09:38:56.6913398Z mid=0.0479
2026-02-21T09:38:56.6913573Z max=0.1679
2026-02-21T09:38:56.6913773Z best={'block_sizes': [1, 8192],
2026-02-21T09:38:56.6914264Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:38:56.6914661Z  'load_eviction_policies': ['', ''],
2026-02-21T09:38:56.6914927Z  'num_stages': 6,
2026-02-21T09:38:56.6915130Z  'num_warps': 16,
2026-02-21T09:38:56.6915330Z  'pid_type': 'flat',
2026-02-21T09:38:56.6915559Z  'range_flattens': [None, None],
2026-02-21T09:38:56.6916318Z  'range_multi_buffers': [None, None],
2026-02-21T09:38:56.6916590Z  'range_num_stages': [0, 1],
2026-02-21T09:38:56.6916840Z  'range_unroll_factors': [0, 2],
2026-02-21T09:38:56.6917090Z  'range_warp_specializes': []}
2026-02-21T09:38:56.6950240Z [387s] Fitting surrogate: 591 points, 591 targets
2026-02-21T09:38:57.5799037Z [388s] Generation 8 starting: 54 neighbors, 5 active search path(s)
2026-02-21T09:39:34.7851681Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 0.5 configs/s
2026-02-21T09:39:39.0197325Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 13.1 configs/s
2026-02-21T09:39:46.2641495Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 139.5         
2026-02-21T09:39:46.2644554Z                                                                   configs/s     
2026-02-21T09:39:46.7969148Z [438s] Generation 8 complete: 
2026-02-21T09:39:46.7969495Z ok=59
2026-02-21T09:39:46.7969694Z min=0.0446
2026-02-21T09:39:46.7969908Z mid=0.0466
2026-02-21T09:39:46.7970215Z max=0.8867
2026-02-21T09:39:46.7970402Z best={'block_sizes': [1, 8192],
2026-02-21T09:39:46.7970756Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:39:46.7971139Z  'load_eviction_policies': ['', ''],
2026-02-21T09:39:46.7971403Z  'num_stages': 6,
2026-02-21T09:39:46.7971599Z  'num_warps': 16,
2026-02-21T09:39:46.7971802Z  'pid_type': 'flat',
2026-02-21T09:39:46.7972034Z  'range_flattens': [None, None],
2026-02-21T09:39:46.7972349Z  'range_multi_buffers': [None, None],
2026-02-21T09:39:46.7972684Z  'range_num_stages': [0, 1],
2026-02-21T09:39:46.7972919Z  'range_unroll_factors': [0, 2],
2026-02-21T09:39:46.7973171Z  'range_warp_specializes': []}
2026-02-21T09:39:46.8011758Z [438s] Fitting surrogate: 650 points, 650 targets
2026-02-21T09:39:47.6688897Z [438s] Generation 9 starting: 54 neighbors, 5 active search path(s)
2026-02-21T09:40:09.9948174Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 2.4 configs/s
2026-02-21T09:40:13.7956568Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 14.3 configs/s
2026-02-21T09:40:22.7412390Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 130.4         
2026-02-21T09:40:22.7412923Z                                                                   configs/s     
2026-02-21T09:40:23.3121817Z [474s] Generation 9 complete: 
2026-02-21T09:40:23.3122275Z ok=59
2026-02-21T09:40:23.3122587Z min=0.0446
2026-02-21T09:40:23.3122856Z mid=0.0455
2026-02-21T09:40:23.3123103Z max=0.0945
2026-02-21T09:40:23.3123399Z best={'block_sizes': [1, 8192],
2026-02-21T09:40:23.3123970Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:40:23.3124849Z  'load_eviction_policies': ['', ''],
2026-02-21T09:40:23.3125295Z  'num_stages': 6,
2026-02-21T09:40:23.3125605Z  'num_warps': 16,
2026-02-21T09:40:23.3125898Z  'pid_type': 'flat',
2026-02-21T09:40:23.3126230Z  'range_flattens': [None, None],
2026-02-21T09:40:23.3127253Z  'range_multi_buffers': [None, None],
2026-02-21T09:40:23.3127657Z  'range_num_stages': [0, 1],
2026-02-21T09:40:23.3128035Z  'range_unroll_factors': [0, 2],
2026-02-21T09:40:23.3128434Z  'range_warp_specializes': []}
2026-02-21T09:40:23.3162575Z [474s] Fitting surrogate: 709 points, 709 targets
2026-02-21T09:40:23.8730622Z [475s] Generation 10 starting: 28 neighbors, 3 active search path(s)
2026-02-21T09:40:34.5635966Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 3.4 configs/s
2026-02-21T09:40:36.7397237Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 14.0 configs/s
2026-02-21T09:40:40.6901992Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 254.7         
2026-02-21T09:40:40.6903087Z                                                                   configs/s     
2026-02-21T09:40:40.9911453Z [492s] Generation 10 complete: 
2026-02-21T09:40:40.9911786Z ok=32
2026-02-21T09:40:40.9911968Z min=0.0445
2026-02-21T09:40:40.9912160Z mid=0.0454
2026-02-21T09:40:40.9912368Z max=0.0946
2026-02-21T09:40:40.9912561Z best={'block_sizes': [1, 8192],
2026-02-21T09:40:40.9912888Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:40:40.9913247Z  'load_eviction_policies': ['', ''],
2026-02-21T09:40:40.9913504Z  'num_stages': 8,
2026-02-21T09:40:40.9913706Z  'num_warps': 16,
2026-02-21T09:40:40.9913902Z  'pid_type': 'flat',
2026-02-21T09:40:40.9914657Z  'range_flattens': [None, None],
2026-02-21T09:40:40.9914931Z  'range_multi_buffers': [None, False],
2026-02-21T09:40:40.9915204Z  'range_num_stages': [0, 2],
2026-02-21T09:40:40.9915453Z  'range_unroll_factors': [0, 2],
2026-02-21T09:40:40.9915700Z  'range_warp_specializes': []}
2026-02-21T09:40:40.9948008Z [492s] Fitting surrogate: 741 points, 741 targets
2026-02-21T09:40:41.4644463Z [492s] Generation 11 starting: 23 neighbors, 2 active search path(s)
2026-02-21T09:40:51.7802697Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 2.4 configs/s
2026-02-21T09:40:53.2500018Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 16.8 configs/s
2026-02-21T09:40:56.1313324Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 348.3         
2026-02-21T09:40:56.1313855Z                                                                   configs/s     
2026-02-21T09:40:56.3591750Z [507s] Generation 11 complete: 
2026-02-21T09:40:56.3592064Z ok=25
2026-02-21T09:40:56.3592261Z min=0.0446
2026-02-21T09:40:56.3592464Z mid=0.0454
2026-02-21T09:40:56.3592658Z max=0.3780
2026-02-21T09:40:56.3592942Z best={'block_sizes': [1, 8192],
2026-02-21T09:40:56.3593369Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:40:56.3593834Z  'load_eviction_policies': ['', ''],
2026-02-21T09:40:56.3594405Z  'num_stages': 8,
2026-02-21T09:40:56.3594631Z  'num_warps': 16,
2026-02-21T09:40:56.3594885Z  'pid_type': 'flat',
2026-02-21T09:40:56.3595146Z  'range_flattens': [None, None],
2026-02-21T09:40:56.3595529Z  'range_multi_buffers': [None, False],
2026-02-21T09:40:56.3595868Z  'range_num_stages': [0, 2],
2026-02-21T09:40:56.3596157Z  'range_unroll_factors': [0, 2],
2026-02-21T09:40:56.3596467Z  'range_warp_specializes': []}
2026-02-21T09:40:56.3631665Z [507s] Fitting surrogate: 766 points, 766 targets
2026-02-21T09:40:56.8434873Z [508s] Generation 12 starting: 23 neighbors, 2 active search path(s)
2026-02-21T09:41:03.5449007Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 2.7 configs/s
2026-02-21T09:41:04.9272716Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 17.2 configs/s
2026-02-21T09:41:08.2032863Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 306.5         
2026-02-21T09:41:08.2033527Z                                                                   configs/s     
2026-02-21T09:41:08.4567558Z [519s] Generation 12 complete: 
2026-02-21T09:41:08.4567940Z ok=25
2026-02-21T09:41:08.4568181Z min=0.0472
2026-02-21T09:41:08.4568411Z mid=0.0484
2026-02-21T09:41:08.4568635Z max=0.0799
2026-02-21T09:41:08.4569412Z best={'block_sizes': [1, 8192],
2026-02-21T09:41:08.4569931Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:41:08.4570554Z  'load_eviction_policies': ['', ''],
2026-02-21T09:41:08.4570928Z  'num_stages': 8,
2026-02-21T09:41:08.4571207Z  'num_warps': 16,
2026-02-21T09:41:08.4571473Z  'pid_type': 'flat',
2026-02-21T09:41:08.4571790Z  'range_flattens': [None, None],
2026-02-21T09:41:08.4572161Z  'range_multi_buffers': [None, False],
2026-02-21T09:41:08.4572541Z  'range_num_stages': [0, 2],
2026-02-21T09:41:08.4572885Z  'range_unroll_factors': [0, 3],
2026-02-21T09:41:08.4573260Z  'range_warp_specializes': []}
2026-02-21T09:41:08.4606331Z [519s] Fitting surrogate: 791 points, 791 targets
2026-02-21T09:41:08.8840120Z [520s] Generation 13 starting: 21 neighbors, 2 active search path(s)
2026-02-21T09:41:15.8192913Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 3.4 configs/s
2026-02-21T09:41:17.2351034Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.8 configs/s
2026-02-21T09:41:20.3301533Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 324.2         
2026-02-21T09:41:20.3302138Z                                                                   configs/s     
2026-02-21T09:41:20.5720681Z [531s] Generation 13 complete: 
2026-02-21T09:41:20.5721045Z ok=24
2026-02-21T09:41:20.5721275Z min=0.0474
2026-02-21T09:41:20.5721500Z mid=0.0548
2026-02-21T09:41:20.5721726Z max=0.0980
2026-02-21T09:41:20.5721990Z best={'block_sizes': [1, 8192],
2026-02-21T09:41:20.5722452Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:41:20.5722954Z  'load_eviction_policies': ['', ''],
2026-02-21T09:41:20.5723322Z  'num_stages': 8,
2026-02-21T09:41:20.5723589Z  'num_warps': 16,
2026-02-21T09:41:20.5723868Z  'pid_type': 'flat',
2026-02-21T09:41:20.5724617Z  'range_flattens': [None, None],
2026-02-21T09:41:20.5725008Z  'range_multi_buffers': [None, None],
2026-02-21T09:41:20.5725395Z  'range_num_stages': [0, 2],
2026-02-21T09:41:20.5725751Z  'range_unroll_factors': [0, 3],
2026-02-21T09:41:20.5726124Z  'range_warp_specializes': []}
2026-02-21T09:41:20.5759932Z [531s] Fitting surrogate: 815 points, 815 targets
2026-02-21T09:41:20.7215910Z [532s] Autotuning complete in 532.0s after searching 751 configs.
2026-02-21T09:41:20.7216542Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:41:20.7218665Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=8, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T09:41:20.7220322Z 
2026-02-21T09:41:20.7220909Z [532s] Code of selected kernel: /tmp/torchinductor_root/nu/cnumxdmrlc4n6axsln3vo4ktjk4hysgie73hfz5r6zpq52y76y66.py
2026-02-21T09:41:21.9629022Z WARNING:tritonbench.utils.triton_op:Completed input ID 56:
2026-02-21T09:41:21.9629636Z (M, N)
2026-02-21T09:41:21.9629872Z ------------
2026-02-21T09:41:21.9630112Z (4096, 7424)
2026-02-21T09:41:21.9630265Z 
2026-02-21T09:41:21.9652760Z  60%|██████    | 12/20 [1:22:51<1:03:20, 475.02s/it]WARNING:tritonbench.utils.triton_op:Running input ID 61:
2026-02-21T09:41:21.9653379Z (M, N)
2026-02-21T09:41:21.9653593Z ------------
2026-02-21T09:41:21.9653824Z (4096, 8064)
2026-02-21T09:41:21.9655867Z INFO:tritonbench.utils.triton_op:Took 0.02ms to get benchmark function for naive_softmax
2026-02-21T09:41:23.3441212Z INFO:tritonbench.utils.triton_op:Took 0.02ms to get benchmark function for triton_softmax
2026-02-21T09:41:24.9585777Z INFO:tritonbench.utils.triton_op:Took 3.52ms to get benchmark function for torch_compile_softmax
2026-02-21T09:41:30.9292013Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:41:30.9292529Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:41:30.9292899Z               'dtype': 'torch.float16',
2026-02-21T09:41:30.9293253Z               'shape': (4096, 8064),
2026-02-21T09:41:30.9294478Z               'stride': (8064, 1)},),
2026-02-21T09:41:30.9294833Z   'kwargs': {}}
2026-02-21T09:41:30.9360029Z INFO:tritonbench.utils.triton_op:Took 7.33ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T09:41:31.2276766Z [0s] Autotune random seed: 2135383793
2026-02-21T09:41:31.4157962Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:42:08.0488252Z [36s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T09:42:09.3255702Z [37s] Timeout after 30s compiling Config(block_sizes=[8, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T09:42:11.0166053Z [39s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:42:24.0439432Z [52s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:42:25.2640443Z [53s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T09:42:26.2712338Z [54s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:42:26.2735175Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T09:42:34.5411291Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.1 configs/s
2026-02-21T09:42:34.5424834Z [63s] Adaptive compile timeout: 30s (90% percentile=24.6s, bounds=[30.0s, 30s])
2026-02-21T09:42:35.9797036Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 682.8 configs/s
2026-02-21T09:42:36.0965223Z [64s] Initial random population of 100, 5 starting points: 
2026-02-21T09:42:36.0965599Z error=2
2026-02-21T09:42:36.0965773Z timeout=6
2026-02-21T09:42:36.0966076Z ok=92
2026-02-21T09:42:36.0968278Z min=0.0796
2026-02-21T09:42:36.0968486Z mid=0.6376
2026-02-21T09:42:36.0968678Z max=164.7278
2026-02-21T09:42:36.0968893Z best={'block_sizes': [1, 256],
2026-02-21T09:42:36.0969292Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:42:36.0969744Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:42:36.0970117Z  'num_stages': 2,
2026-02-21T09:42:36.0970337Z  'num_warps': 1,
2026-02-21T09:42:36.0970558Z  'pid_type': 'flat',
2026-02-21T09:42:36.0971226Z  'range_flattens': [None, True],
2026-02-21T09:42:36.0971466Z  'range_multi_buffers': [None, None],
2026-02-21T09:42:36.0971712Z  'range_num_stages': [0, 3],
2026-02-21T09:42:36.0971936Z  'range_unroll_factors': [0, 2],
2026-02-21T09:42:36.0972167Z  'range_warp_specializes': []}
2026-02-21T09:42:36.0989585Z [64s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:42:37.4923848Z [66s] Generation 1 starting: 86 neighbors, 5 active search path(s)
2026-02-21T09:43:12.4400267Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 1.0 configs/s
2026-02-21T09:43:18.0798303Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 91/91 16.3 configs/s
2026-02-21T09:43:28.0407699Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 101.2         
2026-02-21T09:43:28.0408904Z                                                                   configs/s     
2026-02-21T09:43:28.6119685Z [117s] Generation 1 complete: 
2026-02-21T09:43:28.6120118Z ok=92
2026-02-21T09:43:28.6120443Z min=0.0672
2026-02-21T09:43:28.6120722Z mid=0.0908
2026-02-21T09:43:28.6120985Z max=5.7863
2026-02-21T09:43:28.6121278Z best={'block_sizes': [1, 2048],
2026-02-21T09:43:28.6121841Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:43:28.6122466Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T09:43:28.6122951Z  'maxnreg': 256,
2026-02-21T09:43:28.6123293Z  'num_sm_multiplier': 16,
2026-02-21T09:43:28.6123644Z  'num_stages': 5,
2026-02-21T09:43:28.6123961Z  'num_warps': 4,
2026-02-21T09:43:28.6124528Z  'pid_type': 'persistent_interleaved',
2026-02-21T09:43:28.6124980Z  'range_flattens': [None, False],
2026-02-21T09:43:28.6125384Z  'range_multi_buffers': [False, False],
2026-02-21T09:43:28.6125815Z  'range_num_stages': [1, 2],
2026-02-21T09:43:28.6126221Z  'range_unroll_factors': [1, 1],
2026-02-21T09:43:28.6126629Z  'range_warp_specializes': []}
2026-02-21T09:43:28.6145121Z [117s] Fitting surrogate: 192 points, 192 targets
2026-02-21T09:43:29.8810206Z [118s] Generation 2 starting: 79 neighbors, 5 active search path(s)
2026-02-21T09:43:59.2897016Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84/84 1.6 configs/s
2026-02-21T09:44:04.4603790Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 84/84 16.4 configs/s
2026-02-21T09:44:16.4763850Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 84.0 configs/s
2026-02-21T09:44:17.1843896Z [165s] Generation 2 complete: 
2026-02-21T09:44:17.1844574Z ok=85
2026-02-21T09:44:17.1844874Z min=0.0616
2026-02-21T09:44:17.1845180Z mid=0.0749
2026-02-21T09:44:17.1845455Z max=0.5641
2026-02-21T09:44:17.1845758Z best={'block_sizes': [1, 2048],
2026-02-21T09:44:17.1846391Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:44:17.1847154Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:44:17.1847616Z  'num_stages': 1,
2026-02-21T09:44:17.1847937Z  'num_warps': 2,
2026-02-21T09:44:17.1848254Z  'pid_type': 'flat',
2026-02-21T09:44:17.1848618Z  'range_flattens': [None, False],
2026-02-21T09:44:17.1849060Z  'range_multi_buffers': [None, False],
2026-02-21T09:44:17.1849508Z  'range_num_stages': [0, 0],
2026-02-21T09:44:17.1849909Z  'range_unroll_factors': [0, 1],
2026-02-21T09:44:17.1850462Z  'range_warp_specializes': []}
2026-02-21T09:44:17.1872588Z [165s] Fitting surrogate: 277 points, 277 targets
2026-02-21T09:44:18.3592174Z [166s] Generation 3 starting: 73 neighbors, 5 active search path(s)
2026-02-21T09:44:44.2457625Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76/76 1.5 configs/s
2026-02-21T09:44:48.9401487Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 76/76 16.3 configs/s
2026-02-21T09:44:59.8668324Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 103.8         
2026-02-21T09:44:59.8668851Z                                                                   configs/s     
2026-02-21T09:45:00.5021478Z [209s] Generation 3 complete: 
2026-02-21T09:45:00.5021733Z ok=78
2026-02-21T09:45:00.5021913Z min=0.0484
2026-02-21T09:45:00.5022509Z mid=0.0691
2026-02-21T09:45:00.5022675Z max=1.1350
2026-02-21T09:45:00.5022864Z best={'block_sizes': [1, 8192],
2026-02-21T09:45:00.5023207Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:45:00.5023591Z  'load_eviction_policies': ['', ''],
2026-02-21T09:45:00.5023842Z  'num_stages': 2,
2026-02-21T09:45:00.5024203Z  'num_warps': 4,
2026-02-21T09:45:00.5024397Z  'pid_type': 'flat',
2026-02-21T09:45:00.5024615Z  'range_flattens': [None, True],
2026-02-21T09:45:00.5024867Z  'range_multi_buffers': [None, None],
2026-02-21T09:45:00.5025146Z  'range_num_stages': [0, 4],
2026-02-21T09:45:00.5025384Z  'range_unroll_factors': [0, 1],
2026-02-21T09:45:00.5025627Z  'range_warp_specializes': []}
2026-02-21T09:45:00.5045355Z [209s] Fitting surrogate: 355 points, 355 targets
2026-02-21T09:45:01.5442548Z [210s] Generation 4 starting: 64 neighbors, 5 active search path(s)
2026-02-21T09:45:21.2219520Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 7.2 configs/s
2026-02-21T09:45:25.3288510Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.5 configs/s
2026-02-21T09:45:34.4576617Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 110.6         
2026-02-21T09:45:34.4577117Z                                                                   configs/s     
2026-02-21T09:45:35.0581739Z [243s] Generation 4 complete: 
2026-02-21T09:45:35.0582020Z ok=69
2026-02-21T09:45:35.0582209Z min=0.0476
2026-02-21T09:45:35.0582392Z mid=0.0593
2026-02-21T09:45:35.0582572Z max=0.0776
2026-02-21T09:45:35.0582767Z best={'block_sizes': [1, 8192],
2026-02-21T09:45:35.0583140Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T09:45:35.0583542Z  'load_eviction_policies': ['', ''],
2026-02-21T09:45:35.0583825Z  'num_stages': 2,
2026-02-21T09:45:35.0584218Z  'num_warps': 16,
2026-02-21T09:45:35.0584459Z  'pid_type': 'flat',
2026-02-21T09:45:35.0584698Z  'range_flattens': [None, True],
2026-02-21T09:45:35.0585000Z  'range_multi_buffers': [None, None],
2026-02-21T09:45:35.0585287Z  'range_num_stages': [0, 4],
2026-02-21T09:45:35.0585539Z  'range_unroll_factors': [0, 1],
2026-02-21T09:45:35.0585804Z  'range_warp_specializes': []}
2026-02-21T09:45:35.0618138Z [243s] Fitting surrogate: 424 points, 424 targets
2026-02-21T09:45:35.9092990Z [244s] Generation 5 starting: 53 neighbors, 5 active search path(s)
2026-02-21T09:45:53.0376916Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 3.0 configs/s
2026-02-21T09:45:56.4771310Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 16.5 configs/s
2026-02-21T09:46:03.6234434Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.2         
2026-02-21T09:46:03.6236580Z                                                                   configs/s     
2026-02-21T09:46:04.1040051Z [272s] Generation 5 complete: 
2026-02-21T09:46:04.1040383Z ok=58
2026-02-21T09:46:04.1040560Z min=0.0474
2026-02-21T09:46:04.1040742Z mid=0.0552
2026-02-21T09:46:04.1041647Z max=0.4010
2026-02-21T09:46:04.1041843Z best={'block_sizes': [1, 8192],
2026-02-21T09:46:04.1042167Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:46:04.1042529Z  'load_eviction_policies': ['', ''],
2026-02-21T09:46:04.1042793Z  'num_stages': 6,
2026-02-21T09:46:04.1043000Z  'num_warps': 16,
2026-02-21T09:46:04.1043197Z  'pid_type': 'flat',
2026-02-21T09:46:04.1043422Z  'range_flattens': [None, False],
2026-02-21T09:46:04.1043690Z  'range_multi_buffers': [None, None],
2026-02-21T09:46:04.1043965Z  'range_num_stages': [0, 1],
2026-02-21T09:46:04.1044413Z  'range_unroll_factors': [0, 3],
2026-02-21T09:46:04.1044664Z  'range_warp_specializes': []}
2026-02-21T09:46:04.1077648Z [272s] Fitting surrogate: 482 points, 482 targets
2026-02-21T09:46:04.9397221Z [273s] Generation 6 starting: 49 neighbors, 5 active search path(s)
2026-02-21T09:46:19.9569745Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 3.2 configs/s
2026-02-21T09:46:22.9746975Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 16.8 configs/s
2026-02-21T09:46:31.5438020Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 137.1         
2026-02-21T09:46:31.5438522Z                                                                   configs/s     
2026-02-21T09:46:32.0604735Z [300s] Generation 6 complete: 
2026-02-21T09:46:32.0605177Z ok=54
2026-02-21T09:46:32.0605460Z min=0.0477
2026-02-21T09:46:32.0605776Z mid=0.0486
2026-02-21T09:46:32.0606066Z max=0.0723
2026-02-21T09:46:32.0606370Z best={'block_sizes': [1, 8192],
2026-02-21T09:46:32.0606876Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:46:32.0607463Z  'load_eviction_policies': ['', ''],
2026-02-21T09:46:32.0607891Z  'num_stages': 6,
2026-02-21T09:46:32.0608201Z  'num_warps': 16,
2026-02-21T09:46:32.0608554Z  'pid_type': 'flat',
2026-02-21T09:46:32.0608921Z  'range_flattens': [None, False],
2026-02-21T09:46:32.0609357Z  'range_multi_buffers': [None, None],
2026-02-21T09:46:32.0609799Z  'range_num_stages': [0, 1],
2026-02-21T09:46:32.0610389Z  'range_unroll_factors': [0, 3],
2026-02-21T09:46:32.0610798Z  'range_warp_specializes': []}
2026-02-21T09:46:32.0635950Z [300s] Fitting surrogate: 536 points, 536 targets
2026-02-21T09:46:32.7455366Z [301s] Generation 7 starting: 38 neighbors, 4 active search path(s)
2026-02-21T09:46:44.5752571Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 6.0 configs/s
2026-02-21T09:46:46.9704494Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 39/39 16.6 configs/s
2026-02-21T09:46:52.5102850Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 182.1         
2026-02-21T09:46:52.5106248Z                                                                   configs/s     
2026-02-21T09:46:52.9102594Z [321s] Generation 7 complete: 
2026-02-21T09:46:52.9102902Z ok=42
2026-02-21T09:46:52.9103105Z min=0.0512
2026-02-21T09:46:52.9103315Z mid=0.0524
2026-02-21T09:46:52.9103511Z max=0.1020
2026-02-21T09:46:52.9103740Z best={'block_sizes': [1, 8192],
2026-02-21T09:46:52.9104304Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:46:52.9104733Z  'load_eviction_policies': ['', ''],
2026-02-21T09:46:52.9105038Z  'num_stages': 7,
2026-02-21T09:46:52.9105274Z  'num_warps': 16,
2026-02-21T09:46:52.9105507Z  'pid_type': 'flat',
2026-02-21T09:46:52.9105769Z  'range_flattens': [None, True],
2026-02-21T09:46:52.9106087Z  'range_multi_buffers': [None, False],
2026-02-21T09:46:52.9106419Z  'range_num_stages': [0, 3],
2026-02-21T09:46:52.9106714Z  'range_unroll_factors': [0, 2],
2026-02-21T09:46:52.9107023Z  'range_warp_specializes': []}
2026-02-21T09:46:52.9142969Z [321s] Fitting surrogate: 578 points, 578 targets
2026-02-21T09:46:53.5396237Z [322s] Generation 8 starting: 35 neighbors, 3 active search path(s)
2026-02-21T09:47:05.0179376Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 4.1 configs/s
2026-02-21T09:47:07.3417369Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 16.7 configs/s
2026-02-21T09:47:12.0095461Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 215.7         
2026-02-21T09:47:12.0096180Z                                                                   configs/s     
2026-02-21T09:47:12.3528258Z [340s] Generation 8 complete: 
2026-02-21T09:47:12.3528783Z ok=39
2026-02-21T09:47:12.3529123Z min=0.0477
2026-02-21T09:47:12.3529483Z mid=0.0550
2026-02-21T09:47:12.3529816Z max=0.1320
2026-02-21T09:47:12.3530319Z best={'block_sizes': [1, 8192],
2026-02-21T09:47:12.3531017Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:47:12.3531793Z  'load_eviction_policies': ['', ''],
2026-02-21T09:47:12.3532354Z  'num_stages': 1,
2026-02-21T09:47:12.3532776Z  'num_warps': 16,
2026-02-21T09:47:12.3533208Z  'pid_type': 'flat',
2026-02-21T09:47:12.3534409Z  'range_flattens': [None, True],
2026-02-21T09:47:12.3534748Z  'range_multi_buffers': [None, None],
2026-02-21T09:47:12.3535054Z  'range_num_stages': [0, 1],
2026-02-21T09:47:12.3535342Z  'range_unroll_factors': [0, 1],
2026-02-21T09:47:12.3535646Z  'range_warp_specializes': []}
2026-02-21T09:47:12.3563586Z [340s] Fitting surrogate: 617 points, 617 targets
2026-02-21T09:47:12.9583585Z [341s] Generation 9 starting: 33 neighbors, 3 active search path(s)
2026-02-21T09:47:23.0970242Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 4.1 configs/s
2026-02-21T09:47:25.1013302Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 33/33 16.8 configs/s
2026-02-21T09:47:30.0206403Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 204.8         
2026-02-21T09:47:30.0206928Z                                                                   configs/s     
2026-02-21T09:47:30.3881129Z [358s] Generation 9 complete: 
2026-02-21T09:47:30.3881391Z ok=36
2026-02-21T09:47:30.3881587Z min=0.0512
2026-02-21T09:47:30.3881806Z mid=0.0515
2026-02-21T09:47:30.3881975Z max=0.0933
2026-02-21T09:47:30.3882164Z best={'block_sizes': [1, 8192],
2026-02-21T09:47:30.3882562Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:47:30.3883012Z  'load_eviction_policies': ['', ''],
2026-02-21T09:47:30.3883276Z  'num_stages': 5,
2026-02-21T09:47:30.3883469Z  'num_warps': 16,
2026-02-21T09:47:30.3883691Z  'pid_type': 'flat',
2026-02-21T09:47:30.3883914Z  'range_flattens': [None, False],
2026-02-21T09:47:30.3884361Z  'range_multi_buffers': [None, False],
2026-02-21T09:47:30.3884633Z  'range_num_stages': [0, 3],
2026-02-21T09:47:30.3884878Z  'range_unroll_factors': [0, 2],
2026-02-21T09:47:30.3885127Z  'range_warp_specializes': []}
2026-02-21T09:47:30.3921348Z [358s] Fitting surrogate: 653 points, 653 targets
2026-02-21T09:47:30.8515135Z [359s] Generation 10 starting: 23 neighbors, 2 active search path(s)
2026-02-21T09:47:39.4097829Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 1.6 configs/s
2026-02-21T09:47:40.9285735Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 16.9 configs/s
2026-02-21T09:47:44.1275305Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 313.8         
2026-02-21T09:47:44.1275868Z                                                                   configs/s     
2026-02-21T09:47:44.3767625Z [372s] Generation 10 complete: 
2026-02-21T09:47:44.3768048Z ok=26
2026-02-21T09:47:44.3768313Z min=0.0479
2026-02-21T09:47:44.3768598Z mid=0.0489
2026-02-21T09:47:44.3768861Z max=0.1384
2026-02-21T09:47:44.3769161Z best={'block_sizes': [1, 8192],
2026-02-21T09:47:44.3769754Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:47:44.3770532Z  'load_eviction_policies': ['', ''],
2026-02-21T09:47:44.3770955Z  'num_stages': 5,
2026-02-21T09:47:44.3771263Z  'num_warps': 16,
2026-02-21T09:47:44.3771576Z  'pid_type': 'flat',
2026-02-21T09:47:44.3771924Z  'range_flattens': [None, False],
2026-02-21T09:47:44.3772366Z  'range_multi_buffers': [None, False],
2026-02-21T09:47:44.3772801Z  'range_num_stages': [0, 4],
2026-02-21T09:47:44.3773209Z  'range_unroll_factors': [0, 2],
2026-02-21T09:47:44.3773626Z  'range_warp_specializes': []}
2026-02-21T09:47:44.3805329Z [372s] Fitting surrogate: 679 points, 679 targets
2026-02-21T09:47:44.8261057Z [373s] Generation 11 starting: 22 neighbors, 2 active search path(s)
2026-02-21T09:47:51.6737799Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 4.9 configs/s
2026-02-21T09:47:53.0060227Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.1 configs/s
2026-02-21T09:47:56.3650323Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 299.1         
2026-02-21T09:47:56.3650843Z                                                                   configs/s     
2026-02-21T09:47:56.6213757Z [385s] Generation 11 complete: 
2026-02-21T09:47:56.6214202Z ok=24
2026-02-21T09:47:56.6214379Z min=0.0478
2026-02-21T09:47:56.6214546Z mid=0.0485
2026-02-21T09:47:56.6215143Z max=0.0636
2026-02-21T09:47:56.6215333Z best={'block_sizes': [1, 8192],
2026-02-21T09:47:56.6215681Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:47:56.6216074Z  'load_eviction_policies': ['', ''],
2026-02-21T09:47:56.6216329Z  'num_stages': 5,
2026-02-21T09:47:56.6216521Z  'num_warps': 16,
2026-02-21T09:47:56.6216707Z  'pid_type': 'flat',
2026-02-21T09:47:56.6216919Z  'range_flattens': [None, False],
2026-02-21T09:47:56.6217172Z  'range_multi_buffers': [None, False],
2026-02-21T09:47:56.6217435Z  'range_num_stages': [0, 4],
2026-02-21T09:47:56.6217666Z  'range_unroll_factors': [0, 2],
2026-02-21T09:47:56.6217928Z  'range_warp_specializes': []}
2026-02-21T09:47:56.6250957Z [385s] Fitting surrogate: 703 points, 703 targets
2026-02-21T09:47:56.9148179Z [385s] Generation 12 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:48:00.5488977Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 3.2 configs/s
2026-02-21T09:48:01.1699850Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.4 configs/s
2026-02-21T09:48:02.8443963Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 593.6         
2026-02-21T09:48:02.8444707Z                                                                   configs/s     
2026-02-21T09:48:02.9877266Z [391s] Generation 12 complete: 
2026-02-21T09:48:02.9877732Z ok=12
2026-02-21T09:48:02.9878015Z min=0.0512
2026-02-21T09:48:02.9878330Z mid=0.0515
2026-02-21T09:48:02.9878592Z max=0.0639
2026-02-21T09:48:02.9878887Z best={'block_sizes': [1, 8192],
2026-02-21T09:48:02.9879449Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:48:02.9880079Z  'load_eviction_policies': ['', ''],
2026-02-21T09:48:02.9880501Z  'num_stages': 2,
2026-02-21T09:48:02.9880812Z  'num_warps': 16,
2026-02-21T09:48:02.9881133Z  'pid_type': 'flat',
2026-02-21T09:48:02.9881485Z  'range_flattens': [None, True],
2026-02-21T09:48:02.9881904Z  'range_multi_buffers': [None, False],
2026-02-21T09:48:02.9882353Z  'range_num_stages': [0, 1],
2026-02-21T09:48:02.9882734Z  'range_unroll_factors': [0, 0],
2026-02-21T09:48:02.9883123Z  'range_warp_specializes': []}
2026-02-21T09:48:02.9911731Z [391s] Fitting surrogate: 715 points, 715 targets
2026-02-21T09:48:03.2753330Z [391s] Generation 13 starting: 10 neighbors, 1 active search path(s)
2026-02-21T09:48:06.8098138Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 3.8 configs/s
2026-02-21T09:48:07.4320917Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.3 configs/s
2026-02-21T09:48:08.8101049Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 718.7         
2026-02-21T09:48:08.8101517Z                                                                   configs/s     
2026-02-21T09:48:08.9343111Z [397s] Generation 13 complete: 
2026-02-21T09:48:08.9343465Z ok=11
2026-02-21T09:48:08.9343634Z min=0.0475
2026-02-21T09:48:08.9343801Z mid=0.0500
2026-02-21T09:48:08.9344264Z max=0.0862
2026-02-21T09:48:08.9344881Z best={'block_sizes': [1, 8192],
2026-02-21T09:48:08.9345240Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:48:08.9345617Z  'load_eviction_policies': ['', ''],
2026-02-21T09:48:08.9345889Z  'num_stages': 2,
2026-02-21T09:48:08.9346080Z  'num_warps': 16,
2026-02-21T09:48:08.9346271Z  'pid_type': 'flat',
2026-02-21T09:48:08.9346484Z  'range_flattens': [None, True],
2026-02-21T09:48:08.9346731Z  'range_multi_buffers': [None, False],
2026-02-21T09:48:08.9346999Z  'range_num_stages': [0, 1],
2026-02-21T09:48:08.9347229Z  'range_unroll_factors': [0, 0],
2026-02-21T09:48:08.9347476Z  'range_warp_specializes': []}
2026-02-21T09:48:08.9378164Z [397s] Fitting surrogate: 726 points, 726 targets
2026-02-21T09:48:09.0982491Z [397s] Autotuning complete in 397.7s after searching 695 configs.
2026-02-21T09:48:09.0982968Z One can hardcode the best config and skip autotuning with:
2026-02-21T09:48:09.0984773Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=2, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[]), static_shapes=True)
2026-02-21T09:48:09.0986186Z 
2026-02-21T09:48:09.0986593Z [397s] Code of selected kernel: /tmp/torchinductor_root/ys/cysb6rinsed3nsugbdhr5yvumdq7rwa5ychpd3kkwmdhnmdvmp2i.py
2026-02-21T09:48:09.9770987Z WARNING:tritonbench.utils.triton_op:Completed input ID 61:
2026-02-21T09:48:09.9771598Z (M, N)
2026-02-21T09:48:09.9771879Z ------------
2026-02-21T09:48:09.9772178Z (4096, 8064)
2026-02-21T09:48:09.9772356Z 
2026-02-21T09:48:09.9794516Z  65%|██████▌   | 13/20 [1:29:39<53:03, 454.72s/it]  WARNING:tritonbench.utils.triton_op:Running input ID 66:
2026-02-21T09:48:09.9795327Z (M, N)
2026-02-21T09:48:09.9795623Z ------------
2026-02-21T09:48:09.9795908Z (4096, 8704)
2026-02-21T09:48:09.9797380Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T09:48:11.3428439Z INFO:tritonbench.utils.triton_op:Took 0.02ms to get benchmark function for triton_softmax
2026-02-21T09:48:14.1193834Z INFO:tritonbench.utils.triton_op:Took 2.88ms to get benchmark function for torch_compile_softmax
2026-02-21T09:48:18.8456724Z WARNING:__main__:Input tensor metadata:
2026-02-21T09:48:18.8457283Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T09:48:18.8457728Z               'dtype': 'torch.float16',
2026-02-21T09:48:18.8458178Z               'shape': (4096, 8704),
2026-02-21T09:48:18.8458583Z               'stride': (8704, 1)},),
2026-02-21T09:48:18.8458974Z   'kwargs': {}}
2026-02-21T09:48:18.8479290Z INFO:tritonbench.utils.triton_op:Took 2.69ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T09:48:19.1293295Z [0s] Autotune random seed: 2135383793
2026-02-21T09:48:19.3105173Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T09:48:55.6321812Z [36s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T09:48:56.3461990Z [37s] Timeout after 30s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:48:58.6906648Z [39s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T09:49:07.0582825Z [47s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T09:49:12.4084949Z [53s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T09:49:13.7227840Z [54s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T09:49:14.7682012Z [55s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T09:49:14.7704105Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T09:49:23.0728442Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.1 configs/s
2026-02-21T09:49:23.0741007Z [63s] Adaptive compile timeout: 30s (90% percentile=26.2s, bounds=[30.0s, 30s])
2026-02-21T09:49:24.1353170Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 915.5 configs/s
2026-02-21T09:49:24.2341377Z [64s] Initial random population of 100, 5 starting points: 
2026-02-21T09:49:24.2341724Z error=3
2026-02-21T09:49:24.2341992Z timeout=7
2026-02-21T09:49:24.2342182Z ok=90
2026-02-21T09:49:24.2342341Z min=0.0840
2026-02-21T09:49:24.2342569Z mid=0.6935
2026-02-21T09:49:24.2342754Z max=183.5638
2026-02-21T09:49:24.2342946Z best={'block_sizes': [1, 256],
2026-02-21T09:49:24.2343363Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T09:49:24.2343786Z  'load_eviction_policies': ['', 'last'],
2026-02-21T09:49:24.2344216Z  'num_stages': 2,
2026-02-21T09:49:24.2344406Z  'num_warps': 1,
2026-02-21T09:49:24.2344602Z  'pid_type': 'flat',
2026-02-21T09:49:24.2344849Z  'range_flattens': [None, True],
2026-02-21T09:49:24.2345112Z  'range_multi_buffers': [None, None],
2026-02-21T09:49:24.2345381Z  'range_num_stages': [0, 3],
2026-02-21T09:49:24.2345613Z  'range_unroll_factors': [0, 2],
2026-02-21T09:49:24.2346312Z  'range_warp_specializes': []}
2026-02-21T09:49:24.2361803Z [64s] Fitting surrogate: 100 points, 100 targets
2026-02-21T09:49:25.7627427Z [66s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T09:49:53.3691193Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 4.2 configs/s
2026-02-21T09:49:59.0655665Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 16.4 configs/s
2026-02-21T09:50:10.6213416Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 87.2 configs/s
2026-02-21T09:50:11.2928091Z [111s] Generation 1 complete: 
2026-02-21T09:50:11.2928532Z ok=94
2026-02-21T09:50:11.2928813Z min=0.0738
2026-02-21T09:50:11.2929095Z mid=0.0956
2026-02-21T09:50:11.2929355Z max=0.8015
2026-02-21T09:50:11.2930295Z best={'block_sizes': [2, 1024],
2026-02-21T09:50:11.2930918Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:50:11.2931574Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:50:11.2932067Z  'num_stages': 1,
2026-02-21T09:50:11.2932376Z  'num_warps': 8,
2026-02-21T09:50:11.2932695Z  'pid_type': 'flat',
2026-02-21T09:50:11.2933038Z  'range_flattens': [None, False],
2026-02-21T09:50:11.2933481Z  'range_multi_buffers': [None, False],
2026-02-21T09:50:11.2933899Z  'range_num_stages': [0, 0],
2026-02-21T09:50:11.2934789Z  'range_unroll_factors': [0, 1],
2026-02-21T09:50:11.2935184Z  'range_warp_specializes': []}
2026-02-21T09:50:11.2954656Z [111s] Fitting surrogate: 194 points, 194 targets
2026-02-21T09:50:12.8415285Z [113s] Generation 2 starting: 92 neighbors, 5 active search path(s)
2026-02-21T09:50:42.1679134Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 3.7 configs/s
2026-02-21T09:50:47.9098981Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.5 configs/s
2026-02-21T09:51:03.3979010Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 70.7 configs/s
2026-02-21T09:51:04.2385585Z [164s] Generation 2 complete: 
2026-02-21T09:51:04.2386086Z ok=98
2026-02-21T09:51:04.2386380Z min=0.0666
2026-02-21T09:51:04.2386651Z mid=0.0820
2026-02-21T09:51:04.2386940Z max=0.2085
2026-02-21T09:51:04.2387253Z best={'block_sizes': [2, 2048],
2026-02-21T09:51:04.2387839Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:51:04.2388493Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:51:04.2388949Z  'num_stages': 1,
2026-02-21T09:51:04.2389272Z  'num_warps': 4,
2026-02-21T09:51:04.2389580Z  'pid_type': 'flat',
2026-02-21T09:51:04.2389928Z  'range_flattens': [None, False],
2026-02-21T09:51:04.2390337Z  'range_multi_buffers': [None, False],
2026-02-21T09:51:04.2390762Z  'range_num_stages': [0, 0],
2026-02-21T09:51:04.2391138Z  'range_unroll_factors': [0, 2],
2026-02-21T09:51:04.2391535Z  'range_warp_specializes': []}
2026-02-21T09:51:04.2407588Z [164s] Fitting surrogate: 292 points, 292 targets
2026-02-21T09:51:05.7854818Z [166s] Generation 3 starting: 90 neighbors, 5 active search path(s)
2026-02-21T09:51:34.1668641Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 4.2 configs/s
2026-02-21T09:51:39.8497732Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.3 configs/s
2026-02-21T09:51:52.7083102Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 78.5 configs/s
2026-02-21T09:51:53.4870506Z [214s] Generation 3 complete: 
2026-02-21T09:51:53.4874398Z ok=95
2026-02-21T09:51:53.4874789Z min=0.0636
2026-02-21T09:51:53.4875129Z mid=0.0772
2026-02-21T09:51:53.4875405Z max=0.1664
2026-02-21T09:51:53.4875735Z best={'block_sizes': [1, 2048],
2026-02-21T09:51:53.4876358Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:51:53.4877025Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:51:53.4877494Z  'num_stages': 2,
2026-02-21T09:51:53.4877847Z  'num_warps': 4,
2026-02-21T09:51:53.4878174Z  'pid_type': 'flat',
2026-02-21T09:51:53.4878566Z  'range_flattens': [None, False],
2026-02-21T09:51:53.4879070Z  'range_multi_buffers': [None, False],
2026-02-21T09:51:53.4879944Z  'range_num_stages': [0, 0],
2026-02-21T09:51:53.4880170Z  'range_unroll_factors': [0, 2],
2026-02-21T09:51:53.4880414Z  'range_warp_specializes': []}
2026-02-21T09:51:53.4905060Z [214s] Fitting surrogate: 387 points, 387 targets
2026-02-21T09:51:54.7871913Z [215s] Generation 4 starting: 81 neighbors, 5 active search path(s)
2026-02-21T09:52:20.7767792Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84/84 3.2 configs/s
2026-02-21T09:52:25.9424227Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 84/84 16.4 configs/s
2026-02-21T09:52:37.0748025Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 90.7 configs/s
2026-02-21T09:52:37.7473283Z [258s] Generation 4 complete: 
2026-02-21T09:52:37.7473554Z ok=87
2026-02-21T09:52:37.7473731Z min=0.0585
2026-02-21T09:52:37.7474540Z mid=0.0752
2026-02-21T09:52:37.7474880Z max=0.1895
2026-02-21T09:52:37.7475138Z best={'block_sizes': [1, 8192],
2026-02-21T09:52:37.7475512Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:52:37.7475957Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:52:37.7476255Z  'num_stages': 2,
2026-02-21T09:52:37.7476452Z  'num_warps': 4,
2026-02-21T09:52:37.7476661Z  'pid_type': 'flat',
2026-02-21T09:52:37.7476880Z  'range_flattens': [None, False],
2026-02-21T09:52:37.7477147Z  'range_multi_buffers': [None, True],
2026-02-21T09:52:37.7477408Z  'range_num_stages': [0, 0],
2026-02-21T09:52:37.7477654Z  'range_unroll_factors': [0, 2],
2026-02-21T09:52:37.7477926Z  'range_warp_specializes': []}
2026-02-21T09:52:37.7508218Z [258s] Fitting surrogate: 474 points, 474 targets
2026-02-21T09:52:39.0507521Z [259s] Generation 5 starting: 80 neighbors, 5 active search path(s)
2026-02-21T09:53:04.9456367Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 4.7 configs/s
2026-02-21T09:53:10.0677924Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 16.3 configs/s
2026-02-21T09:53:21.6197379Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 97.8 configs/s
2026-02-21T09:53:22.2713812Z [302s] Generation 5 complete: 
2026-02-21T09:53:22.2714377Z ok=85
2026-02-21T09:53:22.2714565Z min=0.0564
2026-02-21T09:53:22.2714744Z mid=0.0751
2026-02-21T09:53:22.2714913Z max=0.4075
2026-02-21T09:53:22.2715096Z best={'block_sizes': [1, 16384],
2026-02-21T09:53:22.2715458Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:53:22.2715874Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T09:53:22.2716169Z  'num_stages': 2,
2026-02-21T09:53:22.2716369Z  'num_warps': 4,
2026-02-21T09:53:22.2716566Z  'pid_type': 'flat',
2026-02-21T09:53:22.2716791Z  'range_flattens': [None, False],
2026-02-21T09:53:22.2717057Z  'range_multi_buffers': [None, False],
2026-02-21T09:53:22.2717374Z  'range_num_stages': [0, 0],
2026-02-21T09:53:22.2717613Z  'range_unroll_factors': [0, 2],
2026-02-21T09:53:22.2717865Z  'range_warp_specializes': []}
2026-02-21T09:53:22.2749136Z [302s] Fitting surrogate: 559 points, 559 targets
2026-02-21T09:53:23.5996970Z [304s] Generation 6 starting: 81 neighbors, 5 active search path(s)
2026-02-21T09:53:50.6100114Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 2.5 configs/s
2026-02-21T09:53:55.6911840Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 16.5 configs/s
2026-02-21T09:54:05.3238454Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 104.8         
2026-02-21T09:54:05.3238956Z                                                                   configs/s     
2026-02-21T09:54:05.9375098Z [346s] Generation 6 complete: 
2026-02-21T09:54:05.9375533Z ok=86
2026-02-21T09:54:05.9375806Z min=0.0556
2026-02-21T09:54:05.9376116Z mid=0.0751
2026-02-21T09:54:05.9376384Z max=0.1907
2026-02-21T09:54:05.9376685Z best={'block_sizes': [1, 16384],
2026-02-21T09:54:05.9377300Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:54:05.9377953Z  'load_eviction_policies': ['', 'first'],
2026-02-21T09:54:05.9379055Z  'num_stages': 2,
2026-02-21T09:54:05.9379369Z  'num_warps': 4,
2026-02-21T09:54:05.9379693Z  'pid_type': 'flat',
2026-02-21T09:54:05.9380044Z  'range_flattens': [None, False],
2026-02-21T09:54:05.9380477Z  'range_multi_buffers': [None, False],
2026-02-21T09:54:05.9380954Z  'range_num_stages': [0, 0],
2026-02-21T09:54:05.9381425Z  'range_unroll_factors': [0, 2],
2026-02-21T09:54:05.9381829Z  'range_warp_specializes': []}
2026-02-21T09:54:05.9413874Z [346s] Fitting surrogate: 645 points, 645 targets
2026-02-21T09:54:07.2861710Z [347s] Generation 7 starting: 83 neighbors, 5 active search path(s)
2026-02-21T09:54:33.9419633Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 3.6 configs/s
2026-02-21T09:54:39.2028036Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 16.3 configs/s
2026-02-21T09:54:49.0862087Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.1         
2026-02-21T09:54:49.0862578Z                                                                   configs/s     
2026-02-21T09:54:49.7278002Z [390s] Generation 7 complete: 
2026-02-21T09:54:49.7278471Z ok=88
2026-02-21T09:54:49.7278760Z min=0.0530
2026-02-21T09:54:49.7279050Z mid=0.0705
2026-02-21T09:54:49.7279313Z max=0.4045
2026-02-21T09:54:49.7279614Z best={'block_sizes': [1, 16384],
2026-02-21T09:54:49.7280195Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:54:49.7280853Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:54:49.7281348Z  'num_stages': 2,
2026-02-21T09:54:49.7281746Z  'num_warps': 4,
2026-02-21T09:54:49.7282128Z  'pid_type': 'flat',
2026-02-21T09:54:49.7282369Z  'range_flattens': [None, False],
2026-02-21T09:54:49.7282636Z  'range_multi_buffers': [None, False],
2026-02-21T09:54:49.7282898Z  'range_num_stages': [0, 0],
2026-02-21T09:54:49.7283146Z  'range_unroll_factors': [0, 2],
2026-02-21T09:54:49.7283386Z  'range_warp_specializes': []}
2026-02-21T09:54:49.7318672Z [390s] Fitting surrogate: 733 points, 733 targets
2026-02-21T09:54:51.0525514Z [391s] Generation 8 starting: 81 neighbors, 5 active search path(s)
2026-02-21T09:55:20.7281531Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 2.0 configs/s
2026-02-21T09:55:25.7750852Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 16.4 configs/s
2026-02-21T09:55:35.8886224Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 99.9 configs/s
2026-02-21T09:55:36.5615723Z [437s] Generation 8 complete: 
2026-02-21T09:55:36.5615994Z error=1
2026-02-21T09:55:36.5616174Z ok=85
2026-02-21T09:55:36.5616343Z min=0.0533
2026-02-21T09:55:36.5616512Z mid=0.0648
2026-02-21T09:55:36.5616683Z max=0.2593
2026-02-21T09:55:36.5616861Z best={'block_sizes': [1, 16384],
2026-02-21T09:55:36.5617221Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:55:36.5617646Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:55:36.5617932Z  'num_stages': 2,
2026-02-21T09:55:36.5618130Z  'num_warps': 4,
2026-02-21T09:55:36.5618318Z  'pid_type': 'flat',
2026-02-21T09:55:36.5618955Z  'range_flattens': [None, False],
2026-02-21T09:55:36.5619217Z  'range_multi_buffers': [None, False],
2026-02-21T09:55:36.5619490Z  'range_num_stages': [0, 0],
2026-02-21T09:55:36.5619735Z  'range_unroll_factors': [0, 2],
2026-02-21T09:55:36.5619989Z  'range_warp_specializes': []}
2026-02-21T09:55:36.5660672Z [437s] Fitting surrogate: 819 points, 819 targets
2026-02-21T09:55:37.7224836Z [438s] Generation 9 starting: 68 neighbors, 5 active search path(s)
2026-02-21T09:56:00.8968545Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69/69 3.6 configs/s
2026-02-21T09:56:05.2775968Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 69/69 15.9 configs/s
2026-02-21T09:56:13.9219223Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.7         
2026-02-21T09:56:13.9224790Z                                                                   configs/s     
2026-02-21T09:56:14.5027201Z [475s] Generation 9 complete: 
2026-02-21T09:56:14.5027486Z ok=73
2026-02-21T09:56:14.5027664Z min=0.0533
2026-02-21T09:56:14.5027848Z mid=0.0608
2026-02-21T09:56:14.5028021Z max=0.8168
2026-02-21T09:56:14.5028209Z best={'block_sizes': [1, 16384],
2026-02-21T09:56:14.5028551Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:56:14.5028950Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:56:14.5029230Z  'num_stages': 2,
2026-02-21T09:56:14.5029427Z  'num_warps': 4,
2026-02-21T09:56:14.5029616Z  'pid_type': 'flat',
2026-02-21T09:56:14.5029832Z  'range_flattens': [None, None],
2026-02-21T09:56:14.5030085Z  'range_multi_buffers': [None, False],
2026-02-21T09:56:14.5030365Z  'range_num_stages': [0, 0],
2026-02-21T09:56:14.5030626Z  'range_unroll_factors': [0, 1],
2026-02-21T09:56:14.5030872Z  'range_warp_specializes': []}
2026-02-21T09:56:14.5073855Z [475s] Fitting surrogate: 892 points, 892 targets
2026-02-21T09:56:15.5082933Z [476s] Generation 10 starting: 61 neighbors, 5 active search path(s)
2026-02-21T09:56:35.9010822Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 9.8 configs/s
2026-02-21T09:56:39.8946227Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 65/65 16.5 configs/s
2026-02-21T09:56:48.4911816Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 117.4         
2026-02-21T09:56:48.4912336Z                                                                   configs/s     
2026-02-21T09:56:49.0828947Z [509s] Generation 10 complete: 
2026-02-21T09:56:49.0829222Z ok=67
2026-02-21T09:56:49.0829395Z min=0.0532
2026-02-21T09:56:49.0829578Z mid=0.0564
2026-02-21T09:56:49.0829746Z max=0.3138
2026-02-21T09:56:49.0829940Z best={'block_sizes': [1, 16384],
2026-02-21T09:56:49.0830305Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T09:56:49.0830754Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:56:49.0831038Z  'num_stages': 2,
2026-02-21T09:56:49.0831237Z  'num_warps': 8,
2026-02-21T09:56:49.0831451Z  'pid_type': 'flat',
2026-02-21T09:56:49.0831703Z  'range_flattens': [None, None],
2026-02-21T09:56:49.0831993Z  'range_multi_buffers': [None, False],
2026-02-21T09:56:49.0832270Z  'range_num_stages': [0, 1],
2026-02-21T09:56:49.0832514Z  'range_unroll_factors': [0, 1],
2026-02-21T09:56:49.0832773Z  'range_warp_specializes': []}
2026-02-21T09:56:49.0877733Z [509s] Fitting surrogate: 959 points, 959 targets
2026-02-21T09:56:50.0698176Z [510s] Generation 11 starting: 61 neighbors, 5 active search path(s)
2026-02-21T09:57:12.1476522Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 1.5 configs/s
2026-02-21T09:57:15.9210770Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 61/61 16.3 configs/s
2026-02-21T09:57:25.0068808Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 111.1         
2026-02-21T09:57:25.0071212Z                                                                   configs/s     
2026-02-21T09:57:25.6374496Z [546s] Generation 11 complete: 
2026-02-21T09:57:25.6374958Z ok=66
2026-02-21T09:57:25.6375966Z min=0.0532
2026-02-21T09:57:25.6376259Z mid=0.0535
2026-02-21T09:57:25.6376529Z max=0.2626
2026-02-21T09:57:25.6376817Z best={'block_sizes': [1, 16384],
2026-02-21T09:57:25.6377335Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:57:25.6377946Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:57:25.6378408Z  'num_stages': 6,
2026-02-21T09:57:25.6378724Z  'num_warps': 8,
2026-02-21T09:57:25.6379032Z  'pid_type': 'flat',
2026-02-21T09:57:25.6379415Z  'range_flattens': [None, False],
2026-02-21T09:57:25.6379932Z  'range_multi_buffers': [None, False],
2026-02-21T09:57:25.6380461Z  'range_num_stages': [0, 0],
2026-02-21T09:57:25.6380818Z  'range_unroll_factors': [0, 2],
2026-02-21T09:57:25.6381075Z  'range_warp_specializes': []}
2026-02-21T09:57:25.6425176Z [546s] Fitting surrogate: 1025 points, 1025 targets
2026-02-21T09:57:26.4979323Z [547s] Generation 12 starting: 46 neighbors, 4 active search path(s)
2026-02-21T09:57:42.1359861Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 9.1 configs/s
2026-02-21T09:57:45.1363657Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 49/49 16.6 configs/s
2026-02-21T09:57:52.3107127Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 140.6         
2026-02-21T09:57:52.3107617Z                                                                   configs/s     
2026-02-21T09:57:52.8091175Z [573s] Generation 12 complete: 
2026-02-21T09:57:52.8091633Z ok=51
2026-02-21T09:57:52.8091918Z min=0.0566
2026-02-21T09:57:52.8092215Z mid=0.0574
2026-02-21T09:57:52.8092485Z max=0.3091
2026-02-21T09:57:52.8092793Z best={'block_sizes': [1, 16384],
2026-02-21T09:57:52.8093274Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:57:52.8093809Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:57:52.8094752Z  'num_stages': 8,
2026-02-21T09:57:52.8095079Z  'num_warps': 8,
2026-02-21T09:57:52.8095411Z  'pid_type': 'flat',
2026-02-21T09:57:52.8095765Z  'range_flattens': [None, None],
2026-02-21T09:57:52.8096204Z  'range_multi_buffers': [None, None],
2026-02-21T09:57:52.8096629Z  'range_num_stages': [0, 0],
2026-02-21T09:57:52.8097011Z  'range_unroll_factors': [0, 1],
2026-02-21T09:57:52.8097405Z  'range_warp_specializes': []}
2026-02-21T09:57:52.8145391Z [573s] Fitting surrogate: 1076 points, 1076 targets
2026-02-21T09:57:53.5352693Z [574s] Generation 13 starting: 37 neighbors, 3 active search path(s)
2026-02-21T09:58:08.1113613Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 1.9 configs/s
2026-02-21T09:58:10.5726497Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 16.5 configs/s
2026-02-21T09:58:16.0614247Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 183.5         
2026-02-21T09:58:16.0614871Z                                                                   configs/s     
2026-02-21T09:58:16.4461435Z [597s] Generation 13 complete: 
2026-02-21T09:58:16.4461693Z ok=41
2026-02-21T09:58:16.4461870Z min=0.0530
2026-02-21T09:58:16.4462046Z mid=0.0606
2026-02-21T09:58:16.4462231Z max=0.1981
2026-02-21T09:58:16.4462422Z best={'block_sizes': [1, 16384],
2026-02-21T09:58:16.4462729Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T09:58:16.4463089Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:58:16.4463362Z  'num_stages': 6,
2026-02-21T09:58:16.4463551Z  'num_warps': 8,
2026-02-21T09:58:16.4463744Z  'pid_type': 'flat',
2026-02-21T09:58:16.4463961Z  'range_flattens': [None, True],
2026-02-21T09:58:16.4464477Z  'range_multi_buffers': [None, True],
2026-02-21T09:58:16.4464734Z  'range_num_stages': [0, 2],
2026-02-21T09:58:16.4464968Z  'range_unroll_factors': [0, 3],
2026-02-21T09:58:16.4465210Z  'range_warp_specializes': []}
2026-02-21T09:58:16.4517794Z [597s] Fitting surrogate: 1117 points, 1117 targets
2026-02-21T09:58:17.1235563Z [597s] Generation 14 starting: 35 neighbors, 3 active search path(s)
2026-02-21T09:58:28.8357047Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 3.6 configs/s
2026-02-21T09:58:30.9810327Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.6 configs/s
2026-02-21T09:58:36.1186565Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 196.1         
2026-02-21T09:58:36.1187064Z                                                                   configs/s     
2026-02-21T09:58:36.4820146Z [617s] Generation 14 complete: 
2026-02-21T09:58:36.4820401Z ok=38
2026-02-21T09:58:36.4820566Z min=0.0567
2026-02-21T09:58:36.4820744Z mid=0.0572
2026-02-21T09:58:36.4820906Z max=0.1815
2026-02-21T09:58:36.4821089Z best={'block_sizes': [1, 16384],
2026-02-21T09:58:36.4821368Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:58:36.4821698Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:58:36.4821978Z  'num_stages': 2,
2026-02-21T09:58:36.4822739Z  'num_warps': 8,
2026-02-21T09:58:36.4822944Z  'pid_type': 'flat',
2026-02-21T09:58:36.4823154Z  'range_flattens': [None, True],
2026-02-21T09:58:36.4823412Z  'range_multi_buffers': [None, False],
2026-02-21T09:58:36.4823692Z  'range_num_stages': [0, 4],
2026-02-21T09:58:36.4823925Z  'range_unroll_factors': [0, 2],
2026-02-21T09:58:36.4824424Z  'range_warp_specializes': []}
2026-02-21T09:58:36.4872057Z [617s] Fitting surrogate: 1155 points, 1155 targets
2026-02-21T09:58:37.1459413Z [617s] Generation 15 starting: 34 neighbors, 3 active search path(s)
2026-02-21T09:58:49.8903302Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 2.4 configs/s
2026-02-21T09:58:52.1642153Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.6 configs/s
2026-02-21T09:58:57.8688004Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 229.6         
2026-02-21T09:58:57.8690208Z                                                                   configs/s     
2026-02-21T09:58:58.1832103Z [638s] Generation 15 complete: 
2026-02-21T09:58:58.1832542Z ok=38
2026-02-21T09:58:58.1832819Z min=0.0531
2026-02-21T09:58:58.1833084Z mid=0.0571
2026-02-21T09:58:58.1833349Z max=0.1313
2026-02-21T09:58:58.1833662Z best={'block_sizes': [1, 16384],
2026-02-21T09:58:58.1834575Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T09:58:58.1835147Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:58:58.1835625Z  'num_stages': 8,
2026-02-21T09:58:58.1835945Z  'num_warps': 8,
2026-02-21T09:58:58.1836275Z  'pid_type': 'flat',
2026-02-21T09:58:58.1836627Z  'range_flattens': [None, None],
2026-02-21T09:58:58.1837055Z  'range_multi_buffers': [None, False],
2026-02-21T09:58:58.1837500Z  'range_num_stages': [0, 1],
2026-02-21T09:58:58.1837880Z  'range_unroll_factors': [0, 2],
2026-02-21T09:58:58.1838283Z  'range_warp_specializes': []}
2026-02-21T09:58:58.1878179Z [638s] Fitting surrogate: 1193 points, 1193 targets
2026-02-21T09:58:58.8112035Z [639s] Generation 16 starting: 34 neighbors, 3 active search path(s)
2026-02-21T09:59:10.2950142Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 4.4 configs/s
2026-02-21T09:59:12.4815318Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 36/36 16.8 configs/s
2026-02-21T09:59:17.7203449Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 192.2         
2026-02-21T09:59:17.7204184Z                                                                   configs/s     
2026-02-21T09:59:18.0898985Z [658s] Generation 16 complete: 
2026-02-21T09:59:18.0899296Z ok=37
2026-02-21T09:59:18.0899501Z min=0.0568
2026-02-21T09:59:18.0899703Z mid=0.0573
2026-02-21T09:59:18.0899909Z max=0.1128
2026-02-21T09:59:18.0900136Z best={'block_sizes': [1, 16384],
2026-02-21T09:59:18.0900547Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:59:18.0901007Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:59:18.0901352Z  'num_stages': 8,
2026-02-21T09:59:18.0901594Z  'num_warps': 8,
2026-02-21T09:59:18.0901822Z  'pid_type': 'flat',
2026-02-21T09:59:18.0902821Z  'range_flattens': [None, None],
2026-02-21T09:59:18.0903161Z  'range_multi_buffers': [None, False],
2026-02-21T09:59:18.0903502Z  'range_num_stages': [0, 1],
2026-02-21T09:59:18.0903812Z  'range_unroll_factors': [0, 2],
2026-02-21T09:59:18.0904450Z  'range_warp_specializes': []}
2026-02-21T09:59:18.0958411Z [658s] Fitting surrogate: 1230 points, 1230 targets
2026-02-21T09:59:18.7867161Z [659s] Generation 17 starting: 35 neighbors, 3 active search path(s)
2026-02-21T09:59:35.6817390Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 0.8 configs/s
2026-02-21T09:59:38.0313748Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 38/38 16.5 configs/s
2026-02-21T09:59:42.6269007Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 218.8         
2026-02-21T09:59:42.6272376Z                                                                   configs/s     
2026-02-21T09:59:42.9512523Z [683s] Generation 17 complete: 
2026-02-21T09:59:42.9512808Z ok=39
2026-02-21T09:59:42.9513023Z min=0.0570
2026-02-21T09:59:42.9513207Z mid=0.0586
2026-02-21T09:59:42.9513371Z max=1.3343
2026-02-21T09:59:42.9513563Z best={'block_sizes': [1, 16384],
2026-02-21T09:59:42.9513935Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T09:59:42.9514633Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T09:59:42.9514932Z  'num_stages': 8,
2026-02-21T09:59:42.9515126Z  'num_warps': 8,
2026-02-21T09:59:42.9515331Z  'pid_type': 'flat',
2026-02-21T09:59:42.9515543Z  'range_flattens': [None, None],
2026-02-21T09:59:42.9515814Z  'range_multi_buffers': [None, False],
2026-02-21T09:59:42.9516084Z  'range_num_stages': [0, 1],
2026-02-21T09:59:42.9516329Z  'range_unroll_factors': [0, 2],
2026-02-21T09:59:42.9516588Z  'range_warp_specializes': []}
2026-02-21T09:59:42.9568964Z [683s] Fitting surrogate: 1269 points, 1269 targets
2026-02-21T09:59:43.5876012Z [684s] Generation 18 starting: 36 neighbors, 3 active search path(s)
2026-02-21T09:59:57.0551244Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 2.5 configs/s
2026-02-21T09:59:59.4561492Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 39/39 16.5 configs/s
2026-02-21T10:00:04.2282943Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 210.7         
2026-02-21T10:00:04.2289372Z                                                                   configs/s     
2026-02-21T10:00:04.5615361Z [705s] Generation 18 complete: 
2026-02-21T10:00:04.5615816Z ok=40
2026-02-21T10:00:04.5616147Z min=0.0570
2026-02-21T10:00:04.5616429Z mid=0.0614
2026-02-21T10:00:04.5616706Z max=1.3343
2026-02-21T10:00:04.5617000Z best={'block_sizes': [1, 16384],
2026-02-21T10:00:04.5617512Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T10:00:04.5618062Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:00:04.5620206Z  'num_stages': 2,
2026-02-21T10:00:04.5620659Z  'num_warps': 8,
2026-02-21T10:00:04.5621092Z  'pid_type': 'flat',
2026-02-21T10:00:04.5621519Z  'range_flattens': [None, True],
2026-02-21T10:00:04.5621781Z  'range_multi_buffers': [None, None],
2026-02-21T10:00:04.5622046Z  'range_num_stages': [0, 4],
2026-02-21T10:00:04.5622275Z  'range_unroll_factors': [0, 2],
2026-02-21T10:00:04.5622973Z  'range_warp_specializes': []}
2026-02-21T10:00:04.5675544Z [705s] Fitting surrogate: 1309 points, 1309 targets
2026-02-21T10:00:04.8966615Z [705s] Generation 19 starting: 11 neighbors, 1 active search path(s)
2026-02-21T10:00:11.3702662Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 1.5 configs/s
2026-02-21T10:00:12.1146341Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.1 configs/s
2026-02-21T10:00:13.4310666Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 749.4         
2026-02-21T10:00:13.4311128Z                                                                   configs/s     
2026-02-21T10:00:13.5487047Z [714s] Generation 19 complete: 
2026-02-21T10:00:13.5487293Z ok=13
2026-02-21T10:00:13.5487440Z min=0.0570
2026-02-21T10:00:13.5488180Z mid=0.0662
2026-02-21T10:00:13.5488345Z max=0.2891
2026-02-21T10:00:13.5488513Z best={'block_sizes': [1, 16384],
2026-02-21T10:00:13.5488764Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T10:00:13.5489073Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:00:13.5489314Z  'num_stages': 2,
2026-02-21T10:00:13.5489486Z  'num_warps': 8,
2026-02-21T10:00:13.5489650Z  'pid_type': 'flat',
2026-02-21T10:00:13.5489933Z  'range_flattens': [None, True],
2026-02-21T10:00:13.5490157Z  'range_multi_buffers': [None, None],
2026-02-21T10:00:13.5490379Z  'range_num_stages': [0, 4],
2026-02-21T10:00:13.5490581Z  'range_unroll_factors': [0, 2],
2026-02-21T10:00:13.5490789Z  'range_warp_specializes': []}
2026-02-21T10:00:13.5541628Z [714s] Fitting surrogate: 1322 points, 1322 targets
2026-02-21T10:00:13.7311788Z [714s] Autotuning complete in 714.4s after searching 1270 configs.
2026-02-21T10:00:13.7312233Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:00:13.7313613Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 4], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T10:00:13.7315174Z 
2026-02-21T10:00:13.7315565Z [714s] Code of selected kernel: /tmp/torchinductor_root/bq/cbq2sxbpjr5at6zhcfwh2nkjo2yxj34dussej5w6s2ofgsfkuc6y.py
2026-02-21T10:00:14.7085764Z WARNING:tritonbench.utils.triton_op:Completed input ID 66:
2026-02-21T10:00:14.7086379Z (M, N)
2026-02-21T10:00:14.7086656Z ------------
2026-02-21T10:00:14.7086960Z (4096, 8704)
2026-02-21T10:00:14.7087135Z 
2026-02-21T10:00:14.7111129Z  70%|███████   | 14/20 [1:41:44<53:37, 536.28s/it]WARNING:tritonbench.utils.triton_op:Running input ID 71:
2026-02-21T10:00:14.7111887Z (M, N)
2026-02-21T10:00:14.7112153Z ------------
2026-02-21T10:00:14.7112465Z (4096, 9344)
2026-02-21T10:00:14.7117018Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T10:00:16.1707145Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T10:00:17.7462631Z INFO:tritonbench.utils.triton_op:Took 3.43ms to get benchmark function for torch_compile_softmax
2026-02-21T10:00:22.3910793Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:00:22.3911134Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:00:22.3911398Z               'dtype': 'torch.float16',
2026-02-21T10:00:22.3911679Z               'shape': (4096, 9344),
2026-02-21T10:00:22.3911924Z               'stride': (9344, 1)},),
2026-02-21T10:00:22.3912169Z   'kwargs': {}}
2026-02-21T10:00:22.3965366Z INFO:tritonbench.utils.triton_op:Took 5.74ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T10:00:22.6933923Z [0s] Autotune random seed: 2135383793
2026-02-21T10:00:22.8769415Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:00:59.5614951Z [36s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T10:01:00.4066549Z [37s] Timeout after 30s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:01:03.0078885Z [40s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T10:01:12.3791110Z [49s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T10:01:18.3192817Z [55s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T10:01:19.7585578Z [56s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T10:01:20.9668455Z [58s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:01:20.9691081Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T10:01:29.3786361Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 11.9 configs/s
2026-02-21T10:01:29.3799973Z [66s] Adaptive compile timeout: 30s (90% percentile=28.9s, bounds=[30.0s, 30s])
2026-02-21T10:01:30.4860558Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 877.3 configs/s
2026-02-21T10:01:30.5869831Z [67s] Initial random population of 100, 5 starting points: 
2026-02-21T10:01:30.5870166Z error=3
2026-02-21T10:01:30.5870374Z timeout=7
2026-02-21T10:01:30.5870575Z ok=90
2026-02-21T10:01:30.5870775Z min=0.0866
2026-02-21T10:01:30.5870975Z mid=0.7359
2026-02-21T10:01:30.5871185Z max=189.8069
2026-02-21T10:01:30.5871417Z best={'block_sizes': [1, 2048],
2026-02-21T10:01:30.5871886Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:01:30.5872328Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:01:30.5872657Z  'maxnreg': 256,
2026-02-21T10:01:30.5872888Z  'num_sm_multiplier': 16,
2026-02-21T10:01:30.5873170Z  'num_stages': 5,
2026-02-21T10:01:30.5873381Z  'num_warps': 4,
2026-02-21T10:01:30.5873629Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:01:30.5873959Z  'range_flattens': [None, None],
2026-02-21T10:01:30.5875194Z  'range_multi_buffers': [False, False],
2026-02-21T10:01:30.5875539Z  'range_num_stages': [1, 1],
2026-02-21T10:01:30.5875791Z  'range_unroll_factors': [1, 1],
2026-02-21T10:01:30.5876059Z  'range_warp_specializes': []}
2026-02-21T10:01:30.5890729Z [67s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:01:32.0518875Z [69s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T10:02:05.1025173Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 2.1 configs/s
2026-02-21T10:02:10.9522176Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.4 configs/s
2026-02-21T10:02:24.2697995Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 84.3 configs/s
2026-02-21T10:02:24.9325272Z [122s] Generation 1 complete: 
2026-02-21T10:02:24.9326354Z ok=96
2026-02-21T10:02:24.9326661Z min=0.0820
2026-02-21T10:02:24.9326949Z mid=0.1020
2026-02-21T10:02:24.9327216Z max=0.7199
2026-02-21T10:02:24.9327520Z best={'block_sizes': [1, 2048],
2026-02-21T10:02:24.9328132Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:02:24.9328850Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:02:24.9329235Z  'maxnreg': 32,
2026-02-21T10:02:24.9329413Z  'num_sm_multiplier': 64,
2026-02-21T10:02:24.9329603Z  'num_stages': 4,
2026-02-21T10:02:24.9329839Z  'num_warps': 4,
2026-02-21T10:02:24.9330035Z  'pid_type': 'persistent_blocked',
2026-02-21T10:02:24.9330266Z  'range_flattens': [True, True],
2026-02-21T10:02:24.9330491Z  'range_multi_buffers': [None, None],
2026-02-21T10:02:24.9330719Z  'range_num_stages': [4, 2],
2026-02-21T10:02:24.9330929Z  'range_unroll_factors': [0, 1],
2026-02-21T10:02:24.9331148Z  'range_warp_specializes': []}
2026-02-21T10:02:24.9345441Z [122s] Fitting surrogate: 196 points, 196 targets
2026-02-21T10:02:26.2400279Z [123s] Generation 2 starting: 84 neighbors, 5 active search path(s)
2026-02-21T10:02:59.1219121Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 0.7 configs/s
2026-02-21T10:03:04.4576065Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 16.4 configs/s
2026-02-21T10:03:18.6558545Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 71.0 configs/s
2026-02-21T10:03:19.4544522Z [176s] Generation 2 complete: 
2026-02-21T10:03:19.4545802Z ok=90
2026-02-21T10:03:19.4545990Z min=0.0764
2026-02-21T10:03:19.4546190Z mid=0.0877
2026-02-21T10:03:19.4546495Z max=0.7080
2026-02-21T10:03:19.4546865Z best={'block_sizes': [2, 4096],
2026-02-21T10:03:19.4547504Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:03:19.4548208Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:03:19.4548663Z  'num_stages': 2,
2026-02-21T10:03:19.4548984Z  'num_warps': 4,
2026-02-21T10:03:19.4549296Z  'pid_type': 'flat',
2026-02-21T10:03:19.4549692Z  'range_flattens': [None, False],
2026-02-21T10:03:19.4550117Z  'range_multi_buffers': [None, False],
2026-02-21T10:03:19.4550544Z  'range_num_stages': [0, 0],
2026-02-21T10:03:19.4550959Z  'range_unroll_factors': [0, 1],
2026-02-21T10:03:19.4551357Z  'range_warp_specializes': []}
2026-02-21T10:03:19.4571123Z [176s] Fitting surrogate: 286 points, 286 targets
2026-02-21T10:03:20.7355508Z [177s] Generation 3 starting: 81 neighbors, 5 active search path(s)
2026-02-21T10:03:48.7115332Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 4.7 configs/s
2026-02-21T10:03:53.8222105Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 16.4 configs/s
2026-02-21T10:04:07.3167765Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 74.8 configs/s
2026-02-21T10:04:08.1004475Z [225s] Generation 3 complete: 
2026-02-21T10:04:08.1004991Z ok=86
2026-02-21T10:04:08.1005345Z min=0.0727
2026-02-21T10:04:08.1005693Z mid=0.0829
2026-02-21T10:04:08.1006039Z max=0.2770
2026-02-21T10:04:08.1006472Z best={'block_sizes': [1, 2048],
2026-02-21T10:04:08.1007250Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:04:08.1008150Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:04:08.1009796Z  'num_stages': 2,
2026-02-21T10:04:08.1010229Z  'num_warps': 4,
2026-02-21T10:04:08.1010647Z  'pid_type': 'flat',
2026-02-21T10:04:08.1011144Z  'range_flattens': [None, False],
2026-02-21T10:04:08.1011517Z  'range_multi_buffers': [None, False],
2026-02-21T10:04:08.1011823Z  'range_num_stages': [0, 0],
2026-02-21T10:04:08.1012091Z  'range_unroll_factors': [0, 1],
2026-02-21T10:04:08.1012388Z  'range_warp_specializes': []}
2026-02-21T10:04:08.1035843Z [225s] Fitting surrogate: 372 points, 372 targets
2026-02-21T10:04:09.3191928Z [226s] Generation 4 starting: 70 neighbors, 5 active search path(s)
2026-02-21T10:04:33.2475102Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70/70 5.8 configs/s
2026-02-21T10:04:38.7990381Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 70/70 12.7 configs/s
2026-02-21T10:04:49.1502388Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 97.4 configs/s
2026-02-21T10:04:49.7685944Z [266s] Generation 4 complete: 
2026-02-21T10:04:49.7686398Z ok=75
2026-02-21T10:04:49.7686696Z min=0.0708
2026-02-21T10:04:49.7686972Z mid=0.0827
2026-02-21T10:04:49.7687242Z max=0.5602
2026-02-21T10:04:49.7687534Z best={'block_sizes': [1, 2048],
2026-02-21T10:04:49.7688112Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:04:49.7688764Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:04:49.7689269Z  'num_sm_multiplier': 64,
2026-02-21T10:04:49.7689754Z  'num_stages': 2,
2026-02-21T10:04:49.7689926Z  'num_warps': 4,
2026-02-21T10:04:49.7690105Z  'pid_type': 'persistent_blocked',
2026-02-21T10:04:49.7690349Z  'range_flattens': [True, False],
2026-02-21T10:04:49.7690574Z  'range_multi_buffers': [True, False],
2026-02-21T10:04:49.7690807Z  'range_num_stages': [1, 0],
2026-02-21T10:04:49.7691035Z  'range_unroll_factors': [2, 1],
2026-02-21T10:04:49.7691250Z  'range_warp_specializes': []}
2026-02-21T10:04:49.7717374Z [266s] Fitting surrogate: 447 points, 447 targets
2026-02-21T10:04:51.0268994Z [268s] Generation 5 starting: 69 neighbors, 5 active search path(s)
2026-02-21T10:05:16.5788243Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 2.5 configs/s
2026-02-21T10:05:20.9787829Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 16.5 configs/s
2026-02-21T10:05:31.4135927Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 96.6 configs/s
2026-02-21T10:05:32.0366919Z [309s] Generation 5 complete: 
2026-02-21T10:05:32.0367251Z ok=74
2026-02-21T10:05:32.0367434Z min=0.0707
2026-02-21T10:05:32.0367623Z mid=0.0804
2026-02-21T10:05:32.0367798Z max=0.4104
2026-02-21T10:05:32.0367987Z best={'block_sizes': [1, 2048],
2026-02-21T10:05:32.0368370Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:05:32.0368816Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:05:32.0369121Z  'num_sm_multiplier': 32,
2026-02-21T10:05:32.0369353Z  'num_stages': 2,
2026-02-21T10:05:32.0369558Z  'num_warps': 4,
2026-02-21T10:05:32.0370625Z  'pid_type': 'persistent_blocked',
2026-02-21T10:05:32.0370910Z  'range_flattens': [True, True],
2026-02-21T10:05:32.0371169Z  'range_multi_buffers': [True, False],
2026-02-21T10:05:32.0371442Z  'range_num_stages': [1, 0],
2026-02-21T10:05:32.0371680Z  'range_unroll_factors': [2, 1],
2026-02-21T10:05:32.0371921Z  'range_warp_specializes': []}
2026-02-21T10:05:32.0403115Z [309s] Fitting surrogate: 521 points, 521 targets
2026-02-21T10:05:33.4424974Z [310s] Generation 6 starting: 87 neighbors, 5 active search path(s)
2026-02-21T10:06:04.4000702Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 6.9 configs/s
2026-02-21T10:06:09.9829855Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 16.2 configs/s
2026-02-21T10:06:20.0501758Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 100.1         
2026-02-21T10:06:20.0502432Z                                                                   configs/s     
2026-02-21T10:06:20.6594507Z [357s] Generation 6 complete: 
2026-02-21T10:06:20.6594897Z ok=92
2026-02-21T10:06:20.6595081Z min=0.0594
2026-02-21T10:06:20.6595268Z mid=0.0860
2026-02-21T10:06:20.6595450Z max=0.5954
2026-02-21T10:06:20.6595649Z best={'block_sizes': [1, 16384],
2026-02-21T10:06:20.6596018Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:06:20.6596427Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:06:20.6596727Z  'num_stages': 8,
2026-02-21T10:06:20.6596951Z  'num_warps': 8,
2026-02-21T10:06:20.6597162Z  'pid_type': 'flat',
2026-02-21T10:06:20.6597384Z  'range_flattens': [None, True],
2026-02-21T10:06:20.6597650Z  'range_multi_buffers': [None, True],
2026-02-21T10:06:20.6597916Z  'range_num_stages': [0, 2],
2026-02-21T10:06:20.6598161Z  'range_unroll_factors': [0, 1],
2026-02-21T10:06:20.6598434Z  'range_warp_specializes': []}
2026-02-21T10:06:20.6632506Z [357s] Fitting surrogate: 613 points, 613 targets
2026-02-21T10:06:21.9364490Z [359s] Generation 7 starting: 78 neighbors, 5 active search path(s)
2026-02-21T10:06:49.8948596Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 4.8 configs/s
2026-02-21T10:06:56.0973730Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 13.0 configs/s
2026-02-21T10:07:05.3398793Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 109.1         
2026-02-21T10:07:05.3399412Z                                                                   configs/s     
2026-02-21T10:07:05.9094424Z [403s] Generation 7 complete: 
2026-02-21T10:07:05.9094698Z error=3
2026-02-21T10:07:05.9094869Z ok=80
2026-02-21T10:07:05.9095031Z min=0.0594
2026-02-21T10:07:05.9095207Z mid=0.0847
2026-02-21T10:07:05.9095370Z max=0.2915
2026-02-21T10:07:05.9095555Z best={'block_sizes': [1, 16384],
2026-02-21T10:07:05.9095937Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:07:05.9096335Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:07:05.9096612Z  'num_stages': 8,
2026-02-21T10:07:05.9096809Z  'num_warps': 8,
2026-02-21T10:07:05.9097032Z  'pid_type': 'flat',
2026-02-21T10:07:05.9097239Z  'range_flattens': [None, True],
2026-02-21T10:07:05.9097493Z  'range_multi_buffers': [None, True],
2026-02-21T10:07:05.9097746Z  'range_num_stages': [0, 1],
2026-02-21T10:07:05.9097979Z  'range_unroll_factors': [0, 1],
2026-02-21T10:07:05.9098218Z  'range_warp_specializes': []}
2026-02-21T10:07:05.9130506Z [403s] Fitting surrogate: 696 points, 696 targets
2026-02-21T10:07:06.9604203Z [404s] Generation 8 starting: 55 neighbors, 3 active search path(s)
2026-02-21T10:07:35.2763395Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 0.8 configs/s
2026-02-21T10:07:38.8255865Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 16.5 configs/s
2026-02-21T10:07:45.4407352Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 152.2         
2026-02-21T10:07:45.4407862Z                                                                   configs/s     
2026-02-21T10:07:45.8546164Z [442s] Generation 8 complete: 
2026-02-21T10:07:45.8546746Z error=1
2026-02-21T10:07:45.8546918Z ok=58
2026-02-21T10:07:45.8547075Z min=0.0594
2026-02-21T10:07:45.8547245Z mid=0.0839
2026-02-21T10:07:45.8547405Z max=0.3012
2026-02-21T10:07:45.8558838Z best={'block_sizes': [1, 16384],
2026-02-21T10:07:45.8559217Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:07:45.8559603Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:07:45.8559870Z  'num_stages': 8,
2026-02-21T10:07:45.8560056Z  'num_warps': 8,
2026-02-21T10:07:45.8560235Z  'pid_type': 'flat',
2026-02-21T10:07:45.8560447Z  'range_flattens': [None, True],
2026-02-21T10:07:45.8560690Z  'range_multi_buffers': [None, None],
2026-02-21T10:07:45.8560930Z  'range_num_stages': [0, 1],
2026-02-21T10:07:45.8561464Z  'range_unroll_factors': [0, 1],
2026-02-21T10:07:45.8561713Z  'range_warp_specializes': []}
2026-02-21T10:07:45.8589852Z [442s] Fitting surrogate: 755 points, 755 targets
2026-02-21T10:07:46.7437242Z [443s] Generation 9 starting: 42 neighbors, 2 active search path(s)
2026-02-21T10:08:05.2076875Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 1.4 configs/s
2026-02-21T10:08:07.8702081Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 16.4 configs/s
2026-02-21T10:08:13.1100987Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 191.8         
2026-02-21T10:08:13.1103009Z                                                                   configs/s     
2026-02-21T10:08:13.4481500Z [470s] Generation 9 complete: 
2026-02-21T10:08:13.4481840Z ok=45
2026-02-21T10:08:13.4482063Z min=0.0595
2026-02-21T10:08:13.4482294Z mid=0.0787
2026-02-21T10:08:13.4482512Z max=0.4452
2026-02-21T10:08:13.4482777Z best={'block_sizes': [1, 16384],
2026-02-21T10:08:13.4483304Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:08:13.4483869Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:08:13.4484431Z  'num_stages': 8,
2026-02-21T10:08:13.4484697Z  'num_warps': 8,
2026-02-21T10:08:13.4484994Z  'pid_type': 'flat',
2026-02-21T10:08:13.4485300Z  'range_flattens': [None, True],
2026-02-21T10:08:13.4485683Z  'range_multi_buffers': [None, None],
2026-02-21T10:08:13.4486044Z  'range_num_stages': [0, 1],
2026-02-21T10:08:13.4486384Z  'range_unroll_factors': [0, 1],
2026-02-21T10:08:13.4486752Z  'range_warp_specializes': []}
2026-02-21T10:08:13.4533443Z [470s] Fitting surrogate: 800 points, 800 targets
2026-02-21T10:08:13.8415306Z [470s] Generation 10 starting: 16 neighbors, 1 active search path(s)
2026-02-21T10:08:20.2116331Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 2.5 configs/s
2026-02-21T10:08:21.1980148Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 16/16 17.0 configs/s
2026-02-21T10:08:23.3404832Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 464.9         
2026-02-21T10:08:23.3405284Z                                                                   configs/s     
2026-02-21T10:08:23.5065534Z [480s] Generation 10 complete: 
2026-02-21T10:08:23.5065875Z ok=18
2026-02-21T10:08:23.5066075Z min=0.0594
2026-02-21T10:08:23.5066290Z mid=0.0709
2026-02-21T10:08:23.5066488Z max=0.2601
2026-02-21T10:08:23.5066721Z best={'block_sizes': [1, 16384],
2026-02-21T10:08:23.5067201Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:08:23.5067738Z  'load_eviction_policies': ['last', ''],
2026-02-21T10:08:23.5068068Z  'num_stages': 4,
2026-02-21T10:08:23.5068299Z  'num_warps': 8,
2026-02-21T10:08:23.5068548Z  'pid_type': 'flat',
2026-02-21T10:08:23.5068820Z  'range_flattens': [None, None],
2026-02-21T10:08:23.5069153Z  'range_multi_buffers': [None, None],
2026-02-21T10:08:23.5069479Z  'range_num_stages': [0, 1],
2026-02-21T10:08:23.5069767Z  'range_unroll_factors': [0, 2],
2026-02-21T10:08:23.5070079Z  'range_warp_specializes': []}
2026-02-21T10:08:23.5105980Z [480s] Fitting surrogate: 818 points, 818 targets
2026-02-21T10:08:23.7804448Z [480s] Generation 11 starting: 9 neighbors, 1 active search path(s)
2026-02-21T10:08:27.9765613Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 3.0 configs/s
2026-02-21T10:08:28.5333100Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 17.6 configs/s
2026-02-21T10:08:30.0455834Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 654.2         
2026-02-21T10:08:30.0456340Z                                                                   configs/s     
2026-02-21T10:08:30.1746784Z [487s] Generation 11 complete: 
2026-02-21T10:08:30.1747046Z ok=10
2026-02-21T10:08:30.1747227Z min=0.0592
2026-02-21T10:08:30.1747403Z mid=0.0656
2026-02-21T10:08:30.1747566Z max=0.0752
2026-02-21T10:08:30.1747753Z best={'block_sizes': [1, 16384],
2026-02-21T10:08:30.1748565Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:08:30.1749001Z  'load_eviction_policies': ['last', ''],
2026-02-21T10:08:30.1749269Z  'num_stages': 4,
2026-02-21T10:08:30.1749458Z  'num_warps': 8,
2026-02-21T10:08:30.1749673Z  'pid_type': 'flat',
2026-02-21T10:08:30.1749885Z  'range_flattens': [None, None],
2026-02-21T10:08:30.1750160Z  'range_multi_buffers': [None, None],
2026-02-21T10:08:30.1750431Z  'range_num_stages': [0, 1],
2026-02-21T10:08:30.1750666Z  'range_unroll_factors': [0, 2],
2026-02-21T10:08:30.1750908Z  'range_warp_specializes': []}
2026-02-21T10:08:30.1785800Z [487s] Fitting surrogate: 828 points, 828 targets
2026-02-21T10:08:30.4467027Z [487s] Generation 12 starting: 7 neighbors, 1 active search path(s)
2026-02-21T10:08:34.5416657Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7/7 1.2 configs/s
2026-02-21T10:08:34.9748593Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 7/7 18.1 configs/s
2026-02-21T10:08:36.0070191Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 949.0         
2026-02-21T10:08:36.0070785Z                                                                   configs/s     
2026-02-21T10:08:36.1076906Z [493s] Generation 12 complete: 
2026-02-21T10:08:36.1077405Z ok=8
2026-02-21T10:08:36.1077683Z min=0.0593
2026-02-21T10:08:36.1077970Z mid=0.0653
2026-02-21T10:08:36.1078263Z max=0.0927
2026-02-21T10:08:36.1078563Z best={'block_sizes': [1, 16384],
2026-02-21T10:08:36.1079196Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:08:36.1079889Z  'load_eviction_policies': ['last', ''],
2026-02-21T10:08:36.1080346Z  'num_stages': 4,
2026-02-21T10:08:36.1080678Z  'num_warps': 8,
2026-02-21T10:08:36.1080992Z  'pid_type': 'flat',
2026-02-21T10:08:36.1081352Z  'range_flattens': [None, None],
2026-02-21T10:08:36.1081780Z  'range_multi_buffers': [None, None],
2026-02-21T10:08:36.1082223Z  'range_num_stages': [0, 1],
2026-02-21T10:08:36.1082601Z  'range_unroll_factors': [0, 2],
2026-02-21T10:08:36.1083021Z  'range_warp_specializes': []}
2026-02-21T10:08:36.1115942Z [493s] Fitting surrogate: 836 points, 836 targets
2026-02-21T10:08:36.2821689Z [493s] Autotuning complete in 493.4s after searching 803 configs.
2026-02-21T10:08:36.2822547Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:08:36.2824261Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', ''], num_stages=4, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T10:08:36.2825689Z 
2026-02-21T10:08:36.2826116Z [493s] Code of selected kernel: /tmp/torchinductor_root/jo/cjopanbdynp3hpjhetsk7psquhcgykqeuaifv3w26tcl6quks3zo.py
2026-02-21T10:08:37.2972794Z WARNING:tritonbench.utils.triton_op:Completed input ID 71:
2026-02-21T10:08:37.2973389Z (M, N)
2026-02-21T10:08:37.2973677Z ------------
2026-02-21T10:08:37.2974899Z (4096, 9344)
2026-02-21T10:08:37.2975170Z 
2026-02-21T10:08:37.2996754Z  75%|███████▌  | 15/20 [1:50:07<43:50, 526.12s/it]WARNING:tritonbench.utils.triton_op:Running input ID 77:
2026-02-21T10:08:37.2997228Z (M, N)
2026-02-21T10:08:37.2999716Z -------------
2026-02-21T10:08:37.3000033Z (4096, 10112)
2026-02-21T10:08:37.3000635Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T10:08:38.7513358Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T10:08:40.3130517Z INFO:tritonbench.utils.triton_op:Took 3.42ms to get benchmark function for torch_compile_softmax
2026-02-21T10:08:46.1388593Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:08:46.1389162Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:08:46.1389610Z               'dtype': 'torch.float16',
2026-02-21T10:08:46.1390064Z               'shape': (4096, 10112),
2026-02-21T10:08:46.1390516Z               'stride': (10112, 1)},),
2026-02-21T10:08:46.1390906Z   'kwargs': {}}
2026-02-21T10:08:46.1460636Z INFO:tritonbench.utils.triton_op:Took 7.75ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T10:08:46.4340151Z [0s] Autotune random seed: 2135383793
2026-02-21T10:08:46.6195312Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:09:23.7105032Z [37s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T10:09:24.5666840Z [37s] Timeout after 30s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:09:25.2278389Z [38s] Timeout after 30s compiling Config(block_sizes=[4, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T10:09:27.4449409Z [40s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T10:09:37.7038381Z [51s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T10:09:44.2377059Z [57s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T10:09:45.7800830Z [59s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T10:09:47.0746980Z [60s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:09:47.0767121Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T10:09:55.6824532Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 11.6 configs/s
2026-02-21T10:09:55.6838755Z [69s] Adaptive compile timeout: 30s (90% percentile=30.0s, bounds=[30.0s, 30s])
2026-02-21T10:09:56.8321453Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 845.3 configs/s
2026-02-21T10:09:56.9358399Z [70s] Initial random population of 100, 5 starting points: 
2026-02-21T10:09:56.9361925Z error=3
2026-02-21T10:09:56.9362397Z timeout=8
2026-02-21T10:09:56.9362748Z ok=89
2026-02-21T10:09:56.9363078Z min=0.0908
2026-02-21T10:09:56.9363437Z mid=0.7205
2026-02-21T10:09:56.9363802Z max=207.6707
2026-02-21T10:09:56.9364506Z best={'block_sizes': [1, 2048],
2026-02-21T10:09:56.9364945Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:09:56.9365398Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:09:56.9365721Z  'maxnreg': 256,
2026-02-21T10:09:56.9365950Z  'num_sm_multiplier': 16,
2026-02-21T10:09:56.9366203Z  'num_stages': 5,
2026-02-21T10:09:56.9366412Z  'num_warps': 4,
2026-02-21T10:09:56.9366672Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:09:56.9367012Z  'range_flattens': [None, None],
2026-02-21T10:09:56.9367319Z  'range_multi_buffers': [False, False],
2026-02-21T10:09:56.9367637Z  'range_num_stages': [1, 1],
2026-02-21T10:09:56.9367912Z  'range_unroll_factors': [1, 1],
2026-02-21T10:09:56.9368205Z  'range_warp_specializes': []}
2026-02-21T10:09:56.9378577Z [70s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:09:58.3901044Z [71s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T10:10:32.9221251Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 5.2 configs/s
2026-02-21T10:10:38.5922219Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.3 configs/s
2026-02-21T10:10:51.6315697Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 77.2 configs/s
2026-02-21T10:10:52.3340473Z [125s] Generation 1 complete: 
2026-02-21T10:10:52.3340908Z ok=95
2026-02-21T10:10:52.3341213Z min=0.0848
2026-02-21T10:10:52.3341492Z mid=0.1055
2026-02-21T10:10:52.3341761Z max=0.8217
2026-02-21T10:10:52.3342096Z best={'block_sizes': [1, 4096],
2026-02-21T10:10:52.3342784Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:10:52.3343193Z  'load_eviction_policies': ['', 'last'],
2026-02-21T10:10:52.3343450Z  'maxnreg': 32,
2026-02-21T10:10:52.3343643Z  'num_sm_multiplier': 64,
2026-02-21T10:10:52.3344521Z  'num_stages': 4,
2026-02-21T10:10:52.3344708Z  'num_warps': 8,
2026-02-21T10:10:52.3344919Z  'pid_type': 'persistent_blocked',
2026-02-21T10:10:52.3345175Z  'range_flattens': [True, False],
2026-02-21T10:10:52.3345432Z  'range_multi_buffers': [None, None],
2026-02-21T10:10:52.3345693Z  'range_num_stages': [4, 1],
2026-02-21T10:10:52.3345924Z  'range_unroll_factors': [0, 1],
2026-02-21T10:10:52.3346172Z  'range_warp_specializes': []}
2026-02-21T10:10:52.3367084Z [125s] Fitting surrogate: 195 points, 195 targets
2026-02-21T10:10:53.5481176Z [126s] Generation 2 starting: 76 neighbors, 5 active search path(s)
2026-02-21T10:11:22.1606911Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79/79 5.5 configs/s
2026-02-21T10:11:26.9961980Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 79/79 16.5 configs/s
2026-02-21T10:11:39.4823434Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 80.7 configs/s
2026-02-21T10:11:40.1817473Z [173s] Generation 2 complete: 
2026-02-21T10:11:40.1817759Z ok=82
2026-02-21T10:11:40.1817932Z min=0.0804
2026-02-21T10:11:40.1818103Z mid=0.0922
2026-02-21T10:11:40.1818273Z max=0.8970
2026-02-21T10:11:40.1818451Z best={'block_sizes': [1, 2048],
2026-02-21T10:11:40.1818831Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:11:40.1819264Z  'load_eviction_policies': ['last', ''],
2026-02-21T10:11:40.1819527Z  'num_stages': 2,
2026-02-21T10:11:40.1819723Z  'num_warps': 2,
2026-02-21T10:11:40.1819914Z  'pid_type': 'flat',
2026-02-21T10:11:40.1820131Z  'range_flattens': [None, True],
2026-02-21T10:11:40.1820381Z  'range_multi_buffers': [None, False],
2026-02-21T10:11:40.1820654Z  'range_num_stages': [0, 3],
2026-02-21T10:11:40.1820887Z  'range_unroll_factors': [0, 2],
2026-02-21T10:11:40.1821149Z  'range_warp_specializes': []}
2026-02-21T10:11:40.1846960Z [173s] Fitting surrogate: 277 points, 277 targets
2026-02-21T10:11:41.2949118Z [174s] Generation 3 starting: 71 neighbors, 5 active search path(s)
2026-02-21T10:12:10.9598533Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73/73 1.3 configs/s
2026-02-21T10:12:15.4683889Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 73/73 16.3 configs/s
2026-02-21T10:12:26.4848322Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 91.5 configs/s
2026-02-21T10:12:27.1301821Z [220s] Generation 3 complete: 
2026-02-21T10:12:27.1302072Z ok=77
2026-02-21T10:12:27.1302242Z min=0.0684
2026-02-21T10:12:27.1302416Z mid=0.0871
2026-02-21T10:12:27.1302578Z max=0.3405
2026-02-21T10:12:27.1302762Z best={'block_sizes': [1, 4096],
2026-02-21T10:12:27.1303125Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:12:27.1303547Z  'load_eviction_policies': ['last', ''],
2026-02-21T10:12:27.1303805Z  'num_stages': 2,
2026-02-21T10:12:27.1304291Z  'num_warps': 4,
2026-02-21T10:12:27.1304494Z  'pid_type': 'flat',
2026-02-21T10:12:27.1304711Z  'range_flattens': [None, True],
2026-02-21T10:12:27.1304967Z  'range_multi_buffers': [None, True],
2026-02-21T10:12:27.1305354Z  'range_num_stages': [0, 3],
2026-02-21T10:12:27.1305609Z  'range_unroll_factors': [0, 2],
2026-02-21T10:12:27.1305856Z  'range_warp_specializes': []}
2026-02-21T10:12:27.1329316Z [220s] Fitting surrogate: 354 points, 354 targets
2026-02-21T10:12:28.1453734Z [221s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T10:12:54.9355035Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 2.7 configs/s
2026-02-21T10:13:00.3546019Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.3 configs/s
2026-02-21T10:13:10.4587919Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 99.7 configs/s
2026-02-21T10:13:11.0768915Z [264s] Generation 4 complete: 
2026-02-21T10:13:11.0769337Z ok=70
2026-02-21T10:13:11.0769669Z min=0.0636
2026-02-21T10:13:11.0770076Z mid=0.0776
2026-02-21T10:13:11.0770354Z max=0.2765
2026-02-21T10:13:11.0770647Z best={'block_sizes': [1, 16384],
2026-02-21T10:13:11.0771867Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:13:11.0772537Z  'load_eviction_policies': ['last', ''],
2026-02-21T10:13:11.0772970Z  'num_stages': 2,
2026-02-21T10:13:11.0773276Z  'num_warps': 8,
2026-02-21T10:13:11.0773610Z  'pid_type': 'flat',
2026-02-21T10:13:11.0774270Z  'range_flattens': [None, True],
2026-02-21T10:13:11.0774694Z  'range_multi_buffers': [None, True],
2026-02-21T10:13:11.0775124Z  'range_num_stages': [0, 3],
2026-02-21T10:13:11.0775505Z  'range_unroll_factors': [0, 2],
2026-02-21T10:13:11.0775892Z  'range_warp_specializes': []}
2026-02-21T10:13:11.0793833Z [264s] Fitting surrogate: 424 points, 424 targets
2026-02-21T10:13:12.1360034Z [265s] Generation 5 starting: 67 neighbors, 5 active search path(s)
2026-02-21T10:13:37.8717777Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 4.7 configs/s
2026-02-21T10:13:42.2307254Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 16.4 configs/s
2026-02-21T10:13:53.5845904Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.9 configs/s
2026-02-21T10:13:54.2981056Z [307s] Generation 5 complete: 
2026-02-21T10:13:54.2981322Z ok=73
2026-02-21T10:13:54.2981492Z min=0.0618
2026-02-21T10:13:54.2981671Z mid=0.0697
2026-02-21T10:13:54.2981842Z max=0.3116
2026-02-21T10:13:54.2982022Z best={'block_sizes': [1, 16384],
2026-02-21T10:13:54.2982343Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:13:54.2982705Z  'load_eviction_policies': ['', 'first'],
2026-02-21T10:13:54.2982983Z  'num_stages': 1,
2026-02-21T10:13:54.2983173Z  'num_warps': 8,
2026-02-21T10:13:54.2983367Z  'pid_type': 'flat',
2026-02-21T10:13:54.2983587Z  'range_flattens': [None, False],
2026-02-21T10:13:54.2983851Z  'range_multi_buffers': [None, True],
2026-02-21T10:13:54.2984288Z  'range_num_stages': [0, 0],
2026-02-21T10:13:54.2984532Z  'range_unroll_factors': [0, 2],
2026-02-21T10:13:54.2984780Z  'range_warp_specializes': []}
2026-02-21T10:13:54.3015080Z [307s] Fitting surrogate: 497 points, 497 targets
2026-02-21T10:13:55.2358569Z [308s] Generation 6 starting: 58 neighbors, 5 active search path(s)
2026-02-21T10:14:17.3645766Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 4.4 configs/s
2026-02-21T10:14:21.0397985Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.5 configs/s
2026-02-21T10:14:30.4791534Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.9         
2026-02-21T10:14:30.4792055Z                                                                   configs/s     
2026-02-21T10:14:31.0813847Z [344s] Generation 6 complete: 
2026-02-21T10:14:31.0814565Z ok=64
2026-02-21T10:14:31.0814916Z min=0.0621
2026-02-21T10:14:31.0815200Z mid=0.0659
2026-02-21T10:14:31.0815371Z max=0.3169
2026-02-21T10:14:31.0815571Z best={'block_sizes': [1, 16384],
2026-02-21T10:14:31.0815916Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:14:31.0816286Z  'load_eviction_policies': ['', 'first'],
2026-02-21T10:14:31.0816569Z  'num_stages': 1,
2026-02-21T10:14:31.0816754Z  'num_warps': 8,
2026-02-21T10:14:31.0816955Z  'pid_type': 'flat',
2026-02-21T10:14:31.0817166Z  'range_flattens': [None, False],
2026-02-21T10:14:31.0817423Z  'range_multi_buffers': [None, True],
2026-02-21T10:14:31.0817679Z  'range_num_stages': [0, 0],
2026-02-21T10:14:31.0817916Z  'range_unroll_factors': [0, 2],
2026-02-21T10:14:31.0818161Z  'range_warp_specializes': []}
2026-02-21T10:14:31.0849154Z [344s] Fitting surrogate: 561 points, 561 targets
2026-02-21T10:14:31.9042361Z [345s] Generation 7 starting: 49 neighbors, 5 active search path(s)
2026-02-21T10:14:49.8888111Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 10.3 configs/s
2026-02-21T10:14:52.9559996Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 16.5 configs/s
2026-02-21T10:15:02.3878811Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.5         
2026-02-21T10:15:02.3883512Z                                                                   configs/s     
2026-02-21T10:15:02.9123375Z [376s] Generation 7 complete: 
2026-02-21T10:15:02.9123656Z ok=54
2026-02-21T10:15:02.9123838Z min=0.0611
2026-02-21T10:15:02.9124386Z mid=0.0646
2026-02-21T10:15:02.9124568Z max=0.0948
2026-02-21T10:15:02.9124757Z best={'block_sizes': [1, 16384],
2026-02-21T10:15:02.9125120Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:15:02.9125535Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:15:02.9125826Z  'num_stages': 1,
2026-02-21T10:15:02.9126021Z  'num_warps': 8,
2026-02-21T10:15:02.9126240Z  'pid_type': 'flat',
2026-02-21T10:15:02.9126480Z  'range_flattens': [None, False],
2026-02-21T10:15:02.9126768Z  'range_multi_buffers': [None, True],
2026-02-21T10:15:02.9127002Z  'range_num_stages': [0, 0],
2026-02-21T10:15:02.9127552Z  'range_unroll_factors': [0, 2],
2026-02-21T10:15:02.9127789Z  'range_warp_specializes': []}
2026-02-21T10:15:02.9156099Z [376s] Fitting surrogate: 615 points, 615 targets
2026-02-21T10:15:03.5582656Z [376s] Generation 8 starting: 36 neighbors, 3 active search path(s)
2026-02-21T10:15:17.7515830Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 2.2 configs/s
2026-02-21T10:15:19.9555682Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 16.7 configs/s
2026-02-21T10:15:25.8343701Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 171.3         
2026-02-21T10:15:25.8344959Z                                                                   configs/s     
2026-02-21T10:15:26.2279240Z [399s] Generation 8 complete: 
2026-02-21T10:15:26.2279674Z ok=39
2026-02-21T10:15:26.2279994Z min=0.0605
2026-02-21T10:15:26.2280312Z mid=0.0636
2026-02-21T10:15:26.2280576Z max=0.3186
2026-02-21T10:15:26.2280883Z best={'block_sizes': [1, 16384],
2026-02-21T10:15:26.2281450Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:15:26.2282084Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:15:26.2282547Z  'num_stages': 3,
2026-02-21T10:15:26.2282899Z  'num_warps': 8,
2026-02-21T10:15:26.2283227Z  'pid_type': 'flat',
2026-02-21T10:15:26.2283607Z  'range_flattens': [None, None],
2026-02-21T10:15:26.2284327Z  'range_multi_buffers': [None, True],
2026-02-21T10:15:26.2284576Z  'range_num_stages': [0, 1],
2026-02-21T10:15:26.2284786Z  'range_unroll_factors': [0, 2],
2026-02-21T10:15:26.2285000Z  'range_warp_specializes': []}
2026-02-21T10:15:26.2320575Z [399s] Fitting surrogate: 654 points, 654 targets
2026-02-21T10:15:26.9300868Z [400s] Generation 9 starting: 41 neighbors, 3 active search path(s)
2026-02-21T10:15:42.0265970Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 5.6 configs/s
2026-02-21T10:15:44.5319253Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 41/41 16.6 configs/s
2026-02-21T10:15:50.6356698Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 165.1         
2026-02-21T10:15:50.6357966Z                                                                   configs/s     
2026-02-21T10:15:51.0482381Z [424s] Generation 9 complete: 
2026-02-21T10:15:51.0485780Z ok=44
2026-02-21T10:15:51.0486121Z min=0.0602
2026-02-21T10:15:51.0486424Z mid=0.0622
2026-02-21T10:15:51.0486691Z max=1.3575
2026-02-21T10:15:51.0486979Z best={'block_sizes': [1, 16384],
2026-02-21T10:15:51.0487496Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:15:51.0488062Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:15:51.0488509Z  'num_stages': 3,
2026-02-21T10:15:51.0488801Z  'num_warps': 8,
2026-02-21T10:15:51.0489104Z  'pid_type': 'flat',
2026-02-21T10:15:51.0489466Z  'range_flattens': [None, None],
2026-02-21T10:15:51.0489877Z  'range_multi_buffers': [None, True],
2026-02-21T10:15:51.0490443Z  'range_num_stages': [0, 1],
2026-02-21T10:15:51.0490815Z  'range_unroll_factors': [0, 2],
2026-02-21T10:15:51.0491587Z  'range_warp_specializes': []}
2026-02-21T10:15:51.0520628Z [424s] Fitting surrogate: 698 points, 698 targets
2026-02-21T10:15:51.4721403Z [424s] Generation 10 starting: 19 neighbors, 2 active search path(s)
2026-02-21T10:15:59.6399875Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 2.9 configs/s
2026-02-21T10:16:00.7993962Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 17.0 configs/s
2026-02-21T10:16:03.8369731Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 329.5         
2026-02-21T10:16:03.8370292Z                                                                   configs/s     
2026-02-21T10:16:04.0572652Z [437s] Generation 10 complete: 
2026-02-21T10:16:04.0572923Z ok=21
2026-02-21T10:16:04.0573106Z min=0.0608
2026-02-21T10:16:04.0573280Z mid=0.0623
2026-02-21T10:16:04.0573449Z max=0.0915
2026-02-21T10:16:04.0573675Z best={'block_sizes': [1, 16384],
2026-02-21T10:16:04.0574266Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:16:04.0574679Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:16:04.0574967Z  'num_stages': 3,
2026-02-21T10:16:04.0575173Z  'num_warps': 8,
2026-02-21T10:16:04.0575387Z  'pid_type': 'flat',
2026-02-21T10:16:04.0575610Z  'range_flattens': [None, False],
2026-02-21T10:16:04.0575869Z  'range_multi_buffers': [None, True],
2026-02-21T10:16:04.0576146Z  'range_num_stages': [0, 1],
2026-02-21T10:16:04.0576390Z  'range_unroll_factors': [0, 1],
2026-02-21T10:16:04.0576652Z  'range_warp_specializes': []}
2026-02-21T10:16:04.0607589Z [437s] Fitting surrogate: 719 points, 719 targets
2026-02-21T10:16:04.5352157Z [437s] Generation 11 starting: 23 neighbors, 2 active search path(s)
2026-02-21T10:16:15.7201669Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 1.1 configs/s
2026-02-21T10:16:17.1518180Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.6 configs/s
2026-02-21T10:16:20.7885258Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 275.7         
2026-02-21T10:16:20.7885790Z                                                                   configs/s     
2026-02-21T10:16:21.0469840Z [454s] Generation 11 complete: 
2026-02-21T10:16:21.0470169Z ok=25
2026-02-21T10:16:21.0470363Z min=0.0605
2026-02-21T10:16:21.0470573Z mid=0.0620
2026-02-21T10:16:21.0470770Z max=1.3578
2026-02-21T10:16:21.0470999Z best={'block_sizes': [1, 16384],
2026-02-21T10:16:21.0471558Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:16:21.0472482Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:16:21.0473099Z  'num_stages': 3,
2026-02-21T10:16:21.0473504Z  'num_warps': 8,
2026-02-21T10:16:21.0473927Z  'pid_type': 'flat',
2026-02-21T10:16:21.0474881Z  'range_flattens': [None, False],
2026-02-21T10:16:21.0475470Z  'range_multi_buffers': [None, None],
2026-02-21T10:16:21.0476048Z  'range_num_stages': [0, 2],
2026-02-21T10:16:21.0476585Z  'range_unroll_factors': [0, 1],
2026-02-21T10:16:21.0477142Z  'range_warp_specializes': []}
2026-02-21T10:16:21.0507241Z [454s] Fitting surrogate: 744 points, 744 targets
2026-02-21T10:16:21.3762042Z [454s] Generation 12 starting: 13 neighbors, 1 active search path(s)
2026-02-21T10:16:27.4235168Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 2.4 configs/s
2026-02-21T10:16:28.2302541Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.0 configs/s
2026-02-21T10:16:30.3758386Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 464.0         
2026-02-21T10:16:30.3758939Z                                                                   configs/s     
2026-02-21T10:16:30.5405272Z [463s] Generation 12 complete: 
2026-02-21T10:16:30.5405552Z ok=14
2026-02-21T10:16:30.5405734Z min=0.0645
2026-02-21T10:16:30.5405938Z mid=0.0650
2026-02-21T10:16:30.5406119Z max=0.0827
2026-02-21T10:16:30.5406333Z best={'block_sizes': [1, 16384],
2026-02-21T10:16:30.5406710Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:16:30.5407643Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:16:30.5408001Z  'num_stages': 3,
2026-02-21T10:16:30.5408216Z  'num_warps': 8,
2026-02-21T10:16:30.5408437Z  'pid_type': 'flat',
2026-02-21T10:16:30.5408701Z  'range_flattens': [None, False],
2026-02-21T10:16:30.5409005Z  'range_multi_buffers': [None, True],
2026-02-21T10:16:30.5409302Z  'range_num_stages': [0, 3],
2026-02-21T10:16:30.5409579Z  'range_unroll_factors': [0, 1],
2026-02-21T10:16:30.5409865Z  'range_warp_specializes': []}
2026-02-21T10:16:30.5441188Z [463s] Fitting surrogate: 758 points, 758 targets
2026-02-21T10:16:30.8598673Z [464s] Generation 13 starting: 13 neighbors, 1 active search path(s)
2026-02-21T10:16:36.6622846Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 4.6 configs/s
2026-02-21T10:16:37.5250402Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 17.1 configs/s
2026-02-21T10:16:39.4666992Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 512.6         
2026-02-21T10:16:39.4667636Z                                                                   configs/s     
2026-02-21T10:16:39.6211930Z [473s] Generation 13 complete: 
2026-02-21T10:16:39.6212239Z ok=15
2026-02-21T10:16:39.6212468Z min=0.0608
2026-02-21T10:16:39.6212669Z mid=0.0621
2026-02-21T10:16:39.6212872Z max=0.4261
2026-02-21T10:16:39.6213097Z best={'block_sizes': [1, 16384],
2026-02-21T10:16:39.6213451Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T10:16:39.6213854Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:16:39.6214474Z  'num_stages': 3,
2026-02-21T10:16:39.6214708Z  'num_warps': 8,
2026-02-21T10:16:39.6214947Z  'pid_type': 'flat',
2026-02-21T10:16:39.6215229Z  'range_flattens': [None, False],
2026-02-21T10:16:39.6215554Z  'range_multi_buffers': [None, True],
2026-02-21T10:16:39.6215884Z  'range_num_stages': [0, 3],
2026-02-21T10:16:39.6216189Z  'range_unroll_factors': [0, 1],
2026-02-21T10:16:39.6216504Z  'range_warp_specializes': []}
2026-02-21T10:16:39.6248990Z [473s] Fitting surrogate: 773 points, 773 targets
2026-02-21T10:16:39.9486149Z [473s] Generation 14 starting: 13 neighbors, 1 active search path(s)
2026-02-21T10:16:45.2808726Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 5.3 configs/s
2026-02-21T10:16:46.0743708Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.4 configs/s
2026-02-21T10:16:48.0352347Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 507.0         
2026-02-21T10:16:48.0352851Z                                                                   configs/s     
2026-02-21T10:16:48.1907810Z [481s] Generation 14 complete: 
2026-02-21T10:16:48.1908082Z ok=14
2026-02-21T10:16:48.1908252Z min=0.0645
2026-02-21T10:16:48.1908435Z mid=0.0648
2026-02-21T10:16:48.1908599Z max=0.1046
2026-02-21T10:16:48.1908790Z best={'block_sizes': [1, 16384],
2026-02-21T10:16:48.1909087Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T10:16:48.1909413Z  'load_eviction_policies': ['', 'first'],
2026-02-21T10:16:48.1909691Z  'num_stages': 3,
2026-02-21T10:16:48.1909916Z  'num_warps': 8,
2026-02-21T10:16:48.1910157Z  'pid_type': 'flat',
2026-02-21T10:16:48.1910520Z  'range_flattens': [None, False],
2026-02-21T10:16:48.1910955Z  'range_multi_buffers': [None, True],
2026-02-21T10:16:48.1912040Z  'range_num_stages': [0, 3],
2026-02-21T10:16:48.1912431Z  'range_unroll_factors': [0, 2],
2026-02-21T10:16:48.1912826Z  'range_warp_specializes': []}
2026-02-21T10:16:48.1945025Z [481s] Fitting surrogate: 787 points, 787 targets
2026-02-21T10:16:48.5124885Z [481s] Generation 15 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:16:53.9698138Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 4.5 configs/s
2026-02-21T10:16:54.7658041Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.3 configs/s
2026-02-21T10:16:56.7320172Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 505.6         
2026-02-21T10:16:56.7320795Z                                                                   configs/s     
2026-02-21T10:16:56.8877122Z [490s] Generation 15 complete: 
2026-02-21T10:16:56.8877465Z ok=14
2026-02-21T10:16:56.8877684Z min=0.0599
2026-02-21T10:16:56.8877916Z mid=0.0652
2026-02-21T10:16:56.8878155Z max=0.1008
2026-02-21T10:16:56.8878421Z best={'block_sizes': [1, 16384],
2026-02-21T10:16:56.8878821Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T10:16:56.8879252Z  'load_eviction_policies': ['', ''],
2026-02-21T10:16:56.8879598Z  'num_stages': 3,
2026-02-21T10:16:56.8879854Z  'num_warps': 8,
2026-02-21T10:16:56.8880122Z  'pid_type': 'flat',
2026-02-21T10:16:56.8880422Z  'range_flattens': [None, False],
2026-02-21T10:16:56.8880804Z  'range_multi_buffers': [None, True],
2026-02-21T10:16:56.8881167Z  'range_num_stages': [0, 3],
2026-02-21T10:16:56.8881506Z  'range_unroll_factors': [0, 2],
2026-02-21T10:16:56.8881856Z  'range_warp_specializes': []}
2026-02-21T10:16:56.8915056Z [490s] Fitting surrogate: 801 points, 801 targets
2026-02-21T10:16:57.2059818Z [490s] Generation 16 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:17:02.3130751Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.9 configs/s
2026-02-21T10:17:03.0458022Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.5 configs/s
2026-02-21T10:17:05.0035923Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 508.0         
2026-02-21T10:17:05.0036512Z                                                                   configs/s     
2026-02-21T10:17:05.1589595Z [498s] Generation 16 complete: 
2026-02-21T10:17:05.1589902Z ok=13
2026-02-21T10:17:05.1590091Z min=0.0630
2026-02-21T10:17:05.1590298Z mid=0.0634
2026-02-21T10:17:05.1590492Z max=0.0825
2026-02-21T10:17:05.1590721Z best={'block_sizes': [1, 16384],
2026-02-21T10:17:05.1591111Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:17:05.1591534Z  'load_eviction_policies': ['', ''],
2026-02-21T10:17:05.1591846Z  'num_stages': 2,
2026-02-21T10:17:05.1592187Z  'num_warps': 8,
2026-02-21T10:17:05.1592701Z  'pid_type': 'flat',
2026-02-21T10:17:05.1593200Z  'range_flattens': [None, False],
2026-02-21T10:17:05.1593777Z  'range_multi_buffers': [None, True],
2026-02-21T10:17:05.1594943Z  'range_num_stages': [0, 3],
2026-02-21T10:17:05.1596242Z  'range_unroll_factors': [0, 2],
2026-02-21T10:17:05.1596805Z  'range_warp_specializes': []}
2026-02-21T10:17:05.1627913Z [498s] Fitting surrogate: 814 points, 814 targets
2026-02-21T10:17:05.4824442Z [498s] Generation 17 starting: 13 neighbors, 1 active search path(s)
2026-02-21T10:17:11.3643732Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 5.6 configs/s
2026-02-21T10:17:12.2323208Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 17.0 configs/s
2026-02-21T10:17:14.3996918Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 459.2         
2026-02-21T10:17:14.3997434Z                                                                   configs/s     
2026-02-21T10:17:14.5668206Z [507s] Generation 17 complete: 
2026-02-21T10:17:14.5669016Z ok=15
2026-02-21T10:17:14.5669224Z min=0.0596
2026-02-21T10:17:14.5669433Z mid=0.0668
2026-02-21T10:17:14.5669626Z max=0.1605
2026-02-21T10:17:14.5669850Z best={'block_sizes': [1, 16384],
2026-02-21T10:17:14.5670251Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:17:14.5670675Z  'load_eviction_policies': ['', ''],
2026-02-21T10:17:14.5670979Z  'num_stages': 2,
2026-02-21T10:17:14.5671206Z  'num_warps': 8,
2026-02-21T10:17:14.5671429Z  'pid_type': 'flat',
2026-02-21T10:17:14.5671689Z  'range_flattens': [None, False],
2026-02-21T10:17:14.5672010Z  'range_multi_buffers': [None, None],
2026-02-21T10:17:14.5672326Z  'range_num_stages': [0, 3],
2026-02-21T10:17:14.5672611Z  'range_unroll_factors': [0, 2],
2026-02-21T10:17:14.5672916Z  'range_warp_specializes': []}
2026-02-21T10:17:14.5707374Z [507s] Fitting surrogate: 829 points, 829 targets
2026-02-21T10:17:14.8723192Z [508s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T10:17:20.2285293Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 0.8 configs/s
2026-02-21T10:17:20.9125209Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.2 configs/s
2026-02-21T10:17:22.3907005Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 669.2         
2026-02-21T10:17:22.3907536Z                                                                   configs/s     
2026-02-21T10:17:22.5178587Z [515s] Generation 18 complete: 
2026-02-21T10:17:22.5178897Z ok=12
2026-02-21T10:17:22.5190512Z min=0.0594
2026-02-21T10:17:22.5190720Z mid=0.0611
2026-02-21T10:17:22.5190924Z max=1.3609
2026-02-21T10:17:22.5191147Z best={'block_sizes': [1, 16384],
2026-02-21T10:17:22.5191538Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:17:22.5191943Z  'load_eviction_policies': ['', ''],
2026-02-21T10:17:22.5192254Z  'num_stages': 2,
2026-02-21T10:17:22.5192477Z  'num_warps': 8,
2026-02-21T10:17:22.5192712Z  'pid_type': 'flat',
2026-02-21T10:17:22.5193003Z  'range_flattens': [None, False],
2026-02-21T10:17:22.5193320Z  'range_multi_buffers': [None, None],
2026-02-21T10:17:22.5193642Z  'range_num_stages': [0, 3],
2026-02-21T10:17:22.5193925Z  'range_unroll_factors': [0, 3],
2026-02-21T10:17:22.5194407Z  'range_warp_specializes': []}
2026-02-21T10:17:22.5218080Z [515s] Fitting surrogate: 841 points, 841 targets
2026-02-21T10:17:22.8355248Z [516s] Generation 19 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:17:30.2999652Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 0.7 configs/s
2026-02-21T10:17:31.0485120Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.0 configs/s
2026-02-21T10:17:32.7398242Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 586.0         
2026-02-21T10:17:32.7398777Z                                                                   configs/s     
2026-02-21T10:17:32.8783831Z [526s] Generation 19 complete: 
2026-02-21T10:17:32.8784409Z ok=13
2026-02-21T10:17:32.8784626Z min=0.0629
2026-02-21T10:17:32.8784850Z mid=0.0645
2026-02-21T10:17:32.8785056Z max=1.6907
2026-02-21T10:17:32.8785283Z best={'block_sizes': [1, 16384],
2026-02-21T10:17:32.8785689Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:17:32.8786495Z  'load_eviction_policies': ['', ''],
2026-02-21T10:17:32.8786814Z  'num_stages': 2,
2026-02-21T10:17:32.8787046Z  'num_warps': 8,
2026-02-21T10:17:32.8787290Z  'pid_type': 'flat',
2026-02-21T10:17:32.8787560Z  'range_flattens': [None, False],
2026-02-21T10:17:32.8787884Z  'range_multi_buffers': [None, None],
2026-02-21T10:17:32.8788215Z  'range_num_stages': [0, 3],
2026-02-21T10:17:32.8788519Z  'range_unroll_factors': [0, 3],
2026-02-21T10:17:32.8788844Z  'range_warp_specializes': []}
2026-02-21T10:17:32.8824321Z [526s] Fitting surrogate: 854 points, 854 targets
2026-02-21T10:17:33.0434283Z [526s] Autotuning complete in 526.4s after searching 805 configs.
2026-02-21T10:17:33.0434848Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:17:33.0436978Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T10:17:33.0438532Z 
2026-02-21T10:17:33.0438997Z [526s] Code of selected kernel: /tmp/torchinductor_root/3i/c3ie5soa4joupp4bsczc3ohgfv2c5jie2j3zn7pumtdujieelup6.py
2026-02-21T10:17:33.9044788Z WARNING:tritonbench.utils.triton_op:Completed input ID 77:
2026-02-21T10:17:33.9045125Z (M, N)
2026-02-21T10:17:33.9045277Z -------------
2026-02-21T10:17:33.9045442Z (4096, 10112)
2026-02-21T10:17:33.9045835Z 
2026-02-21T10:17:33.9067497Z  80%|████████  | 16/20 [1:59:03<35:17, 529.28s/it]WARNING:tritonbench.utils.triton_op:Running input ID 82:
2026-02-21T10:17:33.9067972Z (M, N)
2026-02-21T10:17:33.9068142Z -------------
2026-02-21T10:17:33.9068324Z (4096, 10752)
2026-02-21T10:17:33.9070119Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T10:17:35.3537882Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T10:17:36.9064458Z INFO:tritonbench.utils.triton_op:Took 3.35ms to get benchmark function for torch_compile_softmax
2026-02-21T10:17:43.9052134Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:17:43.9052528Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:17:43.9052812Z               'dtype': 'torch.float16',
2026-02-21T10:17:43.9053108Z               'shape': (4096, 10752),
2026-02-21T10:17:43.9053366Z               'stride': (10752, 1)},),
2026-02-21T10:17:43.9053617Z   'kwargs': {}}
2026-02-21T10:17:43.9076929Z INFO:tritonbench.utils.triton_op:Took 2.84ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T10:17:44.1903165Z [0s] Autotune random seed: 2135383793
2026-02-21T10:17:44.3700315Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:18:21.7647396Z [37s] Timeout after 30s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T10:18:22.6444386Z [38s] Timeout after 30s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:18:23.3245624Z [38s] Timeout after 30s compiling Config(block_sizes=[4, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T10:18:25.6922566Z [41s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T10:18:43.5341708Z [59s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T10:18:45.1799458Z [60s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T10:18:46.5520239Z [62s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:18:46.5543165Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.4 configs/s
2026-02-21T10:18:55.5826953Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 11.1 configs/s
2026-02-21T10:18:55.5840241Z [71s] Adaptive compile timeout: 30s (90% percentile=31.1s, bounds=[30.0s, 30s])
2026-02-21T10:18:57.2503947Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 587.8 configs/s
2026-02-21T10:18:57.3749541Z [73s] Initial random population of 100, 5 starting points: 
2026-02-21T10:18:57.3749960Z error=3
2026-02-21T10:18:57.3750250Z timeout=7
2026-02-21T10:18:57.3750635Z ok=90
2026-02-21T10:18:57.3751022Z min=0.1024
2026-02-21T10:18:57.3751393Z mid=0.8560
2026-02-21T10:18:57.3751744Z max=218.5939
2026-02-21T10:18:57.3752353Z best={'block_sizes': [1, 256],
2026-02-21T10:18:57.3753298Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:18:57.3754821Z  'load_eviction_policies': ['', 'last'],
2026-02-21T10:18:57.3755480Z  'num_stages': 2,
2026-02-21T10:18:57.3755919Z  'num_warps': 1,
2026-02-21T10:18:57.3756399Z  'pid_type': 'flat',
2026-02-21T10:18:57.3756899Z  'range_flattens': [None, True],
2026-02-21T10:18:57.3757477Z  'range_multi_buffers': [None, None],
2026-02-21T10:18:57.3758116Z  'range_num_stages': [0, 3],
2026-02-21T10:18:57.3758647Z  'range_unroll_factors': [0, 2],
2026-02-21T10:18:57.3759221Z  'range_warp_specializes': []}
2026-02-21T10:18:57.3768493Z [73s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:18:58.8222673Z [74s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T10:19:34.9520957Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 1.5 configs/s
2026-02-21T10:19:40.7844822Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.2 configs/s
2026-02-21T10:19:53.2614407Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 80.7 configs/s
2026-02-21T10:19:53.9122260Z [129s] Generation 1 complete: 
2026-02-21T10:19:53.9122688Z ok=95
2026-02-21T10:19:53.9122984Z min=0.0903
2026-02-21T10:19:53.9123267Z mid=0.1147
2026-02-21T10:19:53.9123569Z max=0.8879
2026-02-21T10:19:53.9123873Z best={'block_sizes': [1, 4096],
2026-02-21T10:19:53.9124913Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:19:53.9126204Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:19:53.9126648Z  'maxnreg': 256,
2026-02-21T10:19:53.9126978Z  'num_sm_multiplier': 16,
2026-02-21T10:19:53.9127327Z  'num_stages': 5,
2026-02-21T10:19:53.9127647Z  'num_warps': 4,
2026-02-21T10:19:53.9127997Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:19:53.9128445Z  'range_flattens': [None, False],
2026-02-21T10:19:53.9128863Z  'range_multi_buffers': [False, False],
2026-02-21T10:19:53.9129288Z  'range_num_stages': [1, 2],
2026-02-21T10:19:53.9129687Z  'range_unroll_factors': [1, 1],
2026-02-21T10:19:53.9130228Z  'range_warp_specializes': []}
2026-02-21T10:19:53.9143228Z [129s] Fitting surrogate: 195 points, 195 targets
2026-02-21T10:19:55.2878208Z [130s] Generation 2 starting: 85 neighbors, 5 active search path(s)
2026-02-21T10:20:29.3093948Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 3.3 configs/s
2026-02-21T10:20:35.4998853Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 14.3 configs/s
2026-02-21T10:20:48.9794933Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 74.7 configs/s
2026-02-21T10:20:49.7044355Z [185s] Generation 2 complete: 
2026-02-21T10:20:49.7044893Z ok=91
2026-02-21T10:20:49.7045253Z min=0.0800
2026-02-21T10:20:49.7045627Z mid=0.0989
2026-02-21T10:20:49.7045972Z max=0.4539
2026-02-21T10:20:49.7046364Z best={'block_sizes': [2, 4096],
2026-02-21T10:20:49.7047257Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:20:49.7048235Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:20:49.7048853Z  'num_stages': 1,
2026-02-21T10:20:49.7049081Z  'num_warps': 4,
2026-02-21T10:20:49.7049300Z  'pid_type': 'flat',
2026-02-21T10:20:49.7049548Z  'range_flattens': [None, False],
2026-02-21T10:20:49.7049875Z  'range_multi_buffers': [None, False],
2026-02-21T10:20:49.7050268Z  'range_num_stages': [0, 1],
2026-02-21T10:20:49.7050541Z  'range_unroll_factors': [0, 1],
2026-02-21T10:20:49.7050849Z  'range_warp_specializes': []}
2026-02-21T10:20:49.7068343Z [185s] Fitting surrogate: 286 points, 286 targets
2026-02-21T10:20:51.0476416Z [186s] Generation 3 starting: 84 neighbors, 5 active search path(s)
2026-02-21T10:21:23.5327310Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85/85 2.1 configs/s
2026-02-21T10:21:28.9464920Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 85/85 15.8 configs/s
2026-02-21T10:21:42.1821025Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 85.9 configs/s
2026-02-21T10:21:42.8464307Z [238s] Generation 3 complete: 
2026-02-21T10:21:42.8464600Z ok=89
2026-02-21T10:21:42.8464944Z min=0.0691
2026-02-21T10:21:42.8465219Z mid=0.0966
2026-02-21T10:21:42.8465625Z max=1.1691
2026-02-21T10:21:42.8466157Z best={'block_sizes': [1, 16384],
2026-02-21T10:21:42.8467154Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:21:42.8468139Z  'load_eviction_policies': ['last', ''],
2026-02-21T10:21:42.8468713Z  'num_stages': 2,
2026-02-21T10:21:42.8469169Z  'num_warps': 4,
2026-02-21T10:21:42.8469584Z  'pid_type': 'flat',
2026-02-21T10:21:42.8470075Z  'range_flattens': [None, True],
2026-02-21T10:21:42.8470666Z  'range_multi_buffers': [None, None],
2026-02-21T10:21:42.8471248Z  'range_num_stages': [0, 3],
2026-02-21T10:21:42.8471803Z  'range_unroll_factors': [0, 0],
2026-02-21T10:21:42.8472359Z  'range_warp_specializes': []}
2026-02-21T10:21:42.8494334Z [238s] Fitting surrogate: 375 points, 375 targets
2026-02-21T10:21:44.0638886Z [239s] Generation 4 starting: 76 neighbors, 5 active search path(s)
2026-02-21T10:22:15.4363425Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79/79 1.8 configs/s
2026-02-21T10:22:20.3122784Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 79/79 16.3 configs/s
2026-02-21T10:22:29.2196248Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 113.0         
2026-02-21T10:22:29.2198952Z                                                                   configs/s     
2026-02-21T10:22:29.7465740Z [285s] Generation 4 complete: 
2026-02-21T10:22:29.7466000Z ok=81
2026-02-21T10:22:29.7466166Z min=0.0685
2026-02-21T10:22:29.7466342Z mid=0.0959
2026-02-21T10:22:29.7466504Z max=0.6484
2026-02-21T10:22:29.7466693Z best={'block_sizes': [1, 16384],
2026-02-21T10:22:29.7467079Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:22:29.7467520Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:22:29.7467794Z  'num_stages': 1,
2026-02-21T10:22:29.7468097Z  'num_warps': 4,
2026-02-21T10:22:29.7468503Z  'pid_type': 'flat',
2026-02-21T10:22:29.7468924Z  'range_flattens': [None, True],
2026-02-21T10:22:29.7469375Z  'range_multi_buffers': [None, None],
2026-02-21T10:22:29.7469793Z  'range_num_stages': [0, 3],
2026-02-21T10:22:29.7470696Z  'range_unroll_factors': [0, 0],
2026-02-21T10:22:29.7471144Z  'range_warp_specializes': []}
2026-02-21T10:22:29.7497993Z [285s] Fitting surrogate: 456 points, 456 targets
2026-02-21T10:22:30.8831490Z [286s] Generation 5 starting: 73 neighbors, 5 active search path(s)
2026-02-21T10:23:07.4133383Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 0.7 configs/s
2026-02-21T10:23:12.2546667Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 16.3 configs/s
2026-02-21T10:23:21.5773409Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.1         
2026-02-21T10:23:21.5773855Z                                                                   configs/s     
2026-02-21T10:23:22.1663392Z [337s] Generation 5 complete: 
2026-02-21T10:23:22.1663650Z ok=79
2026-02-21T10:23:22.1663831Z min=0.0652
2026-02-21T10:23:22.1664261Z mid=0.0870
2026-02-21T10:23:22.1664437Z max=0.7944
2026-02-21T10:23:22.1664618Z best={'block_sizes': [1, 16384],
2026-02-21T10:23:22.1665229Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:23:22.1666010Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:23:22.1666515Z  'num_stages': 4,
2026-02-21T10:23:22.1666875Z  'num_warps': 8,
2026-02-21T10:23:22.1667191Z  'pid_type': 'flat',
2026-02-21T10:23:22.1667580Z  'range_flattens': [None, False],
2026-02-21T10:23:22.1668013Z  'range_multi_buffers': [None, False],
2026-02-21T10:23:22.1668484Z  'range_num_stages': [0, 2],
2026-02-21T10:23:22.1668866Z  'range_unroll_factors': [0, 1],
2026-02-21T10:23:22.1669271Z  'range_warp_specializes': []}
2026-02-21T10:23:22.1700740Z [337s] Fitting surrogate: 535 points, 535 targets
2026-02-21T10:23:23.1973624Z [338s] Generation 6 starting: 62 neighbors, 5 active search path(s)
2026-02-21T10:23:48.7213134Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 2.1 configs/s
2026-02-21T10:23:52.6711047Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 16.4 configs/s
2026-02-21T10:24:03.2529158Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 111.4         
2026-02-21T10:24:03.2529683Z                                                                   configs/s     
2026-02-21T10:24:03.8312344Z [379s] Generation 6 complete: 
2026-02-21T10:24:03.8312618Z ok=67
2026-02-21T10:24:03.8312795Z min=0.0652
2026-02-21T10:24:03.8312979Z mid=0.0691
2026-02-21T10:24:03.8313143Z max=0.6630
2026-02-21T10:24:03.8313335Z best={'block_sizes': [1, 16384],
2026-02-21T10:24:03.8313894Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:24:03.8315026Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:24:03.8315489Z  'num_stages': 4,
2026-02-21T10:24:03.8315805Z  'num_warps': 8,
2026-02-21T10:24:03.8316126Z  'pid_type': 'flat',
2026-02-21T10:24:03.8316476Z  'range_flattens': [None, False],
2026-02-21T10:24:03.8316923Z  'range_multi_buffers': [None, True],
2026-02-21T10:24:03.8317352Z  'range_num_stages': [0, 2],
2026-02-21T10:24:03.8317750Z  'range_unroll_factors': [0, 1],
2026-02-21T10:24:03.8318704Z  'range_warp_specializes': []}
2026-02-21T10:24:03.8345663Z [379s] Fitting surrogate: 602 points, 602 targets
2026-02-21T10:24:04.8202670Z [380s] Generation 7 starting: 62 neighbors, 5 active search path(s)
2026-02-21T10:24:29.1473316Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 5.1 configs/s
2026-02-21T10:24:33.0414640Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 16.4 configs/s
2026-02-21T10:24:43.6190199Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 95.4 configs/s
2026-02-21T10:24:44.2932890Z [419s] Generation 7 complete: 
2026-02-21T10:24:44.2933129Z ok=67
2026-02-21T10:24:44.2933282Z min=0.0652
2026-02-21T10:24:44.2933445Z mid=0.0684
2026-02-21T10:24:44.2933591Z max=0.0957
2026-02-21T10:24:44.2933741Z best={'block_sizes': [1, 16384],
2026-02-21T10:24:44.2934334Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:24:44.2934686Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:24:44.2934960Z  'num_stages': 4,
2026-02-21T10:24:44.2935123Z  'num_warps': 8,
2026-02-21T10:24:44.2935289Z  'pid_type': 'flat',
2026-02-21T10:24:44.2935468Z  'range_flattens': [None, False],
2026-02-21T10:24:44.2935721Z  'range_multi_buffers': [None, True],
2026-02-21T10:24:44.2935941Z  'range_num_stages': [0, 1],
2026-02-21T10:24:44.2936141Z  'range_unroll_factors': [0, 1],
2026-02-21T10:24:44.2936348Z  'range_warp_specializes': []}
2026-02-21T10:24:44.2972150Z [419s] Fitting surrogate: 669 points, 669 targets
2026-02-21T10:24:45.1585685Z [420s] Generation 8 starting: 50 neighbors, 4 active search path(s)
2026-02-21T10:25:04.6456279Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 3.3 configs/s
2026-02-21T10:25:07.7561270Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 16.3 configs/s
2026-02-21T10:25:16.0912198Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.0         
2026-02-21T10:25:16.0914786Z                                                                   configs/s     
2026-02-21T10:25:16.6281444Z [452s] Generation 8 complete: 
2026-02-21T10:25:16.6281786Z ok=54
2026-02-21T10:25:16.6282015Z min=0.0652
2026-02-21T10:25:16.6282238Z mid=0.0669
2026-02-21T10:25:16.6282505Z max=0.1939
2026-02-21T10:25:16.6282755Z best={'block_sizes': [1, 16384],
2026-02-21T10:25:16.6283292Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:25:16.6283930Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:25:16.6284666Z  'maxnreg': 128,
2026-02-21T10:25:16.6284949Z  'num_sm_multiplier': 32,
2026-02-21T10:25:16.6285253Z  'num_stages': 5,
2026-02-21T10:25:16.6285507Z  'num_warps': 4,
2026-02-21T10:25:16.6285821Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:25:16.6286314Z  'range_flattens': [False, False],
2026-02-21T10:25:16.6286681Z  'range_multi_buffers': [None, False],
2026-02-21T10:25:16.6287045Z  'range_num_stages': [1, 3],
2026-02-21T10:25:16.6287373Z  'range_unroll_factors': [1, 0],
2026-02-21T10:25:16.6287740Z  'range_warp_specializes': []}
2026-02-21T10:25:16.6319324Z [452s] Fitting surrogate: 723 points, 723 targets
2026-02-21T10:25:17.3948335Z [453s] Generation 9 starting: 44 neighbors, 3 active search path(s)
2026-02-21T10:25:35.4020255Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 2.9 configs/s
2026-02-21T10:25:38.1543743Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.2 configs/s
2026-02-21T10:25:44.7012921Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 153.8         
2026-02-21T10:25:44.7013521Z                                                                   configs/s     
2026-02-21T10:25:45.1331898Z [480s] Generation 9 complete: 
2026-02-21T10:25:45.1332345Z ok=47
2026-02-21T10:25:45.1332628Z min=0.0652
2026-02-21T10:25:45.1332915Z mid=0.0666
2026-02-21T10:25:45.1333183Z max=1.5248
2026-02-21T10:25:45.1333488Z best={'block_sizes': [1, 16384],
2026-02-21T10:25:45.1335150Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:25:45.1335611Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:25:45.1335908Z  'maxnreg': 128,
2026-02-21T10:25:45.1336109Z  'num_sm_multiplier': 32,
2026-02-21T10:25:45.1336355Z  'num_stages': 5,
2026-02-21T10:25:45.1336539Z  'num_warps': 4,
2026-02-21T10:25:45.1336757Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:25:45.1337045Z  'range_flattens': [False, False],
2026-02-21T10:25:45.1337311Z  'range_multi_buffers': [None, False],
2026-02-21T10:25:45.1337568Z  'range_num_stages': [1, 3],
2026-02-21T10:25:45.1337805Z  'range_unroll_factors': [0, 0],
2026-02-21T10:25:45.1338057Z  'range_warp_specializes': []}
2026-02-21T10:25:45.1370262Z [480s] Fitting surrogate: 770 points, 770 targets
2026-02-21T10:25:45.7115143Z [481s] Generation 10 starting: 31 neighbors, 2 active search path(s)
2026-02-21T10:25:58.8629625Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 2.2 configs/s
2026-02-21T10:26:00.7846371Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.5 configs/s
2026-02-21T10:26:05.6887448Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 205.0         
2026-02-21T10:26:05.6891705Z                                                                   configs/s     
2026-02-21T10:26:06.0152685Z [501s] Generation 10 complete: 
2026-02-21T10:26:06.0153210Z ok=33
2026-02-21T10:26:06.0153564Z min=0.0691
2026-02-21T10:26:06.0153937Z mid=0.0694
2026-02-21T10:26:06.0154733Z max=0.1937
2026-02-21T10:26:06.0155138Z best={'block_sizes': [1, 16384],
2026-02-21T10:26:06.0155940Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:26:06.0156833Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:26:06.0157452Z  'num_stages': 4,
2026-02-21T10:26:06.0157863Z  'num_warps': 8,
2026-02-21T10:26:06.0158291Z  'pid_type': 'flat',
2026-02-21T10:26:06.0158867Z  'range_flattens': [None, None],
2026-02-21T10:26:06.0159561Z  'range_multi_buffers': [None, None],
2026-02-21T10:26:06.0160124Z  'range_num_stages': [0, 2],
2026-02-21T10:26:06.0160438Z  'range_unroll_factors': [0, 2],
2026-02-21T10:26:06.0160752Z  'range_warp_specializes': []}
2026-02-21T10:26:06.0196349Z [501s] Fitting surrogate: 803 points, 803 targets
2026-02-21T10:26:06.3613687Z [501s] Generation 11 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:26:12.2741284Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 2.2 configs/s
2026-02-21T10:26:13.0747260Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.2 configs/s
2026-02-21T10:26:15.2857523Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 450.1         
2026-02-21T10:26:15.2858541Z                                                                   configs/s     
2026-02-21T10:26:15.4521610Z [511s] Generation 11 complete: 
2026-02-21T10:26:15.4522047Z ok=14
2026-02-21T10:26:15.4522322Z min=0.0691
2026-02-21T10:26:15.4525901Z mid=0.0702
2026-02-21T10:26:15.4526350Z max=0.0822
2026-02-21T10:26:15.4526593Z best={'block_sizes': [1, 16384],
2026-02-21T10:26:15.4527040Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:26:15.4527515Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:26:15.4528324Z  'num_stages': 4,
2026-02-21T10:26:15.4528549Z  'num_warps': 8,
2026-02-21T10:26:15.4528770Z  'pid_type': 'flat',
2026-02-21T10:26:15.4529015Z  'range_flattens': [None, None],
2026-02-21T10:26:15.4529315Z  'range_multi_buffers': [None, None],
2026-02-21T10:26:15.4529615Z  'range_num_stages': [0, 2],
2026-02-21T10:26:15.4529981Z  'range_unroll_factors': [0, 2],
2026-02-21T10:26:15.4530271Z  'range_warp_specializes': []}
2026-02-21T10:26:15.4558658Z [511s] Fitting surrogate: 817 points, 817 targets
2026-02-21T10:26:15.8099028Z [511s] Generation 12 starting: 13 neighbors, 1 active search path(s)
2026-02-21T10:26:42.2376407Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 0.1 configs/s
2026-02-21T10:26:43.1227382Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 16.6 configs/s
2026-02-21T10:26:45.0060917Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 527.4         
2026-02-21T10:26:45.0061483Z                                                                   configs/s     
2026-02-21T10:26:45.1544735Z [540s] Generation 12 complete: 
2026-02-21T10:26:45.1545010Z ok=15
2026-02-21T10:26:45.1545178Z min=0.0689
2026-02-21T10:26:45.1545352Z mid=0.0699
2026-02-21T10:26:45.1545515Z max=1.5253
2026-02-21T10:26:45.1545747Z best={'block_sizes': [1, 16384],
2026-02-21T10:26:45.1546171Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:26:45.1546651Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:26:45.1546971Z  'num_stages': 4,
2026-02-21T10:26:45.1547187Z  'num_warps': 8,
2026-02-21T10:26:45.1547382Z  'pid_type': 'flat',
2026-02-21T10:26:45.1547605Z  'range_flattens': [None, None],
2026-02-21T10:26:45.1547868Z  'range_multi_buffers': [None, None],
2026-02-21T10:26:45.1548147Z  'range_num_stages': [0, 2],
2026-02-21T10:26:45.1548412Z  'range_unroll_factors': [0, 2],
2026-02-21T10:26:45.1548660Z  'range_warp_specializes': []}
2026-02-21T10:26:45.1582386Z [540s] Fitting surrogate: 832 points, 832 targets
2026-02-21T10:26:45.4845348Z [541s] Generation 13 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:26:52.1122131Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 1.2 configs/s
2026-02-21T10:26:52.9238744Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 16.9 configs/s
2026-02-21T10:26:54.3339099Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 699.2         
2026-02-21T10:26:54.3339525Z                                                                   configs/s     
2026-02-21T10:26:54.4543230Z [550s] Generation 13 complete: 
2026-02-21T10:26:54.4543499Z ok=14
2026-02-21T10:26:54.4543660Z min=0.0690
2026-02-21T10:26:54.4543830Z mid=0.0755
2026-02-21T10:26:54.4544292Z max=0.1448
2026-02-21T10:26:54.4544484Z best={'block_sizes': [1, 16384],
2026-02-21T10:26:54.4544851Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:26:54.4545249Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:26:54.4545528Z  'num_stages': 4,
2026-02-21T10:26:54.4546114Z  'num_warps': 8,
2026-02-21T10:26:54.4546318Z  'pid_type': 'flat',
2026-02-21T10:26:54.4546529Z  'range_flattens': [None, None],
2026-02-21T10:26:54.4546785Z  'range_multi_buffers': [None, None],
2026-02-21T10:26:54.4547040Z  'range_num_stages': [0, 2],
2026-02-21T10:26:54.4547274Z  'range_unroll_factors': [0, 2],
2026-02-21T10:26:54.4547511Z  'range_warp_specializes': []}
2026-02-21T10:26:54.4584621Z [550s] Fitting surrogate: 846 points, 846 targets
2026-02-21T10:26:54.6288383Z [550s] Autotuning complete in 550.3s after searching 809 configs.
2026-02-21T10:26:54.6288880Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:26:54.6290965Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=4, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T10:26:54.6292384Z 
2026-02-21T10:26:55.5647850Z [550s] Code of selected kernel: /tmp/torchinductor_root/ye/cye5qs3xzgnnxfstfvifeycjl5a7xja3htfzr4in5k3h3dlavigu.py
2026-02-21T10:26:55.5648987Z WARNING:tritonbench.utils.triton_op:Completed input ID 82:
2026-02-21T10:26:55.5649660Z (M, N)
2026-02-21T10:26:55.5649945Z -------------
2026-02-21T10:26:55.5650230Z (4096, 10752)
2026-02-21T10:26:55.5650414Z 
2026-02-21T10:26:55.5672142Z  85%|████████▌ | 17/20 [2:08:25<26:57, 539.02s/it]WARNING:tritonbench.utils.triton_op:Running input ID 87:
2026-02-21T10:26:55.5672597Z (M, N)
2026-02-21T10:26:55.5672762Z -------------
2026-02-21T10:26:55.5672986Z (4096, 11392)
2026-02-21T10:26:55.5675451Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T10:26:57.0011810Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T10:26:58.5575498Z INFO:tritonbench.utils.triton_op:Took 3.60ms to get benchmark function for torch_compile_softmax
2026-02-21T10:27:04.7777227Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:27:04.7777823Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:27:04.7778270Z               'dtype': 'torch.float16',
2026-02-21T10:27:04.7778724Z               'shape': (4096, 11392),
2026-02-21T10:27:04.7779167Z               'stride': (11392, 1)},),
2026-02-21T10:27:04.7779636Z   'kwargs': {}}
2026-02-21T10:27:04.7801718Z INFO:tritonbench.utils.triton_op:Took 2.86ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T10:27:05.0612680Z [0s] Autotune random seed: 2135383793
2026-02-21T10:27:05.2440519Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:27:44.0345526Z [38s] Timeout after 31s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T10:27:44.4526984Z [39s] Timeout after 31s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:27:44.8683416Z [39s] Timeout after 30s compiling Config(block_sizes=[4, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T10:27:46.9478888Z [41s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T10:27:58.3628592Z [53s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T10:28:05.4632171Z [60s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T10:28:07.2089492Z [61s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T10:28:08.6192781Z [63s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:28:08.6213879Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.3 configs/s
2026-02-21T10:28:17.7412273Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 11.0 configs/s
2026-02-21T10:28:17.7426005Z [72s] Adaptive compile timeout: 30s (90% percentile=32.4s, bounds=[30.0s, 30s])
2026-02-21T10:28:19.4638831Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 568.9 configs/s
2026-02-21T10:28:19.5912437Z [74s] Initial random population of 100, 5 starting points: 
2026-02-21T10:28:19.5913110Z error=3
2026-02-21T10:28:19.5913397Z timeout=8
2026-02-21T10:28:19.5913673Z ok=89
2026-02-21T10:28:19.5913939Z min=0.1046
2026-02-21T10:28:19.5914738Z mid=0.8527
2026-02-21T10:28:19.5915016Z max=236.1653
2026-02-21T10:28:19.5915375Z best={'block_sizes': [1, 2048],
2026-02-21T10:28:19.5915954Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:28:19.5916582Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:28:19.5917052Z  'maxnreg': 256,
2026-02-21T10:28:19.5917377Z  'num_sm_multiplier': 16,
2026-02-21T10:28:19.5917735Z  'num_stages': 5,
2026-02-21T10:28:19.5918039Z  'num_warps': 4,
2026-02-21T10:28:19.5918417Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:28:19.5918868Z  'range_flattens': [None, None],
2026-02-21T10:28:19.5919272Z  'range_multi_buffers': [False, False],
2026-02-21T10:28:19.5919707Z  'range_num_stages': [1, 1],
2026-02-21T10:28:19.5920079Z  'range_unroll_factors': [1, 1],
2026-02-21T10:28:19.5920479Z  'range_warp_specializes': []}
2026-02-21T10:28:19.5930968Z [74s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:28:21.0546708Z [75s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T10:29:02.3004617Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 0.6 configs/s
2026-02-21T10:29:08.1458229Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.4 configs/s
2026-02-21T10:29:22.8918597Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 68.3 configs/s
2026-02-21T10:29:23.6319079Z [138s] Generation 1 complete: 
2026-02-21T10:29:23.6319660Z ok=96
2026-02-21T10:29:23.6320028Z min=0.0987
2026-02-21T10:29:23.6320404Z mid=0.1194
2026-02-21T10:29:23.6320765Z max=1.0492
2026-02-21T10:29:23.6321174Z best={'block_sizes': [1, 4096],
2026-02-21T10:29:23.6321950Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:29:23.6322846Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:29:23.6323457Z  'num_stages': 5,
2026-02-21T10:29:23.6323867Z  'num_warps': 4,
2026-02-21T10:29:23.6324722Z  'pid_type': 'flat',
2026-02-21T10:29:23.6325200Z  'range_flattens': [None, None],
2026-02-21T10:29:23.6325782Z  'range_multi_buffers': [None, False],
2026-02-21T10:29:23.6326371Z  'range_num_stages': [0, 0],
2026-02-21T10:29:23.6327418Z  'range_unroll_factors': [0, 1],
2026-02-21T10:29:23.6327733Z  'range_warp_specializes': []}
2026-02-21T10:29:23.6346028Z [138s] Fitting surrogate: 196 points, 196 targets
2026-02-21T10:29:24.9606177Z [139s] Generation 2 starting: 84 neighbors, 5 active search path(s)
2026-02-21T10:29:59.1725298Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 3.2 configs/s
2026-02-21T10:30:04.4984376Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 16.5 configs/s
2026-02-21T10:30:19.6824677Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 66.4 configs/s
2026-02-21T10:30:20.4769132Z [195s] Generation 2 complete: 
2026-02-21T10:30:20.4769607Z ok=90
2026-02-21T10:30:20.4770027Z min=0.0798
2026-02-21T10:30:20.4770305Z mid=0.1044
2026-02-21T10:30:20.4770577Z max=0.3089
2026-02-21T10:30:20.4770865Z best={'block_sizes': [1, 4096],
2026-02-21T10:30:20.4771446Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:30:20.4772117Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:30:20.4772594Z  'num_stages': 1,
2026-02-21T10:30:20.4772907Z  'num_warps': 8,
2026-02-21T10:30:20.4773231Z  'pid_type': 'flat',
2026-02-21T10:30:20.4773641Z  'range_flattens': [None, False],
2026-02-21T10:30:20.4774468Z  'range_multi_buffers': [None, False],
2026-02-21T10:30:20.4774914Z  'range_num_stages': [0, 0],
2026-02-21T10:30:20.4775315Z  'range_unroll_factors': [0, 0],
2026-02-21T10:30:20.4775714Z  'range_warp_specializes': []}
2026-02-21T10:30:20.4795495Z [195s] Fitting surrogate: 286 points, 286 targets
2026-02-21T10:30:21.8354527Z [196s] Generation 3 starting: 85 neighbors, 5 active search path(s)
2026-02-21T10:31:01.0341340Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 0.8 configs/s
2026-02-21T10:31:07.9065956Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 12.7 configs/s
2026-02-21T10:31:20.9926128Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 77.0 configs/s
2026-02-21T10:31:21.7307796Z [256s] Generation 3 complete: 
2026-02-21T10:31:21.7308096Z ok=91
2026-02-21T10:31:21.7308284Z min=0.0694
2026-02-21T10:31:21.7308454Z mid=0.0976
2026-02-21T10:31:21.7308627Z max=0.5373
2026-02-21T10:31:21.7308871Z best={'block_sizes': [1, 16384],
2026-02-21T10:31:21.7309310Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:31:21.7309805Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T10:31:21.7310128Z  'num_stages': 5,
2026-02-21T10:31:21.7310329Z  'num_warps': 4,
2026-02-21T10:31:21.7310535Z  'pid_type': 'flat',
2026-02-21T10:31:21.7310772Z  'range_flattens': [None, None],
2026-02-21T10:31:21.7311042Z  'range_multi_buffers': [None, False],
2026-02-21T10:31:21.7311321Z  'range_num_stages': [0, 1],
2026-02-21T10:31:21.7311557Z  'range_unroll_factors': [0, 1],
2026-02-21T10:31:21.7311820Z  'range_warp_specializes': []}
2026-02-21T10:31:21.7339512Z [256s] Fitting surrogate: 377 points, 377 targets
2026-02-21T10:31:22.8612445Z [257s] Generation 4 starting: 71 neighbors, 5 active search path(s)
2026-02-21T10:31:53.6559643Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75/75 4.6 configs/s
2026-02-21T10:31:58.2676949Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 75/75 16.4 configs/s
2026-02-21T10:32:09.6270067Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 88.8 configs/s
2026-02-21T10:32:10.3027494Z [305s] Generation 4 complete: 
2026-02-21T10:32:10.3027786Z ok=77
2026-02-21T10:32:10.3027964Z min=0.0674
2026-02-21T10:32:10.3028145Z mid=0.0808
2026-02-21T10:32:10.3028311Z max=0.7876
2026-02-21T10:32:10.3028497Z best={'block_sizes': [1, 16384],
2026-02-21T10:32:10.3028842Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:32:10.3029225Z  'load_eviction_policies': ['', ''],
2026-02-21T10:32:10.3029479Z  'num_stages': 7,
2026-02-21T10:32:10.3029667Z  'num_warps': 8,
2026-02-21T10:32:10.3029862Z  'pid_type': 'flat',
2026-02-21T10:32:10.3030077Z  'range_flattens': [None, False],
2026-02-21T10:32:10.3030965Z  'range_multi_buffers': [None, None],
2026-02-21T10:32:10.3031244Z  'range_num_stages': [0, 2],
2026-02-21T10:32:10.3031489Z  'range_unroll_factors': [0, 2],
2026-02-21T10:32:10.3031752Z  'range_warp_specializes': []}
2026-02-21T10:32:10.3057481Z [305s] Fitting surrogate: 454 points, 454 targets
2026-02-21T10:32:11.2585887Z [306s] Generation 5 starting: 59 neighbors, 5 active search path(s)
2026-02-21T10:32:37.5901643Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 2.6 configs/s
2026-02-21T10:32:41.4587915Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 16.5 configs/s
2026-02-21T10:32:51.6586010Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.9 configs/s
2026-02-21T10:32:52.2822524Z [347s] Generation 5 complete: 
2026-02-21T10:32:52.2822826Z ok=65
2026-02-21T10:32:52.2822999Z min=0.0677
2026-02-21T10:32:52.2823176Z mid=0.0716
2026-02-21T10:32:52.2823345Z max=0.1235
2026-02-21T10:32:52.2823534Z best={'block_sizes': [1, 16384],
2026-02-21T10:32:52.2823916Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:32:52.2824581Z  'load_eviction_policies': ['', ''],
2026-02-21T10:32:52.2824846Z  'num_stages': 6,
2026-02-21T10:32:52.2825060Z  'num_warps': 8,
2026-02-21T10:32:52.2825269Z  'pid_type': 'flat',
2026-02-21T10:32:52.2825480Z  'range_flattens': [None, False],
2026-02-21T10:32:52.2825742Z  'range_multi_buffers': [None, None],
2026-02-21T10:32:52.2826002Z  'range_num_stages': [0, 2],
2026-02-21T10:32:52.2826239Z  'range_unroll_factors': [0, 2],
2026-02-21T10:32:52.2826488Z  'range_warp_specializes': []}
2026-02-21T10:32:52.2853440Z [347s] Fitting surrogate: 519 points, 519 targets
2026-02-21T10:32:53.1266144Z [347s] Generation 6 starting: 51 neighbors, 5 active search path(s)
2026-02-21T10:33:14.5740784Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 5.2 configs/s
2026-02-21T10:33:17.8226872Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 53/53 16.5 configs/s
2026-02-21T10:33:28.3993039Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 112.0         
2026-02-21T10:33:28.3993595Z                                                                   configs/s     
2026-02-21T10:33:28.9667956Z [383s] Generation 6 complete: 
2026-02-21T10:33:28.9668534Z ok=56
2026-02-21T10:33:28.9668907Z min=0.0677
2026-02-21T10:33:28.9669276Z mid=0.0708
2026-02-21T10:33:28.9669618Z max=0.0961
2026-02-21T10:33:28.9670037Z best={'block_sizes': [1, 16384],
2026-02-21T10:33:28.9670820Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:33:28.9671664Z  'load_eviction_policies': ['', ''],
2026-02-21T10:33:28.9672201Z  'num_stages': 6,
2026-02-21T10:33:28.9672612Z  'num_warps': 8,
2026-02-21T10:33:28.9673019Z  'pid_type': 'flat',
2026-02-21T10:33:28.9673502Z  'range_flattens': [None, False],
2026-02-21T10:33:28.9674583Z  'range_multi_buffers': [None, None],
2026-02-21T10:33:28.9675190Z  'range_num_stages': [0, 3],
2026-02-21T10:33:28.9675747Z  'range_unroll_factors': [0, 2],
2026-02-21T10:33:28.9676330Z  'range_warp_specializes': []}
2026-02-21T10:33:28.9700336Z [383s] Fitting surrogate: 575 points, 575 targets
2026-02-21T10:33:29.8148211Z [384s] Generation 7 starting: 52 neighbors, 5 active search path(s)
2026-02-21T10:34:00.2909120Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 0.3 configs/s
2026-02-21T10:34:03.6042449Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 16.5 configs/s
2026-02-21T10:34:11.9174438Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.2         
2026-02-21T10:34:11.9176958Z                                                                   configs/s     
2026-02-21T10:34:12.4355122Z [427s] Generation 7 complete: 
2026-02-21T10:34:12.4355440Z ok=57
2026-02-21T10:34:12.4355641Z min=0.0673
2026-02-21T10:34:12.4355838Z mid=0.0696
2026-02-21T10:34:12.4356009Z max=0.5751
2026-02-21T10:34:12.4356206Z best={'block_sizes': [1, 16384],
2026-02-21T10:34:12.4357213Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:34:12.4357653Z  'load_eviction_policies': ['', ''],
2026-02-21T10:34:12.4357932Z  'num_stages': 6,
2026-02-21T10:34:12.4358136Z  'num_warps': 8,
2026-02-21T10:34:12.4358372Z  'pid_type': 'flat',
2026-02-21T10:34:12.4358603Z  'range_flattens': [None, False],
2026-02-21T10:34:12.4358858Z  'range_multi_buffers': [None, None],
2026-02-21T10:34:12.4359084Z  'range_num_stages': [0, 3],
2026-02-21T10:34:12.4359293Z  'range_unroll_factors': [0, 3],
2026-02-21T10:34:12.4359507Z  'range_warp_specializes': []}
2026-02-21T10:34:12.4397962Z [427s] Fitting surrogate: 632 points, 632 targets
2026-02-21T10:34:13.1168919Z [427s] Generation 8 starting: 38 neighbors, 3 active search path(s)
2026-02-21T10:34:29.0432707Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 5.2 configs/s
2026-02-21T10:34:31.3885899Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 16.5 configs/s
2026-02-21T10:34:37.6495065Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 160.7         
2026-02-21T10:34:37.6495690Z                                                                   configs/s     
2026-02-21T10:34:38.0418827Z [452s] Generation 8 complete: 
2026-02-21T10:34:38.0419153Z ok=41
2026-02-21T10:34:38.0419320Z min=0.0711
2026-02-21T10:34:38.0419492Z mid=0.0726
2026-02-21T10:34:38.0419652Z max=1.6178
2026-02-21T10:34:38.0419837Z best={'block_sizes': [1, 16384],
2026-02-21T10:34:38.0420181Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:34:38.0420568Z  'load_eviction_policies': ['', ''],
2026-02-21T10:34:38.0420836Z  'num_stages': 6,
2026-02-21T10:34:38.0421030Z  'num_warps': 8,
2026-02-21T10:34:38.0421221Z  'pid_type': 'flat',
2026-02-21T10:34:38.0421447Z  'range_flattens': [None, False],
2026-02-21T10:34:38.0421707Z  'range_multi_buffers': [None, None],
2026-02-21T10:34:38.0421967Z  'range_num_stages': [0, 4],
2026-02-21T10:34:38.0422213Z  'range_unroll_factors': [0, 3],
2026-02-21T10:34:38.0422469Z  'range_warp_specializes': []}
2026-02-21T10:34:38.0461270Z [452s] Fitting surrogate: 673 points, 673 targets
2026-02-21T10:34:38.5143332Z [453s] Generation 9 starting: 24 neighbors, 2 active search path(s)
2026-02-21T10:34:53.4695731Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 1.0 configs/s
2026-02-21T10:34:55.0769933Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 26/26 16.6 configs/s
2026-02-21T10:34:58.7038078Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 276.0         
2026-02-21T10:34:58.7038570Z                                                                   configs/s     
2026-02-21T10:34:58.9489446Z [473s] Generation 9 complete: 
2026-02-21T10:34:58.9490019Z ok=27
2026-02-21T10:34:58.9490290Z min=0.0674
2026-02-21T10:34:58.9490576Z mid=0.0809
2026-02-21T10:34:58.9490854Z max=1.9376
2026-02-21T10:34:58.9491162Z best={'block_sizes': [1, 16384],
2026-02-21T10:34:58.9491683Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:34:58.9492781Z  'load_eviction_policies': ['', ''],
2026-02-21T10:34:58.9493227Z  'num_stages': 2,
2026-02-21T10:34:58.9493537Z  'num_warps': 4,
2026-02-21T10:34:58.9493863Z  'pid_type': 'flat',
2026-02-21T10:34:58.9494568Z  'range_flattens': [None, True],
2026-02-21T10:34:58.9494891Z  'range_multi_buffers': [None, False],
2026-02-21T10:34:58.9495204Z  'range_num_stages': [0, 1],
2026-02-21T10:34:58.9495488Z  'range_unroll_factors': [0, 0],
2026-02-21T10:34:58.9495783Z  'range_warp_specializes': []}
2026-02-21T10:34:58.9523072Z [473s] Fitting surrogate: 700 points, 700 targets
2026-02-21T10:34:59.4352327Z [474s] Generation 10 starting: 23 neighbors, 2 active search path(s)
2026-02-21T10:35:09.3424546Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 8.2 configs/s
2026-02-21T10:35:10.7835763Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.4 configs/s
2026-02-21T10:35:14.1245757Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 300.0         
2026-02-21T10:35:14.1246322Z                                                                   configs/s     
2026-02-21T10:35:14.3589267Z [489s] Generation 10 complete: 
2026-02-21T10:35:14.3589533Z ok=25
2026-02-21T10:35:14.3589734Z min=0.0710
2026-02-21T10:35:14.3589898Z mid=0.0715
2026-02-21T10:35:14.3590067Z max=1.6176
2026-02-21T10:35:14.3590242Z best={'block_sizes': [1, 16384],
2026-02-21T10:35:14.3590568Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:35:14.3590911Z  'load_eviction_policies': ['', ''],
2026-02-21T10:35:14.3591199Z  'num_stages': 2,
2026-02-21T10:35:14.3591435Z  'num_warps': 8,
2026-02-21T10:35:14.3591667Z  'pid_type': 'flat',
2026-02-21T10:35:14.3591932Z  'range_flattens': [None, False],
2026-02-21T10:35:14.3592244Z  'range_multi_buffers': [None, False],
2026-02-21T10:35:14.3592525Z  'range_num_stages': [0, 1],
2026-02-21T10:35:14.3592763Z  'range_unroll_factors': [0, 1],
2026-02-21T10:35:14.3593018Z  'range_warp_specializes': []}
2026-02-21T10:35:14.3625206Z [489s] Fitting surrogate: 725 points, 725 targets
2026-02-21T10:35:14.8565906Z [489s] Generation 11 starting: 24 neighbors, 2 active search path(s)
2026-02-21T10:35:26.8630743Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 3.9 configs/s
2026-02-21T10:35:28.5513569Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 15.8 configs/s
2026-02-21T10:35:32.1519931Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 278.1         
2026-02-21T10:35:32.1520532Z                                                                   configs/s     
2026-02-21T10:35:32.3946492Z [507s] Generation 11 complete: 
2026-02-21T10:35:32.3947032Z ok=27
2026-02-21T10:35:32.3947396Z min=0.0673
2026-02-21T10:35:32.3947746Z mid=0.0787
2026-02-21T10:35:32.3948095Z max=1.6436
2026-02-21T10:35:32.3948492Z best={'block_sizes': [1, 16384],
2026-02-21T10:35:32.3949225Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:35:32.3950002Z  'load_eviction_policies': ['', ''],
2026-02-21T10:35:32.3950588Z  'num_stages': 2,
2026-02-21T10:35:32.3951016Z  'num_warps': 8,
2026-02-21T10:35:32.3951431Z  'pid_type': 'flat',
2026-02-21T10:35:32.3951915Z  'range_flattens': [None, True],
2026-02-21T10:35:32.3953127Z  'range_multi_buffers': [None, True],
2026-02-21T10:35:32.3953718Z  'range_num_stages': [0, 1],
2026-02-21T10:35:32.3954435Z  'range_unroll_factors': [0, 1],
2026-02-21T10:35:32.3954734Z  'range_warp_specializes': []}
2026-02-21T10:35:32.3983208Z [507s] Fitting surrogate: 752 points, 752 targets
2026-02-21T10:35:32.8757172Z [507s] Generation 12 starting: 24 neighbors, 2 active search path(s)
2026-02-21T10:35:43.3051231Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 4.7 configs/s
2026-02-21T10:35:44.7720998Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 16.9 configs/s
2026-02-21T10:35:48.9448086Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 240.5         
2026-02-21T10:35:48.9449324Z                                                                   configs/s     
2026-02-21T10:35:49.2264287Z [523s] Generation 12 complete: 
2026-02-21T10:35:49.2264562Z ok=26
2026-02-21T10:35:49.2264731Z min=0.0709
2026-02-21T10:35:49.2264904Z mid=0.0713
2026-02-21T10:35:49.2265098Z max=0.0909
2026-02-21T10:35:49.2265283Z best={'block_sizes': [1, 16384],
2026-02-21T10:35:49.2265630Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T10:35:49.2265999Z  'load_eviction_policies': ['', ''],
2026-02-21T10:35:49.2266253Z  'num_stages': 5,
2026-02-21T10:35:49.2266445Z  'num_warps': 8,
2026-02-21T10:35:49.2266636Z  'pid_type': 'flat',
2026-02-21T10:35:49.2266844Z  'range_flattens': [None, False],
2026-02-21T10:35:49.2267087Z  'range_multi_buffers': [None, None],
2026-02-21T10:35:49.2267325Z  'range_num_stages': [0, 4],
2026-02-21T10:35:49.2267546Z  'range_unroll_factors': [0, 2],
2026-02-21T10:35:49.2267774Z  'range_warp_specializes': []}
2026-02-21T10:35:49.2307574Z [523s] Fitting surrogate: 778 points, 778 targets
2026-02-21T10:35:49.6509437Z [524s] Generation 13 starting: 19 neighbors, 2 active search path(s)
2026-02-21T10:35:59.6715622Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 2.1 configs/s
2026-02-21T10:36:00.8922288Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 17.0 configs/s
2026-02-21T10:36:04.5015494Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 277.4         
2026-02-21T10:36:04.5016213Z                                                                   configs/s     
2026-02-21T10:36:04.7442935Z [539s] Generation 13 complete: 
2026-02-21T10:36:04.7443344Z ok=22
2026-02-21T10:36:04.7443623Z min=0.0668
2026-02-21T10:36:04.7443894Z mid=0.0779
2026-02-21T10:36:04.7444628Z max=0.0957
2026-02-21T10:36:04.7444929Z best={'block_sizes': [1, 16384],
2026-02-21T10:36:04.7445491Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:36:04.7446092Z  'load_eviction_policies': ['', ''],
2026-02-21T10:36:04.7446520Z  'num_stages': 2,
2026-02-21T10:36:04.7446893Z  'num_warps': 8,
2026-02-21T10:36:04.7447181Z  'pid_type': 'flat',
2026-02-21T10:36:04.7447386Z  'range_flattens': [None, True],
2026-02-21T10:36:04.7447607Z  'range_multi_buffers': [None, True],
2026-02-21T10:36:04.7447856Z  'range_num_stages': [0, 1],
2026-02-21T10:36:04.7448054Z  'range_unroll_factors': [0, 1],
2026-02-21T10:36:04.7448270Z  'range_warp_specializes': []}
2026-02-21T10:36:04.7481474Z [539s] Fitting surrogate: 800 points, 800 targets
2026-02-21T10:36:05.2350922Z [539s] Generation 14 starting: 22 neighbors, 2 active search path(s)
2026-02-21T10:36:14.5556645Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 1.9 configs/s
2026-02-21T10:36:15.8728759Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.3 configs/s
2026-02-21T10:36:19.7400724Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 259.3         
2026-02-21T10:36:19.7401370Z                                                                   configs/s     
2026-02-21T10:36:20.0020150Z [554s] Generation 14 complete: 
2026-02-21T10:36:20.0020403Z ok=24
2026-02-21T10:36:20.0020576Z min=0.0707
2026-02-21T10:36:20.0020743Z mid=0.0714
2026-02-21T10:36:20.0020927Z max=0.0942
2026-02-21T10:36:20.0021517Z best={'block_sizes': [1, 16384],
2026-02-21T10:36:20.0021862Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:36:20.0022230Z  'load_eviction_policies': ['', ''],
2026-02-21T10:36:20.0022480Z  'num_stages': 5,
2026-02-21T10:36:20.0022671Z  'num_warps': 8,
2026-02-21T10:36:20.0022857Z  'pid_type': 'flat',
2026-02-21T10:36:20.0023070Z  'range_flattens': [None, False],
2026-02-21T10:36:20.0023320Z  'range_multi_buffers': [None, None],
2026-02-21T10:36:20.0023578Z  'range_num_stages': [0, 4],
2026-02-21T10:36:20.0023809Z  'range_unroll_factors': [0, 2],
2026-02-21T10:36:20.0024202Z  'range_warp_specializes': []}
2026-02-21T10:36:20.0060271Z [554s] Fitting surrogate: 824 points, 824 targets
2026-02-21T10:36:20.3245150Z [555s] Generation 15 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:36:39.3829994Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 0.2 configs/s
2026-02-21T10:36:40.1782551Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.3 configs/s
2026-02-21T10:36:41.7961992Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 610.7         
2026-02-21T10:36:41.7962744Z                                                                   configs/s     
2026-02-21T10:36:41.9267909Z [576s] Generation 15 complete: 
2026-02-21T10:36:41.9268162Z ok=14
2026-02-21T10:36:41.9268340Z min=0.0710
2026-02-21T10:36:41.9268511Z mid=0.0832
2026-02-21T10:36:41.9268681Z max=1.6929
2026-02-21T10:36:41.9268866Z best={'block_sizes': [1, 16384],
2026-02-21T10:36:41.9269212Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:36:41.9269593Z  'load_eviction_policies': ['', ''],
2026-02-21T10:36:41.9269849Z  'num_stages': 5,
2026-02-21T10:36:41.9270045Z  'num_warps': 8,
2026-02-21T10:36:41.9270258Z  'pid_type': 'flat',
2026-02-21T10:36:41.9270487Z  'range_flattens': [None, False],
2026-02-21T10:36:41.9270740Z  'range_multi_buffers': [None, None],
2026-02-21T10:36:41.9271007Z  'range_num_stages': [0, 4],
2026-02-21T10:36:41.9271267Z  'range_unroll_factors': [0, 2],
2026-02-21T10:36:41.9271511Z  'range_warp_specializes': []}
2026-02-21T10:36:41.9307313Z [576s] Fitting surrogate: 838 points, 838 targets
2026-02-21T10:36:42.2486687Z [577s] Generation 16 starting: 11 neighbors, 1 active search path(s)
2026-02-21T10:36:56.8131836Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 0.5 configs/s
2026-02-21T10:36:57.5562443Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.2 configs/s
2026-02-21T10:37:00.6174743Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 671.8         
2026-02-21T10:37:00.6175321Z                                                                   configs/s     
2026-02-21T10:37:00.7408048Z [595s] Generation 16 complete: 
2026-02-21T10:37:00.7408548Z ok=13
2026-02-21T10:37:00.7408819Z min=0.0671
2026-02-21T10:37:00.7409099Z mid=0.0890
2026-02-21T10:37:00.7409354Z max=0.2853
2026-02-21T10:37:00.7409650Z best={'block_sizes': [1, 16384],
2026-02-21T10:37:00.7411142Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:37:00.7411777Z  'load_eviction_policies': ['', ''],
2026-02-21T10:37:00.7412196Z  'num_stages': 5,
2026-02-21T10:37:00.7412509Z  'num_warps': 8,
2026-02-21T10:37:00.7412834Z  'pid_type': 'flat',
2026-02-21T10:37:00.7413177Z  'range_flattens': [None, False],
2026-02-21T10:37:00.7413621Z  'range_multi_buffers': [None, None],
2026-02-21T10:37:00.7414325Z  'range_num_stages': [0, 4],
2026-02-21T10:37:00.7414723Z  'range_unroll_factors': [0, 2],
2026-02-21T10:37:00.7415120Z  'range_warp_specializes': []}
2026-02-21T10:37:00.7439535Z [595s] Fitting surrogate: 851 points, 851 targets
2026-02-21T10:37:01.0520732Z [595s] Generation 17 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:37:06.6525871Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 1.4 configs/s
2026-02-21T10:37:07.3608830Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 18.2 configs/s
2026-02-21T10:37:09.5808550Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 448.7         
2026-02-21T10:37:09.5808985Z                                                                   configs/s     
2026-02-21T10:37:09.7477133Z [604s] Generation 17 complete: 
2026-02-21T10:37:09.7477613Z ok=14
2026-02-21T10:37:09.7477907Z min=0.0671
2026-02-21T10:37:09.7478187Z mid=0.0678
2026-02-21T10:37:09.7478462Z max=0.0929
2026-02-21T10:37:09.7478754Z best={'block_sizes': [1, 16384],
2026-02-21T10:37:09.7479333Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:37:09.7479979Z  'load_eviction_policies': ['', ''],
2026-02-21T10:37:09.7480411Z  'num_stages': 5,
2026-02-21T10:37:09.7480719Z  'num_warps': 8,
2026-02-21T10:37:09.7481047Z  'pid_type': 'flat',
2026-02-21T10:37:09.7481427Z  'range_flattens': [None, False],
2026-02-21T10:37:09.7481898Z  'range_multi_buffers': [None, None],
2026-02-21T10:37:09.7482380Z  'range_num_stages': [0, 4],
2026-02-21T10:37:09.7482666Z  'range_unroll_factors': [0, 2],
2026-02-21T10:37:09.7482916Z  'range_warp_specializes': []}
2026-02-21T10:37:09.7517728Z [604s] Fitting surrogate: 865 points, 865 targets
2026-02-21T10:37:10.0696638Z [604s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T10:37:16.0565765Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 0.7 configs/s
2026-02-21T10:37:16.7015573Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 18.4 configs/s
2026-02-21T10:37:18.7200719Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 492.8         
2026-02-21T10:37:18.7201236Z                                                                   configs/s     
2026-02-21T10:37:18.8771945Z [613s] Generation 18 complete: 
2026-02-21T10:37:18.8772364Z ok=13
2026-02-21T10:37:18.8772631Z min=0.0676
2026-02-21T10:37:18.8772957Z mid=0.0679
2026-02-21T10:37:18.8773242Z max=0.0827
2026-02-21T10:37:18.8773551Z best={'block_sizes': [1, 16384],
2026-02-21T10:37:18.8774619Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:37:18.8775274Z  'load_eviction_policies': ['', ''],
2026-02-21T10:37:18.8775680Z  'num_stages': 6,
2026-02-21T10:37:18.8776003Z  'num_warps': 8,
2026-02-21T10:37:18.8776335Z  'pid_type': 'flat',
2026-02-21T10:37:18.8776685Z  'range_flattens': [None, False],
2026-02-21T10:37:18.8777106Z  'range_multi_buffers': [None, False],
2026-02-21T10:37:18.8777529Z  'range_num_stages': [0, 3],
2026-02-21T10:37:18.8777946Z  'range_unroll_factors': [0, 3],
2026-02-21T10:37:18.8778493Z  'range_warp_specializes': []}
2026-02-21T10:37:18.8810838Z [613s] Fitting surrogate: 878 points, 878 targets
2026-02-21T10:37:19.2161401Z [613s] Generation 19 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:37:24.8720884Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.8 configs/s
2026-02-21T10:37:25.5919430Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.8 configs/s
2026-02-21T10:37:27.6653213Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 479.6         
2026-02-21T10:37:27.6654717Z                                                                   configs/s     
2026-02-21T10:37:27.8241154Z [622s] Generation 19 complete: 
2026-02-21T10:37:27.8241620Z ok=13
2026-02-21T10:37:27.8241906Z min=0.0709
2026-02-21T10:37:27.8242185Z mid=0.0716
2026-02-21T10:37:27.8242462Z max=0.0832
2026-02-21T10:37:27.8242783Z best={'block_sizes': [1, 16384],
2026-02-21T10:37:27.8243370Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:37:27.8244232Z  'load_eviction_policies': ['', ''],
2026-02-21T10:37:27.8244673Z  'num_stages': 6,
2026-02-21T10:37:27.8245028Z  'num_warps': 8,
2026-02-21T10:37:27.8245264Z  'pid_type': 'flat',
2026-02-21T10:37:27.8245453Z  'range_flattens': [None, False],
2026-02-21T10:37:27.8246113Z  'range_multi_buffers': [None, False],
2026-02-21T10:37:27.8246356Z  'range_num_stages': [0, 4],
2026-02-21T10:37:27.8246561Z  'range_unroll_factors': [0, 3],
2026-02-21T10:37:27.8246787Z  'range_warp_specializes': []}
2026-02-21T10:37:27.8279467Z [622s] Fitting surrogate: 891 points, 891 targets
2026-02-21T10:37:28.1369607Z [622s] Generation 20 starting: 10 neighbors, 1 active search path(s)
2026-02-21T10:37:33.8272049Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 3.5 configs/s
2026-02-21T10:37:34.4880691Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.9 configs/s
2026-02-21T10:37:36.4432616Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 507.7         
2026-02-21T10:37:36.4433184Z                                                                   configs/s     
2026-02-21T10:37:36.5931269Z [631s] Generation 20 complete: 
2026-02-21T10:37:36.5931717Z ok=12
2026-02-21T10:37:36.5931990Z min=0.0707
2026-02-21T10:37:36.5932273Z mid=0.0790
2026-02-21T10:37:36.5932572Z max=0.1024
2026-02-21T10:37:36.5932871Z best={'block_sizes': [1, 16384],
2026-02-21T10:37:36.5933379Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:37:36.5933961Z  'load_eviction_policies': ['', ''],
2026-02-21T10:37:36.5934839Z  'num_stages': 6,
2026-02-21T10:37:36.5935161Z  'num_warps': 8,
2026-02-21T10:37:36.5935480Z  'pid_type': 'flat',
2026-02-21T10:37:36.5935843Z  'range_flattens': [None, False],
2026-02-21T10:37:36.5936259Z  'range_multi_buffers': [None, False],
2026-02-21T10:37:36.5936685Z  'range_num_stages': [0, 4],
2026-02-21T10:37:36.5937074Z  'range_unroll_factors': [0, 3],
2026-02-21T10:37:36.5937494Z  'range_warp_specializes': []}
2026-02-21T10:37:36.5970895Z [631s] Fitting surrogate: 903 points, 903 targets
2026-02-21T10:37:36.7600793Z [631s] Autotuning complete in 631.5s after searching 856 configs.
2026-02-21T10:37:36.7601244Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:37:36.7602538Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=6, num_warps=8, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T10:37:36.7603701Z 
2026-02-21T10:37:36.7604317Z [631s] Code of selected kernel: /tmp/torchinductor_root/xa/cxa4vow6ke6udow2urhqtx3osguj5ogchs4xz2kudm73mjb6kgsh.py
2026-02-21T10:37:37.7454898Z WARNING:tritonbench.utils.triton_op:Completed input ID 87:
2026-02-21T10:37:37.7455504Z (M, N)
2026-02-21T10:37:37.7455796Z -------------
2026-02-21T10:37:37.7456108Z (4096, 11392)
2026-02-21T10:37:37.7456278Z 
2026-02-21T10:37:37.7475213Z  90%|█████████ | 18/20 [2:19:07<19:00, 570.02s/it]WARNING:tritonbench.utils.triton_op:Running input ID 92:
2026-02-21T10:37:37.7475978Z (M, N)
2026-02-21T10:37:37.7476249Z -------------
2026-02-21T10:37:37.7476545Z (4096, 12032)
2026-02-21T10:37:37.7477577Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T10:37:39.1855261Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T10:37:40.7430275Z INFO:tritonbench.utils.triton_op:Took 3.22ms to get benchmark function for torch_compile_softmax
2026-02-21T10:37:46.6258103Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:37:46.6258458Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:37:46.6258718Z               'dtype': 'torch.float16',
2026-02-21T10:37:46.6258988Z               'shape': (4096, 12032),
2026-02-21T10:37:46.6259244Z               'stride': (12032, 1)},),
2026-02-21T10:37:46.6259483Z   'kwargs': {}}
2026-02-21T10:37:46.6303843Z INFO:tritonbench.utils.triton_op:Took 4.99ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T10:37:46.9178808Z [0s] Autotune random seed: 2135383793
2026-02-21T10:37:47.0992182Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:38:28.7219141Z [41s] Timeout after 34s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T10:38:29.1918862Z [42s] Timeout after 33s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:38:29.6440865Z [42s] Timeout after 33s compiling Config(block_sizes=[4, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], num_sm_multiplier=16, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, True], range_num_stages=[1, 0], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T10:38:30.1488615Z [43s] Timeout after 31s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T10:38:41.8193401Z [54s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_sm_multiplier=1, num_stages=5, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T10:38:49.4639575Z [62s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T10:38:51.3418887Z [64s] Timeout after 30s compiling Config(block_sizes=[64, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=4, num_warps=32, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[True, True], range_num_stages=[0, 3], range_unroll_factors=[3, 2], range_warp_specializes=[])
2026-02-21T10:38:52.8765658Z [65s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:38:52.8788575Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.2 configs/s
2026-02-21T10:39:03.0967642Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━━ 100/100 9.8 configs/s
2026-02-21T10:39:03.0981380Z [75s] Adaptive compile timeout: 30s (90% percentile=34.9s, bounds=[30.0s, 30s])
2026-02-21T10:39:04.8574527Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 556.3 configs/s
2026-02-21T10:39:04.9861573Z [77s] Initial random population of 100, 5 starting points: 
2026-02-21T10:39:04.9862185Z error=3
2026-02-21T10:39:04.9862528Z timeout=8
2026-02-21T10:39:04.9862850Z ok=89
2026-02-21T10:39:04.9863151Z min=0.1084
2026-02-21T10:39:04.9863340Z mid=0.9194
2026-02-21T10:39:04.9864402Z max=246.0429
2026-02-21T10:39:04.9864614Z best={'block_sizes': [1, 2048],
2026-02-21T10:39:04.9864949Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:39:04.9865348Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:39:04.9865618Z  'maxnreg': 256,
2026-02-21T10:39:04.9865817Z  'num_sm_multiplier': 16,
2026-02-21T10:39:04.9866029Z  'num_stages': 5,
2026-02-21T10:39:04.9866216Z  'num_warps': 4,
2026-02-21T10:39:04.9866420Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:39:04.9866692Z  'range_flattens': [None, None],
2026-02-21T10:39:04.9866949Z  'range_multi_buffers': [False, False],
2026-02-21T10:39:04.9867217Z  'range_num_stages': [1, 1],
2026-02-21T10:39:04.9867449Z  'range_unroll_factors': [1, 1],
2026-02-21T10:39:04.9867695Z  'range_warp_specializes': []}
2026-02-21T10:39:04.9880105Z [77s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:39:06.4531368Z [79s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T10:39:50.4496665Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 1.2 configs/s
2026-02-21T10:39:56.3276332Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.3 configs/s
2026-02-21T10:40:07.1262081Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.1 configs/s
2026-02-21T10:40:07.6815558Z [140s] Generation 1 complete: 
2026-02-21T10:40:07.6815833Z ok=96
2026-02-21T10:40:07.6816001Z min=0.0842
2026-02-21T10:40:07.6816168Z mid=0.1241
2026-02-21T10:40:07.6816339Z max=0.6754
2026-02-21T10:40:07.6816519Z best={'block_sizes': [1, 4096],
2026-02-21T10:40:07.6816860Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:40:07.6817241Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:40:07.6817515Z  'maxnreg': 256,
2026-02-21T10:40:07.6817713Z  'num_sm_multiplier': 16,
2026-02-21T10:40:07.6817932Z  'num_stages': 5,
2026-02-21T10:40:07.6818124Z  'num_warps': 4,
2026-02-21T10:40:07.6818357Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:40:07.6818652Z  'range_flattens': [None, None],
2026-02-21T10:40:07.6818903Z  'range_multi_buffers': [False, False],
2026-02-21T10:40:07.6819170Z  'range_num_stages': [1, 0],
2026-02-21T10:40:07.6819426Z  'range_unroll_factors': [1, 1],
2026-02-21T10:40:07.6819677Z  'range_warp_specializes': []}
2026-02-21T10:40:07.6838127Z [140s] Fitting surrogate: 196 points, 196 targets
2026-02-21T10:40:09.2478472Z [142s] Generation 2 starting: 88 neighbors, 5 active search path(s)
2026-02-21T10:40:47.1636734Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 2.0 configs/s
2026-02-21T10:40:52.6232589Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 16.4 configs/s
2026-02-21T10:41:02.0301068Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 107.0         
2026-02-21T10:41:02.0301544Z                                                                   configs/s     
2026-02-21T10:41:02.5459508Z [195s] Generation 2 complete: 
2026-02-21T10:41:02.5459789Z ok=93
2026-02-21T10:41:02.5459962Z min=0.0736
2026-02-21T10:41:02.5460136Z mid=0.1097
2026-02-21T10:41:02.5460298Z max=0.3655
2026-02-21T10:41:02.5460480Z best={'block_sizes': [1, 16384],
2026-02-21T10:41:02.5461211Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:41:02.5461605Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:41:02.5461872Z  'num_stages': 5,
2026-02-21T10:41:02.5462065Z  'num_warps': 4,
2026-02-21T10:41:02.5462263Z  'pid_type': 'flat',
2026-02-21T10:41:02.5462472Z  'range_flattens': [None, None],
2026-02-21T10:41:02.5462726Z  'range_multi_buffers': [None, False],
2026-02-21T10:41:02.5462985Z  'range_num_stages': [0, 0],
2026-02-21T10:41:02.5463221Z  'range_unroll_factors': [0, 1],
2026-02-21T10:41:02.5463470Z  'range_warp_specializes': []}
2026-02-21T10:41:02.5485165Z [195s] Fitting surrogate: 289 points, 289 targets
2026-02-21T10:41:03.8141385Z [196s] Generation 3 starting: 77 neighbors, 5 active search path(s)
2026-02-21T10:41:37.3556327Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 2.6 configs/s
2026-02-21T10:41:42.9322481Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 14.1 configs/s
2026-02-21T10:41:55.4243433Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 93.1 configs/s
2026-02-21T10:41:56.0292304Z [248s] Generation 3 complete: 
2026-02-21T10:41:56.0292822Z ok=82
2026-02-21T10:41:56.0293198Z min=0.0735
2026-02-21T10:41:56.0293554Z mid=0.1031
2026-02-21T10:41:56.0293899Z max=1.5438
2026-02-21T10:41:56.0294704Z best={'block_sizes': [1, 16384],
2026-02-21T10:41:56.0295485Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:41:56.0296383Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:41:56.0296976Z  'num_stages': 2,
2026-02-21T10:41:56.0297389Z  'num_warps': 4,
2026-02-21T10:41:56.0297804Z  'pid_type': 'flat',
2026-02-21T10:41:56.0298283Z  'range_flattens': [None, True],
2026-02-21T10:41:56.0298856Z  'range_multi_buffers': [None, True],
2026-02-21T10:41:56.0299510Z  'range_num_stages': [0, 3],
2026-02-21T10:41:56.0300041Z  'range_unroll_factors': [0, 1],
2026-02-21T10:41:56.0300605Z  'range_warp_specializes': []}
2026-02-21T10:41:56.0316354Z [248s] Fitting surrogate: 371 points, 371 targets
2026-02-21T10:41:57.0842562Z [249s] Generation 4 starting: 64 neighbors, 5 active search path(s)
2026-02-21T10:42:25.5497724Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 3.3 configs/s
2026-02-21T10:42:29.7459560Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 16.4 configs/s
2026-02-21T10:42:39.4120018Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 104.2         
2026-02-21T10:42:39.4120960Z                                                                   configs/s     
2026-02-21T10:42:39.9712098Z [292s] Generation 4 complete: 
2026-02-21T10:42:39.9712397Z ok=70
2026-02-21T10:42:39.9712740Z min=0.0732
2026-02-21T10:42:39.9713153Z mid=0.0936
2026-02-21T10:42:39.9713534Z max=0.5040
2026-02-21T10:42:39.9714495Z best={'block_sizes': [1, 16384],
2026-02-21T10:42:39.9715217Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T10:42:39.9716021Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T10:42:39.9717329Z  'num_stages': 1,
2026-02-21T10:42:39.9717750Z  'num_warps': 16,
2026-02-21T10:42:39.9718184Z  'pid_type': 'flat',
2026-02-21T10:42:39.9718683Z  'range_flattens': [None, False],
2026-02-21T10:42:39.9719279Z  'range_multi_buffers': [None, False],
2026-02-21T10:42:39.9719865Z  'range_num_stages': [0, 1],
2026-02-21T10:42:39.9720415Z  'range_unroll_factors': [0, 1],
2026-02-21T10:42:39.9720971Z  'range_warp_specializes': []}
2026-02-21T10:42:39.9746073Z [292s] Fitting surrogate: 441 points, 441 targets
2026-02-21T10:42:40.9515353Z [293s] Generation 5 starting: 59 neighbors, 5 active search path(s)
2026-02-21T10:43:09.6716855Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63/63 1.5 configs/s
2026-02-21T10:43:13.5426796Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 63/63 16.5 configs/s
2026-02-21T10:43:23.0246734Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.2         
2026-02-21T10:43:23.0247251Z                                                                   configs/s     
2026-02-21T10:43:23.5921252Z [336s] Generation 5 complete: 
2026-02-21T10:43:23.5921734Z ok=65
2026-02-21T10:43:23.5922018Z min=0.0712
2026-02-21T10:43:23.5922305Z mid=0.0793
2026-02-21T10:43:23.5922573Z max=0.1945
2026-02-21T10:43:23.5922881Z best={'block_sizes': [1, 16384],
2026-02-21T10:43:23.5923407Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:43:23.5924443Z  'load_eviction_policies': ['', ''],
2026-02-21T10:43:23.5924887Z  'num_stages': 8,
2026-02-21T10:43:23.5925229Z  'num_warps': 4,
2026-02-21T10:43:23.5925561Z  'pid_type': 'flat',
2026-02-21T10:43:23.5925937Z  'range_flattens': [None, None],
2026-02-21T10:43:23.5926353Z  'range_multi_buffers': [None, None],
2026-02-21T10:43:23.5926786Z  'range_num_stages': [0, 2],
2026-02-21T10:43:23.5927199Z  'range_unroll_factors': [0, 2],
2026-02-21T10:43:23.5927627Z  'range_warp_specializes': []}
2026-02-21T10:43:23.5952032Z [336s] Fitting surrogate: 506 points, 506 targets
2026-02-21T10:43:24.3899484Z [337s] Generation 6 starting: 42 neighbors, 4 active search path(s)
2026-02-21T10:43:44.4379921Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 4.6 configs/s
2026-02-21T10:43:47.1239639Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 42/42 15.9 configs/s
2026-02-21T10:43:54.3804403Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 138.8         
2026-02-21T10:43:54.3804950Z                                                                   configs/s     
2026-02-21T10:43:54.8324387Z [367s] Generation 6 complete: 
2026-02-21T10:43:54.8324704Z ok=46
2026-02-21T10:43:54.8324905Z min=0.0713
2026-02-21T10:43:54.8325082Z mid=0.0747
2026-02-21T10:43:54.8325268Z max=1.4591
2026-02-21T10:43:54.8325457Z best={'block_sizes': [1, 16384],
2026-02-21T10:43:54.8325860Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:43:54.8326255Z  'load_eviction_policies': ['', ''],
2026-02-21T10:43:54.8326526Z  'num_stages': 8,
2026-02-21T10:43:54.8326765Z  'num_warps': 4,
2026-02-21T10:43:54.8326982Z  'pid_type': 'flat',
2026-02-21T10:43:54.8327218Z  'range_flattens': [None, None],
2026-02-21T10:43:54.8327479Z  'range_multi_buffers': [None, None],
2026-02-21T10:43:54.8327767Z  'range_num_stages': [0, 2],
2026-02-21T10:43:54.8328021Z  'range_unroll_factors': [0, 2],
2026-02-21T10:43:54.8328279Z  'range_warp_specializes': []}
2026-02-21T10:43:54.8358273Z [367s] Fitting surrogate: 552 points, 552 targets
2026-02-21T10:43:55.5509205Z [368s] Generation 7 starting: 41 neighbors, 4 active search path(s)
2026-02-21T10:44:14.0249321Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 3.2 configs/s
2026-02-21T10:44:17.8287137Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 41/41 10.8 configs/s
2026-02-21T10:44:25.0442438Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 139.6         
2026-02-21T10:44:25.0442963Z                                                                   configs/s     
2026-02-21T10:44:25.4952710Z [398s] Generation 7 complete: 
2026-02-21T10:44:25.4953063Z ok=45
2026-02-21T10:44:25.4953291Z min=0.0716
2026-02-21T10:44:25.4953514Z mid=0.0735
2026-02-21T10:44:25.4953741Z max=0.2103
2026-02-21T10:44:25.4954435Z best={'block_sizes': [1, 16384],
2026-02-21T10:44:25.4954944Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:44:25.4955472Z  'load_eviction_policies': ['', ''],
2026-02-21T10:44:25.4955824Z  'num_stages': 8,
2026-02-21T10:44:25.4956107Z  'num_warps': 4,
2026-02-21T10:44:25.4956372Z  'pid_type': 'flat',
2026-02-21T10:44:25.4956674Z  'range_flattens': [None, None],
2026-02-21T10:44:25.4956975Z  'range_multi_buffers': [None, None],
2026-02-21T10:44:25.4957282Z  'range_num_stages': [0, 1],
2026-02-21T10:44:25.4957556Z  'range_unroll_factors': [0, 2],
2026-02-21T10:44:25.4958371Z  'range_warp_specializes': []}
2026-02-21T10:44:25.4987879Z [398s] Fitting surrogate: 597 points, 597 targets
2026-02-21T10:44:26.2509591Z [399s] Generation 8 starting: 43 neighbors, 4 active search path(s)
2026-02-21T10:44:47.9798117Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 1.9 configs/s
2026-02-21T10:44:51.2269978Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 13.4 configs/s
2026-02-21T10:44:58.2799063Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 142.7         
2026-02-21T10:44:58.2799609Z                                                                   configs/s     
2026-02-21T10:44:58.7150001Z [431s] Generation 8 complete: 
2026-02-21T10:44:58.7150363Z ok=47
2026-02-21T10:44:58.7150556Z min=0.0716
2026-02-21T10:44:58.7150746Z mid=0.0747
2026-02-21T10:44:58.7150920Z max=2.0289
2026-02-21T10:44:58.7151107Z best={'block_sizes': [1, 16384],
2026-02-21T10:44:58.7151523Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:44:58.7151909Z  'load_eviction_policies': ['', ''],
2026-02-21T10:44:58.7152190Z  'num_stages': 8,
2026-02-21T10:44:58.7152386Z  'num_warps': 8,
2026-02-21T10:44:58.7152610Z  'pid_type': 'flat',
2026-02-21T10:44:58.7152835Z  'range_flattens': [None, True],
2026-02-21T10:44:58.7153110Z  'range_multi_buffers': [None, None],
2026-02-21T10:44:58.7153384Z  'range_num_stages': [0, 1],
2026-02-21T10:44:58.7153617Z  'range_unroll_factors': [0, 2],
2026-02-21T10:44:58.7153871Z  'range_warp_specializes': []}
2026-02-21T10:44:58.7188440Z [431s] Fitting surrogate: 644 points, 644 targets
2026-02-21T10:44:59.2855480Z [432s] Generation 9 starting: 27 neighbors, 3 active search path(s)
2026-02-21T10:45:11.4979407Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 3.0 configs/s
2026-02-21T10:45:13.1496994Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 27/27 16.8 configs/s
2026-02-21T10:45:18.1333615Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 201.5         
2026-02-21T10:45:18.1334402Z                                                                   configs/s     
2026-02-21T10:45:18.4534229Z [451s] Generation 9 complete: 
2026-02-21T10:45:18.4534648Z ok=30
2026-02-21T10:45:18.4534874Z min=0.0714
2026-02-21T10:45:18.4535094Z mid=0.0735
2026-02-21T10:45:18.4535318Z max=0.1057
2026-02-21T10:45:18.4535570Z best={'block_sizes': [1, 16384],
2026-02-21T10:45:18.4536032Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:45:18.4536513Z  'load_eviction_policies': ['', ''],
2026-02-21T10:45:18.4536857Z  'num_stages': 8,
2026-02-21T10:45:18.4537113Z  'num_warps': 8,
2026-02-21T10:45:18.4537380Z  'pid_type': 'flat',
2026-02-21T10:45:18.4537676Z  'range_flattens': [None, True],
2026-02-21T10:45:18.4538052Z  'range_multi_buffers': [None, None],
2026-02-21T10:45:18.4538414Z  'range_num_stages': [0, 1],
2026-02-21T10:45:18.4538736Z  'range_unroll_factors': [0, 2],
2026-02-21T10:45:18.4539099Z  'range_warp_specializes': []}
2026-02-21T10:45:18.4568979Z [451s] Fitting surrogate: 674 points, 674 targets
2026-02-21T10:45:18.8903600Z [451s] Generation 10 starting: 21 neighbors, 2 active search path(s)
2026-02-21T10:45:29.0480942Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 2.4 configs/s
2026-02-21T10:45:30.3405867Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 17.6 configs/s
2026-02-21T10:45:33.6247277Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 304.5         
2026-02-21T10:45:33.6247901Z                                                                   configs/s     
2026-02-21T10:45:33.8490177Z [466s] Generation 10 complete: 
2026-02-21T10:45:33.8490538Z error=1
2026-02-21T10:45:33.8490753Z ok=22
2026-02-21T10:45:33.8490973Z min=0.0714
2026-02-21T10:45:33.8491197Z mid=0.0749
2026-02-21T10:45:33.8491420Z max=0.1823
2026-02-21T10:45:33.8491677Z best={'block_sizes': [1, 16384],
2026-02-21T10:45:33.8492127Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:45:33.8538040Z  'load_eviction_policies': ['', ''],
2026-02-21T10:45:33.8538400Z  'num_stages': 7,
2026-02-21T10:45:33.8538650Z  'num_warps': 8,
2026-02-21T10:45:33.8538889Z  'pid_type': 'flat',
2026-02-21T10:45:33.8539185Z  'range_flattens': [None, True],
2026-02-21T10:45:33.8539508Z  'range_multi_buffers': [None, None],
2026-02-21T10:45:33.8539848Z  'range_num_stages': [0, 1],
2026-02-21T10:45:33.8540153Z  'range_unroll_factors': [0, 2],
2026-02-21T10:45:33.8540468Z  'range_warp_specializes': []}
2026-02-21T10:45:33.8540831Z [466s] Fitting surrogate: 697 points, 697 targets
2026-02-21T10:45:34.3332537Z [467s] Generation 11 starting: 23 neighbors, 2 active search path(s)
2026-02-21T10:45:46.7160363Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 3.4 configs/s
2026-02-21T10:45:48.4614656Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 13.4 configs/s
2026-02-21T10:45:52.4317905Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 252.5         
2026-02-21T10:45:52.4318437Z                                                                   configs/s     
2026-02-21T10:45:52.6954683Z [485s] Generation 11 complete: 
2026-02-21T10:45:52.6954978Z ok=25
2026-02-21T10:45:52.6955192Z min=0.0714
2026-02-21T10:45:52.6955380Z mid=0.0736
2026-02-21T10:45:52.6955565Z max=0.2626
2026-02-21T10:45:52.6955764Z best={'block_sizes': [1, 16384],
2026-02-21T10:45:52.6956097Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T10:45:52.6956464Z  'load_eviction_policies': ['', ''],
2026-02-21T10:45:52.6956732Z  'num_stages': 7,
2026-02-21T10:45:52.6956943Z  'num_warps': 8,
2026-02-21T10:45:52.6957151Z  'pid_type': 'flat',
2026-02-21T10:45:52.6957379Z  'range_flattens': [None, True],
2026-02-21T10:45:52.6957655Z  'range_multi_buffers': [None, None],
2026-02-21T10:45:52.6957944Z  'range_num_stages': [0, 1],
2026-02-21T10:45:52.6958201Z  'range_unroll_factors': [0, 2],
2026-02-21T10:45:52.6958451Z  'range_warp_specializes': []}
2026-02-21T10:45:52.6990936Z [485s] Fitting surrogate: 722 points, 722 targets
2026-02-21T10:45:53.1092355Z [486s] Generation 12 starting: 18 neighbors, 2 active search path(s)
2026-02-21T10:46:02.0543349Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.0 configs/s
2026-02-21T10:46:03.2427180Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.6 configs/s
2026-02-21T10:46:06.4399431Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 312.5         
2026-02-21T10:46:06.4399959Z                                                                   configs/s     
2026-02-21T10:46:06.6560973Z [499s] Generation 12 complete: 
2026-02-21T10:46:06.6561257Z ok=20
2026-02-21T10:46:06.6561442Z min=0.0711
2026-02-21T10:46:06.6561617Z mid=0.0765
2026-02-21T10:46:06.6561791Z max=0.2671
2026-02-21T10:46:06.6561981Z best={'block_sizes': [1, 16384],
2026-02-21T10:46:06.6562355Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:46:06.6562746Z  'load_eviction_policies': ['', ''],
2026-02-21T10:46:06.6563565Z  'num_stages': 7,
2026-02-21T10:46:06.6563783Z  'num_warps': 8,
2026-02-21T10:46:06.6564339Z  'pid_type': 'flat',
2026-02-21T10:46:06.6564585Z  'range_flattens': [None, True],
2026-02-21T10:46:06.6564865Z  'range_multi_buffers': [None, None],
2026-02-21T10:46:06.6565136Z  'range_num_stages': [0, 1],
2026-02-21T10:46:06.6565394Z  'range_unroll_factors': [0, 2],
2026-02-21T10:46:06.6565649Z  'range_warp_specializes': []}
2026-02-21T10:46:06.6598125Z [499s] Fitting surrogate: 742 points, 742 targets
2026-02-21T10:46:06.9767456Z [499s] Generation 13 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:46:12.9824955Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.0 configs/s
2026-02-21T10:46:13.7191880Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.4 configs/s
2026-02-21T10:46:15.9848374Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 439.0         
2026-02-21T10:46:15.9848900Z                                                                   configs/s     
2026-02-21T10:46:16.1530201Z [509s] Generation 13 complete: 
2026-02-21T10:46:16.1530466Z ok=14
2026-02-21T10:46:16.1530649Z min=0.0716
2026-02-21T10:46:16.1530857Z mid=0.0735
2026-02-21T10:46:16.1531029Z max=0.0907
2026-02-21T10:46:16.1531216Z best={'block_sizes': [1, 16384],
2026-02-21T10:46:16.1531572Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:46:16.1531963Z  'load_eviction_policies': ['', ''],
2026-02-21T10:46:16.1532217Z  'num_stages': 7,
2026-02-21T10:46:16.1532419Z  'num_warps': 8,
2026-02-21T10:46:16.1532616Z  'pid_type': 'flat',
2026-02-21T10:46:16.1532842Z  'range_flattens': [None, True],
2026-02-21T10:46:16.1533105Z  'range_multi_buffers': [None, None],
2026-02-21T10:46:16.1533393Z  'range_num_stages': [0, 1],
2026-02-21T10:46:16.1533602Z  'range_unroll_factors': [0, 2],
2026-02-21T10:46:16.1533813Z  'range_warp_specializes': []}
2026-02-21T10:46:16.1566094Z [509s] Fitting surrogate: 756 points, 756 targets
2026-02-21T10:46:16.4659998Z [509s] Generation 14 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:46:22.7382726Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.5 configs/s
2026-02-21T10:46:23.4898885Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.0 configs/s
2026-02-21T10:46:25.7976201Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 431.1         
2026-02-21T10:46:25.7977233Z                                                                   configs/s     
2026-02-21T10:46:25.9660632Z [518s] Generation 14 complete: 
2026-02-21T10:46:25.9660891Z ok=14
2026-02-21T10:46:25.9661052Z min=0.0716
2026-02-21T10:46:25.9661232Z mid=0.0747
2026-02-21T10:46:25.9661412Z max=0.1051
2026-02-21T10:46:25.9661592Z best={'block_sizes': [1, 16384],
2026-02-21T10:46:25.9661938Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:46:25.9662315Z  'load_eviction_policies': ['', ''],
2026-02-21T10:46:25.9662572Z  'num_stages': 7,
2026-02-21T10:46:25.9662797Z  'num_warps': 8,
2026-02-21T10:46:25.9662998Z  'pid_type': 'flat',
2026-02-21T10:46:25.9663203Z  'range_flattens': [None, True],
2026-02-21T10:46:25.9663453Z  'range_multi_buffers': [None, None],
2026-02-21T10:46:25.9711293Z  'range_num_stages': [0, 1],
2026-02-21T10:46:25.9711542Z  'range_unroll_factors': [0, 2],
2026-02-21T10:46:25.9711806Z  'range_warp_specializes': []}
2026-02-21T10:46:25.9712096Z [518s] Fitting surrogate: 770 points, 770 targets
2026-02-21T10:46:26.2755776Z [519s] Generation 15 starting: 11 neighbors, 1 active search path(s)
2026-02-21T10:46:46.0783149Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 0.2 configs/s
2026-02-21T10:46:47.0133293Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 12.0 configs/s
2026-02-21T10:46:48.8186022Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 548.9         
2026-02-21T10:46:48.8186654Z                                                                   configs/s     
2026-02-21T10:46:48.9601615Z [541s] Generation 15 complete: 
2026-02-21T10:46:48.9601896Z ok=13
2026-02-21T10:46:48.9602079Z min=0.0715
2026-02-21T10:46:48.9602251Z mid=0.0749
2026-02-21T10:46:48.9602422Z max=1.7004
2026-02-21T10:46:48.9602633Z best={'block_sizes': [1, 16384],
2026-02-21T10:46:48.9602994Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:46:48.9603378Z  'load_eviction_policies': ['', ''],
2026-02-21T10:46:48.9603645Z  'num_stages': 7,
2026-02-21T10:46:48.9603850Z  'num_warps': 8,
2026-02-21T10:46:48.9604244Z  'pid_type': 'flat',
2026-02-21T10:46:48.9604497Z  'range_flattens': [None, True],
2026-02-21T10:46:48.9604760Z  'range_multi_buffers': [None, None],
2026-02-21T10:46:48.9605033Z  'range_num_stages': [0, 1],
2026-02-21T10:46:48.9605274Z  'range_unroll_factors': [0, 2],
2026-02-21T10:46:48.9605548Z  'range_warp_specializes': []}
2026-02-21T10:46:48.9640684Z [541s] Fitting surrogate: 783 points, 783 targets
2026-02-21T10:46:49.2789713Z [542s] Generation 16 starting: 12 neighbors, 1 active search path(s)
2026-02-21T10:46:54.9932197Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 3.1 configs/s
2026-02-21T10:46:55.7371946Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.2 configs/s
2026-02-21T10:46:57.5104801Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 558.2         
2026-02-21T10:46:57.5105429Z                                                                   configs/s     
2026-02-21T10:46:57.6508021Z [550s] Generation 16 complete: 
2026-02-21T10:46:57.6508277Z ok=14
2026-02-21T10:46:57.6508462Z min=0.0717
2026-02-21T10:46:57.6508629Z mid=0.0748
2026-02-21T10:46:57.6508801Z max=0.2717
2026-02-21T10:46:57.6508985Z best={'block_sizes': [1, 16384],
2026-02-21T10:46:57.6509323Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T10:46:57.6509703Z  'load_eviction_policies': ['', ''],
2026-02-21T10:46:57.6509952Z  'num_stages': 7,
2026-02-21T10:46:57.6510143Z  'num_warps': 8,
2026-02-21T10:46:57.6510357Z  'pid_type': 'flat',
2026-02-21T10:46:57.6510568Z  'range_flattens': [None, True],
2026-02-21T10:46:57.6510815Z  'range_multi_buffers': [None, None],
2026-02-21T10:46:57.6511079Z  'range_num_stages': [0, 1],
2026-02-21T10:46:57.6511322Z  'range_unroll_factors': [0, 2],
2026-02-21T10:46:57.6511569Z  'range_warp_specializes': []}
2026-02-21T10:46:57.6545380Z [550s] Fitting surrogate: 797 points, 797 targets
2026-02-21T10:46:57.9276812Z [550s] Autotuning complete in 550.8s after searching 749 configs.
2026-02-21T10:46:57.9277293Z One can hardcode the best config and skip autotuning with:
2026-02-21T10:46:57.9278783Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=7, num_warps=8, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T10:46:57.9280159Z 
2026-02-21T10:46:57.9280584Z [550s] Code of selected kernel: /tmp/torchinductor_root/22/c22u6z7yfus2gf7ttztyts3ifmwve45c5amhsucbmz5ktevhlb7h.py
2026-02-21T10:46:59.1997395Z WARNING:tritonbench.utils.triton_op:Completed input ID 92:
2026-02-21T10:46:59.2510885Z (M, N)
2026-02-21T10:46:59.2511052Z -------------
2026-02-21T10:46:59.2511233Z (4096, 12032)
2026-02-21T10:46:59.2511342Z 
2026-02-21T10:46:59.2511904Z  95%|█████████▌| 19/20 [2:28:29<09:27, 567.44s/it]WARNING:tritonbench.utils.triton_op:Running input ID 97:
2026-02-21T10:46:59.2512329Z (M, N)
2026-02-21T10:46:59.2512484Z -------------
2026-02-21T10:46:59.2512652Z (4096, 12672)
2026-02-21T10:46:59.2512997Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T10:47:00.6285439Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T10:47:02.1856651Z INFO:tritonbench.utils.triton_op:Took 3.30ms to get benchmark function for torch_compile_softmax
2026-02-21T10:47:07.1754736Z WARNING:__main__:Input tensor metadata:
2026-02-21T10:47:07.1755137Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T10:47:07.1755409Z               'dtype': 'torch.float16',
2026-02-21T10:47:07.1755712Z               'shape': (4096, 12672),
2026-02-21T10:47:07.1755958Z               'stride': (12672, 1)},),
2026-02-21T10:47:07.1756213Z   'kwargs': {}}
2026-02-21T10:47:07.1798328Z INFO:tritonbench.utils.triton_op:Took 4.79ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T10:47:07.4677135Z [0s] Autotune random seed: 2135383793
2026-02-21T10:47:07.6512584Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T10:47:51.3817027Z [43s] Timeout after 35s compiling Config(block_sizes=[32, 2048], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[None, None], range_num_stages=[1, 1], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T10:47:51.9888895Z [44s] Timeout after 34s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_interleaved', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[0, 4], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:47:52.4708355Z [44s] Timeout after 31s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T10:48:11.8161588Z [64s] Timeout after 30s compiling Config(block_sizes=[16, 1024], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=3, num_warps=1, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[0, 3], range_unroll_factors=[2, 2], range_warp_specializes=[])
2026-02-21T10:48:15.3415152Z [67s] Timeout after 30s compiling Config(block_sizes=[512, 1024], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=6, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T10:48:15.3434928Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.3 configs/s
2026-02-21T10:48:25.4219006Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━━ 100/100 9.9 configs/s
2026-02-21T10:48:25.4232218Z [77s] Adaptive compile timeout: 30s (90% percentile=36.0s, bounds=[30.0s, 30s])
2026-02-21T10:48:27.2553399Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 534.1 configs/s
2026-02-21T10:48:27.3870046Z [79s] Initial random population of 100, 5 starting points: 
2026-02-21T10:48:27.3870906Z error=4
2026-02-21T10:48:27.3871092Z timeout=5
2026-02-21T10:48:27.3871256Z ok=91
2026-02-21T10:48:27.3871422Z min=0.1200
2026-02-21T10:48:27.3871592Z mid=1.0110
2026-02-21T10:48:27.3871763Z max=258.4560
2026-02-21T10:48:27.3871959Z best={'block_sizes': [1, 2048],
2026-02-21T10:48:27.3872326Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:48:27.3872715Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T10:48:27.3873126Z  'maxnreg': 256,
2026-02-21T10:48:27.3873354Z  'num_sm_multiplier': 16,
2026-02-21T10:48:27.3873628Z  'num_stages': 5,
2026-02-21T10:48:27.3873843Z  'num_warps': 4,
2026-02-21T10:48:27.3874430Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:48:27.3874751Z  'range_flattens': [None, None],
2026-02-21T10:48:27.3875383Z  'range_multi_buffers': [False, False],
2026-02-21T10:48:27.3875673Z  'range_num_stages': [1, 1],
2026-02-21T10:48:27.3875888Z  'range_unroll_factors': [1, 1],
2026-02-21T10:48:27.3876134Z  'range_warp_specializes': []}
2026-02-21T10:48:27.3888853Z [79s] Fitting surrogate: 100 points, 100 targets
2026-02-21T10:48:28.8349081Z [81s] Generation 1 starting: 90 neighbors, 5 active search path(s)
2026-02-21T10:49:10.3384337Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 2.1 configs/s
2026-02-21T10:49:16.1124398Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 16.2 configs/s
2026-02-21T10:49:30.9006930Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 76.7 configs/s
2026-02-21T10:49:31.5335043Z [143s] Generation 1 complete: 
2026-02-21T10:49:31.5335497Z ok=95
2026-02-21T10:49:31.5335772Z min=0.1053
2026-02-21T10:49:31.5336053Z mid=0.1367
2026-02-21T10:49:31.5336318Z max=0.8345
2026-02-21T10:49:31.5336612Z best={'block_sizes': [1, 4096],
2026-02-21T10:49:31.5337219Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:49:31.5337850Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:49:31.5338309Z  'maxnreg': 256,
2026-02-21T10:49:31.5338631Z  'num_sm_multiplier': 16,
2026-02-21T10:49:31.5338975Z  'num_stages': 5,
2026-02-21T10:49:31.5339286Z  'num_warps': 4,
2026-02-21T10:49:31.5339702Z  'pid_type': 'persistent_interleaved',
2026-02-21T10:49:31.5340238Z  'range_flattens': [None, None],
2026-02-21T10:49:31.5340533Z  'range_multi_buffers': [False, False],
2026-02-21T10:49:31.5340792Z  'range_num_stages': [1, 0],
2026-02-21T10:49:31.5341030Z  'range_unroll_factors': [1, 1],
2026-02-21T10:49:31.5341271Z  'range_warp_specializes': []}
2026-02-21T10:49:31.5354507Z [143s] Fitting surrogate: 195 points, 195 targets
2026-02-21T10:49:33.1181880Z [145s] Generation 2 starting: 98 neighbors, 5 active search path(s)
2026-02-21T10:50:16.3978582Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 100/100 3.4 configs/s
2026-02-21T10:50:22.5729107Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━ 100/100 16.3 configs/s
2026-02-21T10:50:30.6023224Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.2         
2026-02-21T10:50:30.6025874Z                                                                   configs/s     
2026-02-21T10:50:31.0329972Z [203s] Generation 2 complete: 
2026-02-21T10:50:31.0330283Z ok=104
2026-02-21T10:50:31.0330478Z min=0.0768
2026-02-21T10:50:31.0330654Z mid=0.1165
2026-02-21T10:50:31.0330833Z max=0.3970
2026-02-21T10:50:31.0331020Z best={'block_sizes': [1, 16384],
2026-02-21T10:50:31.0331389Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:50:31.0331791Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:50:31.0332071Z  'num_stages': 5,
2026-02-21T10:50:31.0332263Z  'num_warps': 8,
2026-02-21T10:50:31.0332467Z  'pid_type': 'flat',
2026-02-21T10:50:31.0332685Z  'range_flattens': [None, None],
2026-02-21T10:50:31.0332985Z  'range_multi_buffers': [None, False],
2026-02-21T10:50:31.0333261Z  'range_num_stages': [0, 0],
2026-02-21T10:50:31.0333514Z  'range_unroll_factors': [0, 1],
2026-02-21T10:50:31.0333782Z  'range_warp_specializes': []}
2026-02-21T10:50:31.0359539Z [203s] Fitting surrogate: 299 points, 299 targets
2026-02-21T10:50:32.3618949Z [204s] Generation 3 starting: 83 neighbors, 5 active search path(s)
2026-02-21T10:51:16.4980161Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 1.1 configs/s
2026-02-21T10:51:22.6829122Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 14.0 configs/s
2026-02-21T10:51:30.4188643Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 129.9         
2026-02-21T10:51:30.4189154Z                                                                   configs/s     
2026-02-21T10:51:30.8401936Z [263s] Generation 3 complete: 
2026-02-21T10:51:30.8402254Z ok=88
2026-02-21T10:51:30.8402444Z min=0.0768
2026-02-21T10:51:30.8402626Z mid=0.1181
2026-02-21T10:51:30.9672477Z max=17.0612
2026-02-21T10:51:30.9672798Z best={'block_sizes': [1, 16384],
2026-02-21T10:51:30.9673450Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:51:30.9674441Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:51:30.9674860Z  'num_stages': 5,
2026-02-21T10:51:30.9675161Z  'num_warps': 8,
2026-02-21T10:51:30.9675464Z  'pid_type': 'flat',
2026-02-21T10:51:30.9675794Z  'range_flattens': [None, None],
2026-02-21T10:51:30.9676176Z  'range_multi_buffers': [None, False],
2026-02-21T10:51:30.9676582Z  'range_num_stages': [0, 0],
2026-02-21T10:51:30.9676932Z  'range_unroll_factors': [0, 1],
2026-02-21T10:51:30.9677303Z  'range_warp_specializes': []}
2026-02-21T10:51:30.9677759Z [263s] Fitting surrogate: 387 points, 387 targets
2026-02-21T10:51:32.1699332Z [264s] Generation 4 starting: 80 neighbors, 5 active search path(s)
2026-02-21T10:52:13.4967055Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 1.4 configs/s
2026-02-21T10:52:18.7215165Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 15.8 configs/s
2026-02-21T10:52:26.8739880Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 123.3         
2026-02-21T10:52:26.8741944Z                                                                   configs/s     
2026-02-21T10:52:27.3244616Z [319s] Generation 4 complete: 
2026-02-21T10:52:27.3244941Z error=1
2026-02-21T10:52:27.3245131Z ok=85
2026-02-21T10:52:27.3245310Z min=0.0768
2026-02-21T10:52:27.3245489Z mid=0.1149
2026-02-21T10:52:27.3245654Z max=0.3795
2026-02-21T10:52:27.3245849Z best={'block_sizes': [1, 16384],
2026-02-21T10:52:27.3246215Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:52:27.3246635Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:52:27.3246913Z  'num_stages': 5,
2026-02-21T10:52:27.3247113Z  'num_warps': 8,
2026-02-21T10:52:27.3247310Z  'pid_type': 'flat',
2026-02-21T10:52:27.3247536Z  'range_flattens': [None, None],
2026-02-21T10:52:27.3247838Z  'range_multi_buffers': [None, False],
2026-02-21T10:52:27.3248128Z  'range_num_stages': [0, 0],
2026-02-21T10:52:27.3248381Z  'range_unroll_factors': [0, 1],
2026-02-21T10:52:27.3248631Z  'range_warp_specializes': []}
2026-02-21T10:52:27.3277843Z [319s] Fitting surrogate: 473 points, 473 targets
2026-02-21T10:52:28.5259725Z [320s] Generation 5 starting: 73 neighbors, 4 active search path(s)
2026-02-21T10:53:08.6925246Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74/74 0.8 configs/s
2026-02-21T10:53:13.7946734Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 74/74 14.6 configs/s
2026-02-21T10:53:24.6201924Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.9         
2026-02-21T10:53:24.6203119Z                                                                   configs/s     
2026-02-21T10:53:25.1180064Z [377s] Generation 5 complete: 
2026-02-21T10:53:25.1180357Z ok=78
2026-02-21T10:53:25.1180538Z min=0.0767
2026-02-21T10:53:25.1180725Z mid=0.1124
2026-02-21T10:53:25.1181448Z max=0.3276
2026-02-21T10:53:25.1181659Z best={'block_sizes': [1, 16384],
2026-02-21T10:53:25.1182049Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:53:25.1182540Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:53:25.1182807Z  'num_stages': 5,
2026-02-21T10:53:25.1182995Z  'num_warps': 8,
2026-02-21T10:53:25.1183183Z  'pid_type': 'flat',
2026-02-21T10:53:25.1183398Z  'range_flattens': [None, None],
2026-02-21T10:53:25.1183649Z  'range_multi_buffers': [None, False],
2026-02-21T10:53:25.1183917Z  'range_num_stages': [0, 0],
2026-02-21T10:53:25.1184508Z  'range_unroll_factors': [0, 1],
2026-02-21T10:53:25.1184763Z  'range_warp_specializes': []}
2026-02-21T10:53:25.1208994Z [377s] Fitting surrogate: 551 points, 551 targets
2026-02-21T10:53:26.3277892Z [378s] Generation 6 starting: 72 neighbors, 4 active search path(s)
2026-02-21T10:54:03.3374591Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75/75 1.7 configs/s
2026-02-21T10:54:08.3260162Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 75/75 15.1 configs/s
2026-02-21T10:54:13.8461133Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 181.8         
2026-02-21T10:54:13.8463564Z                                                                   configs/s     
2026-02-21T10:54:14.1688012Z [426s] Generation 6 complete: 
2026-02-21T10:54:14.1688443Z ok=77
2026-02-21T10:54:14.1688718Z min=0.0768
2026-02-21T10:54:14.1689005Z mid=0.1198
2026-02-21T10:54:14.1689267Z max=1.5401
2026-02-21T10:54:14.1689564Z best={'block_sizes': [1, 16384],
2026-02-21T10:54:14.1690277Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:54:14.1690921Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:54:14.1691365Z  'num_stages': 5,
2026-02-21T10:54:14.1691675Z  'num_warps': 8,
2026-02-21T10:54:14.1691990Z  'pid_type': 'flat',
2026-02-21T10:54:14.1692344Z  'range_flattens': [None, None],
2026-02-21T10:54:14.1692767Z  'range_multi_buffers': [None, False],
2026-02-21T10:54:14.1693221Z  'range_num_stages': [0, 0],
2026-02-21T10:54:14.1693608Z  'range_unroll_factors': [0, 1],
2026-02-21T10:54:14.1694259Z  'range_warp_specializes': []}
2026-02-21T10:54:14.1725120Z [426s] Fitting surrogate: 628 points, 628 targets
2026-02-21T10:54:15.5058170Z [427s] Generation 7 starting: 79 neighbors, 4 active search path(s)
2026-02-21T10:54:53.4673056Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81/81 1.5 configs/s
2026-02-21T10:54:58.8383358Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 81/81 15.2 configs/s
2026-02-21T10:55:07.9269885Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 110.7         
2026-02-21T10:55:07.9272335Z                                                                   configs/s     
2026-02-21T10:55:08.4328204Z [480s] Generation 7 complete: 
2026-02-21T10:55:08.4328499Z ok=84
2026-02-21T10:55:08.4328674Z min=0.0767
2026-02-21T10:55:08.4328857Z mid=0.1118
2026-02-21T10:55:08.4329026Z max=1.3586
2026-02-21T10:55:08.4342501Z best={'block_sizes': [1, 16384],
2026-02-21T10:55:08.4342961Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:55:08.4343358Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:55:08.4344366Z  'num_stages': 5,
2026-02-21T10:55:08.4344557Z  'num_warps': 8,
2026-02-21T10:55:08.4344758Z  'pid_type': 'flat',
2026-02-21T10:55:08.4344980Z  'range_flattens': [None, None],
2026-02-21T10:55:08.4345236Z  'range_multi_buffers': [None, False],
2026-02-21T10:55:08.4345466Z  'range_num_stages': [0, 0],
2026-02-21T10:55:08.4345658Z  'range_unroll_factors': [0, 1],
2026-02-21T10:55:08.4345871Z  'range_warp_specializes': []}
2026-02-21T10:55:08.4369462Z [480s] Fitting surrogate: 712 points, 712 targets
2026-02-21T10:55:09.4891043Z [481s] Generation 8 starting: 64 neighbors, 4 active search path(s)
2026-02-21T10:55:40.7741831Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 1.9 configs/s
2026-02-21T10:55:45.1587776Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 15.2 configs/s
2026-02-21T10:55:52.5067532Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 136.9         
2026-02-21T10:55:52.5070390Z                                                                   configs/s     
2026-02-21T10:55:52.9346022Z [525s] Generation 8 complete: 
2026-02-21T10:55:52.9346499Z ok=69
2026-02-21T10:55:52.9346777Z min=0.0767
2026-02-21T10:55:52.9347085Z mid=0.1072
2026-02-21T10:55:52.9347354Z max=4.6366
2026-02-21T10:55:52.9347660Z best={'block_sizes': [1, 16384],
2026-02-21T10:55:52.9348180Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T10:55:52.9348760Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:55:52.9349204Z  'num_stages': 3,
2026-02-21T10:55:52.9349517Z  'num_warps': 8,
2026-02-21T10:55:52.9349835Z  'pid_type': 'flat',
2026-02-21T10:55:52.9350184Z  'range_flattens': [None, None],
2026-02-21T10:55:52.9350609Z  'range_multi_buffers': [None, True],
2026-02-21T10:55:52.9351044Z  'range_num_stages': [0, 1],
2026-02-21T10:55:52.9351485Z  'range_unroll_factors': [0, 1],
2026-02-21T10:55:52.9351896Z  'range_warp_specializes': []}
2026-02-21T10:55:52.9390376Z [525s] Fitting surrogate: 781 points, 781 targets
2026-02-21T10:55:53.9730571Z [526s] Generation 9 starting: 63 neighbors, 4 active search path(s)
2026-02-21T10:56:25.6021499Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 3.0 configs/s
2026-02-21T10:56:29.6540151Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.5 configs/s
2026-02-21T10:56:39.4245390Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 103.1         
2026-02-21T10:56:39.4245850Z                                                                   configs/s     
2026-02-21T10:56:39.9858184Z [572s] Generation 9 complete: 
2026-02-21T10:56:39.9858504Z ok=67
2026-02-21T10:56:39.9858669Z min=0.0766
2026-02-21T10:56:39.9858846Z mid=0.0899
2026-02-21T10:56:39.9859009Z max=0.4423
2026-02-21T10:56:39.9859195Z best={'block_sizes': [1, 16384],
2026-02-21T10:56:39.9859571Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:56:39.9859953Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:56:39.9860241Z  'num_stages': 7,
2026-02-21T10:56:39.9860430Z  'num_warps': 8,
2026-02-21T10:56:39.9860623Z  'pid_type': 'flat',
2026-02-21T10:56:39.9860831Z  'range_flattens': [None, None],
2026-02-21T10:56:39.9861086Z  'range_multi_buffers': [None, True],
2026-02-21T10:56:39.9861352Z  'range_num_stages': [0, 2],
2026-02-21T10:56:39.9861595Z  'range_unroll_factors': [0, 2],
2026-02-21T10:56:39.9904107Z  'range_warp_specializes': []}
2026-02-21T10:56:39.9904410Z [572s] Fitting surrogate: 848 points, 848 targets
2026-02-21T10:56:41.0579920Z [573s] Generation 10 starting: 64 neighbors, 4 active search path(s)
2026-02-21T10:57:11.7529638Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 3.6 configs/s
2026-02-21T10:57:15.8172324Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 66/66 16.4 configs/s
2026-02-21T10:57:26.8928527Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 107.8         
2026-02-21T10:57:26.8928973Z                                                                   configs/s     
2026-02-21T10:57:27.4437362Z [619s] Generation 10 complete: 
2026-02-21T10:57:27.4437677Z ok=69
2026-02-21T10:57:27.4437858Z min=0.0765
2026-02-21T10:57:27.4438046Z mid=0.0811
2026-02-21T10:57:27.4438210Z max=1.7521
2026-02-21T10:57:27.4438404Z best={'block_sizes': [1, 16384],
2026-02-21T10:57:27.4438764Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:57:27.4439160Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:57:27.4439435Z  'num_stages': 7,
2026-02-21T10:57:27.4439636Z  'num_warps': 8,
2026-02-21T10:57:27.4439835Z  'pid_type': 'flat',
2026-02-21T10:57:27.4440059Z  'range_flattens': [None, None],
2026-02-21T10:57:27.4440330Z  'range_multi_buffers': [None, False],
2026-02-21T10:57:27.4440610Z  'range_num_stages': [0, 2],
2026-02-21T10:57:27.4441409Z  'range_unroll_factors': [0, 2],
2026-02-21T10:57:27.4441681Z  'range_warp_specializes': []}
2026-02-21T10:57:27.4475994Z [619s] Fitting surrogate: 917 points, 917 targets
2026-02-21T10:57:28.0383872Z [620s] Generation 11 starting: 30 neighbors, 2 active search path(s)
2026-02-21T10:57:42.7428708Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 4.4 configs/s
2026-02-21T10:57:44.6539799Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.6 configs/s
2026-02-21T10:57:48.0092046Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 297.7         
2026-02-21T10:57:48.0094931Z                                                                   configs/s     
2026-02-21T10:57:48.2290233Z [640s] Generation 11 complete: 
2026-02-21T10:57:48.2290534Z ok=32
2026-02-21T10:57:48.2290734Z min=0.0765
2026-02-21T10:57:48.2290921Z mid=0.1135
2026-02-21T10:57:48.2291089Z max=0.3676
2026-02-21T10:57:48.2291280Z best={'block_sizes': [1, 16384],
2026-02-21T10:57:48.2291676Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:57:48.2292087Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:57:48.2292365Z  'num_stages': 7,
2026-02-21T10:57:48.2292608Z  'num_warps': 8,
2026-02-21T10:57:48.2292812Z  'pid_type': 'flat',
2026-02-21T10:57:48.2293043Z  'range_flattens': [None, False],
2026-02-21T10:57:48.2293307Z  'range_multi_buffers': [None, False],
2026-02-21T10:57:48.2293586Z  'range_num_stages': [0, 2],
2026-02-21T10:57:48.2293837Z  'range_unroll_factors': [0, 1],
2026-02-21T10:57:48.2294423Z  'range_warp_specializes': []}
2026-02-21T10:57:48.2354848Z [640s] Fitting surrogate: 949 points, 949 targets
2026-02-21T10:57:48.9081566Z [641s] Generation 12 starting: 34 neighbors, 2 active search path(s)
2026-02-21T10:58:06.4158405Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 3.1 configs/s
2026-02-21T10:58:10.0263287Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 35/35 9.7 configs/s
2026-02-21T10:58:13.7362504Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 269.4         
2026-02-21T10:58:13.7363035Z                                                                   configs/s     
2026-02-21T10:58:13.9767821Z [666s] Generation 12 complete: 
2026-02-21T10:58:13.9768121Z ok=36
2026-02-21T10:58:13.9768299Z min=0.0758
2026-02-21T10:58:13.9768479Z mid=0.1119
2026-02-21T10:58:13.9768645Z max=0.3464
2026-02-21T10:58:13.9768843Z best={'block_sizes': [1, 16384],
2026-02-21T10:58:13.9769203Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:58:13.9769596Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:58:13.9769989Z  'num_stages': 8,
2026-02-21T10:58:13.9770190Z  'num_warps': 8,
2026-02-21T10:58:13.9770394Z  'pid_type': 'flat',
2026-02-21T10:58:13.9770615Z  'range_flattens': [None, False],
2026-02-21T10:58:13.9770887Z  'range_multi_buffers': [None, False],
2026-02-21T10:58:13.9771155Z  'range_num_stages': [0, 2],
2026-02-21T10:58:13.9771398Z  'range_unroll_factors': [0, 1],
2026-02-21T10:58:13.9846321Z  'range_warp_specializes': []}
2026-02-21T10:58:13.9846694Z [666s] Fitting surrogate: 985 points, 985 targets
2026-02-21T10:58:14.5950846Z [666s] Generation 13 starting: 32 neighbors, 2 active search path(s)
2026-02-21T10:58:31.1715149Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 4.3 configs/s
2026-02-21T10:58:33.2177932Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.5 configs/s
2026-02-21T10:58:36.3749962Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 316.3         
2026-02-21T10:58:36.3752528Z                                                                   configs/s     
2026-02-21T10:58:36.5845944Z [688s] Generation 13 complete: 
2026-02-21T10:58:36.5846245Z ok=34
2026-02-21T10:58:36.5846422Z min=0.0766
2026-02-21T10:58:36.5846609Z mid=0.1138
2026-02-21T10:58:36.5846790Z max=0.7562
2026-02-21T10:58:36.5846979Z best={'block_sizes': [1, 16384],
2026-02-21T10:58:36.5847371Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:58:36.5847773Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:58:36.5848053Z  'num_stages': 8,
2026-02-21T10:58:36.5848245Z  'num_warps': 8,
2026-02-21T10:58:36.5848466Z  'pid_type': 'flat',
2026-02-21T10:58:36.5848682Z  'range_flattens': [None, False],
2026-02-21T10:58:36.5848951Z  'range_multi_buffers': [None, False],
2026-02-21T10:58:36.5849231Z  'range_num_stages': [0, 2],
2026-02-21T10:58:36.5849481Z  'range_unroll_factors': [0, 2],
2026-02-21T10:58:36.5849699Z  'range_warp_specializes': []}
2026-02-21T10:58:36.5893666Z [688s] Fitting surrogate: 1019 points, 1019 targets
2026-02-21T10:58:37.1959609Z [689s] Generation 14 starting: 32 neighbors, 2 active search path(s)
2026-02-21T10:58:52.8060119Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 3.6 configs/s
2026-02-21T10:58:54.8502146Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.5 configs/s
2026-02-21T10:58:57.6401217Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 357.2         
2026-02-21T10:58:57.6403770Z                                                                   configs/s     
2026-02-21T10:58:57.8305083Z [710s] Generation 14 complete: 
2026-02-21T10:58:57.8305383Z ok=34
2026-02-21T10:58:57.8305572Z min=0.0761
2026-02-21T10:58:57.8305749Z mid=0.1148
2026-02-21T10:58:57.8305921Z max=1.7520
2026-02-21T10:58:57.8306122Z best={'block_sizes': [1, 16384],
2026-02-21T10:58:57.8306477Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:58:57.8306873Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:58:57.8307146Z  'num_stages': 8,
2026-02-21T10:58:57.8307345Z  'num_warps': 8,
2026-02-21T10:58:57.8307547Z  'pid_type': 'flat',
2026-02-21T10:58:57.8307769Z  'range_flattens': [None, False],
2026-02-21T10:58:57.8308044Z  'range_multi_buffers': [None, False],
2026-02-21T10:58:57.8308314Z  'range_num_stages': [0, 2],
2026-02-21T10:58:57.8308556Z  'range_unroll_factors': [0, 2],
2026-02-21T10:58:57.8308812Z  'range_warp_specializes': []}
2026-02-21T10:58:57.8356410Z [710s] Fitting surrogate: 1053 points, 1053 targets
2026-02-21T10:58:58.1893672Z [710s] Generation 15 starting: 15 neighbors, 1 active search path(s)
2026-02-21T10:59:09.2684950Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 1.3 configs/s
2026-02-21T10:59:10.7777634Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 16/16 12.4 configs/s
2026-02-21T10:59:12.2353288Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 672.9         
2026-02-21T10:59:12.2353836Z                                                                   configs/s     
2026-02-21T10:59:12.3536887Z [724s] Generation 15 complete: 
2026-02-21T10:59:12.3537146Z ok=17
2026-02-21T10:59:12.3537318Z min=0.0766
2026-02-21T10:59:12.3537485Z mid=0.1147
2026-02-21T10:59:12.3537651Z max=0.2674
2026-02-21T10:59:12.3537835Z best={'block_sizes': [1, 16384],
2026-02-21T10:59:12.3538183Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:59:12.4731548Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:59:12.4732005Z  'num_stages': 8,
2026-02-21T10:59:12.4732198Z  'num_warps': 8,
2026-02-21T10:59:12.4732394Z  'pid_type': 'flat',
2026-02-21T10:59:12.4732623Z  'range_flattens': [None, False],
2026-02-21T10:59:12.4732885Z  'range_multi_buffers': [None, False],
2026-02-21T10:59:12.4733134Z  'range_num_stages': [0, 2],
2026-02-21T10:59:12.4733348Z  'range_unroll_factors': [0, 2],
2026-02-21T10:59:12.4733583Z  'range_warp_specializes': []}
2026-02-21T10:59:12.4733860Z [724s] Fitting surrogate: 1070 points, 1070 targets
2026-02-21T10:59:12.7924406Z [725s] Generation 16 starting: 19 neighbors, 1 active search path(s)
2026-02-21T10:59:24.6707150Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 2.7 configs/s
2026-02-21T10:59:26.1353133Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 14.0 configs/s
2026-02-21T10:59:28.5728237Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 406.9         
2026-02-21T10:59:28.5728764Z                                                                   configs/s     
2026-02-21T10:59:28.7378193Z [741s] Generation 16 complete: 
2026-02-21T10:59:28.7378467Z ok=21
2026-02-21T10:59:28.7378637Z min=0.0765
2026-02-21T10:59:28.7378800Z mid=0.1110
2026-02-21T10:59:28.7378978Z max=0.3051
2026-02-21T10:59:28.7379155Z best={'block_sizes': [1, 16384],
2026-02-21T10:59:28.7379496Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:59:28.7379873Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:59:28.7380156Z  'num_stages': 8,
2026-02-21T10:59:28.7380345Z  'num_warps': 8,
2026-02-21T10:59:28.7380533Z  'pid_type': 'flat',
2026-02-21T10:59:28.7380749Z  'range_flattens': [None, False],
2026-02-21T10:59:28.7381001Z  'range_multi_buffers': [None, False],
2026-02-21T10:59:28.7381267Z  'range_num_stages': [0, 2],
2026-02-21T10:59:28.7381498Z  'range_unroll_factors': [0, 2],
2026-02-21T10:59:28.7381752Z  'range_warp_specializes': []}
2026-02-21T10:59:28.7434544Z [741s] Fitting surrogate: 1091 points, 1091 targets
2026-02-21T10:59:29.2079943Z [741s] Generation 17 starting: 21 neighbors, 1 active search path(s)
2026-02-21T10:59:44.0202849Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 1.4 configs/s
2026-02-21T10:59:45.4072364Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 16.4 configs/s
2026-02-21T10:59:47.4739195Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 478.2         
2026-02-21T10:59:47.4739682Z                                                                   configs/s     
2026-02-21T10:59:47.6205650Z [759s] Generation 17 complete: 
2026-02-21T10:59:47.6205938Z ok=23
2026-02-21T10:59:47.6206121Z min=0.0765
2026-02-21T10:59:47.6206307Z mid=0.1142
2026-02-21T10:59:47.6206476Z max=0.4388
2026-02-21T10:59:47.6206674Z best={'block_sizes': [1, 16384],
2026-02-21T10:59:47.6207035Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T10:59:47.6207476Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T10:59:47.6207759Z  'num_stages': 8,
2026-02-21T10:59:47.6207967Z  'num_warps': 8,
2026-02-21T10:59:47.6208170Z  'pid_type': 'flat',
2026-02-21T10:59:47.6209033Z  'range_flattens': [None, False],
2026-02-21T10:59:47.6209298Z  'range_multi_buffers': [None, False],
2026-02-21T10:59:47.6209521Z  'range_num_stages': [0, 2],
2026-02-21T10:59:47.6209732Z  'range_unroll_factors': [0, 2],
2026-02-21T10:59:47.6210056Z  'range_warp_specializes': []}
2026-02-21T10:59:47.6256156Z [759s] Fitting surrogate: 1114 points, 1114 targets
2026-02-21T10:59:48.1024168Z [760s] Generation 18 starting: 21 neighbors, 1 active search path(s)
2026-02-21T11:00:13.9499398Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 0.1 configs/s
2026-02-21T11:00:15.3376079Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 16.3 configs/s
2026-02-21T11:00:17.5806745Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 441.6         
2026-02-21T11:00:17.6287815Z                                                                   configs/s     
2026-02-21T11:00:17.7372601Z [790s] Generation 18 complete: 
2026-02-21T11:00:17.7372928Z ok=23
2026-02-21T11:00:17.7373195Z min=0.0764
2026-02-21T11:00:17.7373431Z mid=0.1142
2026-02-21T11:00:17.7373652Z max=0.3735
2026-02-21T11:00:17.7373906Z best={'block_sizes': [1, 16384],
2026-02-21T11:00:17.7374564Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:00:17.7375125Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:00:17.7375525Z  'num_stages': 8,
2026-02-21T11:00:17.7375787Z  'num_warps': 8,
2026-02-21T11:00:17.7376058Z  'pid_type': 'flat',
2026-02-21T11:00:17.7376357Z  'range_flattens': [None, False],
2026-02-21T11:00:17.7376726Z  'range_multi_buffers': [None, False],
2026-02-21T11:00:17.7377093Z  'range_num_stages': [0, 2],
2026-02-21T11:00:17.7377435Z  'range_unroll_factors': [0, 2],
2026-02-21T11:00:17.7377795Z  'range_warp_specializes': []}
2026-02-21T11:00:17.7431227Z [790s] Fitting surrogate: 1137 points, 1137 targets
2026-02-21T11:00:18.0837349Z [790s] Generation 19 starting: 14 neighbors, 1 active search path(s)
2026-02-21T11:00:27.9407542Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 2.3 configs/s
2026-02-21T11:00:28.8055967Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 18.4 configs/s
2026-02-21T11:00:31.1179737Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 429.2         
2026-02-21T11:00:31.1180286Z                                                                   configs/s     
2026-02-21T11:00:31.2807005Z [803s] Generation 19 complete: 
2026-02-21T11:00:31.2807359Z error=1
2026-02-21T11:00:31.2807572Z ok=15
2026-02-21T11:00:31.2807787Z min=0.0764
2026-02-21T11:00:31.2808008Z mid=0.0796
2026-02-21T11:00:31.2808232Z max=0.5450
2026-02-21T11:00:31.2808482Z best={'block_sizes': [1, 16384],
2026-02-21T11:00:31.2808971Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:00:31.2809544Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:00:31.2809992Z  'num_stages': 8,
2026-02-21T11:00:31.2810259Z  'num_warps': 8,
2026-02-21T11:00:31.2810516Z  'pid_type': 'flat',
2026-02-21T11:00:31.3435850Z  'range_flattens': [None, False],
2026-02-21T11:00:31.3436177Z  'range_multi_buffers': [None, False],
2026-02-21T11:00:31.3436511Z  'range_num_stages': [0, 2],
2026-02-21T11:00:31.3436798Z  'range_unroll_factors': [0, 2],
2026-02-21T11:00:31.3437105Z  'range_warp_specializes': []}
2026-02-21T11:00:31.3437459Z [803s] Fitting surrogate: 1153 points, 1153 targets
2026-02-21T11:00:31.5910275Z [803s] Generation 20 starting: 11 neighbors, 1 active search path(s)
2026-02-21T11:00:38.5062729Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.7 configs/s
2026-02-21T11:00:39.1779185Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.6 configs/s
2026-02-21T11:00:41.3597025Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 455.0         
2026-02-21T11:00:41.3598203Z                                                                   configs/s     
2026-02-21T11:00:41.5194905Z [813s] Generation 20 complete: 
2026-02-21T11:00:41.5195175Z ok=13
2026-02-21T11:00:41.5195392Z min=0.0766
2026-02-21T11:00:41.5195576Z mid=0.0783
2026-02-21T11:00:41.5195739Z max=0.0950
2026-02-21T11:00:41.5195928Z best={'block_sizes': [1, 16384],
2026-02-21T11:00:41.5196279Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:00:41.5196690Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:00:41.5196966Z  'num_stages': 8,
2026-02-21T11:00:41.5197161Z  'num_warps': 8,
2026-02-21T11:00:41.5197366Z  'pid_type': 'flat',
2026-02-21T11:00:41.5197584Z  'range_flattens': [None, False],
2026-02-21T11:00:41.5197854Z  'range_multi_buffers': [None, False],
2026-02-21T11:00:41.5198121Z  'range_num_stages': [0, 2],
2026-02-21T11:00:41.5198362Z  'range_unroll_factors': [0, 2],
2026-02-21T11:00:41.5198609Z  'range_warp_specializes': []}
2026-02-21T11:00:41.5247071Z [813s] Fitting surrogate: 1166 points, 1166 targets
2026-02-21T11:00:41.7003373Z [814s] Autotuning complete in 814.0s after searching 1122 configs.
2026-02-21T11:00:41.7004134Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:00:41.7006059Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], num_stages=8, num_warps=8, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:00:41.7007752Z 
2026-02-21T11:00:41.7008204Z [814s] Code of selected kernel: /tmp/torchinductor_root/b3/cb3u4l2a2sns4hyr2a742rquhcftzwtxu5vmqai2fkhgltvcg6vx.py
2026-02-21T11:00:42.7596168Z WARNING:tritonbench.utils.triton_op:Completed input ID 97:
2026-02-21T11:00:42.7596662Z (M, N)
2026-02-21T11:00:42.7596878Z -------------
2026-02-21T11:00:42.7597129Z (4096, 12672)
2026-02-21T11:00:42.7597470Z 
2026-02-21T11:00:42.7599055Z 100%|██████████| 20/20 [2:42:12<00:00, 644.34s/it]
2026-02-21T11:00:42.7599505Z 100%|██████████| 20/20 [2:42:12<00:00, 486.63s/it]
2026-02-21T11:00:42.7638922Z INFO:tritonbench.utils.run_utils:[tritonbench] Output result csv to /tmp/tmpht2vpwgi.csv
2026-02-21T11:00:47.5742799Z        (M, N)    triton_softmax-speedup    triton_softmax-accuracy    torch_compile_softmax-speedup    torch_compile_softmax-accuracy    helion_softmax_tritonbench-speedup    helion_softmax_tritonbench-accuracy
2026-02-21T11:00:47.5744562Z -------------  ------------------------  -------------------------  -------------------------------  --------------------------------  ------------------------------------  -------------------------------------
2026-02-21T11:00:47.5745581Z   (4096, 256)                  0.987402                          1                         1.26298                                  1                               1.76216                                      1
2026-02-21T11:00:47.5746423Z   (4096, 896)                  1.53759                           1                         1.44397                                  1                               2.0945                                       1
2026-02-21T11:00:47.5747852Z  (4096, 1536)                  1.93319                           1                         1.37969                                  1                               2.14707                                      1
2026-02-21T11:00:47.5748670Z  (4096, 2176)                  2.14521                           1                         1.82419                                  1                               2.86881                                      1
2026-02-21T11:00:47.5749494Z  (4096, 2816)                  2.07871                           1                         1.63204                                  1                               2.46691                                      1
2026-02-21T11:00:47.5750549Z  (4096, 3584)                  2.13669                           1                         1.56681                                  1                               2.38294                                      1
2026-02-21T11:00:47.5751383Z  (4096, 4224)                  2.13249                           1                         1.4555                                   1                               2.34194                                      1
2026-02-21T11:00:47.5752175Z  (4096, 4864)                  2.11794                           1                         1.42644                                  1                               2.25326                                      1
2026-02-21T11:00:47.5752932Z  (4096, 5504)                  2.23392                           1                         1.47036                                  1                               2.2569                                       1
2026-02-21T11:00:47.5753697Z  (4096, 6144)                  2.18527                           1                         1.49951                                  1                               2.2221                                       1
2026-02-21T11:00:47.5754612Z  (4096, 6784)                  2.9922                            1                         1.9031                                   1                               2.95368                                      1
2026-02-21T11:00:47.5755385Z  (4096, 7424)                  2.97773                           1                         1.93628                                  1                               2.97979                                      1
2026-02-21T11:00:47.5756149Z  (4096, 8064)                  2.893                             1                         1.87126                                  1                               2.89582                                      1
2026-02-21T11:00:47.5756917Z  (4096, 8704)                  2.3519                            1                         1.87006                                  1                               2.73903                                      1
2026-02-21T11:00:47.5757674Z  (4096, 9344)                  1.496                             1                         1.08039                                  1                               1.71407                                      1
2026-02-21T11:00:47.5758442Z (4096, 10112)                  1.48034                           1                         1.07637                                  1                               1.64826                                      1
2026-02-21T11:00:47.5759201Z (4096, 10752)                  1.48589                           1                         1.05541                                  1                               1.55089                                      1
2026-02-21T11:00:47.5759984Z (4096, 11392)                  1.49128                           1                         0.952184                                 1                               1.54089                                      1
2026-02-21T11:00:47.5760760Z (4096, 12032)                  1.47481                           1                         0.993168                                 1                               1.50397                                      1
2026-02-21T11:00:47.5761660Z (4096, 12672)                  1.46039                           1                         0.90682                                  1                               1.50029                                      1
2026-02-21T11:00:47.5762345Z       average                  1.9796                            1                         1.43033                                  1                               2.19116                                      1
2026-02-21T11:03:04.4926631Z Using num_inputs=20 for softmax
2026-02-21T11:03:04.5092494Z Running softmax benchmark with Helion implementation...
2026-02-21T11:03:04.5092935Z 
2026-02-21T11:03:04.7497102Z Equally-spaced-k mode: Selected 20 equally spaced inputs (total available: 98)
2026-02-21T11:03:04.7498398Z WARNING:tritonbench.utils.triton_op:Input IDs to run: [0, 5, 10, 15, 20, 26, 31, 36, 41, 46, 51, 56, 61, 66, 71, 77, 82, 87, 92, 97]
2026-02-21T11:03:04.7503962Z 
2026-02-21T11:03:04.7514543Z   0%|          | 0/20 [00:00<?, ?it/s]WARNING:tritonbench.utils.triton_op:Running input ID 0:
2026-02-21T11:03:04.7514919Z (M, N)
2026-02-21T11:03:04.7515076Z -----------
2026-02-21T11:03:04.7515236Z (4096, 256)
2026-02-21T11:03:04.7517964Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T11:03:06.6176451Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:03:08.6186195Z INFO:tritonbench.utils.triton_op:Took 55.47ms to get benchmark function for torch_compile_softmax
2026-02-21T11:03:10.2379947Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:03:10.2380466Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:03:10.2380794Z               'dtype': 'torch.float16',
2026-02-21T11:03:10.2381133Z               'shape': (4096, 256),
2026-02-21T11:03:10.2381418Z               'stride': (256, 1)},),
2026-02-21T11:03:10.2381707Z   'kwargs': {}}
2026-02-21T11:03:10.2382260Z INFO:tritonbench.utils.triton_op:Took 0.91ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:03:10.6529754Z [0s] Autotune random seed: 2145258556
2026-02-21T11:03:10.6933351Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:04:15.0337494Z [64s] Timeout after 60s compiling Config(block_sizes=[1024, 16], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=8, num_stages=4, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[3, 0], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T11:04:15.0361095Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.1 configs/s
2026-02-21T11:04:21.0782675Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.7 configs/s
2026-02-21T11:04:21.0796618Z [70s] Adaptive compile timeout: 30s (90% percentile=3.2s, bounds=[30.0s, 60s])
2026-02-21T11:04:22.0876513Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1014.2 configs/s
2026-02-21T11:04:22.1778660Z [71s] Initial random population of 100, 5 starting points: 
2026-02-21T11:04:22.1778959Z error=4
2026-02-21T11:04:22.1779133Z timeout=1
2026-02-21T11:04:22.1779278Z ok=95
2026-02-21T11:04:22.1779426Z min=0.0089
2026-02-21T11:04:22.1779571Z mid=0.0725
2026-02-21T11:04:22.1779727Z max=8.1258
2026-02-21T11:04:22.1779889Z best={'block_sizes': [4, 64],
2026-02-21T11:04:22.1780173Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:04:22.1780514Z  'load_eviction_policies': ['first', ''],
2026-02-21T11:04:22.1780791Z  'num_sm_multiplier': 8,
2026-02-21T11:04:22.1781015Z  'num_stages': 1,
2026-02-21T11:04:22.1781198Z  'num_warps': 1,
2026-02-21T11:04:22.1781432Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:04:22.1781704Z  'range_flattens': [True, None],
2026-02-21T11:04:22.1781964Z  'range_multi_buffers': [True, False],
2026-02-21T11:04:22.1782677Z  'range_num_stages': [1, 0],
2026-02-21T11:04:22.1782914Z  'range_unroll_factors': [2, 2],
2026-02-21T11:04:22.1783156Z  'range_warp_specializes': []}
2026-02-21T11:04:22.1798066Z [71s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:04:23.5087820Z [72s] Generation 1 starting: 84 neighbors, 5 active search path(s)
2026-02-21T11:04:29.1237345Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 21.0 configs/s
2026-02-21T11:04:34.9416206Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 15.0 configs/s
2026-02-21T11:04:41.2683858Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 161.3         
2026-02-21T11:04:41.2684818Z                                                                   configs/s     
2026-02-21T11:04:41.9371525Z [91s] Generation 1 complete: 
2026-02-21T11:04:41.9371982Z ok=90
2026-02-21T11:04:41.9372277Z min=0.0076
2026-02-21T11:04:41.9372563Z mid=0.0096
2026-02-21T11:04:41.9372819Z max=0.0349
2026-02-21T11:04:41.9373151Z best={'block_sizes': [4, 256],
2026-02-21T11:04:41.9373702Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:04:41.9374908Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T11:04:41.9375192Z  'num_stages': 4,
2026-02-21T11:04:41.9375385Z  'num_warps': 4,
2026-02-21T11:04:41.9375573Z  'pid_type': 'flat',
2026-02-21T11:04:41.9375788Z  'range_flattens': [None, False],
2026-02-21T11:04:41.9376040Z  'range_multi_buffers': [None, None],
2026-02-21T11:04:41.9376302Z  'range_num_stages': [0, 4],
2026-02-21T11:04:41.9376540Z  'range_unroll_factors': [0, 3],
2026-02-21T11:04:41.9376785Z  'range_warp_specializes': []}
2026-02-21T11:04:41.9392094Z [91s] Fitting surrogate: 190 points, 190 targets
2026-02-21T11:04:43.3795573Z [92s] Generation 2 starting: 90 neighbors, 5 active search path(s)
2026-02-21T11:04:49.4483458Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 14.4 configs/s
2026-02-21T11:04:55.2098197Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 91/91 15.9 configs/s
2026-02-21T11:05:04.2347932Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.7         
2026-02-21T11:05:04.2349834Z                                                                   configs/s     
2026-02-21T11:05:05.1090935Z [114s] Generation 2 complete: 
2026-02-21T11:05:05.1091171Z ok=96
2026-02-21T11:05:05.1091329Z min=0.0076
2026-02-21T11:05:05.1091478Z mid=0.0085
2026-02-21T11:05:05.1091624Z max=0.0156
2026-02-21T11:05:05.1091780Z best={'block_sizes': [4, 256],
2026-02-21T11:05:05.1092084Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:05:05.1092437Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T11:05:05.1092688Z  'num_stages': 4,
2026-02-21T11:05:05.1092859Z  'num_warps': 4,
2026-02-21T11:05:05.1093061Z  'pid_type': 'flat',
2026-02-21T11:05:05.1093256Z  'range_flattens': [None, False],
2026-02-21T11:05:05.1093484Z  'range_multi_buffers': [None, None],
2026-02-21T11:05:05.1093714Z  'range_num_stages': [0, 4],
2026-02-21T11:05:05.1093935Z  'range_unroll_factors': [0, 3],
2026-02-21T11:05:05.1094480Z  'range_warp_specializes': []}
2026-02-21T11:05:05.1111168Z [114s] Fitting surrogate: 286 points, 286 targets
2026-02-21T11:05:06.5443347Z [115s] Generation 3 starting: 88 neighbors, 5 active search path(s)
2026-02-21T11:05:11.9807059Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 55.1 configs/s
2026-02-21T11:05:17.6787435Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 15.5 configs/s
2026-02-21T11:05:26.4594610Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 120.0         
2026-02-21T11:05:26.4595204Z                                                                   configs/s     
2026-02-21T11:05:27.3033769Z [136s] Generation 3 complete: 
2026-02-21T11:05:27.3034517Z ok=94
2026-02-21T11:05:27.3034805Z min=0.0075
2026-02-21T11:05:27.3035092Z mid=0.0080
2026-02-21T11:05:27.3035354Z max=0.0167
2026-02-21T11:05:27.3035653Z best={'block_sizes': [4, 256],
2026-02-21T11:05:27.3036890Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:05:27.3037326Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T11:05:27.3037612Z  'num_stages': 4,
2026-02-21T11:05:27.3037807Z  'num_warps': 4,
2026-02-21T11:05:27.3038014Z  'pid_type': 'flat',
2026-02-21T11:05:27.3038245Z  'range_flattens': [None, None],
2026-02-21T11:05:27.3038509Z  'range_multi_buffers': [None, None],
2026-02-21T11:05:27.3038775Z  'range_num_stages': [0, 4],
2026-02-21T11:05:27.3039014Z  'range_unroll_factors': [0, 2],
2026-02-21T11:05:27.3039255Z  'range_warp_specializes': []}
2026-02-21T11:05:27.3060383Z [136s] Fitting surrogate: 380 points, 380 targets
2026-02-21T11:05:28.5212198Z [137s] Generation 4 starting: 68 neighbors, 5 active search path(s)
2026-02-21T11:05:34.1470564Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69/69 22.0 configs/s
2026-02-21T11:05:38.8609135Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 69/69 14.7 configs/s
2026-02-21T11:05:45.3440706Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 157.4         
2026-02-21T11:05:45.3441158Z                                                                   configs/s     
2026-02-21T11:05:46.0045910Z [155s] Generation 4 complete: 
2026-02-21T11:05:46.0046198Z ok=73
2026-02-21T11:05:46.0046379Z min=0.0075
2026-02-21T11:05:46.0046563Z mid=0.0080
2026-02-21T11:05:46.0046728Z max=0.0227
2026-02-21T11:05:46.0046919Z best={'block_sizes': [4, 256],
2026-02-21T11:05:46.0047282Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:05:46.0047689Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:05:46.0047980Z  'num_stages': 5,
2026-02-21T11:05:46.0048188Z  'num_warps': 4,
2026-02-21T11:05:46.0048395Z  'pid_type': 'flat',
2026-02-21T11:05:46.0048635Z  'range_flattens': [None, None],
2026-02-21T11:05:46.0048900Z  'range_multi_buffers': [None, True],
2026-02-21T11:05:46.0049181Z  'range_num_stages': [0, 1],
2026-02-21T11:05:46.0049435Z  'range_unroll_factors': [0, 4],
2026-02-21T11:05:46.0049712Z  'range_warp_specializes': []}
2026-02-21T11:05:46.0074233Z [155s] Fitting surrogate: 453 points, 453 targets
2026-02-21T11:05:47.1869177Z [156s] Generation 5 starting: 66 neighbors, 5 active search path(s)
2026-02-21T11:05:54.6530667Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 2.1 configs/s
2026-02-21T11:05:58.9015604Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 15.9 configs/s
2026-02-21T11:06:05.3807259Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 157.5         
2026-02-21T11:06:05.3807753Z                                                                   configs/s     
2026-02-21T11:06:06.0532313Z [175s] Generation 5 complete: 
2026-02-21T11:06:06.0532737Z ok=71
2026-02-21T11:06:06.0533052Z min=0.0075
2026-02-21T11:06:06.0533345Z mid=0.0079
2026-02-21T11:06:06.0533626Z max=0.0274
2026-02-21T11:06:06.0533921Z best={'block_sizes': [4, 256],
2026-02-21T11:06:06.0535015Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:06:06.0535698Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:06:06.0536158Z  'num_stages': 5,
2026-02-21T11:06:06.0536471Z  'num_warps': 4,
2026-02-21T11:06:06.0536805Z  'pid_type': 'flat',
2026-02-21T11:06:06.0537165Z  'range_flattens': [None, None],
2026-02-21T11:06:06.0537593Z  'range_multi_buffers': [None, None],
2026-02-21T11:06:06.0538034Z  'range_num_stages': [0, 1],
2026-02-21T11:06:06.0538416Z  'range_unroll_factors': [0, 4],
2026-02-21T11:06:06.0538807Z  'range_warp_specializes': []}
2026-02-21T11:06:06.0560381Z [175s] Fitting surrogate: 524 points, 524 targets
2026-02-21T11:06:07.2333419Z [176s] Generation 6 starting: 67 neighbors, 5 active search path(s)
2026-02-21T11:06:12.7208834Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 52.6 configs/s
2026-02-21T11:06:17.1198254Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 15.4 configs/s
2026-02-21T11:06:23.4703530Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 160.8         
2026-02-21T11:06:23.4704941Z                                                                   configs/s     
2026-02-21T11:06:24.1122315Z [193s] Generation 6 complete: 
2026-02-21T11:06:24.1122599Z ok=72
2026-02-21T11:06:24.1122781Z min=0.0073
2026-02-21T11:06:24.1122964Z mid=0.0077
2026-02-21T11:06:24.1123127Z max=0.0147
2026-02-21T11:06:24.1123350Z best={'block_sizes': [4, 256],
2026-02-21T11:06:24.1123740Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:06:24.1124544Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:06:24.1124831Z  'num_stages': 5,
2026-02-21T11:06:24.1125031Z  'num_warps': 4,
2026-02-21T11:06:24.1125231Z  'pid_type': 'flat',
2026-02-21T11:06:24.1125487Z  'range_flattens': [None, False],
2026-02-21T11:06:24.1126133Z  'range_multi_buffers': [None, None],
2026-02-21T11:06:24.1126394Z  'range_num_stages': [0, 1],
2026-02-21T11:06:24.1126605Z  'range_unroll_factors': [0, 4],
2026-02-21T11:06:24.1126832Z  'range_warp_specializes': []}
2026-02-21T11:06:24.1153048Z [193s] Fitting surrogate: 596 points, 596 targets
2026-02-21T11:06:25.2544741Z [194s] Generation 7 starting: 67 neighbors, 5 active search path(s)
2026-02-21T11:06:30.7109150Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 18.8 configs/s
2026-02-21T11:06:34.9094662Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.1 configs/s
2026-02-21T11:06:41.6445862Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 151.5         
2026-02-21T11:06:41.6446394Z                                                                   configs/s     
2026-02-21T11:06:42.3518581Z [211s] Generation 7 complete: 
2026-02-21T11:06:42.3518911Z ok=72
2026-02-21T11:06:42.3519107Z min=0.0073
2026-02-21T11:06:42.3519331Z mid=0.0076
2026-02-21T11:06:42.3519504Z max=0.0129
2026-02-21T11:06:42.3519697Z best={'block_sizes': [4, 256],
2026-02-21T11:06:42.3520046Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:06:42.3520473Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:06:42.3520758Z  'num_stages': 5,
2026-02-21T11:06:42.3520958Z  'num_warps': 4,
2026-02-21T11:06:42.3521154Z  'pid_type': 'flat',
2026-02-21T11:06:42.3521381Z  'range_flattens': [None, False],
2026-02-21T11:06:42.3521637Z  'range_multi_buffers': [None, None],
2026-02-21T11:06:42.3521905Z  'range_num_stages': [0, 1],
2026-02-21T11:06:42.3522148Z  'range_unroll_factors': [0, 4],
2026-02-21T11:06:42.3522410Z  'range_warp_specializes': []}
2026-02-21T11:06:42.3551555Z [211s] Fitting surrogate: 668 points, 668 targets
2026-02-21T11:06:43.5970910Z [212s] Generation 8 starting: 57 neighbors, 4 active search path(s)
2026-02-21T11:06:47.3367819Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 40.9 configs/s
2026-02-21T11:06:50.9165532Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 16.1 configs/s
2026-02-21T11:06:56.6879622Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 176.9         
2026-02-21T11:06:56.6880887Z                                                                   configs/s     
2026-02-21T11:06:57.2755038Z [226s] Generation 8 complete: 
2026-02-21T11:06:57.2755346Z ok=61
2026-02-21T11:06:57.2755541Z min=0.0074
2026-02-21T11:06:57.2755717Z mid=0.0077
2026-02-21T11:06:57.2755905Z max=0.0118
2026-02-21T11:06:57.2756098Z best={'block_sizes': [4, 256],
2026-02-21T11:06:57.2756465Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:06:57.2756884Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:06:57.2757180Z  'num_stages': 7,
2026-02-21T11:06:57.2757388Z  'num_warps': 4,
2026-02-21T11:06:57.2757588Z  'pid_type': 'flat',
2026-02-21T11:06:57.2757819Z  'range_flattens': [None, None],
2026-02-21T11:06:57.2758762Z  'range_multi_buffers': [None, False],
2026-02-21T11:06:57.2759020Z  'range_num_stages': [0, 0],
2026-02-21T11:06:57.2759229Z  'range_unroll_factors': [0, 4],
2026-02-21T11:06:57.2759463Z  'range_warp_specializes': []}
2026-02-21T11:06:57.2796367Z [226s] Fitting surrogate: 729 points, 729 targets
2026-02-21T11:06:58.0818918Z [227s] Generation 9 starting: 47 neighbors, 4 active search path(s)
2026-02-21T11:07:01.5118551Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 28.3 configs/s
2026-02-21T11:07:04.4557584Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.2 configs/s
2026-02-21T11:07:08.6837153Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 241.1         
2026-02-21T11:07:08.6837687Z                                                                   configs/s     
2026-02-21T11:07:09.1169018Z [238s] Generation 9 complete: 
2026-02-21T11:07:09.1169322Z ok=51
2026-02-21T11:07:09.1169514Z min=0.0072
2026-02-21T11:07:09.1169706Z mid=0.0077
2026-02-21T11:07:09.1169920Z max=0.0118
2026-02-21T11:07:09.1170213Z best={'block_sizes': [4, 256],
2026-02-21T11:07:09.1170595Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:07:09.1171029Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:07:09.1171310Z  'num_stages': 7,
2026-02-21T11:07:09.1171513Z  'num_warps': 4,
2026-02-21T11:07:09.1171711Z  'pid_type': 'flat',
2026-02-21T11:07:09.1171940Z  'range_flattens': [None, None],
2026-02-21T11:07:09.1172196Z  'range_multi_buffers': [None, False],
2026-02-21T11:07:09.1172470Z  'range_num_stages': [0, 0],
2026-02-21T11:07:09.1172709Z  'range_unroll_factors': [0, 3],
2026-02-21T11:07:09.1172967Z  'range_warp_specializes': []}
2026-02-21T11:07:09.1203290Z [238s] Fitting surrogate: 780 points, 780 targets
2026-02-21T11:07:09.9822635Z [239s] Generation 10 starting: 53 neighbors, 4 active search path(s)
2026-02-21T11:07:13.4263187Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 29.7 configs/s
2026-02-21T11:07:16.7428202Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 53/53 16.2 configs/s
2026-02-21T11:07:22.1170446Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 200.3         
2026-02-21T11:07:22.1171009Z                                                                   configs/s     
2026-02-21T11:07:22.6372550Z [251s] Generation 10 complete: 
2026-02-21T11:07:22.6372849Z ok=57
2026-02-21T11:07:22.6373050Z min=0.0074
2026-02-21T11:07:22.6373230Z mid=0.0076
2026-02-21T11:07:22.6373409Z max=0.0117
2026-02-21T11:07:22.6373601Z best={'block_sizes': [4, 256],
2026-02-21T11:07:22.6374312Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:07:22.6374747Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:07:22.6375055Z  'num_stages': 5,
2026-02-21T11:07:22.6375259Z  'num_warps': 4,
2026-02-21T11:07:22.6375473Z  'pid_type': 'flat',
2026-02-21T11:07:22.6375699Z  'range_flattens': [None, False],
2026-02-21T11:07:22.6375992Z  'range_multi_buffers': [None, False],
2026-02-21T11:07:22.6376343Z  'range_num_stages': [0, 0],
2026-02-21T11:07:22.6376636Z  'range_unroll_factors': [0, 4],
2026-02-21T11:07:22.6376892Z  'range_warp_specializes': []}
2026-02-21T11:07:22.6404952Z [251s] Fitting surrogate: 837 points, 837 targets
2026-02-21T11:07:23.1301181Z [252s] Generation 11 starting: 25 neighbors, 2 active search path(s)
2026-02-21T11:07:24.9805923Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 43.1 configs/s
2026-02-21T11:07:26.6005498Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 16.5 configs/s
2026-02-21T11:07:28.9964958Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 425.2         
2026-02-21T11:07:28.9965472Z                                                                   configs/s     
2026-02-21T11:07:29.2519190Z [258s] Generation 11 complete: 
2026-02-21T11:07:29.2519614Z ok=27
2026-02-21T11:07:29.2519893Z min=0.0075
2026-02-21T11:07:29.2520204Z mid=0.0077
2026-02-21T11:07:29.2520477Z max=0.0120
2026-02-21T11:07:29.2521600Z best={'block_sizes': [4, 256],
2026-02-21T11:07:29.2522122Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:07:29.2522533Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:07:29.2522855Z  'num_stages': 5,
2026-02-21T11:07:29.2523052Z  'num_warps': 4,
2026-02-21T11:07:29.2523259Z  'pid_type': 'flat',
2026-02-21T11:07:29.2523478Z  'range_flattens': [None, False],
2026-02-21T11:07:29.2523747Z  'range_multi_buffers': [None, False],
2026-02-21T11:07:29.2524364Z  'range_num_stages': [0, 0],
2026-02-21T11:07:29.2524641Z  'range_unroll_factors': [0, 4],
2026-02-21T11:07:29.2524899Z  'range_warp_specializes': []}
2026-02-21T11:07:29.2555372Z [258s] Fitting surrogate: 864 points, 864 targets
2026-02-21T11:07:29.5857210Z [258s] Generation 12 starting: 14 neighbors, 1 active search path(s)
2026-02-21T11:07:31.6936967Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 5.5 configs/s
2026-02-21T11:07:32.6394902Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 16.6 configs/s
2026-02-21T11:07:33.9730789Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 761.9         
2026-02-21T11:07:33.9731277Z                                                                   configs/s     
2026-02-21T11:07:34.1216262Z [263s] Generation 12 complete: 
2026-02-21T11:07:34.1216527Z ok=16
2026-02-21T11:07:34.1216692Z min=0.0075
2026-02-21T11:07:34.1216883Z mid=0.0084
2026-02-21T11:07:34.1217055Z max=0.0200
2026-02-21T11:07:34.1217234Z best={'block_sizes': [4, 256],
2026-02-21T11:07:34.1217575Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:07:34.1217960Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:07:34.1218252Z  'num_stages': 5,
2026-02-21T11:07:34.1218445Z  'num_warps': 4,
2026-02-21T11:07:34.1218645Z  'pid_type': 'flat',
2026-02-21T11:07:34.1218856Z  'range_flattens': [None, False],
2026-02-21T11:07:34.1219116Z  'range_multi_buffers': [None, False],
2026-02-21T11:07:34.1219393Z  'range_num_stages': [0, 0],
2026-02-21T11:07:34.1219624Z  'range_unroll_factors': [0, 4],
2026-02-21T11:07:34.1219876Z  'range_warp_specializes': []}
2026-02-21T11:07:34.1250487Z [263s] Fitting surrogate: 880 points, 880 targets
2026-02-21T11:07:34.4647562Z [263s] Generation 13 starting: 14 neighbors, 1 active search path(s)
2026-02-21T11:07:36.6393649Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 7.4 configs/s
2026-02-21T11:07:37.5828532Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 16.6 configs/s
2026-02-21T11:07:39.2023424Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 762.7         
2026-02-21T11:07:39.2023909Z                                                                   configs/s     
2026-02-21T11:07:39.3511265Z [268s] Generation 13 complete: 
2026-02-21T11:07:39.3511689Z ok=16
2026-02-21T11:07:39.3511967Z min=0.0075
2026-02-21T11:07:39.3512254Z mid=0.0084
2026-02-21T11:07:39.3512522Z max=0.0151
2026-02-21T11:07:39.3512861Z best={'block_sizes': [4, 256],
2026-02-21T11:07:39.3513424Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:07:39.3514530Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:07:39.3515627Z  'num_stages': 5,
2026-02-21T11:07:39.3515939Z  'num_warps': 4,
2026-02-21T11:07:39.3516259Z  'pid_type': 'flat',
2026-02-21T11:07:39.3516614Z  'range_flattens': [None, False],
2026-02-21T11:07:39.3517044Z  'range_multi_buffers': [None, False],
2026-02-21T11:07:39.3517467Z  'range_num_stages': [0, 0],
2026-02-21T11:07:39.3517870Z  'range_unroll_factors': [0, 4],
2026-02-21T11:07:39.3518303Z  'range_warp_specializes': []}
2026-02-21T11:07:39.3542008Z [268s] Fitting surrogate: 896 points, 896 targets
2026-02-21T11:07:39.6803328Z [268s] Generation 14 starting: 14 neighbors, 1 active search path(s)
2026-02-21T11:07:41.3460752Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 12.3 configs/s
2026-02-21T11:07:42.3043553Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 16.4 configs/s
2026-02-21T11:07:43.4501388Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 892.9         
2026-02-21T11:07:43.4501881Z                                                                   configs/s     
2026-02-21T11:07:43.5809330Z [272s] Generation 14 complete: 
2026-02-21T11:07:43.5809769Z ok=16
2026-02-21T11:07:43.5810159Z min=0.0075
2026-02-21T11:07:43.5810466Z mid=0.0088
2026-02-21T11:07:43.5810738Z max=0.0151
2026-02-21T11:07:43.5811050Z best={'block_sizes': [4, 256],
2026-02-21T11:07:43.5811540Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:07:43.5811938Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:07:43.5812242Z  'num_stages': 5,
2026-02-21T11:07:43.5812442Z  'num_warps': 4,
2026-02-21T11:07:43.5812645Z  'pid_type': 'flat',
2026-02-21T11:07:43.5812867Z  'range_flattens': [None, False],
2026-02-21T11:07:43.5813137Z  'range_multi_buffers': [None, False],
2026-02-21T11:07:43.5813403Z  'range_num_stages': [0, 0],
2026-02-21T11:07:43.5813662Z  'range_unroll_factors': [0, 4],
2026-02-21T11:07:43.5813911Z  'range_warp_specializes': []}
2026-02-21T11:07:43.5845482Z [272s] Fitting surrogate: 912 points, 912 targets
2026-02-21T11:07:43.7417536Z [273s] Autotuning complete in 273.0s after searching 863 configs.
2026-02-21T11:07:43.7417963Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:07:43.7419312Z     @helion.kernel(config=helion.Config(block_sizes=[4, 256], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=5, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:07:43.7420558Z 
2026-02-21T11:07:43.7420968Z [273s] Code of selected kernel: /tmp/torchinductor_root/li/clip25z7w3mis4muipkmmet4ppxjafi535hk4s73lrrrqc2k7hk2.py
2026-02-21T11:07:43.7715894Z from __future__ import annotations
2026-02-21T11:07:43.7716105Z 
2026-02-21T11:07:43.7716194Z import torch
2026-02-21T11:07:43.7716380Z import triton
2026-02-21T11:07:43.7716594Z import triton.language as tl
2026-02-21T11:07:43.7716897Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:07:43.7717302Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:07:43.7717741Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:07:43.7718030Z 
2026-02-21T11:07:43.7718127Z _BLOCK_SIZE_0 = tl.constexpr(4)
2026-02-21T11:07:43.7718376Z _BLOCK_SIZE_1 = tl.constexpr(256)
2026-02-21T11:07:43.7718567Z 
2026-02-21T11:07:43.7718647Z @triton.jit
2026-02-21T11:07:43.7718861Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:07:43.7719242Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:07:43.7719637Z     pid_0 = tl.program_id(0)
2026-02-21T11:07:43.7719878Z     offset_0 = pid_0 * _BLOCK_SIZE_0
2026-02-21T11:07:43.7720246Z     indices_0 = (offset_0 + tl.arange(0, _BLOCK_SIZE_0)).to(tl.int32)
2026-02-21T11:07:43.7720754Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:07:43.7721287Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:07:43.7722081Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:07:43.7722429Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:07:43.7722788Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:07:43.7723166Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:07:43.7723529Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:07:43.7723846Z     # src[softmax.py:82-89]: ...
2026-02-21T11:07:43.7724599Z     for offset_2 in tl.range(0, 256, _BLOCK_SIZE_1, loop_unroll_factor=4, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T11:07:43.7725175Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:07:43.7725684Z         mi_copy = mi
2026-02-21T11:07:43.7725873Z         di_copy = di
2026-02-21T11:07:43.7726047Z         mi_copy_0 = mi_copy
2026-02-21T11:07:43.7726295Z         di_copy_0 = di_copy
2026-02-21T11:07:43.7726534Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:07:43.7727007Z         values = tl.load(x + (indices_0[:, None] * 256 + indices_2[None, :] * 1), None, eviction_policy='evict_first')
2026-02-21T11:07:43.7727526Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:07:43.7727886Z         local_amax = tl.cast(tl.max(values, 1), tl.float16)
2026-02-21T11:07:43.7728242Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:07:43.7728573Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:07:43.7728855Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:07:43.7729231Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:07:43.7729578Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:07:43.7729802Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:07:43.7730135Z         v_4 = di_copy_0 * v_3
2026-02-21T11:07:43.7730395Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:07:43.7730680Z         subscript = v_1[:, None]
2026-02-21T11:07:43.7730913Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:07:43.7731165Z         v_6 = v_5 - subscript
2026-02-21T11:07:43.7731462Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:07:43.7731803Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:07:43.7732068Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:07:43.7732305Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:07:43.7732532Z         sum_1 = tl.cast(tl.sum(v_7, 1), tl.float32)
2026-02-21T11:07:43.7732768Z         di = v_4 + sum_1
2026-02-21T11:07:43.7732952Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:07:43.7733162Z         mi = v_1
2026-02-21T11:07:43.7733412Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:07:43.7733753Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:07:43.7734271Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:07:43.7734836Z     for offset_2 in tl.range(0, 256, _BLOCK_SIZE_1, loop_unroll_factor=4, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T11:07:43.7735349Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:07:43.7735633Z         mi_copy_1 = mi
2026-02-21T11:07:43.7735802Z         di_copy_1 = di
2026-02-21T11:07:43.7735971Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:07:43.7736160Z         di_copy_1_0 = di_copy_1
2026-02-21T11:07:43.7736384Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:07:43.7736816Z         values_1 = tl.load(x + (indices_0[:, None] * 256 + indices_2[None, :] * 1), None, eviction_policy='evict_first')
2026-02-21T11:07:43.7737349Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:07:43.7737720Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:07:43.7738112Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:07:43.7738345Z         v_10 = v_9 - subscript_1
2026-02-21T11:07:43.7738550Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:07:43.7738764Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:07:43.7738970Z         v_12 = v_11 / subscript_2
2026-02-21T11:07:43.7739170Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:07:43.7739471Z         tl.store(out + (indices_0[:, None] * 256 + indices_2[None, :] * 1), v_13, None)
2026-02-21T11:07:43.7739739Z 
2026-02-21T11:07:43.7739895Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:07:43.7740191Z     """
2026-02-21T11:07:43.7740430Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:07:43.7740942Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:07:43.7741225Z     Args:
2026-02-21T11:07:43.7741411Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:07:43.7741650Z     Returns:
2026-02-21T11:07:43.7741862Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:07:43.7742114Z     """
2026-02-21T11:07:43.7742269Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:07:43.7742483Z     m, n = x.size()
2026-02-21T11:07:43.7742678Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:07:43.7742926Z     out = torch.empty_like(x)
2026-02-21T11:07:43.7743202Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:07:43.7743504Z     _BLOCK_SIZE_0 = 4
2026-02-21T11:07:43.7743747Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:07:43.7744261Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:07:43.7744659Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:07:43.7744958Z     # src[softmax.py:79-92]: ...
2026-02-21T11:07:43.7745343Z     _launcher(_helion_softmax_two_pass, (triton.cdiv(4096, _BLOCK_SIZE_0),), x, out, num_warps=4, num_stages=5)
2026-02-21T11:07:43.7745757Z     # src[softmax.py:93]: return out
2026-02-21T11:07:43.7745958Z     return out
2026-02-21T11:07:44.7109579Z WARNING:tritonbench.utils.triton_op:Completed input ID 0:
2026-02-21T11:07:44.7109930Z (M, N)
2026-02-21T11:07:44.7110105Z -----------
2026-02-21T11:07:44.7110273Z (4096, 256)
2026-02-21T11:07:44.7110380Z 
2026-02-21T11:07:44.7120278Z   5%|▌         | 1/20 [04:39<1:28:39, 279.96s/it]WARNING:tritonbench.utils.triton_op:Running input ID 5:
2026-02-21T11:07:44.7120723Z (M, N)
2026-02-21T11:07:44.7122359Z -----------
2026-02-21T11:07:44.7122510Z (4096, 896)
2026-02-21T11:07:44.7122839Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T11:07:46.5107851Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:07:48.3215532Z INFO:tritonbench.utils.triton_op:Took 3.12ms to get benchmark function for torch_compile_softmax
2026-02-21T11:07:49.4877957Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:07:49.4878298Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:07:49.4878573Z               'dtype': 'torch.float16',
2026-02-21T11:07:49.4878859Z               'shape': (4096, 896),
2026-02-21T11:07:49.4879121Z               'stride': (896, 1)},),
2026-02-21T11:07:49.4879378Z   'kwargs': {}}
2026-02-21T11:07:49.4901049Z INFO:tritonbench.utils.triton_op:Took 2.66ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:07:49.7807260Z [0s] Autotune random seed: 2145258556
2026-02-21T11:07:49.8154704Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:08:23.0687065Z [33s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:08:24.6515269Z [34s] Timeout after 30s compiling Config(block_sizes=[512, 32], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_interleaved', range_flattens=[False, False], range_multi_buffers=[None, False], range_num_stages=[3, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:08:24.7381273Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first'], num_stages=1, num_warps=2, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T11:08:24.8379475Z [35s] Timeout after 30s compiling Config(block_sizes=[512, 32], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=8, num_warps=1, pid_type='persistent_blocked', range_flattens=[None, True], range_multi_buffers=[False, True], range_num_stages=[3, 1], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T11:08:24.9748675Z [35s] Timeout after 30s compiling Config(block_sizes=[1024, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=32, num_sm_multiplier=8, num_stages=8, num_warps=4, pid_type='persistent_interleaved', range_flattens=[False, True], range_multi_buffers=[True, None], range_num_stages=[3, 4], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T11:08:24.9769132Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 1.0 configs/s
2026-02-21T11:08:31.1691558Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.3 configs/s
2026-02-21T11:08:31.1705286Z [41s] Adaptive compile timeout: 30s (90% percentile=11.8s, bounds=[30.0s, 30s])
2026-02-21T11:08:32.2173639Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 973.0 configs/s
2026-02-21T11:08:32.3323409Z [42s] Initial random population of 100, 5 starting points: 
2026-02-21T11:08:32.3323773Z error=2
2026-02-21T11:08:32.3323954Z timeout=5
2026-02-21T11:08:32.3324394Z ok=93
2026-02-21T11:08:32.3324559Z min=0.0158
2026-02-21T11:08:32.3324737Z mid=0.1459
2026-02-21T11:08:32.3324908Z max=28.2163
2026-02-21T11:08:32.3325114Z best={'block_sizes': [16, 128],
2026-02-21T11:08:32.3325461Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:08:32.3325841Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:08:32.3326122Z  'maxnreg': 128,
2026-02-21T11:08:32.3326352Z  'num_sm_multiplier': 2,
2026-02-21T11:08:32.3326580Z  'num_stages': 5,
2026-02-21T11:08:32.3326770Z  'num_warps': 8,
2026-02-21T11:08:32.3326992Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:08:32.3327707Z  'range_flattens': [None, True],
2026-02-21T11:08:32.3327972Z  'range_multi_buffers': [None, True],
2026-02-21T11:08:32.3328235Z  'range_num_stages': [2, 4],
2026-02-21T11:08:32.3328480Z  'range_unroll_factors': [4, 2],
2026-02-21T11:08:32.3328732Z  'range_warp_specializes': []}
2026-02-21T11:08:32.3344122Z [42s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:08:33.7306354Z [43s] Generation 1 starting: 84 neighbors, 5 active search path(s)
2026-02-21T11:09:07.6550714Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 0.8 configs/s
2026-02-21T11:09:13.1803128Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 15.9 configs/s
2026-02-21T11:09:16.3632116Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 320.0         
2026-02-21T11:09:16.3633370Z                                                                   configs/s     
2026-02-21T11:09:16.6759554Z [86s] Generation 1 complete: 
2026-02-21T11:09:16.6759814Z error=1
2026-02-21T11:09:16.6760017Z ok=89
2026-02-21T11:09:16.6760185Z min=0.0114
2026-02-21T11:09:16.6760365Z mid=0.0180
2026-02-21T11:09:16.6760542Z max=0.2129
2026-02-21T11:09:16.6760724Z best={'block_sizes': [16, 256],
2026-02-21T11:09:16.6761025Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:09:16.6761362Z  'load_eviction_policies': ['first', 'last'],
2026-02-21T11:09:16.6761668Z  'maxnreg': 64,
2026-02-21T11:09:16.6761876Z  'num_sm_multiplier': 4,
2026-02-21T11:09:16.6762107Z  'num_stages': 2,
2026-02-21T11:09:16.6762301Z  'num_warps': 16,
2026-02-21T11:09:16.6762545Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:09:16.6762828Z  'range_flattens': [True, True],
2026-02-21T11:09:16.6763090Z  'range_multi_buffers': [True, True],
2026-02-21T11:09:16.6763366Z  'range_num_stages': [4, 3],
2026-02-21T11:09:16.6763603Z  'range_unroll_factors': [0, 2],
2026-02-21T11:09:16.6763852Z  'range_warp_specializes': []}
2026-02-21T11:09:16.6780451Z [86s] Fitting surrogate: 190 points, 190 targets
2026-02-21T11:09:18.0721315Z [88s] Generation 2 starting: 88 neighbors, 5 active search path(s)
2026-02-21T11:09:51.5821287Z [121s] Timeout after 30s compiling Config(block_sizes=[32, 512], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'last'], maxnreg=128, num_sm_multiplier=2, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[2, 4], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T11:09:51.5838353Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 0.3 configs/s
2026-02-21T11:09:57.7051800Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 15.1 configs/s
2026-02-21T11:10:02.2590694Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 223.7         
2026-02-21T11:10:02.2591211Z                                                                   configs/s     
2026-02-21T11:10:02.7045875Z [132s] Generation 2 complete: 
2026-02-21T11:10:02.7046363Z timeout=1
2026-02-21T11:10:02.7046647Z ok=93
2026-02-21T11:10:02.7046920Z min=0.0099
2026-02-21T11:10:02.7047191Z mid=0.0143
2026-02-21T11:10:02.7047487Z max=0.1482
2026-02-21T11:10:02.7047782Z best={'block_sizes': [1, 1024],
2026-02-21T11:10:02.7048300Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:10:02.7048783Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:10:02.7049062Z  'num_stages': 7,
2026-02-21T11:10:02.7049255Z  'num_warps': 1,
2026-02-21T11:10:02.7049455Z  'pid_type': 'flat',
2026-02-21T11:10:02.7049681Z  'range_flattens': [None, True],
2026-02-21T11:10:02.7050025Z  'range_multi_buffers': [None, None],
2026-02-21T11:10:02.7050304Z  'range_num_stages': [0, 0],
2026-02-21T11:10:02.7050539Z  'range_unroll_factors': [0, 4],
2026-02-21T11:10:02.7050803Z  'range_warp_specializes': []}
2026-02-21T11:10:02.7067231Z [132s] Fitting surrogate: 284 points, 284 targets
2026-02-21T11:10:04.0775561Z [134s] Generation 3 starting: 78 neighbors, 5 active search path(s)
2026-02-21T11:10:13.1687620Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 3.8 configs/s
2026-02-21T11:10:18.6014412Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 14.8 configs/s
2026-02-21T11:10:24.3585786Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 177.0         
2026-02-21T11:10:24.3590143Z                                                                   configs/s     
2026-02-21T11:10:24.9189266Z [155s] Generation 3 complete: 
2026-02-21T11:10:24.9189509Z ok=84
2026-02-21T11:10:24.9189686Z min=0.0095
2026-02-21T11:10:24.9189852Z mid=0.0132
2026-02-21T11:10:24.9190022Z max=0.0624
2026-02-21T11:10:24.9190204Z best={'block_sizes': [1, 1024],
2026-02-21T11:10:24.9190511Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:10:24.9191421Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:10:24.9191699Z  'num_stages': 7,
2026-02-21T11:10:24.9191910Z  'num_warps': 1,
2026-02-21T11:10:24.9192100Z  'pid_type': 'flat',
2026-02-21T11:10:24.9192336Z  'range_flattens': [None, True],
2026-02-21T11:10:24.9192583Z  'range_multi_buffers': [None, None],
2026-02-21T11:10:24.9192844Z  'range_num_stages': [0, 0],
2026-02-21T11:10:24.9193079Z  'range_unroll_factors': [0, 4],
2026-02-21T11:10:24.9193325Z  'range_warp_specializes': []}
2026-02-21T11:10:24.9212912Z [155s] Fitting surrogate: 368 points, 368 targets
2026-02-21T11:10:25.9674938Z [156s] Generation 4 starting: 62 neighbors, 5 active search path(s)
2026-02-21T11:10:31.2731002Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 32.2 configs/s
2026-02-21T11:10:35.1385761Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 16.7 configs/s
2026-02-21T11:10:40.2588843Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 211.8         
2026-02-21T11:10:40.2589386Z                                                                   configs/s     
2026-02-21T11:10:40.7300888Z [170s] Generation 4 complete: 
2026-02-21T11:10:40.7301172Z error=3
2026-02-21T11:10:40.7301342Z ok=65
2026-02-21T11:10:40.7301518Z min=0.0100
2026-02-21T11:10:40.7301682Z mid=0.0123
2026-02-21T11:10:40.7301849Z max=0.0241
2026-02-21T11:10:40.7302030Z best={'block_sizes': [1, 1024],
2026-02-21T11:10:40.7302347Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:10:40.7302696Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:10:40.7302969Z  'num_stages': 7,
2026-02-21T11:10:40.7303160Z  'num_warps': 1,
2026-02-21T11:10:40.7303346Z  'pid_type': 'flat',
2026-02-21T11:10:40.7303557Z  'range_flattens': [None, True],
2026-02-21T11:10:40.7303815Z  'range_multi_buffers': [None, None],
2026-02-21T11:10:40.7304487Z  'range_num_stages': [0, 0],
2026-02-21T11:10:40.7304723Z  'range_unroll_factors': [0, 4],
2026-02-21T11:10:40.7304975Z  'range_warp_specializes': []}
2026-02-21T11:10:40.7325563Z [170s] Fitting surrogate: 436 points, 436 targets
2026-02-21T11:10:41.6224828Z [171s] Generation 5 starting: 55 neighbors, 5 active search path(s)
2026-02-21T11:10:46.2695789Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 24.1 configs/s
2026-02-21T11:10:49.6889279Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.3 configs/s
2026-02-21T11:10:55.5419513Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 186.0         
2026-02-21T11:10:55.5420032Z                                                                   configs/s     
2026-02-21T11:10:56.0821777Z [186s] Generation 5 complete: 
2026-02-21T11:10:56.0822047Z error=1
2026-02-21T11:10:56.0822212Z ok=60
2026-02-21T11:10:56.0822382Z min=0.0098
2026-02-21T11:10:56.0822560Z mid=0.0113
2026-02-21T11:10:56.0822728Z max=0.0266
2026-02-21T11:10:56.0822907Z best={'block_sizes': [1, 1024],
2026-02-21T11:10:56.0823227Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:10:56.0823593Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:10:56.0823867Z  'num_stages': 7,
2026-02-21T11:10:56.0824328Z  'num_warps': 1,
2026-02-21T11:10:56.0824983Z  'pid_type': 'flat',
2026-02-21T11:10:56.0825200Z  'range_flattens': [None, True],
2026-02-21T11:10:56.0825466Z  'range_multi_buffers': [None, False],
2026-02-21T11:10:56.0825733Z  'range_num_stages': [0, 3],
2026-02-21T11:10:56.0825962Z  'range_unroll_factors': [0, 1],
2026-02-21T11:10:56.0826211Z  'range_warp_specializes': []}
2026-02-21T11:10:56.0848861Z [186s] Fitting surrogate: 497 points, 497 targets
2026-02-21T11:10:56.8565705Z [187s] Generation 6 starting: 47 neighbors, 4 active search path(s)
2026-02-21T11:11:01.3892946Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 10.1 configs/s
2026-02-21T11:11:04.4233568Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.4 configs/s
2026-02-21T11:11:08.1776638Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 270.8         
2026-02-21T11:11:08.1777118Z                                                                   configs/s     
2026-02-21T11:11:08.5545637Z [198s] Generation 6 complete: 
2026-02-21T11:11:08.5546134Z error=1
2026-02-21T11:11:08.5546409Z ok=50
2026-02-21T11:11:08.5546678Z min=0.0097
2026-02-21T11:11:08.5546945Z mid=0.0109
2026-02-21T11:11:08.5547211Z max=0.0284
2026-02-21T11:11:08.5547499Z best={'block_sizes': [1, 1024],
2026-02-21T11:11:08.5548012Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:11:08.5548600Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:11:08.5549039Z  'num_stages': 7,
2026-02-21T11:11:08.5549347Z  'num_warps': 1,
2026-02-21T11:11:08.5549665Z  'pid_type': 'flat',
2026-02-21T11:11:08.5550021Z  'range_flattens': [None, False],
2026-02-21T11:11:08.5550433Z  'range_multi_buffers': [None, False],
2026-02-21T11:11:08.5550870Z  'range_num_stages': [0, 3],
2026-02-21T11:11:08.5551250Z  'range_unroll_factors': [0, 1],
2026-02-21T11:11:08.5551661Z  'range_warp_specializes': []}
2026-02-21T11:11:08.5574741Z [198s] Fitting surrogate: 548 points, 548 targets
2026-02-21T11:11:09.3895306Z [199s] Generation 7 starting: 49 neighbors, 4 active search path(s)
2026-02-21T11:11:16.4682207Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 1.7 configs/s
2026-02-21T11:11:19.0637147Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 19.7 configs/s
2026-02-21T11:11:22.7398351Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 303.7         
2026-02-21T11:11:22.7398875Z                                                                   configs/s     
2026-02-21T11:11:23.0821023Z [213s] Generation 7 complete: 
2026-02-21T11:11:23.0821276Z error=9
2026-02-21T11:11:23.0821447Z ok=44
2026-02-21T11:11:23.0821610Z min=0.0095
2026-02-21T11:11:23.0821786Z mid=0.0100
2026-02-21T11:11:23.0821951Z max=0.1759
2026-02-21T11:11:23.0822153Z best={'block_sizes': [1, 1024],
2026-02-21T11:11:23.0822518Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:11:23.0822906Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:11:23.0823188Z  'num_stages': 8,
2026-02-21T11:11:23.0823382Z  'num_warps': 1,
2026-02-21T11:11:23.0823595Z  'pid_type': 'flat',
2026-02-21T11:11:23.0823840Z  'range_flattens': [None, True],
2026-02-21T11:11:23.0824476Z  'range_multi_buffers': [None, True],
2026-02-21T11:11:23.0824797Z  'range_num_stages': [0, 0],
2026-02-21T11:11:23.0825075Z  'range_unroll_factors': [0, 1],
2026-02-21T11:11:23.0825331Z  'range_warp_specializes': []}
2026-02-21T11:11:23.0849163Z [213s] Fitting surrogate: 601 points, 601 targets
2026-02-21T11:11:23.9213970Z [214s] Generation 8 starting: 41 neighbors, 3 active search path(s)
2026-02-21T11:11:27.8386830Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 28.6 configs/s
2026-02-21T11:11:30.5438585Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 16.1 configs/s
2026-02-21T11:11:33.6196400Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 330.9         
2026-02-21T11:11:33.6196918Z                                                                   configs/s     
2026-02-21T11:11:33.9321139Z [224s] Generation 8 complete: 
2026-02-21T11:11:33.9322219Z ok=45
2026-02-21T11:11:33.9322495Z min=0.0095
2026-02-21T11:11:33.9322782Z mid=0.0125
2026-02-21T11:11:33.9323103Z max=0.0465
2026-02-21T11:11:33.9323403Z best={'block_sizes': [1, 1024],
2026-02-21T11:11:33.9323929Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:11:33.9325098Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:11:33.9325578Z  'num_stages': 8,
2026-02-21T11:11:33.9325888Z  'num_warps': 1,
2026-02-21T11:11:33.9326218Z  'pid_type': 'flat',
2026-02-21T11:11:33.9326587Z  'range_flattens': [None, False],
2026-02-21T11:11:33.9327012Z  'range_multi_buffers': [None, False],
2026-02-21T11:11:33.9327448Z  'range_num_stages': [0, 3],
2026-02-21T11:11:33.9327824Z  'range_unroll_factors': [0, 2],
2026-02-21T11:11:33.9328642Z  'range_warp_specializes': []}
2026-02-21T11:11:33.9353576Z [224s] Fitting surrogate: 646 points, 646 targets
2026-02-21T11:11:34.7034088Z [224s] Generation 9 starting: 41 neighbors, 3 active search path(s)
2026-02-21T11:11:38.5392422Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 16.7 configs/s
2026-02-21T11:11:41.1754711Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 42/42 16.2 configs/s
2026-02-21T11:11:43.9261773Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 369.4         
2026-02-21T11:11:43.9262249Z                                                                   configs/s     
2026-02-21T11:11:44.2082700Z [234s] Generation 9 complete: 
2026-02-21T11:11:44.2083152Z ok=44
2026-02-21T11:11:44.2083423Z min=0.0094
2026-02-21T11:11:44.2083735Z mid=0.0111
2026-02-21T11:11:44.2084548Z max=0.0338
2026-02-21T11:11:44.2084901Z best={'block_sizes': [1, 1024],
2026-02-21T11:11:44.2085503Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:11:44.2086189Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:11:44.2086629Z  'num_stages': 8,
2026-02-21T11:11:44.2086948Z  'num_warps': 1,
2026-02-21T11:11:44.2087267Z  'pid_type': 'flat',
2026-02-21T11:11:44.2087637Z  'range_flattens': [None, False],
2026-02-21T11:11:44.2088057Z  'range_multi_buffers': [None, False],
2026-02-21T11:11:44.2088518Z  'range_num_stages': [0, 2],
2026-02-21T11:11:44.2088984Z  'range_unroll_factors': [0, 2],
2026-02-21T11:11:44.2089371Z  'range_warp_specializes': []}
2026-02-21T11:11:44.2117153Z [234s] Fitting surrogate: 690 points, 690 targets
2026-02-21T11:11:45.1882582Z [235s] Generation 10 starting: 34 neighbors, 3 active search path(s)
2026-02-21T11:11:51.3072419Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 1.9 configs/s
2026-02-21T11:11:53.4779930Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.4 configs/s
2026-02-21T11:11:56.7292580Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 312.5         
2026-02-21T11:11:56.7293122Z                                                                   configs/s     
2026-02-21T11:11:57.0760540Z [247s] Generation 10 complete: 
2026-02-21T11:11:57.0761587Z ok=37
2026-02-21T11:11:57.0761896Z min=0.0095
2026-02-21T11:11:57.0762177Z mid=0.0099
2026-02-21T11:11:57.0762443Z max=0.0679
2026-02-21T11:11:57.0762735Z best={'block_sizes': [1, 1024],
2026-02-21T11:11:57.0763300Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:11:57.0763940Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:11:57.0764687Z  'num_stages': 6,
2026-02-21T11:11:57.0765024Z  'num_warps': 1,
2026-02-21T11:11:57.0765349Z  'pid_type': 'flat',
2026-02-21T11:11:57.0765706Z  'range_flattens': [None, None],
2026-02-21T11:11:57.0766137Z  'range_multi_buffers': [None, None],
2026-02-21T11:11:57.0766568Z  'range_num_stages': [0, 0],
2026-02-21T11:11:57.0766949Z  'range_unroll_factors': [0, 4],
2026-02-21T11:11:57.0767377Z  'range_warp_specializes': []}
2026-02-21T11:11:57.0796277Z [247s] Fitting surrogate: 727 points, 727 targets
2026-02-21T11:11:57.5911627Z [247s] Generation 11 starting: 28 neighbors, 3 active search path(s)
2026-02-21T11:12:00.2109506Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 21.3 configs/s
2026-02-21T11:12:02.0141471Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 16.5 configs/s
2026-02-21T11:12:05.0564638Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 334.0         
2026-02-21T11:12:05.0565278Z                                                                   configs/s     
2026-02-21T11:12:05.3686337Z [255s] Generation 11 complete: 
2026-02-21T11:12:05.3686796Z ok=31
2026-02-21T11:12:05.3687080Z min=0.0095
2026-02-21T11:12:05.3687370Z mid=0.0099
2026-02-21T11:12:05.3687635Z max=0.0121
2026-02-21T11:12:05.3687940Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:05.3688585Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:12:05.3689316Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:05.3689763Z  'num_stages': 8,
2026-02-21T11:12:05.3690190Z  'num_warps': 1,
2026-02-21T11:12:05.3690518Z  'pid_type': 'flat',
2026-02-21T11:12:05.3690894Z  'range_flattens': [None, False],
2026-02-21T11:12:05.3691317Z  'range_multi_buffers': [None, False],
2026-02-21T11:12:05.3691738Z  'range_num_stages': [0, 1],
2026-02-21T11:12:05.3692121Z  'range_unroll_factors': [0, 2],
2026-02-21T11:12:05.3692514Z  'range_warp_specializes': []}
2026-02-21T11:12:05.3726317Z [255s] Fitting surrogate: 758 points, 758 targets
2026-02-21T11:12:05.7332509Z [255s] Generation 12 starting: 14 neighbors, 2 active search path(s)
2026-02-21T11:12:07.1215140Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 13.4 configs/s
2026-02-21T11:12:07.9793810Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 17.2 configs/s
2026-02-21T11:12:09.9196949Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 650.3         
2026-02-21T11:12:09.9197498Z                                                                   configs/s     
2026-02-21T11:12:10.0882062Z [260s] Generation 12 complete: 
2026-02-21T11:12:10.0882532Z ok=16
2026-02-21T11:12:10.0882859Z min=0.0095
2026-02-21T11:12:10.0883155Z mid=0.0098
2026-02-21T11:12:10.0883427Z max=0.0112
2026-02-21T11:12:10.0883733Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:10.0884897Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:10.0885556Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:10.0886012Z  'num_stages': 6,
2026-02-21T11:12:10.0886320Z  'num_warps': 1,
2026-02-21T11:12:10.0886694Z  'pid_type': 'flat',
2026-02-21T11:12:10.0887067Z  'range_flattens': [None, None],
2026-02-21T11:12:10.0887452Z  'range_multi_buffers': [None, None],
2026-02-21T11:12:10.0887682Z  'range_num_stages': [0, 1],
2026-02-21T11:12:10.0887892Z  'range_unroll_factors': [0, 3],
2026-02-21T11:12:10.0888105Z  'range_warp_specializes': []}
2026-02-21T11:12:10.0910633Z [260s] Fitting surrogate: 774 points, 774 targets
2026-02-21T11:12:10.4905622Z [260s] Generation 13 starting: 17 neighbors, 2 active search path(s)
2026-02-21T11:12:12.4600655Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 11.7 configs/s
2026-02-21T11:12:13.5169249Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 16.8 configs/s
2026-02-21T11:12:15.2745400Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 576.4         
2026-02-21T11:12:15.2745905Z                                                                   configs/s     
2026-02-21T11:12:15.4615432Z [265s] Generation 13 complete: 
2026-02-21T11:12:15.4615701Z ok=19
2026-02-21T11:12:15.4615864Z min=0.0094
2026-02-21T11:12:15.4616044Z mid=0.0099
2026-02-21T11:12:15.4627644Z max=0.0146
2026-02-21T11:12:15.4627892Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:15.4628280Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:15.4628674Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:15.4629307Z  'num_stages': 6,
2026-02-21T11:12:15.4629507Z  'num_warps': 1,
2026-02-21T11:12:15.4629707Z  'pid_type': 'flat',
2026-02-21T11:12:15.4629924Z  'range_flattens': [None, None],
2026-02-21T11:12:15.4630213Z  'range_multi_buffers': [None, None],
2026-02-21T11:12:15.4630479Z  'range_num_stages': [0, 1],
2026-02-21T11:12:15.4630718Z  'range_unroll_factors': [0, 3],
2026-02-21T11:12:15.4630960Z  'range_warp_specializes': []}
2026-02-21T11:12:15.4652124Z [265s] Fitting surrogate: 793 points, 793 targets
2026-02-21T11:12:15.7141216Z [265s] Generation 14 starting: 6 neighbors, 1 active search path(s)
2026-02-21T11:12:16.9281212Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6/6 3.2 configs/s
2026-02-21T11:12:17.2961243Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 6/6 18.8 configs/s
2026-02-21T11:12:17.9640453Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 1500.9        
2026-02-21T11:12:17.9640951Z                                                                   configs/s     
2026-02-21T11:12:18.0501289Z [268s] Generation 14 complete: 
2026-02-21T11:12:18.0501525Z ok=8
2026-02-21T11:12:18.0501674Z min=0.0095
2026-02-21T11:12:18.0501848Z mid=0.0095
2026-02-21T11:12:18.0502022Z max=0.0230
2026-02-21T11:12:18.0502198Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:18.0502549Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:18.0502930Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:18.0503211Z  'num_stages': 6,
2026-02-21T11:12:18.0503403Z  'num_warps': 1,
2026-02-21T11:12:18.0503601Z  'pid_type': 'flat',
2026-02-21T11:12:18.0503820Z  'range_flattens': [None, None],
2026-02-21T11:12:18.0504361Z  'range_multi_buffers': [None, None],
2026-02-21T11:12:18.0504630Z  'range_num_stages': [0, 1],
2026-02-21T11:12:18.0504863Z  'range_unroll_factors': [0, 3],
2026-02-21T11:12:18.0505114Z  'range_warp_specializes': []}
2026-02-21T11:12:18.0536949Z [268s] Fitting surrogate: 801 points, 801 targets
2026-02-21T11:12:18.3277844Z [268s] Generation 15 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:12:19.4715900Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 11.0 configs/s
2026-02-21T11:12:20.0844410Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.6 configs/s
2026-02-21T11:12:21.2443279Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 866.3         
2026-02-21T11:12:21.2443812Z                                                                   configs/s     
2026-02-21T11:12:21.3751483Z [271s] Generation 15 complete: 
2026-02-21T11:12:21.3751939Z ok=12
2026-02-21T11:12:21.3752223Z min=0.0094
2026-02-21T11:12:21.3752516Z mid=0.0096
2026-02-21T11:12:21.3752785Z max=0.0113
2026-02-21T11:12:21.3753113Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:21.3753680Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:21.3754824Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:21.3755271Z  'num_stages': 6,
2026-02-21T11:12:21.3755460Z  'num_warps': 1,
2026-02-21T11:12:21.3755649Z  'pid_type': 'flat',
2026-02-21T11:12:21.3755837Z  'range_flattens': [None, None],
2026-02-21T11:12:21.3756067Z  'range_multi_buffers': [None, None],
2026-02-21T11:12:21.3756611Z  'range_num_stages': [0, 1],
2026-02-21T11:12:21.3756824Z  'range_unroll_factors': [0, 3],
2026-02-21T11:12:21.3757037Z  'range_warp_specializes': []}
2026-02-21T11:12:21.3789076Z [271s] Fitting surrogate: 813 points, 813 targets
2026-02-21T11:12:21.6688140Z [271s] Generation 16 starting: 11 neighbors, 1 active search path(s)
2026-02-21T11:12:22.9480209Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 15.1 configs/s
2026-02-21T11:12:23.6277436Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.3 configs/s
2026-02-21T11:12:24.8868013Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 800.3         
2026-02-21T11:12:24.8869689Z                                                                   configs/s     
2026-02-21T11:12:25.0276752Z [275s] Generation 16 complete: 
2026-02-21T11:12:25.0277226Z ok=13
2026-02-21T11:12:25.0277515Z min=0.0095
2026-02-21T11:12:25.0277826Z mid=0.0097
2026-02-21T11:12:25.0278113Z max=0.0111
2026-02-21T11:12:25.0278411Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:25.0278975Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:25.0279634Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:25.0280086Z  'num_stages': 8,
2026-02-21T11:12:25.0280393Z  'num_warps': 1,
2026-02-21T11:12:25.0280713Z  'pid_type': 'flat',
2026-02-21T11:12:25.0281057Z  'range_flattens': [None, True],
2026-02-21T11:12:25.0281505Z  'range_multi_buffers': [None, False],
2026-02-21T11:12:25.0281944Z  'range_num_stages': [0, 2],
2026-02-21T11:12:25.0282341Z  'range_unroll_factors': [0, 1],
2026-02-21T11:12:25.0282736Z  'range_warp_specializes': []}
2026-02-21T11:12:25.0348485Z [275s] Fitting surrogate: 826 points, 826 targets
2026-02-21T11:12:25.3188905Z [275s] Generation 17 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:12:26.4767289Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 20.8 configs/s
2026-02-21T11:12:27.0973634Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.4 configs/s
2026-02-21T11:12:28.1578004Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 948.6         
2026-02-21T11:12:28.1578486Z                                                                   configs/s     
2026-02-21T11:12:28.2794726Z [278s] Generation 17 complete: 
2026-02-21T11:12:28.2795158Z ok=11
2026-02-21T11:12:28.2795450Z min=0.0095
2026-02-21T11:12:28.2795725Z mid=0.0095
2026-02-21T11:12:28.2795991Z max=0.0111
2026-02-21T11:12:28.2796282Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:28.2796846Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:28.2797476Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:28.2797911Z  'num_stages': 8,
2026-02-21T11:12:28.2798258Z  'num_warps': 1,
2026-02-21T11:12:28.2798596Z  'pid_type': 'flat',
2026-02-21T11:12:28.2798954Z  'range_flattens': [None, True],
2026-02-21T11:12:28.2799376Z  'range_multi_buffers': [None, None],
2026-02-21T11:12:28.2800528Z  'range_num_stages': [0, 1],
2026-02-21T11:12:28.2800729Z  'range_unroll_factors': [0, 1],
2026-02-21T11:12:28.2800946Z  'range_warp_specializes': []}
2026-02-21T11:12:28.2834658Z [278s] Fitting surrogate: 837 points, 837 targets
2026-02-21T11:12:28.5750766Z [278s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T11:12:30.1274865Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 5.5 configs/s
2026-02-21T11:12:30.8073092Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.3 configs/s
2026-02-21T11:12:31.8665957Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 949.9         
2026-02-21T11:12:31.8666469Z                                                                   configs/s     
2026-02-21T11:12:31.9888832Z [282s] Generation 18 complete: 
2026-02-21T11:12:31.9889332Z ok=12
2026-02-21T11:12:31.9889628Z min=0.0095
2026-02-21T11:12:31.9889908Z mid=0.0095
2026-02-21T11:12:31.9890326Z max=0.0151
2026-02-21T11:12:31.9890656Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:31.9891176Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:31.9891752Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:31.9892226Z  'num_stages': 8,
2026-02-21T11:12:31.9892570Z  'num_warps': 1,
2026-02-21T11:12:31.9892863Z  'pid_type': 'flat',
2026-02-21T11:12:31.9893055Z  'range_flattens': [None, True],
2026-02-21T11:12:31.9893276Z  'range_multi_buffers': [None, None],
2026-02-21T11:12:31.9893512Z  'range_num_stages': [0, 1],
2026-02-21T11:12:31.9893712Z  'range_unroll_factors': [0, 2],
2026-02-21T11:12:31.9893927Z  'range_warp_specializes': []}
2026-02-21T11:12:31.9928211Z [282s] Fitting surrogate: 849 points, 849 targets
2026-02-21T11:12:32.2790753Z [282s] Generation 19 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:12:33.3217886Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 22.0 configs/s
2026-02-21T11:12:33.9337922Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.7 configs/s
2026-02-21T11:12:35.3595808Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 948.0         
2026-02-21T11:12:35.3596264Z                                                                   configs/s     
2026-02-21T11:12:35.4821425Z [285s] Generation 19 complete: 
2026-02-21T11:12:35.4821675Z ok=11
2026-02-21T11:12:35.4821841Z min=0.0095
2026-02-21T11:12:35.4822018Z mid=0.0095
2026-02-21T11:12:35.4822200Z max=0.0124
2026-02-21T11:12:35.4822391Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:35.4822701Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:35.4823055Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:35.4823328Z  'num_stages': 8,
2026-02-21T11:12:35.4823518Z  'num_warps': 1,
2026-02-21T11:12:35.4823711Z  'pid_type': 'flat',
2026-02-21T11:12:35.4823937Z  'range_flattens': [None, True],
2026-02-21T11:12:35.4824521Z  'range_multi_buffers': [None, False],
2026-02-21T11:12:35.4824789Z  'range_num_stages': [0, 2],
2026-02-21T11:12:35.4825051Z  'range_unroll_factors': [0, 2],
2026-02-21T11:12:35.4825292Z  'range_warp_specializes': []}
2026-02-21T11:12:35.4855607Z [285s] Fitting surrogate: 860 points, 860 targets
2026-02-21T11:12:35.7720648Z [285s] Generation 20 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:12:37.0944781Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 6.3 configs/s
2026-02-21T11:12:37.7025168Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.8 configs/s
2026-02-21T11:12:38.7661738Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 948.7         
2026-02-21T11:12:38.7662242Z                                                                   configs/s     
2026-02-21T11:12:38.8885699Z [289s] Generation 20 complete: 
2026-02-21T11:12:38.8886136Z ok=11
2026-02-21T11:12:38.8886473Z min=0.0095
2026-02-21T11:12:38.8886764Z mid=0.0096
2026-02-21T11:12:38.8887040Z max=0.0118
2026-02-21T11:12:38.8887364Z best={'block_sizes': [1, 1024],
2026-02-21T11:12:38.8888509Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:12:38.8889110Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:12:38.8889568Z  'num_stages': 8,
2026-02-21T11:12:38.8889878Z  'num_warps': 1,
2026-02-21T11:12:38.8890358Z  'pid_type': 'flat',
2026-02-21T11:12:38.8890711Z  'range_flattens': [None, True],
2026-02-21T11:12:38.8891133Z  'range_multi_buffers': [None, False],
2026-02-21T11:12:38.8891567Z  'range_num_stages': [0, 2],
2026-02-21T11:12:38.8891971Z  'range_unroll_factors': [0, 2],
2026-02-21T11:12:38.8892374Z  'range_warp_specializes': []}
2026-02-21T11:12:38.8925907Z [289s] Fitting surrogate: 871 points, 871 targets
2026-02-21T11:12:39.0507555Z [289s] Autotuning complete in 289.2s after searching 819 configs.
2026-02-21T11:12:39.0508437Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:12:39.0509854Z     @helion.kernel(config=helion.Config(block_sizes=[1, 1024], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], num_stages=8, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:12:39.0511141Z 
2026-02-21T11:12:39.0511530Z [289s] Code of selected kernel: /tmp/torchinductor_root/6a/c6ascxzli64knl2c3wa3a2bjnf2vif34jcnwugvlhtrao77apwy6.py
2026-02-21T11:12:39.0826487Z from __future__ import annotations
2026-02-21T11:12:39.0826684Z 
2026-02-21T11:12:39.0826768Z import torch
2026-02-21T11:12:39.0827013Z import triton
2026-02-21T11:12:39.0827308Z import triton.language as tl
2026-02-21T11:12:39.0827734Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:12:39.0828264Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:12:39.0828813Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:12:39.0829151Z 
2026-02-21T11:12:39.0829275Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:12:39.0829592Z _BLOCK_SIZE_1 = tl.constexpr(1024)
2026-02-21T11:12:39.0829804Z 
2026-02-21T11:12:39.0829898Z @triton.jit
2026-02-21T11:12:39.0830138Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:12:39.0830591Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:12:39.0831078Z     pid_0 = tl.program_id(0)
2026-02-21T11:12:39.0831367Z     offset_0 = pid_0
2026-02-21T11:12:39.0831655Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:12:39.0832162Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:12:39.0832702Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:12:39.0833182Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:12:39.0833643Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:12:39.0834477Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:12:39.0834991Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:12:39.0835484Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:12:39.0835928Z     # src[softmax.py:82-89]: ...
2026-02-21T11:12:39.0836605Z     for offset_2 in tl.range(0, 896, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True, flatten=True):
2026-02-21T11:12:39.0837516Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:12:39.0837849Z         mask_1 = indices_2 < 896
2026-02-21T11:12:39.0838060Z         mi_copy = mi
2026-02-21T11:12:39.0838240Z         di_copy = di
2026-02-21T11:12:39.0838415Z         mi_copy_0 = mi_copy
2026-02-21T11:12:39.0838618Z         di_copy_0 = di_copy
2026-02-21T11:12:39.0838855Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:12:39.0839387Z         values = tl.load(x + (indices_0[:, None] * 896 + indices_2[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_last')
2026-02-21T11:12:39.0839963Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:12:39.0840824Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:12:39.0841444Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:12:39.0841815Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:12:39.0842143Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:12:39.0842428Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:12:39.0842785Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:12:39.0843128Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:12:39.0843346Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:12:39.0843723Z         v_4 = di_copy_0 * v_3
2026-02-21T11:12:39.0844118Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:12:39.0844402Z         subscript = v_1[:, None]
2026-02-21T11:12:39.0844637Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:12:39.0844878Z         v_6 = v_5 - subscript
2026-02-21T11:12:39.0845186Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:12:39.0845560Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:12:39.0845855Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:12:39.0846107Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:12:39.0846567Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:12:39.0847092Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:12:39.0847374Z         di = v_4 + sum_1
2026-02-21T11:12:39.0847582Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:12:39.0847795Z         mi = v_1
2026-02-21T11:12:39.0848041Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:12:39.0848370Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:12:39.0848746Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:12:39.0849344Z     for offset_2 in tl.range(0, 896, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True, flatten=True):
2026-02-21T11:12:39.0849872Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:12:39.0850270Z         mask_2 = indices_2 < 896
2026-02-21T11:12:39.0850457Z         mi_copy_1 = mi
2026-02-21T11:12:39.0850624Z         di_copy_1 = di
2026-02-21T11:12:39.0850787Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:12:39.0850979Z         di_copy_1_0 = di_copy_1
2026-02-21T11:12:39.0851206Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:12:39.0851679Z         values_1 = tl.load(x + (indices_0[:, None] * 896 + indices_2[None, :] * 1), mask_2[None, :], other=0, eviction_policy='evict_last')
2026-02-21T11:12:39.0852243Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:12:39.0852596Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:12:39.0852828Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:12:39.0853045Z         v_10 = v_9 - subscript_1
2026-02-21T11:12:39.0853248Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:12:39.0853457Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:12:39.0853664Z         v_12 = v_11 / subscript_2
2026-02-21T11:12:39.0853867Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:12:39.0854307Z         tl.store(out + (indices_0[:, None] * 896 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:12:39.0854586Z 
2026-02-21T11:12:39.0854741Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:12:39.0855027Z     """
2026-02-21T11:12:39.0855283Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:12:39.0855671Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:12:39.0856105Z     Args:
2026-02-21T11:12:39.0856295Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:12:39.0856530Z     Returns:
2026-02-21T11:12:39.0856742Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:12:39.0856996Z     """
2026-02-21T11:12:39.0857162Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:12:39.0857365Z     m, n = x.size()
2026-02-21T11:12:39.0857557Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:12:39.0857801Z     out = torch.empty_like(x)
2026-02-21T11:12:39.0858071Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:12:39.0858478Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:12:39.0859008Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:12:39.0859309Z     # src[softmax.py:79-92]: ...
2026-02-21T11:12:39.0859623Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=1, num_stages=8)
2026-02-21T11:12:39.0859966Z     # src[softmax.py:93]: return out
2026-02-21T11:12:39.0860172Z     return out
2026-02-21T11:12:39.8758410Z WARNING:tritonbench.utils.triton_op:Completed input ID 5:
2026-02-21T11:12:39.8759017Z (M, N)
2026-02-21T11:12:39.8759295Z -----------
2026-02-21T11:12:39.8759584Z (4096, 896)
2026-02-21T11:12:39.8760056Z 
2026-02-21T11:12:39.8771986Z  10%|█         | 2/20 [09:35<1:26:40, 288.90s/it]WARNING:tritonbench.utils.triton_op:Running input ID 10:
2026-02-21T11:12:39.8772407Z (M, N)
2026-02-21T11:12:39.8772559Z ------------
2026-02-21T11:12:39.8772732Z (4096, 1536)
2026-02-21T11:12:39.8775830Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T11:12:41.6065781Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:12:43.4171328Z INFO:tritonbench.utils.triton_op:Took 3.44ms to get benchmark function for torch_compile_softmax
2026-02-21T11:12:44.6179228Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:12:44.6179744Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:12:44.6180181Z               'dtype': 'torch.float16',
2026-02-21T11:12:44.6180642Z               'shape': (4096, 1536),
2026-02-21T11:12:44.6181141Z               'stride': (1536, 1)},),
2026-02-21T11:12:44.6181620Z   'kwargs': {}}
2026-02-21T11:12:44.6221850Z INFO:tritonbench.utils.triton_op:Took 4.55ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:12:44.9093307Z [0s] Autotune random seed: 2145258556
2026-02-21T11:12:44.9449146Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:13:18.3241609Z [33s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:13:18.4064164Z [33s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:13:20.7180246Z [35s] Timeout after 30s compiling Config(block_sizes=[512, 32], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=8, num_warps=2, pid_type='persistent_interleaved', range_flattens=[False, False], range_multi_buffers=[None, False], range_num_stages=[3, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:13:20.8167672Z [35s] Timeout after 30s compiling Config(block_sizes=[256, 128], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first'], num_stages=1, num_warps=2, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T11:13:21.0048989Z [36s] Timeout after 30s compiling Config(block_sizes=[512, 32], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=8, num_warps=1, pid_type='persistent_blocked', range_flattens=[None, True], range_multi_buffers=[False, True], range_num_stages=[3, 1], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T11:13:21.1498166Z [36s] Timeout after 30s compiling Config(block_sizes=[1024, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=32, num_sm_multiplier=8, num_stages=8, num_warps=4, pid_type='persistent_interleaved', range_flattens=[False, True], range_multi_buffers=[True, None], range_num_stages=[3, 4], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T11:13:22.3932094Z [37s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, False], range_multi_buffers=[False, True], range_num_stages=[1, 1], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T11:13:22.4872505Z [37s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], num_stages=5, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T11:13:22.4895989Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 1.0 configs/s
2026-02-21T11:13:28.3498259Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.2 configs/s
2026-02-21T11:13:28.3512199Z [43s] Adaptive compile timeout: 30s (90% percentile=20.4s, bounds=[30.0s, 30s])
2026-02-21T11:13:28.9738443Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1614.6 configs/s
2026-02-21T11:13:29.0531866Z [44s] Initial random population of 100, 5 starting points: 
2026-02-21T11:13:29.0534973Z error=4
2026-02-21T11:13:29.0535202Z timeout=8
2026-02-21T11:13:29.0535439Z ok=88
2026-02-21T11:13:29.0535615Z min=0.0168
2026-02-21T11:13:29.0535811Z mid=0.1470
2026-02-21T11:13:29.0535983Z max=18.1600
2026-02-21T11:13:29.0536179Z best={'block_sizes': [2, 512],
2026-02-21T11:13:29.0536589Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:13:29.0537021Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:13:29.0537312Z  'maxnreg': 256,
2026-02-21T11:13:29.0537539Z  'num_sm_multiplier': 32,
2026-02-21T11:13:29.0537769Z  'num_stages': 1,
2026-02-21T11:13:29.0537963Z  'num_warps': 2,
2026-02-21T11:13:29.0538189Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:13:29.0538470Z  'range_flattens': [True, None],
2026-02-21T11:13:29.0538727Z  'range_multi_buffers': [True, False],
2026-02-21T11:13:29.0539007Z  'range_num_stages': [3, 0],
2026-02-21T11:13:29.0539260Z  'range_unroll_factors': [1, 0],
2026-02-21T11:13:29.0539513Z  'range_warp_specializes': []}
2026-02-21T11:13:29.0554303Z [44s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:13:30.4965646Z [45s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T11:13:44.7477110Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 3.9 configs/s
2026-02-21T11:13:50.7420950Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.0 configs/s
2026-02-21T11:13:58.8823005Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 131.6         
2026-02-21T11:13:58.8824426Z                                                                   configs/s     
2026-02-21T11:13:59.6033558Z [74s] Generation 1 complete: 
2026-02-21T11:13:59.6034264Z ok=97
2026-02-21T11:13:59.6034581Z min=0.0150
2026-02-21T11:13:59.6034876Z mid=0.0193
2026-02-21T11:13:59.6035141Z max=0.0795
2026-02-21T11:13:59.6035437Z best={'block_sizes': [1, 512],
2026-02-21T11:13:59.6035998Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:13:59.6036616Z  'load_eviction_policies': ['', 'last'],
2026-02-21T11:13:59.6037040Z  'num_stages': 5,
2026-02-21T11:13:59.6037351Z  'num_warps': 1,
2026-02-21T11:13:59.6037657Z  'pid_type': 'flat',
2026-02-21T11:13:59.6038012Z  'range_flattens': [None, False],
2026-02-21T11:13:59.6039007Z  'range_multi_buffers': [None, None],
2026-02-21T11:13:59.6039461Z  'range_num_stages': [0, 2],
2026-02-21T11:13:59.6039843Z  'range_unroll_factors': [0, 4],
2026-02-21T11:13:59.6040242Z  'range_warp_specializes': []}
2026-02-21T11:13:59.6055505Z [74s] Fitting surrogate: 197 points, 197 targets
2026-02-21T11:14:00.7557474Z [75s] Generation 2 starting: 74 neighbors, 5 active search path(s)
2026-02-21T11:14:10.7640219Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76/76 3.6 configs/s
2026-02-21T11:14:15.4753697Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 76/76 16.3 configs/s
2026-02-21T11:14:21.9525348Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 167.7         
2026-02-21T11:14:21.9527351Z                                                                   configs/s     
2026-02-21T11:14:22.5222082Z [97s] Generation 2 complete: 
2026-02-21T11:14:22.5222346Z ok=79
2026-02-21T11:14:22.5222527Z min=0.0131
2026-02-21T11:14:22.5222702Z mid=0.0163
2026-02-21T11:14:22.5222865Z max=0.0783
2026-02-21T11:14:22.5223072Z best={'block_sizes': [1, 2048],
2026-02-21T11:14:22.5223412Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:14:22.5223819Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:14:22.5224410Z  'maxnreg': 128,
2026-02-21T11:14:22.5224609Z  'num_sm_multiplier': 32,
2026-02-21T11:14:22.5224830Z  'num_stages': 1,
2026-02-21T11:14:22.5225016Z  'num_warps': 2,
2026-02-21T11:14:22.5225232Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:14:22.5225515Z  'range_flattens': [True, None],
2026-02-21T11:14:22.5225783Z  'range_multi_buffers': [None, None],
2026-02-21T11:14:22.5226038Z  'range_num_stages': [3, 0],
2026-02-21T11:14:22.5226271Z  'range_unroll_factors': [1, 0],
2026-02-21T11:14:22.5226510Z  'range_warp_specializes': []}
2026-02-21T11:14:22.5244118Z [97s] Fitting surrogate: 276 points, 276 targets
2026-02-21T11:14:23.6722468Z [98s] Generation 3 starting: 73 neighbors, 5 active search path(s)
2026-02-21T11:14:33.9417241Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73/73 2.9 configs/s
2026-02-21T11:14:38.4962897Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 73/73 16.2 configs/s
2026-02-21T11:14:45.7279365Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 148.3         
2026-02-21T11:14:45.7281380Z                                                                   configs/s     
2026-02-21T11:14:46.3740422Z [121s] Generation 3 complete: 
2026-02-21T11:14:46.3740701Z ok=78
2026-02-21T11:14:46.3740876Z min=0.0132
2026-02-21T11:14:46.3741048Z mid=0.0157
2026-02-21T11:14:46.3741211Z max=0.0799
2026-02-21T11:14:46.3741395Z best={'block_sizes': [1, 2048],
2026-02-21T11:14:46.3741752Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:14:46.3742161Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:14:46.3742438Z  'maxnreg': 128,
2026-02-21T11:14:46.3742647Z  'num_sm_multiplier': 32,
2026-02-21T11:14:46.3742861Z  'num_stages': 1,
2026-02-21T11:14:46.3743051Z  'num_warps': 2,
2026-02-21T11:14:46.3743289Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:14:46.3743561Z  'range_flattens': [True, None],
2026-02-21T11:14:46.3743810Z  'range_multi_buffers': [None, None],
2026-02-21T11:14:46.3744843Z  'range_num_stages': [3, 0],
2026-02-21T11:14:46.3745084Z  'range_unroll_factors': [1, 0],
2026-02-21T11:14:46.3745327Z  'range_warp_specializes': []}
2026-02-21T11:14:46.3763808Z [121s] Fitting surrogate: 354 points, 354 targets
2026-02-21T11:14:47.3798774Z [122s] Generation 4 starting: 64 neighbors, 5 active search path(s)
2026-02-21T11:14:54.4655606Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 10.2 configs/s
2026-02-21T11:14:58.5209115Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 16.2 configs/s
2026-02-21T11:15:04.6194556Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 166.8         
2026-02-21T11:15:04.6195071Z                                                                   configs/s     
2026-02-21T11:15:05.2022006Z [140s] Generation 4 complete: 
2026-02-21T11:15:05.2022276Z ok=70
2026-02-21T11:15:05.2022471Z min=0.0128
2026-02-21T11:15:05.2022645Z mid=0.0153
2026-02-21T11:15:05.2022814Z max=0.0430
2026-02-21T11:15:05.2023011Z best={'block_sizes': [1, 2048],
2026-02-21T11:15:05.2023322Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:15:05.2023653Z  'load_eviction_policies': ['', ''],
2026-02-21T11:15:05.2023908Z  'num_stages': 5,
2026-02-21T11:15:05.2024371Z  'num_warps': 1,
2026-02-21T11:15:05.2024566Z  'pid_type': 'flat',
2026-02-21T11:15:05.2024776Z  'range_flattens': [None, False],
2026-02-21T11:15:05.2025046Z  'range_multi_buffers': [None, None],
2026-02-21T11:15:05.2025301Z  'range_num_stages': [0, 2],
2026-02-21T11:15:05.2025538Z  'range_unroll_factors': [0, 3],
2026-02-21T11:15:05.2025787Z  'range_warp_specializes': []}
2026-02-21T11:15:05.2051762Z [140s] Fitting surrogate: 424 points, 424 targets
2026-02-21T11:15:05.9325280Z [140s] Generation 5 starting: 45 neighbors, 4 active search path(s)
2026-02-21T11:15:40.4905273Z [175s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=2, num_warps=4, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[False, False], range_num_stages=[0, 4], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:15:40.4926164Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 0.3 configs/s
2026-02-21T11:15:43.3517125Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.7 configs/s
2026-02-21T11:15:46.4151202Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 330.7         
2026-02-21T11:15:46.4153597Z                                                                   configs/s     
2026-02-21T11:15:46.7173495Z [181s] Generation 5 complete: 
2026-02-21T11:15:46.7173827Z timeout=1
2026-02-21T11:15:46.7174461Z ok=48
2026-02-21T11:15:46.7174675Z min=0.0124
2026-02-21T11:15:46.7174878Z mid=0.0146
2026-02-21T11:15:46.7175049Z max=0.5937
2026-02-21T11:15:46.7175234Z best={'block_sizes': [1, 2048],
2026-02-21T11:15:46.7175537Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:15:46.7176622Z  'load_eviction_policies': ['', ''],
2026-02-21T11:15:46.7176884Z  'num_stages': 5,
2026-02-21T11:15:46.7177074Z  'num_warps': 1,
2026-02-21T11:15:46.7177277Z  'pid_type': 'flat',
2026-02-21T11:15:46.7177534Z  'range_flattens': [None, False],
2026-02-21T11:15:46.7177851Z  'range_multi_buffers': [None, None],
2026-02-21T11:15:46.7178172Z  'range_num_stages': [0, 2],
2026-02-21T11:15:46.7178444Z  'range_unroll_factors': [0, 3],
2026-02-21T11:15:46.7178692Z  'range_warp_specializes': []}
2026-02-21T11:15:46.7200929Z [181s] Fitting surrogate: 473 points, 473 targets
2026-02-21T11:15:47.4706600Z [182s] Generation 6 starting: 46 neighbors, 4 active search path(s)
2026-02-21T11:15:56.1873642Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 3.1 configs/s
2026-02-21T11:15:59.1197383Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.3 configs/s
2026-02-21T11:16:02.9317945Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 266.1         
2026-02-21T11:16:02.9318489Z                                                                   configs/s     
2026-02-21T11:16:03.3035772Z [198s] Generation 6 complete: 
2026-02-21T11:16:03.3036246Z ok=50
2026-02-21T11:16:03.3036523Z min=0.0126
2026-02-21T11:16:03.3036837Z mid=0.0146
2026-02-21T11:16:03.3037117Z max=0.1365
2026-02-21T11:16:03.3037410Z best={'block_sizes': [1, 2048],
2026-02-21T11:16:03.3037888Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:16:03.3038388Z  'load_eviction_policies': ['', ''],
2026-02-21T11:16:03.3038804Z  'num_stages': 5,
2026-02-21T11:16:03.3039136Z  'num_warps': 1,
2026-02-21T11:16:03.3039496Z  'pid_type': 'flat',
2026-02-21T11:16:03.3039804Z  'range_flattens': [None, None],
2026-02-21T11:16:03.3040068Z  'range_multi_buffers': [None, None],
2026-02-21T11:16:03.3040312Z  'range_num_stages': [0, 2],
2026-02-21T11:16:03.3040533Z  'range_unroll_factors': [0, 3],
2026-02-21T11:16:03.3040766Z  'range_warp_specializes': []}
2026-02-21T11:16:03.3066865Z [198s] Fitting surrogate: 523 points, 523 targets
2026-02-21T11:16:04.0218366Z [199s] Generation 7 starting: 43 neighbors, 4 active search path(s)
2026-02-21T11:16:14.2306842Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 2.2 configs/s
2026-02-21T11:16:16.9588258Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 16.8 configs/s
2026-02-21T11:16:19.7232487Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 366.3         
2026-02-21T11:16:19.7233017Z                                                                   configs/s     
2026-02-21T11:16:20.0030031Z [215s] Generation 7 complete: 
2026-02-21T11:16:20.0030308Z error=1
2026-02-21T11:16:20.0030482Z ok=46
2026-02-21T11:16:20.0030661Z min=0.0126
2026-02-21T11:16:20.0030831Z mid=0.0163
2026-02-21T11:16:20.0031028Z max=0.1432
2026-02-21T11:16:20.0031207Z best={'block_sizes': [1, 2048],
2026-02-21T11:16:20.0031488Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:16:20.0031821Z  'load_eviction_policies': ['', ''],
2026-02-21T11:16:20.0032058Z  'num_stages': 5,
2026-02-21T11:16:20.0032231Z  'num_warps': 1,
2026-02-21T11:16:20.0032412Z  'pid_type': 'flat',
2026-02-21T11:16:20.0032611Z  'range_flattens': [None, None],
2026-02-21T11:16:20.0032850Z  'range_multi_buffers': [None, None],
2026-02-21T11:16:20.0033095Z  'range_num_stages': [0, 2],
2026-02-21T11:16:20.0033309Z  'range_unroll_factors': [0, 3],
2026-02-21T11:16:20.0033542Z  'range_warp_specializes': []}
2026-02-21T11:16:20.0062499Z [215s] Fitting surrogate: 570 points, 570 targets
2026-02-21T11:16:20.7303726Z [215s] Generation 8 starting: 39 neighbors, 4 active search path(s)
2026-02-21T11:16:25.9498238Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 6.8 configs/s
2026-02-21T11:16:28.4908561Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 41/41 16.4 configs/s
2026-02-21T11:16:30.5311145Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 495.6         
2026-02-21T11:16:30.5312223Z                                                                   configs/s     
2026-02-21T11:16:30.7376219Z [225s] Generation 8 complete: 
2026-02-21T11:16:30.7376484Z ok=43
2026-02-21T11:16:30.7376654Z min=0.0125
2026-02-21T11:16:30.7376836Z mid=0.0194
2026-02-21T11:16:30.7377014Z max=0.1394
2026-02-21T11:16:30.7377197Z best={'block_sizes': [1, 2048],
2026-02-21T11:16:30.7377493Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:16:30.7377809Z  'load_eviction_policies': ['', ''],
2026-02-21T11:16:30.7378090Z  'num_stages': 5,
2026-02-21T11:16:30.7378322Z  'num_warps': 1,
2026-02-21T11:16:30.7378564Z  'pid_type': 'flat',
2026-02-21T11:16:30.7378770Z  'range_flattens': [None, None],
2026-02-21T11:16:30.7379024Z  'range_multi_buffers': [None, False],
2026-02-21T11:16:30.7379592Z  'range_num_stages': [0, 2],
2026-02-21T11:16:30.7379853Z  'range_unroll_factors': [0, 3],
2026-02-21T11:16:30.7380112Z  'range_warp_specializes': []}
2026-02-21T11:16:30.7420605Z [225s] Fitting surrogate: 613 points, 613 targets
2026-02-21T11:16:31.6056759Z [226s] Generation 9 starting: 49 neighbors, 4 active search path(s)
2026-02-21T11:16:41.4719512Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 2.8 configs/s
2026-02-21T11:16:44.7402974Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 52/52 16.1 configs/s
2026-02-21T11:16:48.2446756Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 331.2         
2026-02-21T11:16:48.2447218Z                                                                   configs/s     
2026-02-21T11:16:48.5473379Z [243s] Generation 9 complete: 
2026-02-21T11:16:48.5473844Z ok=53
2026-02-21T11:16:48.5474651Z min=0.0125
2026-02-21T11:16:48.5474935Z mid=0.0172
2026-02-21T11:16:48.5475205Z max=0.1342
2026-02-21T11:16:48.5475497Z best={'block_sizes': [1, 2048],
2026-02-21T11:16:48.5476045Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:16:48.5476551Z  'load_eviction_policies': ['', ''],
2026-02-21T11:16:48.5476973Z  'num_stages': 4,
2026-02-21T11:16:48.5477306Z  'num_warps': 1,
2026-02-21T11:16:48.5477623Z  'pid_type': 'flat',
2026-02-21T11:16:48.5477973Z  'range_flattens': [None, None],
2026-02-21T11:16:48.5478408Z  'range_multi_buffers': [None, False],
2026-02-21T11:16:48.5478844Z  'range_num_stages': [0, 2],
2026-02-21T11:16:48.5479220Z  'range_unroll_factors': [0, 3],
2026-02-21T11:16:48.5479623Z  'range_warp_specializes': []}
2026-02-21T11:16:48.5504117Z [243s] Fitting surrogate: 666 points, 666 targets
2026-02-21T11:16:49.1721791Z [244s] Generation 10 starting: 35 neighbors, 3 active search path(s)
2026-02-21T11:16:57.5502370Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 2.4 configs/s
2026-02-21T11:16:59.8655834Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.3 configs/s
2026-02-21T11:17:02.4293736Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 394.3         
2026-02-21T11:17:02.4294593Z                                                                   configs/s     
2026-02-21T11:17:02.6869992Z [257s] Generation 10 complete: 
2026-02-21T11:17:02.6870241Z ok=38
2026-02-21T11:17:02.6870409Z min=0.0124
2026-02-21T11:17:02.6870689Z mid=0.0170
2026-02-21T11:17:02.6871007Z max=0.1697
2026-02-21T11:17:02.6871365Z best={'block_sizes': [1, 2048],
2026-02-21T11:17:02.6871873Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:17:02.6872389Z  'load_eviction_policies': ['', ''],
2026-02-21T11:17:02.6872787Z  'num_stages': 4,
2026-02-21T11:17:02.6873096Z  'num_warps': 1,
2026-02-21T11:17:02.6873407Z  'pid_type': 'flat',
2026-02-21T11:17:02.6873778Z  'range_flattens': [None, False],
2026-02-21T11:17:02.6874701Z  'range_multi_buffers': [None, False],
2026-02-21T11:17:02.6875138Z  'range_num_stages': [0, 2],
2026-02-21T11:17:02.6875532Z  'range_unroll_factors': [0, 3],
2026-02-21T11:17:02.6875966Z  'range_warp_specializes': []}
2026-02-21T11:17:02.6907951Z [257s] Fitting surrogate: 704 points, 704 targets
2026-02-21T11:17:03.2498632Z [258s] Generation 11 starting: 31 neighbors, 3 active search path(s)
2026-02-21T11:17:08.5139963Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 4.7 configs/s
2026-02-21T11:17:10.5675997Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.4 configs/s
2026-02-21T11:17:12.8068593Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 451.2         
2026-02-21T11:17:12.8069059Z                                                                   configs/s     
2026-02-21T11:17:13.0337725Z [268s] Generation 11 complete: 
2026-02-21T11:17:13.0338207Z ok=34
2026-02-21T11:17:13.0338399Z min=0.0125
2026-02-21T11:17:13.0338572Z mid=0.0162
2026-02-21T11:17:13.0338743Z max=0.1123
2026-02-21T11:17:13.0338920Z best={'block_sizes': [1, 2048],
2026-02-21T11:17:13.0339231Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:17:13.0339986Z  'load_eviction_policies': ['', ''],
2026-02-21T11:17:13.0340253Z  'num_stages': 4,
2026-02-21T11:17:13.0340440Z  'num_warps': 1,
2026-02-21T11:17:13.0340636Z  'pid_type': 'flat',
2026-02-21T11:17:13.0340865Z  'range_flattens': [None, False],
2026-02-21T11:17:13.0341127Z  'range_multi_buffers': [None, False],
2026-02-21T11:17:13.0341395Z  'range_num_stages': [0, 2],
2026-02-21T11:17:13.0341623Z  'range_unroll_factors': [0, 3],
2026-02-21T11:17:13.0341875Z  'range_warp_specializes': []}
2026-02-21T11:17:13.0374443Z [268s] Fitting surrogate: 738 points, 738 targets
2026-02-21T11:17:13.6242196Z [268s] Generation 12 starting: 33 neighbors, 3 active search path(s)
2026-02-21T11:17:19.0405958Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 3.9 configs/s
2026-02-21T11:17:21.1966332Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.6 configs/s
2026-02-21T11:17:24.5582326Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 343.7         
2026-02-21T11:17:24.5587198Z                                                                   configs/s     
2026-02-21T11:17:24.8527161Z [279s] Generation 12 complete: 
2026-02-21T11:17:24.8527650Z ok=37
2026-02-21T11:17:24.8527964Z min=0.0125
2026-02-21T11:17:24.8528246Z mid=0.0136
2026-02-21T11:17:24.8528510Z max=0.0894
2026-02-21T11:17:24.8528812Z best={'block_sizes': [1, 2048],
2026-02-21T11:17:24.8529376Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:17:24.8529991Z  'load_eviction_policies': ['', ''],
2026-02-21T11:17:24.8530513Z  'num_stages': 4,
2026-02-21T11:17:24.8530823Z  'num_warps': 1,
2026-02-21T11:17:24.8531129Z  'pid_type': 'flat',
2026-02-21T11:17:24.8531484Z  'range_flattens': [None, False],
2026-02-21T11:17:24.8531898Z  'range_multi_buffers': [None, False],
2026-02-21T11:17:24.8532325Z  'range_num_stages': [0, 2],
2026-02-21T11:17:24.8532704Z  'range_unroll_factors': [0, 3],
2026-02-21T11:17:24.8533086Z  'range_warp_specializes': []}
2026-02-21T11:17:24.8559967Z [279s] Fitting surrogate: 775 points, 775 targets
2026-02-21T11:17:25.4275565Z [280s] Generation 13 starting: 32 neighbors, 3 active search path(s)
2026-02-21T11:17:30.2318227Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 6.0 configs/s
2026-02-21T11:17:32.3082670Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 16.7 configs/s
2026-02-21T11:17:34.7505261Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 413.7         
2026-02-21T11:17:34.7505771Z                                                                   configs/s     
2026-02-21T11:17:34.9947013Z [290s] Generation 13 complete: 
2026-02-21T11:17:34.9947275Z ok=35
2026-02-21T11:17:34.9947451Z min=0.0125
2026-02-21T11:17:34.9947625Z mid=0.0148
2026-02-21T11:17:34.9947794Z max=0.0504
2026-02-21T11:17:34.9947981Z best={'block_sizes': [1, 2048],
2026-02-21T11:17:34.9948332Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:17:34.9948738Z  'load_eviction_policies': ['', ''],
2026-02-21T11:17:34.9948990Z  'num_stages': 4,
2026-02-21T11:17:34.9949172Z  'num_warps': 1,
2026-02-21T11:17:34.9949379Z  'pid_type': 'flat',
2026-02-21T11:17:34.9949598Z  'range_flattens': [None, False],
2026-02-21T11:17:34.9950317Z  'range_multi_buffers': [None, False],
2026-02-21T11:17:34.9950583Z  'range_num_stages': [0, 2],
2026-02-21T11:17:34.9950813Z  'range_unroll_factors': [0, 3],
2026-02-21T11:17:34.9951060Z  'range_warp_specializes': []}
2026-02-21T11:17:34.9985262Z [290s] Fitting surrogate: 810 points, 810 targets
2026-02-21T11:17:35.5160720Z [290s] Generation 14 starting: 27 neighbors, 2 active search path(s)
2026-02-21T11:18:06.5371009Z [321s] Timeout after 30s compiling Config(block_sizes=[16, 2048], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'last'], num_stages=7, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 3], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T11:18:06.5390465Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 0.4 configs/s
2026-02-21T11:18:08.3002703Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 16.3 configs/s
2026-02-21T11:18:10.0600697Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 571.7         
2026-02-21T11:18:10.0601128Z                                                                   configs/s     
2026-02-21T11:18:10.2393107Z [325s] Generation 14 complete: 
2026-02-21T11:18:10.2393607Z timeout=1
2026-02-21T11:18:10.2393919Z ok=29
2026-02-21T11:18:10.2394495Z min=0.0126
2026-02-21T11:18:10.2394773Z mid=0.0174
2026-02-21T11:18:10.2395077Z max=0.0401
2026-02-21T11:18:10.2395408Z best={'block_sizes': [1, 2048],
2026-02-21T11:18:10.2395997Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:18:10.2396629Z  'load_eviction_policies': ['', ''],
2026-02-21T11:18:10.2397067Z  'num_stages': 4,
2026-02-21T11:18:10.2397397Z  'num_warps': 1,
2026-02-21T11:18:10.2397806Z  'pid_type': 'flat',
2026-02-21T11:18:10.2398213Z  'range_flattens': [None, False],
2026-02-21T11:18:10.2398497Z  'range_multi_buffers': [None, False],
2026-02-21T11:18:10.2398749Z  'range_num_stages': [0, 2],
2026-02-21T11:18:10.2398984Z  'range_unroll_factors': [0, 3],
2026-02-21T11:18:10.2399221Z  'range_warp_specializes': []}
2026-02-21T11:18:10.2433290Z [325s] Fitting surrogate: 840 points, 840 targets
2026-02-21T11:18:10.6985245Z [325s] Generation 15 starting: 24 neighbors, 2 active search path(s)
2026-02-21T11:18:15.8718964Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 3.8 configs/s
2026-02-21T11:18:17.4403375Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 16.4 configs/s
2026-02-21T11:18:18.8681747Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 701.9         
2026-02-21T11:18:18.8682248Z                                                                   configs/s     
2026-02-21T11:18:19.0197598Z [334s] Generation 15 complete: 
2026-02-21T11:18:19.0198044Z ok=27
2026-02-21T11:18:19.0198310Z min=0.0128
2026-02-21T11:18:19.0198602Z mid=0.0185
2026-02-21T11:18:19.0198856Z max=0.0538
2026-02-21T11:18:19.0199143Z best={'block_sizes': [1, 2048],
2026-02-21T11:18:19.0200272Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:18:19.0200852Z  'load_eviction_policies': ['', ''],
2026-02-21T11:18:19.0201243Z  'num_stages': 4,
2026-02-21T11:18:19.0201536Z  'num_warps': 1,
2026-02-21T11:18:19.0201843Z  'pid_type': 'flat',
2026-02-21T11:18:19.0202175Z  'range_flattens': [None, False],
2026-02-21T11:18:19.0202575Z  'range_multi_buffers': [None, False],
2026-02-21T11:18:19.0202976Z  'range_num_stages': [0, 2],
2026-02-21T11:18:19.0203342Z  'range_unroll_factors': [0, 3],
2026-02-21T11:18:19.0203738Z  'range_warp_specializes': []}
2026-02-21T11:18:19.0237918Z [334s] Fitting surrogate: 867 points, 867 targets
2026-02-21T11:18:19.4806171Z [334s] Generation 16 starting: 24 neighbors, 2 active search path(s)
2026-02-21T11:18:24.0149155Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 4.9 configs/s
2026-02-21T11:18:25.5122614Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 16.5 configs/s
2026-02-21T11:18:27.5255939Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 492.7         
2026-02-21T11:18:27.5256475Z                                                                   configs/s     
2026-02-21T11:18:27.6960334Z [342s] Generation 16 complete: 
2026-02-21T11:18:27.6960786Z ok=27
2026-02-21T11:18:27.6961070Z min=0.0126
2026-02-21T11:18:27.6961343Z mid=0.0160
2026-02-21T11:18:27.6961613Z max=0.0599
2026-02-21T11:18:27.6961902Z best={'block_sizes': [1, 2048],
2026-02-21T11:18:27.6962464Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:18:27.6963068Z  'load_eviction_policies': ['', ''],
2026-02-21T11:18:27.6963475Z  'num_stages': 4,
2026-02-21T11:18:27.6963775Z  'num_warps': 1,
2026-02-21T11:18:27.6967535Z  'pid_type': 'flat',
2026-02-21T11:18:27.6967952Z  'range_flattens': [None, False],
2026-02-21T11:18:27.6968366Z  'range_multi_buffers': [None, False],
2026-02-21T11:18:27.6968821Z  'range_num_stages': [0, 2],
2026-02-21T11:18:27.6969216Z  'range_unroll_factors': [0, 3],
2026-02-21T11:18:27.6969647Z  'range_warp_specializes': []}
2026-02-21T11:18:27.6997983Z [342s] Fitting surrogate: 894 points, 894 targets
2026-02-21T11:18:28.1479614Z [343s] Generation 17 starting: 21 neighbors, 2 active search path(s)
2026-02-21T11:18:32.4933819Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 4.4 configs/s
2026-02-21T11:18:33.8099474Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 16.5 configs/s
2026-02-21T11:18:35.7576723Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 519.1         
2026-02-21T11:18:35.7577230Z                                                                   configs/s     
2026-02-21T11:18:35.9562282Z [351s] Generation 17 complete: 
2026-02-21T11:18:35.9562757Z ok=24
2026-02-21T11:18:35.9563099Z min=0.0126
2026-02-21T11:18:35.9563400Z mid=0.0147
2026-02-21T11:18:35.9563675Z max=0.0908
2026-02-21T11:18:35.9564428Z best={'block_sizes': [1, 2048],
2026-02-21T11:18:35.9565047Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:18:35.9565751Z  'load_eviction_policies': ['', ''],
2026-02-21T11:18:35.9565981Z  'num_stages': 4,
2026-02-21T11:18:35.9566153Z  'num_warps': 1,
2026-02-21T11:18:35.9566332Z  'pid_type': 'flat',
2026-02-21T11:18:35.9566525Z  'range_flattens': [None, False],
2026-02-21T11:18:35.9566762Z  'range_multi_buffers': [None, False],
2026-02-21T11:18:35.9566990Z  'range_num_stages': [0, 2],
2026-02-21T11:18:35.9567200Z  'range_unroll_factors': [0, 3],
2026-02-21T11:18:35.9567420Z  'range_warp_specializes': []}
2026-02-21T11:18:35.9605364Z [351s] Fitting surrogate: 918 points, 918 targets
2026-02-21T11:18:36.2934951Z [351s] Generation 18 starting: 12 neighbors, 1 active search path(s)
2026-02-21T11:18:38.7340181Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 6.1 configs/s
2026-02-21T11:18:39.4847168Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.0 configs/s
2026-02-21T11:18:40.9049633Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 710.3         
2026-02-21T11:18:40.9050598Z                                                                   configs/s     
2026-02-21T11:18:41.0561956Z [356s] Generation 18 complete: 
2026-02-21T11:18:41.0562407Z ok=14
2026-02-21T11:18:41.0562700Z min=0.0126
2026-02-21T11:18:41.0562990Z mid=0.0136
2026-02-21T11:18:41.0563257Z max=0.0179
2026-02-21T11:18:41.0563564Z best={'block_sizes': [2, 2048],
2026-02-21T11:18:41.0564353Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:18:41.0564994Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:18:41.0565433Z  'num_stages': 6,
2026-02-21T11:18:41.0565757Z  'num_warps': 2,
2026-02-21T11:18:41.0566076Z  'pid_type': 'flat',
2026-02-21T11:18:41.0566437Z  'range_flattens': [None, True],
2026-02-21T11:18:41.0567359Z  'range_multi_buffers': [None, False],
2026-02-21T11:18:41.0567836Z  'range_num_stages': [0, 2],
2026-02-21T11:18:41.0568243Z  'range_unroll_factors': [0, 2],
2026-02-21T11:18:41.0568690Z  'range_warp_specializes': []}
2026-02-21T11:18:41.0608127Z [356s] Fitting surrogate: 932 points, 932 targets
2026-02-21T11:18:41.3854363Z [356s] Generation 19 starting: 12 neighbors, 1 active search path(s)
2026-02-21T11:18:43.2711404Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 13.4 configs/s
2026-02-21T11:18:44.0360233Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 16.6 configs/s
2026-02-21T11:18:45.3500896Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 766.4         
2026-02-21T11:18:45.3501537Z                                                                   configs/s     
2026-02-21T11:18:45.4921817Z [360s] Generation 19 complete: 
2026-02-21T11:18:45.4922266Z ok=13
2026-02-21T11:18:45.4922577Z min=0.0133
2026-02-21T11:18:45.4922901Z mid=0.0137
2026-02-21T11:18:45.4923188Z max=0.0170
2026-02-21T11:18:45.4923502Z best={'block_sizes': [2, 2048],
2026-02-21T11:18:45.4924542Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:18:45.4925258Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:18:45.4925715Z  'num_stages': 6,
2026-02-21T11:18:45.4926026Z  'num_warps': 2,
2026-02-21T11:18:45.4926358Z  'pid_type': 'flat',
2026-02-21T11:18:45.4926731Z  'range_flattens': [None, False],
2026-02-21T11:18:45.4927168Z  'range_multi_buffers': [None, False],
2026-02-21T11:18:45.4927603Z  'range_num_stages': [0, 1],
2026-02-21T11:18:45.4928004Z  'range_unroll_factors': [0, 2],
2026-02-21T11:18:45.4928417Z  'range_warp_specializes': []}
2026-02-21T11:18:45.4964648Z [360s] Fitting surrogate: 945 points, 945 targets
2026-02-21T11:18:45.8657926Z [360s] Generation 20 starting: 14 neighbors, 1 active search path(s)
2026-02-21T11:18:52.7219524Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 1.2 configs/s
2026-02-21T11:18:53.6675219Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 16.6 configs/s
2026-02-21T11:18:54.7678104Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 912.4         
2026-02-21T11:18:54.7678598Z                                                                   configs/s     
2026-02-21T11:18:54.8917417Z [369s] Generation 20 complete: 
2026-02-21T11:18:54.8917835Z ok=16
2026-02-21T11:18:54.8918120Z min=0.0129
2026-02-21T11:18:54.8918400Z mid=0.0159
2026-02-21T11:18:54.8918677Z max=0.0832
2026-02-21T11:18:54.8918979Z best={'block_sizes': [2, 2048],
2026-02-21T11:18:54.8919409Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:18:54.8919797Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:18:54.8920084Z  'num_stages': 6,
2026-02-21T11:18:54.8920295Z  'num_warps': 2,
2026-02-21T11:18:54.8920502Z  'pid_type': 'flat',
2026-02-21T11:18:54.8920729Z  'range_flattens': [None, False],
2026-02-21T11:18:54.8921001Z  'range_multi_buffers': [None, False],
2026-02-21T11:18:54.8921274Z  'range_num_stages': [0, 1],
2026-02-21T11:18:54.8921512Z  'range_unroll_factors': [0, 2],
2026-02-21T11:18:54.8921767Z  'range_warp_specializes': []}
2026-02-21T11:18:54.8964463Z [369s] Fitting surrogate: 961 points, 961 targets
2026-02-21T11:18:55.0546014Z [370s] Autotuning complete in 370.1s after searching 908 configs.
2026-02-21T11:18:55.0546471Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:18:55.0548000Z     @helion.kernel(config=helion.Config(block_sizes=[2, 2048], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], num_stages=6, num_warps=2, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:18:55.0549600Z 
2026-02-21T11:18:55.0550473Z [370s] Code of selected kernel: /tmp/torchinductor_root/i2/ci2jncyllzysxl2myyrupiopdbpqljanhlxjs2lkdzxfapg5digs.py
2026-02-21T11:18:55.0873257Z from __future__ import annotations
2026-02-21T11:18:55.0873625Z 
2026-02-21T11:18:55.0873750Z import torch
2026-02-21T11:18:55.0874311Z import triton
2026-02-21T11:18:55.0874625Z import triton.language as tl
2026-02-21T11:18:55.0875078Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:18:55.0875674Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:18:55.0876374Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:18:55.0876798Z 
2026-02-21T11:18:55.0876939Z _BLOCK_SIZE_0 = tl.constexpr(2)
2026-02-21T11:18:55.0877338Z _BLOCK_SIZE_1 = tl.constexpr(2048)
2026-02-21T11:18:55.0877590Z 
2026-02-21T11:18:55.0877712Z @triton.jit
2026-02-21T11:18:55.0878030Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:18:55.0878630Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:18:55.0879286Z     pid_0 = tl.program_id(0)
2026-02-21T11:18:55.0879562Z     offset_0 = pid_0 * _BLOCK_SIZE_0
2026-02-21T11:18:55.0879876Z     indices_0 = (offset_0 + tl.arange(0, _BLOCK_SIZE_0)).to(tl.int32)
2026-02-21T11:18:55.0880315Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:18:55.0880733Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:18:55.0881098Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:18:55.0881448Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:18:55.0881799Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:18:55.0882200Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:18:55.0882546Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:18:55.0882871Z     # src[softmax.py:82-89]: ...
2026-02-21T11:18:55.0883419Z     for offset_2 in tl.range(0, 1536, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T11:18:55.0884200Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:18:55.0884544Z         mask_1 = indices_2 < 1536
2026-02-21T11:18:55.0884773Z         mi_copy = mi
2026-02-21T11:18:55.0884957Z         di_copy = di
2026-02-21T11:18:55.0885149Z         mi_copy_0 = mi_copy
2026-02-21T11:18:55.0885358Z         di_copy_0 = di_copy
2026-02-21T11:18:55.0885599Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:18:55.0886145Z         values = tl.load(x + (indices_0[:, None] * 1536 + indices_2[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_last')
2026-02-21T11:18:55.0886727Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:18:55.0887327Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:18:55.0887926Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:18:55.0888300Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:18:55.0888636Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:18:55.0888930Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:18:55.0889556Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:18:55.0889981Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:18:55.0890180Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:18:55.0890377Z         v_4 = di_copy_0 * v_3
2026-02-21T11:18:55.0890592Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:18:55.0890836Z         subscript = v_1[:, None]
2026-02-21T11:18:55.0891032Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:18:55.0891248Z         v_6 = v_5 - subscript
2026-02-21T11:18:55.0891517Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:18:55.0891866Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:18:55.0892277Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:18:55.0892522Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:18:55.0892939Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:18:55.0893407Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:18:55.0893657Z         di = v_4 + sum_1
2026-02-21T11:18:55.0893846Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:18:55.0894191Z         mi = v_1
2026-02-21T11:18:55.0894451Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:18:55.0894781Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:18:55.0895152Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:18:55.0895749Z     for offset_2 in tl.range(0, 1536, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T11:18:55.0896311Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:18:55.0896609Z         mask_2 = indices_2 < 1536
2026-02-21T11:18:55.0896806Z         mi_copy_1 = mi
2026-02-21T11:18:55.0896977Z         di_copy_1 = di
2026-02-21T11:18:55.0897141Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:18:55.0897334Z         di_copy_1_0 = di_copy_1
2026-02-21T11:18:55.0897557Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:18:55.0898046Z         values_1 = tl.load(x + (indices_0[:, None] * 1536 + indices_2[None, :] * 1), mask_2[None, :], other=0, eviction_policy='evict_last')
2026-02-21T11:18:55.0898625Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:18:55.0898987Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:18:55.0899220Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:18:55.0899440Z         v_10 = v_9 - subscript_1
2026-02-21T11:18:55.0899646Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:18:55.0899859Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:18:55.0900085Z         v_12 = v_11 / subscript_2
2026-02-21T11:18:55.0900294Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:18:55.0900635Z         tl.store(out + (indices_0[:, None] * 1536 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:18:55.0900920Z 
2026-02-21T11:18:55.0901073Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:18:55.0901357Z     """
2026-02-21T11:18:55.0901603Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:18:55.0901995Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:18:55.0902264Z     Args:
2026-02-21T11:18:55.0902455Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:18:55.0902687Z     Returns:
2026-02-21T11:18:55.0902912Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:18:55.0903168Z     """
2026-02-21T11:18:55.0903325Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:18:55.0903530Z     m, n = x.size()
2026-02-21T11:18:55.0903720Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:18:55.0904269Z     out = torch.empty_like(x)
2026-02-21T11:18:55.0904542Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:18:55.0904840Z     _BLOCK_SIZE_0 = 2
2026-02-21T11:18:55.0905085Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:18:55.0905481Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:18:55.0905871Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:18:55.0906164Z     # src[softmax.py:79-92]: ...
2026-02-21T11:18:55.0906547Z     _launcher(_helion_softmax_two_pass, (triton.cdiv(4096, _BLOCK_SIZE_0),), x, out, num_warps=2, num_stages=6)
2026-02-21T11:18:55.0906961Z     # src[softmax.py:93]: return out
2026-02-21T11:18:55.0907178Z     return out
2026-02-21T11:18:55.8685486Z WARNING:tritonbench.utils.triton_op:Completed input ID 10:
2026-02-21T11:18:55.8686123Z (M, N)
2026-02-21T11:18:55.8686420Z ------------
2026-02-21T11:18:55.8686726Z (4096, 1536)
2026-02-21T11:18:55.8686890Z 
2026-02-21T11:18:55.8767975Z  15%|█▌        | 3/20 [15:51<1:33:07, 328.67s/it]WARNING:tritonbench.utils.triton_op:Running input ID 15:
2026-02-21T11:18:55.8768784Z (M, N)
2026-02-21T11:18:55.8769079Z ------------
2026-02-21T11:18:55.8769380Z (4096, 2176)
2026-02-21T11:18:55.8770102Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T11:18:57.5707606Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:18:59.4467111Z INFO:tritonbench.utils.triton_op:Took 3.03ms to get benchmark function for torch_compile_softmax
2026-02-21T11:19:00.5919196Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:19:00.5919696Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:19:00.5920165Z               'dtype': 'torch.float16',
2026-02-21T11:19:00.5920594Z               'shape': (4096, 2176),
2026-02-21T11:19:00.5921011Z               'stride': (2176, 1)},),
2026-02-21T11:19:00.5921420Z   'kwargs': {}}
2026-02-21T11:19:00.5949869Z INFO:tritonbench.utils.triton_op:Took 3.47ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:19:00.8895577Z [0s] Autotune random seed: 2145258556
2026-02-21T11:19:00.9253453Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:19:34.5907256Z [33s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:19:34.7155599Z [33s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:19:37.2699677Z [36s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:19:37.5944784Z [36s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:19:37.7034677Z [36s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T11:19:38.3771764Z [37s] Timeout after 30s compiling Config(block_sizes=[512, 32], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=8, num_warps=1, pid_type='persistent_blocked', range_flattens=[None, True], range_multi_buffers=[False, True], range_num_stages=[3, 1], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T11:19:38.5658946Z [37s] Timeout after 30s compiling Config(block_sizes=[1024, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=32, num_sm_multiplier=8, num_stages=8, num_warps=4, pid_type='persistent_interleaved', range_flattens=[False, True], range_multi_buffers=[True, None], range_num_stages=[3, 4], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T11:19:40.3842273Z [39s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, False], range_multi_buffers=[False, True], range_num_stages=[1, 1], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T11:19:40.5130387Z [39s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], num_stages=5, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T11:19:41.1199670Z [40s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T11:19:41.1223878Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.9 configs/s
2026-02-21T11:19:46.8948630Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 17.5 configs/s
2026-02-21T11:19:46.8961879Z [45s] Adaptive compile timeout: 30s (90% percentile=30.0s, bounds=[30.0s, 30s])
2026-02-21T11:19:48.7387616Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 700.6 configs/s
2026-02-21T11:19:48.8763629Z [47s] Initial random population of 100, 5 starting points: 
2026-02-21T11:19:48.8764373Z error=6
2026-02-21T11:19:48.8764560Z timeout=10
2026-02-21T11:19:48.8764897Z ok=84
2026-02-21T11:19:48.8765195Z min=0.0265
2026-02-21T11:19:48.8765396Z mid=0.1915
2026-02-21T11:19:48.8765587Z max=25.2933
2026-02-21T11:19:48.8765794Z best={'block_sizes': [2, 512],
2026-02-21T11:19:48.8766211Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:19:48.8766652Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:19:48.8766970Z  'maxnreg': 256,
2026-02-21T11:19:48.8767179Z  'num_sm_multiplier': 32,
2026-02-21T11:19:48.8767406Z  'num_stages': 1,
2026-02-21T11:19:48.8767603Z  'num_warps': 2,
2026-02-21T11:19:48.8767819Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:19:48.8768102Z  'range_flattens': [True, None],
2026-02-21T11:19:48.8768382Z  'range_multi_buffers': [True, False],
2026-02-21T11:19:48.8768648Z  'range_num_stages': [3, 0],
2026-02-21T11:19:48.8768880Z  'range_unroll_factors': [1, 0],
2026-02-21T11:19:48.8769942Z  'range_warp_specializes': []}
2026-02-21T11:19:48.8780741Z [47s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:19:50.2808726Z [49s] Generation 1 starting: 87 neighbors, 5 active search path(s)
2026-02-21T11:20:09.0414526Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 1.9 configs/s
2026-02-21T11:20:14.6688776Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 15.9 configs/s
2026-02-21T11:20:21.4714443Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 149.1         
2026-02-21T11:20:21.4714954Z                                                                   configs/s     
2026-02-21T11:20:22.0425314Z [81s] Generation 1 complete: 
2026-02-21T11:20:22.0425580Z ok=93
2026-02-21T11:20:22.0425755Z min=0.0214
2026-02-21T11:20:22.0426350Z mid=0.0309
2026-02-21T11:20:22.0426529Z max=0.1494
2026-02-21T11:20:22.0426718Z best={'block_sizes': [1, 512],
2026-02-21T11:20:22.0427057Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:20:22.0427456Z  'load_eviction_policies': ['', 'last'],
2026-02-21T11:20:22.0427713Z  'maxnreg': 128,
2026-02-21T11:20:22.0427915Z  'num_sm_multiplier': 16,
2026-02-21T11:20:22.0428128Z  'num_stages': 5,
2026-02-21T11:20:22.0428322Z  'num_warps': 1,
2026-02-21T11:20:22.0428547Z  'pid_type': 'persistent_blocked',
2026-02-21T11:20:22.0428801Z  'range_flattens': [False, False],
2026-02-21T11:20:22.0429056Z  'range_multi_buffers': [None, None],
2026-02-21T11:20:22.0429309Z  'range_num_stages': [3, 2],
2026-02-21T11:20:22.0429546Z  'range_unroll_factors': [2, 4],
2026-02-21T11:20:22.0429790Z  'range_warp_specializes': []}
2026-02-21T11:20:22.0447286Z [81s] Fitting surrogate: 193 points, 193 targets
2026-02-21T11:20:23.2827494Z [82s] Generation 2 starting: 79 neighbors, 5 active search path(s)
2026-02-21T11:20:33.3862984Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81/81 24.9 configs/s
2026-02-21T11:20:38.4337797Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 81/81 16.2 configs/s
2026-02-21T11:20:45.4197619Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 145.2         
2026-02-21T11:20:45.4198147Z                                                                   configs/s     
2026-02-21T11:20:46.0294898Z [105s] Generation 2 complete: 
2026-02-21T11:20:46.0295240Z ok=85
2026-02-21T11:20:46.0295440Z min=0.0204
2026-02-21T11:20:46.0295624Z mid=0.0250
2026-02-21T11:20:46.0295809Z max=0.1044
2026-02-21T11:20:46.0296039Z best={'block_sizes': [1, 512],
2026-02-21T11:20:46.0296497Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:20:46.0296913Z  'load_eviction_policies': ['', 'last'],
2026-02-21T11:20:46.0313425Z  'num_stages': 5,
2026-02-21T11:20:46.0313658Z  'num_warps': 1,
2026-02-21T11:20:46.0313913Z  'pid_type': 'flat',
2026-02-21T11:20:46.0314306Z  'range_flattens': [None, False],
2026-02-21T11:20:46.0314567Z  'range_multi_buffers': [None, None],
2026-02-21T11:20:46.0314833Z  'range_num_stages': [0, 2],
2026-02-21T11:20:46.0315700Z  'range_unroll_factors': [0, 4],
2026-02-21T11:20:46.0315958Z  'range_warp_specializes': []}
2026-02-21T11:20:46.0322062Z [105s] Fitting surrogate: 278 points, 278 targets
2026-02-21T11:20:47.1858179Z [106s] Generation 3 starting: 73 neighbors, 5 active search path(s)
2026-02-21T11:20:57.1197985Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77/77 3.8 configs/s
2026-02-21T11:21:02.4343155Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 77/77 14.6 configs/s
2026-02-21T11:21:08.7351110Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 161.0         
2026-02-21T11:21:08.7351631Z                                                                   configs/s     
2026-02-21T11:21:09.2986182Z [128s] Generation 3 complete: 
2026-02-21T11:21:09.2987029Z ok=79
2026-02-21T11:21:09.2987227Z min=0.0200
2026-02-21T11:21:09.2987406Z mid=0.0230
2026-02-21T11:21:09.2987578Z max=0.0567
2026-02-21T11:21:09.2987769Z best={'block_sizes': [1, 512],
2026-02-21T11:21:09.2988170Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:21:09.2988598Z  'load_eviction_policies': ['', 'first'],
2026-02-21T11:21:09.2988860Z  'num_stages': 5,
2026-02-21T11:21:09.2989053Z  'num_warps': 1,
2026-02-21T11:21:09.2989246Z  'pid_type': 'flat',
2026-02-21T11:21:09.2989455Z  'range_flattens': [None, False],
2026-02-21T11:21:09.2989710Z  'range_multi_buffers': [None, None],
2026-02-21T11:21:09.2989965Z  'range_num_stages': [0, 2],
2026-02-21T11:21:09.2990203Z  'range_unroll_factors': [0, 4],
2026-02-21T11:21:09.2990448Z  'range_warp_specializes': []}
2026-02-21T11:21:09.3009416Z [128s] Fitting surrogate: 357 points, 357 targets
2026-02-21T11:21:10.2806013Z [129s] Generation 4 starting: 63 neighbors, 5 active search path(s)
2026-02-21T11:21:18.7045476Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 6.9 configs/s
2026-02-21T11:21:22.7014775Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 16.2 configs/s
2026-02-21T11:21:28.0988126Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 204.9         
2026-02-21T11:21:28.0988657Z                                                                   configs/s     
2026-02-21T11:21:28.5577659Z [147s] Generation 4 complete: 
2026-02-21T11:21:28.5577935Z ok=68
2026-02-21T11:21:28.5578101Z min=0.0165
2026-02-21T11:21:28.5578277Z mid=0.0225
2026-02-21T11:21:28.5578437Z max=0.0544
2026-02-21T11:21:28.5578620Z best={'block_sizes': [1, 4096],
2026-02-21T11:21:28.5578960Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:21:28.5579333Z  'load_eviction_policies': ['', ''],
2026-02-21T11:21:28.5579586Z  'num_stages': 8,
2026-02-21T11:21:28.5579772Z  'num_warps': 1,
2026-02-21T11:21:28.5579965Z  'pid_type': 'flat',
2026-02-21T11:21:28.5580214Z  'range_flattens': [None, False],
2026-02-21T11:21:28.5580476Z  'range_multi_buffers': [None, None],
2026-02-21T11:21:28.5580734Z  'range_num_stages': [0, 0],
2026-02-21T11:21:28.5580972Z  'range_unroll_factors': [0, 3],
2026-02-21T11:21:28.5581231Z  'range_warp_specializes': []}
2026-02-21T11:21:28.5602768Z [147s] Fitting surrogate: 425 points, 425 targets
2026-02-21T11:21:29.5116949Z [148s] Generation 5 starting: 58 neighbors, 5 active search path(s)
2026-02-21T11:21:37.2443516Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 6.3 configs/s
2026-02-21T11:21:40.9956513Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.2 configs/s
2026-02-21T11:21:44.9263232Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 257.9         
2026-02-21T11:21:44.9264659Z                                                                   configs/s     
2026-02-21T11:21:45.2849517Z [164s] Generation 5 complete: 
2026-02-21T11:21:45.2849825Z ok=63
2026-02-21T11:21:45.2850104Z min=0.0165
2026-02-21T11:21:45.2850328Z mid=0.0243
2026-02-21T11:21:45.2850494Z max=0.0714
2026-02-21T11:21:45.2850685Z best={'block_sizes': [1, 4096],
2026-02-21T11:21:45.2851040Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:21:45.2852069Z  'load_eviction_policies': ['', ''],
2026-02-21T11:21:45.2852332Z  'num_stages': 8,
2026-02-21T11:21:45.2852524Z  'num_warps': 1,
2026-02-21T11:21:45.2852726Z  'pid_type': 'flat',
2026-02-21T11:21:45.2852945Z  'range_flattens': [None, False],
2026-02-21T11:21:45.2853214Z  'range_multi_buffers': [None, True],
2026-02-21T11:21:45.2853478Z  'range_num_stages': [0, 0],
2026-02-21T11:21:45.2853719Z  'range_unroll_factors': [0, 3],
2026-02-21T11:21:45.2854372Z  'range_warp_specializes': []}
2026-02-21T11:21:45.2883596Z [164s] Fitting surrogate: 488 points, 488 targets
2026-02-21T11:21:46.1594273Z [165s] Generation 6 starting: 52 neighbors, 4 active search path(s)
2026-02-21T11:22:01.0867244Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 1.0 configs/s
2026-02-21T11:22:04.4779903Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 16.1 configs/s
2026-02-21T11:22:07.5204663Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 332.0         
2026-02-21T11:22:07.5205228Z                                                                   configs/s     
2026-02-21T11:22:07.8068654Z [186s] Generation 6 complete: 
2026-02-21T11:22:07.8068938Z ok=56
2026-02-21T11:22:07.8069107Z min=0.0166
2026-02-21T11:22:07.8069285Z mid=0.0257
2026-02-21T11:22:07.8069447Z max=0.1487
2026-02-21T11:22:07.8069636Z best={'block_sizes': [1, 4096],
2026-02-21T11:22:07.8069976Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:22:07.8070352Z  'load_eviction_policies': ['', ''],
2026-02-21T11:22:07.8070601Z  'num_stages': 7,
2026-02-21T11:22:07.8070797Z  'num_warps': 1,
2026-02-21T11:22:07.8070984Z  'pid_type': 'flat',
2026-02-21T11:22:07.8071204Z  'range_flattens': [None, False],
2026-02-21T11:22:07.8071484Z  'range_multi_buffers': [None, True],
2026-02-21T11:22:07.8071749Z  'range_num_stages': [0, 0],
2026-02-21T11:22:07.8071981Z  'range_unroll_factors': [0, 3],
2026-02-21T11:22:07.8072236Z  'range_warp_specializes': []}
2026-02-21T11:22:07.8100765Z [186s] Fitting surrogate: 544 points, 544 targets
2026-02-21T11:22:08.5700493Z [187s] Generation 7 starting: 47 neighbors, 4 active search path(s)
2026-02-21T11:22:15.4007691Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 9.2 configs/s
2026-02-21T11:22:18.3947613Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.3 configs/s
2026-02-21T11:22:22.7358559Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 233.3         
2026-02-21T11:22:22.7359594Z                                                                   configs/s     
2026-02-21T11:22:23.1352375Z [202s] Generation 7 complete: 
2026-02-21T11:22:23.1352659Z ok=51
2026-02-21T11:22:23.1352839Z min=0.0164
2026-02-21T11:22:23.1353012Z mid=0.0209
2026-02-21T11:22:23.1353231Z max=0.0584
2026-02-21T11:22:23.1353427Z best={'block_sizes': [1, 4096],
2026-02-21T11:22:23.1353790Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:22:23.1354406Z  'load_eviction_policies': ['', ''],
2026-02-21T11:22:23.1354662Z  'num_stages': 7,
2026-02-21T11:22:23.1354862Z  'num_warps': 1,
2026-02-21T11:22:23.1355057Z  'pid_type': 'flat',
2026-02-21T11:22:23.1355283Z  'range_flattens': [None, False],
2026-02-21T11:22:23.1355547Z  'range_multi_buffers': [None, False],
2026-02-21T11:22:23.1355814Z  'range_num_stages': [0, 0],
2026-02-21T11:22:23.1356051Z  'range_unroll_factors': [0, 3],
2026-02-21T11:22:23.1356304Z  'range_warp_specializes': []}
2026-02-21T11:22:23.1389262Z [202s] Fitting surrogate: 595 points, 595 targets
2026-02-21T11:22:23.8614616Z [202s] Generation 8 starting: 43 neighbors, 4 active search path(s)
2026-02-21T11:22:29.8838337Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 10.3 configs/s
2026-02-21T11:22:32.6216226Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.3 configs/s
2026-02-21T11:22:36.0908005Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 291.6         
2026-02-21T11:22:36.0908964Z                                                                   configs/s     
2026-02-21T11:22:36.4141090Z [215s] Generation 8 complete: 
2026-02-21T11:22:36.4141348Z ok=47
2026-02-21T11:22:36.4141518Z min=0.0167
2026-02-21T11:22:36.4141703Z mid=0.0224
2026-02-21T11:22:36.4141867Z max=0.0504
2026-02-21T11:22:36.4142054Z best={'block_sizes': [1, 4096],
2026-02-21T11:22:36.4142394Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:22:36.4142801Z  'load_eviction_policies': ['', ''],
2026-02-21T11:22:36.4143129Z  'num_stages': 8,
2026-02-21T11:22:36.4143327Z  'num_warps': 1,
2026-02-21T11:22:36.4143524Z  'pid_type': 'flat',
2026-02-21T11:22:36.4143741Z  'range_flattens': [None, False],
2026-02-21T11:22:36.4144178Z  'range_multi_buffers': [None, False],
2026-02-21T11:22:36.4144767Z  'range_num_stages': [0, 1],
2026-02-21T11:22:36.4145029Z  'range_unroll_factors': [0, 3],
2026-02-21T11:22:36.4145275Z  'range_warp_specializes': []}
2026-02-21T11:22:36.4177250Z [215s] Fitting surrogate: 642 points, 642 targets
2026-02-21T11:22:37.1294643Z [216s] Generation 9 starting: 43 neighbors, 4 active search path(s)
2026-02-21T11:22:43.4949890Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 6.5 configs/s
2026-02-21T11:22:46.3160829Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 16.2 configs/s
2026-02-21T11:22:50.5868358Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 266.6         
2026-02-21T11:22:50.5868858Z                                                                   configs/s     
2026-02-21T11:22:50.9392813Z [230s] Generation 9 complete: 
2026-02-21T11:22:50.9393060Z ok=48
2026-02-21T11:22:50.9393300Z min=0.0167
2026-02-21T11:22:50.9393648Z mid=0.0216
2026-02-21T11:22:50.9396164Z max=0.0540
2026-02-21T11:22:50.9396555Z best={'block_sizes': [1, 4096],
2026-02-21T11:22:50.9397181Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:22:50.9397843Z  'load_eviction_policies': ['', ''],
2026-02-21T11:22:50.9398288Z  'num_stages': 7,
2026-02-21T11:22:50.9398588Z  'num_warps': 1,
2026-02-21T11:22:50.9398904Z  'pid_type': 'flat',
2026-02-21T11:22:50.9399285Z  'range_flattens': [None, False],
2026-02-21T11:22:50.9399711Z  'range_multi_buffers': [None, False],
2026-02-21T11:22:50.9400148Z  'range_num_stages': [0, 1],
2026-02-21T11:22:50.9400545Z  'range_unroll_factors': [0, 3],
2026-02-21T11:22:50.9400955Z  'range_warp_specializes': []}
2026-02-21T11:22:50.9425357Z [230s] Fitting surrogate: 690 points, 690 targets
2026-02-21T11:22:51.4771995Z [230s] Generation 10 starting: 29 neighbors, 3 active search path(s)
2026-02-21T11:22:55.9185633Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 9.0 configs/s
2026-02-21T11:22:57.7720792Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 16.6 configs/s
2026-02-21T11:23:00.1335536Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 426.8         
2026-02-21T11:23:00.1336744Z                                                                   configs/s     
2026-02-21T11:23:00.3622534Z [239s] Generation 10 complete: 
2026-02-21T11:23:00.3622834Z ok=32
2026-02-21T11:23:00.3623003Z min=0.0166
2026-02-21T11:23:00.3623169Z mid=0.0204
2026-02-21T11:23:00.3623351Z max=0.0300
2026-02-21T11:23:00.3623531Z best={'block_sizes': [1, 4096],
2026-02-21T11:23:00.3623908Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:23:00.3624619Z  'load_eviction_policies': ['', ''],
2026-02-21T11:23:00.3624875Z  'num_stages': 8,
2026-02-21T11:23:00.3625068Z  'num_warps': 1,
2026-02-21T11:23:00.3625257Z  'pid_type': 'flat',
2026-02-21T11:23:00.3625473Z  'range_flattens': [None, False],
2026-02-21T11:23:00.3625725Z  'range_multi_buffers': [None, True],
2026-02-21T11:23:00.3626359Z  'range_num_stages': [0, 1],
2026-02-21T11:23:00.3626600Z  'range_unroll_factors': [0, 3],
2026-02-21T11:23:00.3626848Z  'range_warp_specializes': []}
2026-02-21T11:23:00.3659862Z [239s] Fitting surrogate: 722 points, 722 targets
2026-02-21T11:23:00.9754477Z [240s] Generation 11 starting: 34 neighbors, 3 active search path(s)
2026-02-21T11:23:06.6271865Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 4.0 configs/s
2026-02-21T11:23:08.8205139Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.3 configs/s
2026-02-21T11:23:11.1881002Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 425.8         
2026-02-21T11:23:11.1881524Z                                                                   configs/s     
2026-02-21T11:23:11.4161582Z [250s] Generation 11 complete: 
2026-02-21T11:23:11.4162027Z ok=37
2026-02-21T11:23:11.4162301Z min=0.0170
2026-02-21T11:23:11.4162586Z mid=0.0219
2026-02-21T11:23:11.4162845Z max=0.0374
2026-02-21T11:23:11.4163140Z best={'block_sizes': [1, 4096],
2026-02-21T11:23:11.4163807Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:23:11.4164695Z  'load_eviction_policies': ['', ''],
2026-02-21T11:23:11.4165167Z  'num_stages': 7,
2026-02-21T11:23:11.4165505Z  'num_warps': 2,
2026-02-21T11:23:11.4165831Z  'pid_type': 'flat',
2026-02-21T11:23:11.4166182Z  'range_flattens': [None, False],
2026-02-21T11:23:11.4166608Z  'range_multi_buffers': [None, True],
2026-02-21T11:23:11.4167021Z  'range_num_stages': [0, 1],
2026-02-21T11:23:11.4167409Z  'range_unroll_factors': [0, 2],
2026-02-21T11:23:11.4167837Z  'range_warp_specializes': []}
2026-02-21T11:23:11.4200515Z [250s] Fitting surrogate: 759 points, 759 targets
2026-02-21T11:23:12.1095388Z [251s] Generation 12 starting: 39 neighbors, 3 active search path(s)
2026-02-21T11:23:22.0276571Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 1.7 configs/s
2026-02-21T11:23:24.6640607Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 42/42 16.2 configs/s
2026-02-21T11:23:27.7299052Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 389.8         
2026-02-21T11:23:27.7299536Z                                                                   configs/s     
2026-02-21T11:23:27.9769669Z [267s] Generation 12 complete: 
2026-02-21T11:23:27.9770211Z ok=43
2026-02-21T11:23:27.9770500Z min=0.0168
2026-02-21T11:23:27.9770777Z mid=0.0229
2026-02-21T11:23:27.9771041Z max=0.0479
2026-02-21T11:23:27.9771328Z best={'block_sizes': [1, 4096],
2026-02-21T11:23:27.9771956Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:23:27.9772634Z  'load_eviction_policies': ['', ''],
2026-02-21T11:23:27.9773055Z  'num_stages': 8,
2026-02-21T11:23:27.9773364Z  'num_warps': 1,
2026-02-21T11:23:27.9773678Z  'pid_type': 'flat',
2026-02-21T11:23:27.9774540Z  'range_flattens': [None, False],
2026-02-21T11:23:27.9775001Z  'range_multi_buffers': [None, True],
2026-02-21T11:23:27.9775436Z  'range_num_stages': [0, 1],
2026-02-21T11:23:27.9775832Z  'range_unroll_factors': [0, 2],
2026-02-21T11:23:27.9776231Z  'range_warp_specializes': []}
2026-02-21T11:23:27.9805954Z [267s] Fitting surrogate: 802 points, 802 targets
2026-02-21T11:23:28.5431387Z [267s] Generation 13 starting: 31 neighbors, 3 active search path(s)
2026-02-21T11:23:33.8992026Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 6.0 configs/s
2026-02-21T11:23:35.9795105Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.2 configs/s
2026-02-21T11:23:38.6642545Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 376.1         
2026-02-21T11:23:38.6642999Z                                                                   configs/s     
2026-02-21T11:23:38.9227080Z [277s] Generation 13 complete: 
2026-02-21T11:23:38.9227574Z ok=34
2026-02-21T11:23:38.9227855Z min=0.0169
2026-02-21T11:23:38.9228130Z mid=0.0216
2026-02-21T11:23:38.9228408Z max=0.0371
2026-02-21T11:23:38.9228705Z best={'block_sizes': [1, 4096],
2026-02-21T11:23:38.9230130Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:23:38.9230784Z  'load_eviction_policies': ['', ''],
2026-02-21T11:23:38.9231201Z  'num_stages': 8,
2026-02-21T11:23:38.9231547Z  'num_warps': 2,
2026-02-21T11:23:38.9231880Z  'pid_type': 'flat',
2026-02-21T11:23:38.9232228Z  'range_flattens': [None, False],
2026-02-21T11:23:38.9232663Z  'range_multi_buffers': [None, True],
2026-02-21T11:23:38.9233086Z  'range_num_stages': [0, 1],
2026-02-21T11:23:38.9254839Z  'range_unroll_factors': [0, 2],
2026-02-21T11:23:38.9255101Z  'range_warp_specializes': []}
2026-02-21T11:23:38.9269037Z [278s] Fitting surrogate: 836 points, 836 targets
2026-02-21T11:23:39.5470077Z [278s] Generation 14 starting: 33 neighbors, 3 active search path(s)
2026-02-21T11:23:44.5029041Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 8.4 configs/s
2026-02-21T11:23:46.6508001Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.6 configs/s
2026-02-21T11:23:49.4271382Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 363.6         
2026-02-21T11:23:49.4271837Z                                                                   configs/s     
2026-02-21T11:23:49.6926308Z [288s] Generation 14 complete: 
2026-02-21T11:23:49.6926575Z ok=37
2026-02-21T11:23:49.6926762Z min=0.0170
2026-02-21T11:23:49.6926938Z mid=0.0205
2026-02-21T11:23:49.6927110Z max=0.0486
2026-02-21T11:23:49.6927300Z best={'block_sizes': [1, 4096],
2026-02-21T11:23:49.6927662Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:23:49.6928068Z  'load_eviction_policies': ['', ''],
2026-02-21T11:23:49.6928339Z  'num_stages': 8,
2026-02-21T11:23:49.6928542Z  'num_warps': 2,
2026-02-21T11:23:49.6928752Z  'pid_type': 'flat',
2026-02-21T11:23:49.6928982Z  'range_flattens': [None, False],
2026-02-21T11:23:49.6929244Z  'range_multi_buffers': [None, True],
2026-02-21T11:23:49.6929513Z  'range_num_stages': [0, 1],
2026-02-21T11:23:49.6929753Z  'range_unroll_factors': [0, 2],
2026-02-21T11:23:49.6930086Z  'range_warp_specializes': []}
2026-02-21T11:23:49.6969494Z [288s] Fitting surrogate: 873 points, 873 targets
2026-02-21T11:23:50.2207606Z [289s] Generation 15 starting: 27 neighbors, 3 active search path(s)
2026-02-21T11:23:54.2088017Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 28/28 5.7 configs/s
2026-02-21T11:23:55.9426992Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 28/28 16.6 configs/s
2026-02-21T11:23:58.3834609Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 413.2         
2026-02-21T11:23:58.3835133Z                                                                   configs/s     
2026-02-21T11:23:58.6262607Z [297s] Generation 15 complete: 
2026-02-21T11:23:58.6262861Z ok=31
2026-02-21T11:23:58.6263039Z min=0.0167
2026-02-21T11:23:58.6263207Z mid=0.0177
2026-02-21T11:23:58.6263374Z max=0.0603
2026-02-21T11:23:58.6263551Z best={'block_sizes': [1, 4096],
2026-02-21T11:23:58.6263912Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:23:58.6264605Z  'load_eviction_policies': ['', ''],
2026-02-21T11:23:58.6264863Z  'num_stages': 8,
2026-02-21T11:23:58.6265067Z  'num_warps': 2,
2026-02-21T11:23:58.6265657Z  'pid_type': 'flat',
2026-02-21T11:23:58.6265879Z  'range_flattens': [None, None],
2026-02-21T11:23:58.6266132Z  'range_multi_buffers': [None, True],
2026-02-21T11:23:58.6266397Z  'range_num_stages': [0, 1],
2026-02-21T11:23:58.6266630Z  'range_unroll_factors': [0, 2],
2026-02-21T11:23:58.6266884Z  'range_warp_specializes': []}
2026-02-21T11:23:58.6307078Z [297s] Fitting surrogate: 904 points, 904 targets
2026-02-21T11:23:59.1049414Z [298s] Generation 16 starting: 25 neighbors, 3 active search path(s)
2026-02-21T11:24:02.7436394Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 7.7 configs/s
2026-02-21T11:24:04.3431772Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 16.7 configs/s
2026-02-21T11:24:07.0781670Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 454.7         
2026-02-21T11:24:07.0782182Z                                                                   configs/s     
2026-02-21T11:24:07.2978302Z [306s] Generation 16 complete: 
2026-02-21T11:24:07.2978574Z ok=28
2026-02-21T11:24:07.2978751Z min=0.0164
2026-02-21T11:24:07.2978921Z mid=0.0177
2026-02-21T11:24:07.2979089Z max=0.0293
2026-02-21T11:24:07.2979267Z best={'block_sizes': [1, 4096],
2026-02-21T11:24:07.2979612Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:24:07.2979991Z  'load_eviction_policies': ['', ''],
2026-02-21T11:24:07.2980243Z  'num_stages': 7,
2026-02-21T11:24:07.2980436Z  'num_warps': 2,
2026-02-21T11:24:07.2980630Z  'pid_type': 'flat',
2026-02-21T11:24:07.2980849Z  'range_flattens': [None, False],
2026-02-21T11:24:07.2981101Z  'range_multi_buffers': [None, True],
2026-02-21T11:24:07.2981378Z  'range_num_stages': [0, 1],
2026-02-21T11:24:07.2981615Z  'range_unroll_factors': [0, 4],
2026-02-21T11:24:07.2981870Z  'range_warp_specializes': []}
2026-02-21T11:24:07.3016346Z [306s] Fitting surrogate: 932 points, 932 targets
2026-02-21T11:24:07.8595964Z [306s] Generation 17 starting: 32 neighbors, 3 active search path(s)
2026-02-21T11:24:12.4856816Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 13.9 configs/s
2026-02-21T11:24:14.4941078Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.8 configs/s
2026-02-21T11:24:17.3654383Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 351.9         
2026-02-21T11:24:17.3654854Z                                                                   configs/s     
2026-02-21T11:24:17.6412823Z [316s] Generation 17 complete: 
2026-02-21T11:24:17.6413277Z ok=35
2026-02-21T11:24:17.6413616Z min=0.0162
2026-02-21T11:24:17.6414365Z mid=0.0170
2026-02-21T11:24:17.6414742Z max=0.0499
2026-02-21T11:24:17.6415051Z best={'block_sizes': [1, 4096],
2026-02-21T11:24:17.6415433Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:24:17.6415821Z  'load_eviction_policies': ['', ''],
2026-02-21T11:24:17.6416067Z  'num_stages': 7,
2026-02-21T11:24:17.6416255Z  'num_warps': 2,
2026-02-21T11:24:17.6416435Z  'pid_type': 'flat',
2026-02-21T11:24:17.6416661Z  'range_flattens': [None, False],
2026-02-21T11:24:17.6416897Z  'range_multi_buffers': [None, True],
2026-02-21T11:24:17.6417144Z  'range_num_stages': [0, 1],
2026-02-21T11:24:17.6417361Z  'range_unroll_factors': [0, 4],
2026-02-21T11:24:17.6417598Z  'range_warp_specializes': []}
2026-02-21T11:24:17.6458560Z [316s] Fitting surrogate: 967 points, 967 targets
2026-02-21T11:24:18.2030943Z [317s] Generation 18 starting: 28 neighbors, 3 active search path(s)
2026-02-21T11:24:22.7986963Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 5.9 configs/s
2026-02-21T11:24:24.6732462Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 16.4 configs/s
2026-02-21T11:24:27.1076489Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 414.4         
2026-02-21T11:24:27.1077540Z                                                                   configs/s     
2026-02-21T11:24:27.3505921Z [326s] Generation 18 complete: 
2026-02-21T11:24:27.3506179Z ok=31
2026-02-21T11:24:27.3506723Z min=0.0166
2026-02-21T11:24:27.3506889Z mid=0.0167
2026-02-21T11:24:27.3507060Z max=0.0412
2026-02-21T11:24:27.3507237Z best={'block_sizes': [1, 4096],
2026-02-21T11:24:27.3507582Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:24:27.3507956Z  'load_eviction_policies': ['', ''],
2026-02-21T11:24:27.3508210Z  'num_stages': 8,
2026-02-21T11:24:27.3508404Z  'num_warps': 1,
2026-02-21T11:24:27.3508602Z  'pid_type': 'flat',
2026-02-21T11:24:27.3508819Z  'range_flattens': [None, None],
2026-02-21T11:24:27.3509068Z  'range_multi_buffers': [None, None],
2026-02-21T11:24:27.3509331Z  'range_num_stages': [0, 0],
2026-02-21T11:24:27.3509560Z  'range_unroll_factors': [0, 3],
2026-02-21T11:24:27.3509806Z  'range_warp_specializes': []}
2026-02-21T11:24:27.3553921Z [326s] Fitting surrogate: 998 points, 998 targets
2026-02-21T11:24:27.9376206Z [327s] Generation 19 starting: 32 neighbors, 3 active search path(s)
2026-02-21T11:24:32.4366979Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 10.2 configs/s
2026-02-21T11:24:34.4562662Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.7 configs/s
2026-02-21T11:24:37.3119040Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 353.9         
2026-02-21T11:24:37.3120762Z                                                                   configs/s     
2026-02-21T11:24:37.5870946Z [336s] Generation 19 complete: 
2026-02-21T11:24:37.5871220Z ok=35
2026-02-21T11:24:37.5871406Z min=0.0164
2026-02-21T11:24:37.5871585Z mid=0.0168
2026-02-21T11:24:37.5871759Z max=0.0505
2026-02-21T11:24:37.5871944Z best={'block_sizes': [1, 4096],
2026-02-21T11:24:37.5872339Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:24:37.5872777Z  'load_eviction_policies': ['', ''],
2026-02-21T11:24:37.5873060Z  'num_stages': 8,
2026-02-21T11:24:37.5873261Z  'num_warps': 2,
2026-02-21T11:24:37.5873461Z  'pid_type': 'flat',
2026-02-21T11:24:37.5873688Z  'range_flattens': [None, None],
2026-02-21T11:24:37.5873963Z  'range_multi_buffers': [None, None],
2026-02-21T11:24:37.5874546Z  'range_num_stages': [0, 0],
2026-02-21T11:24:37.5874783Z  'range_unroll_factors': [0, 3],
2026-02-21T11:24:37.5875050Z  'range_warp_specializes': []}
2026-02-21T11:24:37.5919559Z [336s] Fitting surrogate: 1033 points, 1033 targets
2026-02-21T11:24:38.1680208Z [337s] Generation 20 starting: 32 neighbors, 3 active search path(s)
2026-02-21T11:24:44.1523004Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 3.8 configs/s
2026-02-21T11:24:46.2103621Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 16.9 configs/s
2026-02-21T11:24:49.1869775Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 339.7         
2026-02-21T11:24:49.1871423Z                                                                   configs/s     
2026-02-21T11:24:49.4709989Z [348s] Generation 20 complete: 
2026-02-21T11:24:49.4710399Z ok=35
2026-02-21T11:24:49.4710678Z min=0.0166
2026-02-21T11:24:49.4711789Z mid=0.0171
2026-02-21T11:24:49.4712086Z max=0.0358
2026-02-21T11:24:49.4712388Z best={'block_sizes': [1, 4096],
2026-02-21T11:24:49.4712969Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:24:49.4713581Z  'load_eviction_policies': ['', ''],
2026-02-21T11:24:49.4714459Z  'num_stages': 6,
2026-02-21T11:24:49.4714804Z  'num_warps': 2,
2026-02-21T11:24:49.4715137Z  'pid_type': 'flat',
2026-02-21T11:24:49.4715507Z  'range_flattens': [None, False],
2026-02-21T11:24:49.4715971Z  'range_multi_buffers': [None, True],
2026-02-21T11:24:49.4716484Z  'range_num_stages': [0, 1],
2026-02-21T11:24:49.4716811Z  'range_unroll_factors': [0, 4],
2026-02-21T11:24:49.4717044Z  'range_warp_specializes': []}
2026-02-21T11:24:49.4758411Z [348s] Fitting surrogate: 1068 points, 1068 targets
2026-02-21T11:24:49.6359104Z [348s] Autotuning complete in 348.7s after searching 1011 configs.
2026-02-21T11:24:49.6359613Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:24:49.6361130Z     @helion.kernel(config=helion.Config(block_sizes=[1, 4096], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=6, num_warps=2, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, True], range_num_stages=[0, 1], range_unroll_factors=[0, 4], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:24:49.6362460Z 
2026-02-21T11:24:49.6362872Z [348s] Code of selected kernel: /tmp/torchinductor_root/r3/cr3t3t57wtbjvobqsff3tcor5nynacgvzxo5eqo2y7jvkbwpfenn.py
2026-02-21T11:24:49.6683178Z from __future__ import annotations
2026-02-21T11:24:49.6683379Z 
2026-02-21T11:24:49.6683475Z import torch
2026-02-21T11:24:49.6683676Z import triton
2026-02-21T11:24:49.6683901Z import triton.language as tl
2026-02-21T11:24:49.6684364Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:24:49.6684760Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:24:49.6685199Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:24:49.6685501Z 
2026-02-21T11:24:49.6685602Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:24:49.6685874Z _BLOCK_SIZE_1 = tl.constexpr(4096)
2026-02-21T11:24:49.6686056Z 
2026-02-21T11:24:49.6686150Z @triton.jit
2026-02-21T11:24:49.6686358Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:24:49.6686682Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:24:49.6687020Z     pid_0 = tl.program_id(0)
2026-02-21T11:24:49.6687223Z     offset_0 = pid_0
2026-02-21T11:24:49.6687439Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:24:49.6687792Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:24:49.6688176Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:24:49.6688522Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:24:49.6688864Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:24:49.6689242Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:24:49.6689594Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:24:49.6689931Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:24:49.6690347Z     # src[softmax.py:82-89]: ...
2026-02-21T11:24:49.6690845Z     for offset_2 in tl.range(0, 2176, _BLOCK_SIZE_1, loop_unroll_factor=4, num_stages=1, disallow_acc_multi_buffer=False, flatten=False):
2026-02-21T11:24:49.6691438Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:24:49.6691763Z         mask_1 = indices_2 < 2176
2026-02-21T11:24:49.6691978Z         mi_copy = mi
2026-02-21T11:24:49.6692147Z         di_copy = di
2026-02-21T11:24:49.6692321Z         mi_copy_0 = mi_copy
2026-02-21T11:24:49.6692511Z         di_copy_0 = di_copy
2026-02-21T11:24:49.6692742Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:24:49.6693159Z         values = tl.load(x + (indices_0[:, None] * 2176 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:24:49.6693842Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:24:49.6694566Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:24:49.6695113Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:24:49.6695459Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:24:49.6695780Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:24:49.6696062Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:24:49.6696416Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:24:49.6696886Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:24:49.6697126Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:24:49.6697327Z         v_4 = di_copy_0 * v_3
2026-02-21T11:24:49.6697562Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:24:49.6697825Z         subscript = v_1[:, None]
2026-02-21T11:24:49.6698052Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:24:49.6698271Z         v_6 = v_5 - subscript
2026-02-21T11:24:49.6698544Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:24:49.6698897Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:24:49.6699169Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:24:49.6699396Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:24:49.6699811Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:24:49.6700293Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:24:49.6700544Z         di = v_4 + sum_1
2026-02-21T11:24:49.6700735Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:24:49.6700947Z         mi = v_1
2026-02-21T11:24:49.6701206Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:24:49.6701555Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:24:49.6701930Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:24:49.6702549Z     for offset_2 in tl.range(0, 2176, _BLOCK_SIZE_1, loop_unroll_factor=4, num_stages=1, disallow_acc_multi_buffer=False, flatten=False):
2026-02-21T11:24:49.6703096Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:24:49.6703396Z         mask_2 = indices_2 < 2176
2026-02-21T11:24:49.6703595Z         mi_copy_1 = mi
2026-02-21T11:24:49.6703761Z         di_copy_1 = di
2026-02-21T11:24:49.6703931Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:24:49.6704252Z         di_copy_1_0 = di_copy_1
2026-02-21T11:24:49.6704475Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:24:49.6704872Z         values_1 = tl.load(x + (indices_0[:, None] * 2176 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T11:24:49.6705377Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:24:49.6705737Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:24:49.6705969Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:24:49.6706206Z         v_10 = v_9 - subscript_1
2026-02-21T11:24:49.6706408Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:24:49.6706621Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:24:49.6706831Z         v_12 = v_11 / subscript_2
2026-02-21T11:24:49.6707034Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:24:49.6707368Z         tl.store(out + (indices_0[:, None] * 2176 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:24:49.6707654Z 
2026-02-21T11:24:49.6707813Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:24:49.6708107Z     """
2026-02-21T11:24:49.6708351Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:24:49.6708908Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:24:49.6709180Z     Args:
2026-02-21T11:24:49.6709371Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:24:49.6709607Z     Returns:
2026-02-21T11:24:49.6709817Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:24:49.6710081Z     """
2026-02-21T11:24:49.6710243Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:24:49.6710453Z     m, n = x.size()
2026-02-21T11:24:49.6710638Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:24:49.6710882Z     out = torch.empty_like(x)
2026-02-21T11:24:49.6711149Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:24:49.6711676Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:24:49.6712088Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:24:49.6712396Z     # src[softmax.py:79-92]: ...
2026-02-21T11:24:49.6712707Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=2, num_stages=6)
2026-02-21T11:24:49.6713038Z     # src[softmax.py:93]: return out
2026-02-21T11:24:49.6713239Z     return out
2026-02-21T11:24:50.6149132Z WARNING:tritonbench.utils.triton_op:Completed input ID 15:
2026-02-21T11:24:50.6149773Z (M, N)
2026-02-21T11:24:50.6150071Z ------------
2026-02-21T11:24:50.6150371Z (4096, 2176)
2026-02-21T11:24:50.6150556Z 
2026-02-21T11:24:50.6161633Z  20%|██        | 4/20 [21:45<1:30:23, 338.97s/it]WARNING:tritonbench.utils.triton_op:Running input ID 20:
2026-02-21T11:24:50.6162045Z (M, N)
2026-02-21T11:24:50.6162208Z ------------
2026-02-21T11:24:50.6162365Z (4096, 2816)
2026-02-21T11:24:50.6163827Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T11:24:52.2224406Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:24:54.0015166Z INFO:tritonbench.utils.triton_op:Took 3.06ms to get benchmark function for torch_compile_softmax
2026-02-21T11:24:55.2492160Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:24:55.2492673Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:24:55.2493114Z               'dtype': 'torch.float16',
2026-02-21T11:24:55.2493550Z               'shape': (4096, 2816),
2026-02-21T11:24:55.2494480Z               'stride': (2816, 1)},),
2026-02-21T11:24:55.2494901Z   'kwargs': {}}
2026-02-21T11:24:55.2528828Z INFO:tritonbench.utils.triton_op:Took 3.95ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:24:55.5402863Z [0s] Autotune random seed: 2145258556
2026-02-21T11:24:55.5759752Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:25:29.3422557Z [33s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:25:29.4996124Z [33s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:25:32.8318718Z [37s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:25:33.3054922Z [37s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:25:33.4427611Z [37s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T11:25:34.3183483Z [38s] Timeout after 30s compiling Config(block_sizes=[512, 32], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=8, num_warps=1, pid_type='persistent_blocked', range_flattens=[None, True], range_multi_buffers=[False, True], range_num_stages=[3, 1], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T11:25:34.5458712Z [38s] Timeout after 30s compiling Config(block_sizes=[1024, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=32, num_sm_multiplier=8, num_stages=8, num_warps=4, pid_type='persistent_interleaved', range_flattens=[False, True], range_multi_buffers=[True, None], range_num_stages=[3, 4], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T11:25:36.7906801Z [41s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, False], range_multi_buffers=[False, True], range_num_stages=[1, 1], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T11:25:36.9352338Z [41s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], num_stages=5, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T11:25:37.7166681Z [42s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T11:25:37.7187491Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T11:25:43.7879979Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 16.6 configs/s
2026-02-21T11:25:43.7895526Z [48s] Adaptive compile timeout: 30s (90% percentile=30.0s, bounds=[30.0s, 30s])
2026-02-21T11:25:45.0227270Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 806.3 configs/s
2026-02-21T11:25:45.1430588Z [49s] Initial random population of 100, 5 starting points: 
2026-02-21T11:25:45.1430924Z error=5
2026-02-21T11:25:45.1431084Z timeout=10
2026-02-21T11:25:45.1431250Z ok=85
2026-02-21T11:25:45.1431405Z min=0.0298
2026-02-21T11:25:45.1431573Z mid=0.2387
2026-02-21T11:25:45.1431861Z max=34.0952
2026-02-21T11:25:45.1432061Z best={'block_sizes': [2, 512],
2026-02-21T11:25:45.1432455Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:25:45.1432877Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:25:45.1433191Z  'maxnreg': 256,
2026-02-21T11:25:45.1433392Z  'num_sm_multiplier': 32,
2026-02-21T11:25:45.1434333Z  'num_stages': 1,
2026-02-21T11:25:45.1434514Z  'num_warps': 2,
2026-02-21T11:25:45.1434713Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:25:45.1434975Z  'range_flattens': [True, None],
2026-02-21T11:25:45.1435206Z  'range_multi_buffers': [True, False],
2026-02-21T11:25:45.1435450Z  'range_num_stages': [3, 0],
2026-02-21T11:25:45.1435665Z  'range_unroll_factors': [1, 0],
2026-02-21T11:25:45.1435894Z  'range_warp_specializes': []}
2026-02-21T11:25:45.1449849Z [49s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:25:46.4913465Z [50s] Generation 1 starting: 85 neighbors, 5 active search path(s)
2026-02-21T11:26:05.4979700Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 1.3 configs/s
2026-02-21T11:26:11.0960031Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 16.2 configs/s
2026-02-21T11:26:17.3893951Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 176.9         
2026-02-21T11:26:17.3897075Z                                                                   configs/s     
2026-02-21T11:26:17.8704654Z [82s] Generation 1 complete: 
2026-02-21T11:26:17.8704908Z error=1
2026-02-21T11:26:17.8705073Z ok=90
2026-02-21T11:26:17.8705238Z min=0.0221
2026-02-21T11:26:17.8705400Z mid=0.0346
2026-02-21T11:26:17.8705564Z max=0.1990
2026-02-21T11:26:17.8705741Z best={'block_sizes': [1, 4096],
2026-02-21T11:26:17.8706055Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:26:17.8706390Z  'load_eviction_policies': ['', ''],
2026-02-21T11:26:17.8706643Z  'maxnreg': 64,
2026-02-21T11:26:17.8706857Z  'num_sm_multiplier': 8,
2026-02-21T11:26:17.8707070Z  'num_stages': 1,
2026-02-21T11:26:17.8707275Z  'num_warps': 2,
2026-02-21T11:26:17.8707481Z  'pid_type': 'persistent_blocked',
2026-02-21T11:26:17.8707760Z  'range_flattens': [True, True],
2026-02-21T11:26:17.8708011Z  'range_multi_buffers': [False, False],
2026-02-21T11:26:17.8708284Z  'range_num_stages': [4, 3],
2026-02-21T11:26:17.8708501Z  'range_unroll_factors': [1, 2],
2026-02-21T11:26:17.8708739Z  'range_warp_specializes': []}
2026-02-21T11:26:17.8726398Z [82s] Fitting surrogate: 191 points, 191 targets
2026-02-21T11:26:19.2577562Z [83s] Generation 2 starting: 87 neighbors, 5 active search path(s)
2026-02-21T11:26:38.4299422Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 1.0 configs/s
2026-02-21T11:26:43.9355405Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 16.1 configs/s
2026-02-21T11:26:52.6265725Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 124.5         
2026-02-21T11:26:52.6269603Z                                                                   configs/s     
2026-02-21T11:26:53.3115969Z [117s] Generation 2 complete: 
2026-02-21T11:26:53.3116388Z ok=93
2026-02-21T11:26:53.3116669Z min=0.0193
2026-02-21T11:26:53.3116985Z mid=0.0298
2026-02-21T11:26:53.3117262Z max=0.1602
2026-02-21T11:26:53.3117551Z best={'block_sizes': [1, 4096],
2026-02-21T11:26:53.3118108Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:26:53.3118726Z  'load_eviction_policies': ['', ''],
2026-02-21T11:26:53.3119132Z  'num_stages': 1,
2026-02-21T11:26:53.3119445Z  'num_warps': 2,
2026-02-21T11:26:53.3119750Z  'pid_type': 'flat',
2026-02-21T11:26:53.3120099Z  'range_flattens': [None, True],
2026-02-21T11:26:53.3120512Z  'range_multi_buffers': [None, False],
2026-02-21T11:26:53.3120940Z  'range_num_stages': [0, 3],
2026-02-21T11:26:53.3121318Z  'range_unroll_factors': [0, 2],
2026-02-21T11:26:53.3121805Z  'range_warp_specializes': []}
2026-02-21T11:26:53.3140240Z [117s] Fitting surrogate: 284 points, 284 targets
2026-02-21T11:26:54.4338986Z [118s] Generation 3 starting: 71 neighbors, 5 active search path(s)
2026-02-21T11:27:07.6509983Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 1.7 configs/s
2026-02-21T11:27:12.1327498Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 16.2 configs/s
2026-02-21T11:27:18.6750540Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 155.0         
2026-02-21T11:27:18.6755829Z                                                                   configs/s     
2026-02-21T11:27:19.2566402Z [143s] Generation 3 complete: 
2026-02-21T11:27:19.2566842Z ok=76
2026-02-21T11:27:19.2567126Z min=0.0193
2026-02-21T11:27:19.2567403Z mid=0.0252
2026-02-21T11:27:19.2567678Z max=0.2424
2026-02-21T11:27:19.2567962Z best={'block_sizes': [1, 4096],
2026-02-21T11:27:19.2568482Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:27:19.2569045Z  'load_eviction_policies': ['', ''],
2026-02-21T11:27:19.2569506Z  'num_stages': 1,
2026-02-21T11:27:19.2570028Z  'num_warps': 2,
2026-02-21T11:27:19.2570351Z  'pid_type': 'flat',
2026-02-21T11:27:19.2570562Z  'range_flattens': [None, False],
2026-02-21T11:27:19.2571150Z  'range_multi_buffers': [None, False],
2026-02-21T11:27:19.2571422Z  'range_num_stages': [0, 3],
2026-02-21T11:27:19.2571651Z  'range_unroll_factors': [0, 2],
2026-02-21T11:27:19.2571898Z  'range_warp_specializes': []}
2026-02-21T11:27:19.2595275Z [143s] Fitting surrogate: 360 points, 360 targets
2026-02-21T11:27:20.0998208Z [144s] Generation 4 starting: 55 neighbors, 5 active search path(s)
2026-02-21T11:27:28.3797622Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 12.0 configs/s
2026-02-21T11:27:31.7881258Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.3 configs/s
2026-02-21T11:27:38.4862916Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 164.8         
2026-02-21T11:27:38.4863413Z                                                                   configs/s     
2026-02-21T11:27:39.0341879Z [163s] Generation 4 complete: 
2026-02-21T11:27:39.0342155Z ok=60
2026-02-21T11:27:39.0342354Z min=0.0195
2026-02-21T11:27:39.0342560Z mid=0.0241
2026-02-21T11:27:39.0342746Z max=0.0768
2026-02-21T11:27:39.0342940Z best={'block_sizes': [1, 4096],
2026-02-21T11:27:39.0343351Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:27:39.0343755Z  'load_eviction_policies': ['', ''],
2026-02-21T11:27:39.0344131Z  'num_stages': 5,
2026-02-21T11:27:39.0344320Z  'num_warps': 2,
2026-02-21T11:27:39.0344502Z  'pid_type': 'flat',
2026-02-21T11:27:39.0344727Z  'range_flattens': [None, False],
2026-02-21T11:27:39.0344975Z  'range_multi_buffers': [None, None],
2026-02-21T11:27:39.0345225Z  'range_num_stages': [0, 1],
2026-02-21T11:27:39.0345456Z  'range_unroll_factors': [0, 3],
2026-02-21T11:27:39.0345688Z  'range_warp_specializes': []}
2026-02-21T11:27:39.0374252Z [163s] Fitting surrogate: 420 points, 420 targets
2026-02-21T11:27:39.8203924Z [164s] Generation 5 starting: 47 neighbors, 5 active search path(s)
2026-02-21T11:27:47.1024729Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 18.2 configs/s
2026-02-21T11:27:50.1841520Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.1 configs/s
2026-02-21T11:27:55.6049483Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 187.0         
2026-02-21T11:27:55.6050572Z                                                                   configs/s     
2026-02-21T11:27:56.0980110Z [180s] Generation 5 complete: 
2026-02-21T11:27:56.0980357Z ok=52
2026-02-21T11:27:56.0980536Z min=0.0193
2026-02-21T11:27:56.0980699Z mid=0.0221
2026-02-21T11:27:56.0980868Z max=0.0674
2026-02-21T11:27:56.0981049Z best={'block_sizes': [1, 4096],
2026-02-21T11:27:56.0981403Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:27:56.0981783Z  'load_eviction_policies': ['', ''],
2026-02-21T11:27:56.0982031Z  'num_stages': 1,
2026-02-21T11:27:56.0982224Z  'num_warps': 4,
2026-02-21T11:27:56.0982415Z  'pid_type': 'flat',
2026-02-21T11:27:56.0982629Z  'range_flattens': [None, None],
2026-02-21T11:27:56.0982877Z  'range_multi_buffers': [None, False],
2026-02-21T11:27:56.0983159Z  'range_num_stages': [0, 0],
2026-02-21T11:27:56.0983389Z  'range_unroll_factors': [0, 0],
2026-02-21T11:27:56.0983641Z  'range_warp_specializes': []}
2026-02-21T11:27:56.1017906Z [180s] Fitting surrogate: 472 points, 472 targets
2026-02-21T11:27:56.8745380Z [181s] Generation 6 starting: 44 neighbors, 4 active search path(s)
2026-02-21T11:28:10.5517503Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 0.7 configs/s
2026-02-21T11:28:13.3534654Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 16.3 configs/s
2026-02-21T11:28:18.7446917Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 211.6         
2026-02-21T11:28:18.7447441Z                                                                   configs/s     
2026-02-21T11:28:19.1750586Z [203s] Generation 6 complete: 
2026-02-21T11:28:19.1750860Z ok=48
2026-02-21T11:28:19.1751048Z min=0.0194
2026-02-21T11:28:19.1751276Z mid=0.0224
2026-02-21T11:28:19.1751480Z max=0.0575
2026-02-21T11:28:19.1752162Z best={'block_sizes': [1, 4096],
2026-02-21T11:28:19.1752591Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:28:19.1753043Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:28:19.1753348Z  'num_stages': 7,
2026-02-21T11:28:19.1753550Z  'num_warps': 4,
2026-02-21T11:28:19.1753746Z  'pid_type': 'flat',
2026-02-21T11:28:19.1754153Z  'range_flattens': [None, False],
2026-02-21T11:28:19.1754430Z  'range_multi_buffers': [None, None],
2026-02-21T11:28:19.1754692Z  'range_num_stages': [0, 0],
2026-02-21T11:28:19.1754933Z  'range_unroll_factors': [0, 4],
2026-02-21T11:28:19.1755184Z  'range_warp_specializes': []}
2026-02-21T11:28:19.1779367Z [203s] Fitting surrogate: 520 points, 520 targets
2026-02-21T11:28:19.8657869Z [204s] Generation 7 starting: 38 neighbors, 4 active search path(s)
2026-02-21T11:28:26.2332593Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 33.6 configs/s
2026-02-21T11:28:28.5872142Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 16.4 configs/s
2026-02-21T11:28:33.1601534Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 221.4         
2026-02-21T11:28:33.1602814Z                                                                   configs/s     
2026-02-21T11:28:33.5762348Z [218s] Generation 7 complete: 
2026-02-21T11:28:33.5762650Z ok=42
2026-02-21T11:28:33.5762836Z min=0.0188
2026-02-21T11:28:33.5763026Z mid=0.0196
2026-02-21T11:28:33.5763194Z max=0.0274
2026-02-21T11:28:33.5763393Z best={'block_sizes': [1, 4096],
2026-02-21T11:28:33.5763783Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:28:33.5764655Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:28:33.5764943Z  'num_stages': 7,
2026-02-21T11:28:33.5765146Z  'num_warps': 4,
2026-02-21T11:28:33.5765358Z  'pid_type': 'flat',
2026-02-21T11:28:33.5765583Z  'range_flattens': [None, False],
2026-02-21T11:28:33.5765855Z  'range_multi_buffers': [None, None],
2026-02-21T11:28:33.5766172Z  'range_num_stages': [0, 1],
2026-02-21T11:28:33.5766427Z  'range_unroll_factors': [0, 3],
2026-02-21T11:28:33.5766681Z  'range_warp_specializes': []}
2026-02-21T11:28:33.5796688Z [218s] Fitting surrogate: 562 points, 562 targets
2026-02-21T11:28:34.1901634Z [218s] Generation 8 starting: 34 neighbors, 3 active search path(s)
2026-02-21T11:28:39.5210018Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 9.1 configs/s
2026-02-21T11:28:41.6594730Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 34/34 16.2 configs/s
2026-02-21T11:28:45.6772617Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 251.8         
2026-02-21T11:28:45.6773129Z                                                                   configs/s     
2026-02-21T11:28:46.0581758Z [230s] Generation 8 complete: 
2026-02-21T11:28:46.0582066Z ok=37
2026-02-21T11:28:46.0582234Z min=0.0191
2026-02-21T11:28:46.0582409Z mid=0.0194
2026-02-21T11:28:46.0582572Z max=0.0274
2026-02-21T11:28:46.0583479Z best={'block_sizes': [1, 4096],
2026-02-21T11:28:46.0583877Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:28:46.0584747Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:28:46.0585051Z  'num_stages': 7,
2026-02-21T11:28:46.0585245Z  'num_warps': 4,
2026-02-21T11:28:46.0585437Z  'pid_type': 'flat',
2026-02-21T11:28:46.0585648Z  'range_flattens': [None, False],
2026-02-21T11:28:46.0585907Z  'range_multi_buffers': [None, None],
2026-02-21T11:28:46.0586160Z  'range_num_stages': [0, 1],
2026-02-21T11:28:46.0586400Z  'range_unroll_factors': [0, 3],
2026-02-21T11:28:46.0586645Z  'range_warp_specializes': []}
2026-02-21T11:28:46.0616875Z [230s] Fitting surrogate: 599 points, 599 targets
2026-02-21T11:28:46.6682917Z [231s] Generation 9 starting: 32 neighbors, 3 active search path(s)
2026-02-21T11:28:52.4395683Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 5.7 configs/s
2026-02-21T11:28:54.7774495Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 32/32 13.9 configs/s
2026-02-21T11:28:58.7042199Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 300.7         
2026-02-21T11:28:58.7042716Z                                                                   configs/s     
2026-02-21T11:28:59.0192026Z [243s] Generation 9 complete: 
2026-02-21T11:28:59.0192303Z ok=35
2026-02-21T11:28:59.0192481Z min=0.0191
2026-02-21T11:28:59.0192661Z mid=0.0193
2026-02-21T11:28:59.0192834Z max=0.0291
2026-02-21T11:28:59.0193029Z best={'block_sizes': [1, 4096],
2026-02-21T11:28:59.0193423Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:28:59.0193869Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:28:59.0194528Z  'num_stages': 7,
2026-02-21T11:28:59.0194725Z  'num_warps': 4,
2026-02-21T11:28:59.0194932Z  'pid_type': 'flat',
2026-02-21T11:28:59.0195165Z  'range_flattens': [None, False],
2026-02-21T11:28:59.0195433Z  'range_multi_buffers': [None, None],
2026-02-21T11:28:59.0195693Z  'range_num_stages': [0, 1],
2026-02-21T11:28:59.0195955Z  'range_unroll_factors': [0, 3],
2026-02-21T11:28:59.0196211Z  'range_warp_specializes': []}
2026-02-21T11:28:59.0223026Z [243s] Fitting surrogate: 634 points, 634 targets
2026-02-21T11:28:59.3013272Z [243s] Generation 10 starting: 9 neighbors, 1 active search path(s)
2026-02-21T11:29:01.9195809Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9/9 7.4 configs/s
2026-02-21T11:29:02.4857908Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 9/9 17.3 configs/s
2026-02-21T11:29:03.6825261Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 833.2         
2026-02-21T11:29:03.6825744Z                                                                   configs/s     
2026-02-21T11:29:03.8085682Z [248s] Generation 10 complete: 
2026-02-21T11:29:03.8086122Z ok=11
2026-02-21T11:29:03.8086388Z min=0.0190
2026-02-21T11:29:03.8086677Z mid=0.0226
2026-02-21T11:29:03.8086935Z max=0.0274
2026-02-21T11:29:03.8087222Z best={'block_sizes': [1, 4096],
2026-02-21T11:29:03.8087836Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:29:03.8088495Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:29:03.8089456Z  'num_stages': 7,
2026-02-21T11:29:03.8089872Z  'num_warps': 4,
2026-02-21T11:29:03.8090179Z  'pid_type': 'flat',
2026-02-21T11:29:03.8090508Z  'range_flattens': [None, False],
2026-02-21T11:29:03.8090922Z  'range_multi_buffers': [None, None],
2026-02-21T11:29:03.8091326Z  'range_num_stages': [0, 1],
2026-02-21T11:29:03.8091692Z  'range_unroll_factors': [0, 3],
2026-02-21T11:29:03.8092090Z  'range_warp_specializes': []}
2026-02-21T11:29:03.8117844Z [248s] Fitting surrogate: 645 points, 645 targets
2026-02-21T11:29:04.1155060Z [248s] Generation 11 starting: 11 neighbors, 1 active search path(s)
2026-02-21T11:29:06.3124322Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 1.9 configs/s
2026-02-21T11:29:06.9799476Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.7 configs/s
2026-02-21T11:29:08.2812462Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 767.9         
2026-02-21T11:29:08.2813026Z                                                                   configs/s     
2026-02-21T11:29:08.4162715Z [252s] Generation 11 complete: 
2026-02-21T11:29:08.4162966Z ok=13
2026-02-21T11:29:08.4163127Z min=0.0214
2026-02-21T11:29:08.4163312Z mid=0.0215
2026-02-21T11:29:08.4163481Z max=0.0287
2026-02-21T11:29:08.4163655Z best={'block_sizes': [1, 4096],
2026-02-21T11:29:08.4164295Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:29:08.4164707Z  'load_eviction_policies': ['', ''],
2026-02-21T11:29:08.4164967Z  'num_stages': 7,
2026-02-21T11:29:08.4165155Z  'num_warps': 4,
2026-02-21T11:29:08.4165387Z  'pid_type': 'flat',
2026-02-21T11:29:08.4165655Z  'range_flattens': [None, None],
2026-02-21T11:29:08.4165983Z  'range_multi_buffers': [None, None],
2026-02-21T11:29:08.4166306Z  'range_num_stages': [0, 1],
2026-02-21T11:29:08.4166600Z  'range_unroll_factors': [0, 1],
2026-02-21T11:29:08.4166849Z  'range_warp_specializes': []}
2026-02-21T11:29:08.4196680Z [252s] Fitting surrogate: 658 points, 658 targets
2026-02-21T11:29:08.5752173Z [252s] Autotuning complete in 253.0s after searching 613 configs.
2026-02-21T11:29:08.5752614Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:29:08.5754276Z     @helion.kernel(config=helion.Config(block_sizes=[1, 4096], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=7, num_warps=4, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:29:08.5755659Z 
2026-02-21T11:29:08.5756038Z [252s] Code of selected kernel: /tmp/torchinductor_root/4t/c4tansoj2qozh5sahf47uoubnknigdcwq3hgbtovnb3ssoljntmr.py
2026-02-21T11:29:08.6070388Z from __future__ import annotations
2026-02-21T11:29:08.6070613Z 
2026-02-21T11:29:08.6070693Z import torch
2026-02-21T11:29:08.6070889Z import triton
2026-02-21T11:29:08.6071106Z import triton.language as tl
2026-02-21T11:29:08.6071403Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:29:08.6071810Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:29:08.6072241Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:29:08.6072522Z 
2026-02-21T11:29:08.6072616Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:29:08.6072871Z _BLOCK_SIZE_1 = tl.constexpr(4096)
2026-02-21T11:29:08.6073063Z 
2026-02-21T11:29:08.6073140Z @triton.jit
2026-02-21T11:29:08.6073350Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:29:08.6073742Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:29:08.6074326Z     pid_0 = tl.program_id(0)
2026-02-21T11:29:08.6074561Z     offset_0 = pid_0
2026-02-21T11:29:08.6074816Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:29:08.6075255Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:29:08.6075765Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:29:08.6076522Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:29:08.6076860Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:29:08.6077220Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:29:08.6077579Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:29:08.6077911Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:29:08.6078216Z     # src[softmax.py:82-89]: ...
2026-02-21T11:29:08.6078548Z     for offset_2 in tl.range(0, 2816, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=1):
2026-02-21T11:29:08.6078987Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:29:08.6079290Z         mask_1 = indices_2 < 2816
2026-02-21T11:29:08.6079761Z         mi_copy = mi
2026-02-21T11:29:08.6079994Z         di_copy = di
2026-02-21T11:29:08.6080234Z         mi_copy_0 = mi_copy
2026-02-21T11:29:08.6080492Z         di_copy_0 = di_copy
2026-02-21T11:29:08.6080760Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:29:08.6081246Z         values = tl.load(x + (indices_0[:, None] * 2816 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:29:08.6081745Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:29:08.6082375Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:29:08.6082962Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:29:08.6083374Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:29:08.6083748Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:29:08.6084224Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:29:08.6084632Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:29:08.6084999Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:29:08.6085275Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:29:08.6085521Z         v_4 = di_copy_0 * v_3
2026-02-21T11:29:08.6085822Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:29:08.6086146Z         subscript = v_1[:, None]
2026-02-21T11:29:08.6086399Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:29:08.6086696Z         v_6 = v_5 - subscript
2026-02-21T11:29:08.6087001Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:29:08.6087401Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:29:08.6087699Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:29:08.6105386Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:29:08.6105898Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:29:08.6106386Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:29:08.6106639Z         di = v_4 + sum_1
2026-02-21T11:29:08.6106834Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:29:08.6107039Z         mi = v_1
2026-02-21T11:29:08.6107278Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:29:08.6107618Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:29:08.6107997Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:29:08.6108478Z     for offset_2 in tl.range(0, 2816, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=1):
2026-02-21T11:29:08.6108884Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:29:08.6109171Z         mask_2 = indices_2 < 2816
2026-02-21T11:29:08.6109360Z         mi_copy_1 = mi
2026-02-21T11:29:08.6109519Z         di_copy_1 = di
2026-02-21T11:29:08.6109687Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:29:08.6109879Z         di_copy_1_0 = di_copy_1
2026-02-21T11:29:08.6110097Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:29:08.6110759Z         values_1 = tl.load(x + (indices_0[:, None] * 2816 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T11:29:08.6111251Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:29:08.6111601Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:29:08.6111820Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:29:08.6112035Z         v_10 = v_9 - subscript_1
2026-02-21T11:29:08.6112276Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:29:08.6112524Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:29:08.6112744Z         v_12 = v_11 / subscript_2
2026-02-21T11:29:08.6112942Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:29:08.6113441Z         tl.store(out + (indices_0[:, None] * 2816 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:29:08.6113732Z 
2026-02-21T11:29:08.6113896Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:29:08.6114369Z     """
2026-02-21T11:29:08.6114615Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:29:08.6115012Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:29:08.6115298Z     Args:
2026-02-21T11:29:08.6115492Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:29:08.6115735Z     Returns:
2026-02-21T11:29:08.6115940Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:29:08.6116201Z     """
2026-02-21T11:29:08.6116356Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:29:08.6116590Z     m, n = x.size()
2026-02-21T11:29:08.6116778Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:29:08.6117028Z     out = torch.empty_like(x)
2026-02-21T11:29:08.6117313Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:29:08.6117724Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:29:08.6118123Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:29:08.6118419Z     # src[softmax.py:79-92]: ...
2026-02-21T11:29:08.6118732Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=4, num_stages=7)
2026-02-21T11:29:08.6119065Z     # src[softmax.py:93]: return out
2026-02-21T11:29:08.6119269Z     return out
2026-02-21T11:29:09.7701753Z WARNING:tritonbench.utils.triton_op:Completed input ID 20:
2026-02-21T11:29:09.7702125Z (M, N)
2026-02-21T11:29:09.7702304Z ------------
2026-02-21T11:29:09.7702482Z (4096, 2816)
2026-02-21T11:29:09.7702593Z 
2026-02-21T11:29:09.7722829Z  25%|██▌       | 5/20 [26:05<1:17:32, 310.19s/it]WARNING:tritonbench.utils.triton_op:Running input ID 26:
2026-02-21T11:29:09.7723224Z (M, N)
2026-02-21T11:29:09.7723380Z ------------
2026-02-21T11:29:09.7723546Z (4096, 3584)
2026-02-21T11:29:09.7725376Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T11:29:11.3633509Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:29:13.1204580Z INFO:tritonbench.utils.triton_op:Took 3.00ms to get benchmark function for torch_compile_softmax
2026-02-21T11:29:14.4823750Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:29:14.4824354Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:29:14.4824618Z               'dtype': 'torch.float16',
2026-02-21T11:29:14.4824882Z               'shape': (4096, 3584),
2026-02-21T11:29:14.4825141Z               'stride': (3584, 1)},),
2026-02-21T11:29:14.4825380Z   'kwargs': {}}
2026-02-21T11:29:14.4853048Z INFO:tritonbench.utils.triton_op:Took 3.15ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:29:14.7718446Z [0s] Autotune random seed: 2145258556
2026-02-21T11:29:14.8067960Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:29:48.8313053Z [34s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:29:49.0099376Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:29:52.9459612Z [38s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:29:53.5069533Z [38s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:29:53.6601748Z [38s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T11:29:54.6957174Z [39s] Timeout after 30s compiling Config(block_sizes=[512, 32], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=2, num_stages=8, num_warps=1, pid_type='persistent_blocked', range_flattens=[None, True], range_multi_buffers=[False, True], range_num_stages=[3, 1], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T11:29:54.9212042Z [40s] Timeout after 30s compiling Config(block_sizes=[1024, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=32, num_sm_multiplier=8, num_stages=8, num_warps=4, pid_type='persistent_interleaved', range_flattens=[False, True], range_multi_buffers=[True, None], range_num_stages=[3, 4], range_unroll_factors=[2, 3], range_warp_specializes=[])
2026-02-21T11:29:57.5585337Z [42s] Timeout after 30s compiling Config(block_sizes=[1024, 32], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=128, num_stages=2, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, False], range_multi_buffers=[False, True], range_num_stages=[1, 1], range_unroll_factors=[0, 4], range_warp_specializes=[])
2026-02-21T11:29:57.7188835Z [42s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], num_stages=5, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T11:29:57.7208587Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.9 configs/s
2026-02-21T11:30:04.2231896Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 15.5 configs/s
2026-02-21T11:30:04.2251609Z [49s] Adaptive compile timeout: 30s (90% percentile=25.6s, bounds=[30.0s, 30s])
2026-02-21T11:30:05.5039844Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 775.3 configs/s
2026-02-21T11:30:05.6259184Z [50s] Initial random population of 100, 5 starting points: 
2026-02-21T11:30:05.6259533Z error=5
2026-02-21T11:30:05.6259718Z timeout=9
2026-02-21T11:30:05.6259880Z ok=86
2026-02-21T11:30:05.6260046Z min=0.0343
2026-02-21T11:30:05.6260223Z mid=0.3067
2026-02-21T11:30:05.6260395Z max=46.6342
2026-02-21T11:30:05.6260579Z best={'block_sizes': [2, 512],
2026-02-21T11:30:05.6260923Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:30:05.6261310Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:30:05.6261603Z  'maxnreg': 256,
2026-02-21T11:30:05.6261813Z  'num_sm_multiplier': 32,
2026-02-21T11:30:05.6262029Z  'num_stages': 1,
2026-02-21T11:30:05.6262222Z  'num_warps': 2,
2026-02-21T11:30:05.6262863Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:30:05.6263175Z  'range_flattens': [True, None],
2026-02-21T11:30:05.6263428Z  'range_multi_buffers': [True, False],
2026-02-21T11:30:05.6263724Z  'range_num_stages': [3, 0],
2026-02-21T11:30:05.6263956Z  'range_unroll_factors': [1, 0],
2026-02-21T11:30:05.6264607Z  'range_warp_specializes': []}
2026-02-21T11:30:05.6279466Z [50s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:30:07.0991030Z [52s] Generation 1 starting: 91 neighbors, 5 active search path(s)
2026-02-21T11:30:31.0825506Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95/95 1.7 configs/s
2026-02-21T11:30:37.0271872Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 95/95 16.1 configs/s
2026-02-21T11:30:43.6349458Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 169.0         
2026-02-21T11:30:43.6349963Z                                                                   configs/s     
2026-02-21T11:30:44.1164636Z [89s] Generation 1 complete: 
2026-02-21T11:30:44.1165114Z ok=97
2026-02-21T11:30:44.1165399Z min=0.0255
2026-02-21T11:30:44.1165680Z mid=0.0434
2026-02-21T11:30:44.1165953Z max=0.2674
2026-02-21T11:30:44.1166286Z best={'block_sizes': [1, 4096],
2026-02-21T11:30:44.1166801Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:30:44.1167391Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:30:44.1167822Z  'maxnreg': 64,
2026-02-21T11:30:44.1168152Z  'num_sm_multiplier': 8,
2026-02-21T11:30:44.1168502Z  'num_stages': 1,
2026-02-21T11:30:44.1168817Z  'num_warps': 4,
2026-02-21T11:30:44.1169166Z  'pid_type': 'persistent_blocked',
2026-02-21T11:30:44.1169587Z  'range_flattens': [False, True],
2026-02-21T11:30:44.1170156Z  'range_multi_buffers': [False, False],
2026-02-21T11:30:44.1170615Z  'range_num_stages': [4, 3],
2026-02-21T11:30:44.1171004Z  'range_unroll_factors': [1, 2],
2026-02-21T11:30:44.1171400Z  'range_warp_specializes': []}
2026-02-21T11:30:44.1185845Z [89s] Fitting surrogate: 197 points, 197 targets
2026-02-21T11:30:45.4471912Z [90s] Generation 2 starting: 83 neighbors, 5 active search path(s)
2026-02-21T11:31:01.3692426Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86/86 5.4 configs/s
2026-02-21T11:31:06.7304285Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 86/86 16.2 configs/s
2026-02-21T11:31:13.4748142Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 150.2         
2026-02-21T11:31:13.4749267Z                                                                   configs/s     
2026-02-21T11:31:14.0271604Z [119s] Generation 2 complete: 
2026-02-21T11:31:14.0271864Z ok=89
2026-02-21T11:31:14.0272033Z min=0.0245
2026-02-21T11:31:14.0272210Z mid=0.0342
2026-02-21T11:31:14.0272505Z max=0.3970
2026-02-21T11:31:14.0272734Z best={'block_sizes': [1, 4096],
2026-02-21T11:31:14.0273319Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:31:14.0274570Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:31:14.0275199Z  'maxnreg': 256,
2026-02-21T11:31:14.0276300Z  'num_sm_multiplier': 8,
2026-02-21T11:31:14.0276864Z  'num_stages': 1,
2026-02-21T11:31:14.0277319Z  'num_warps': 1,
2026-02-21T11:31:14.0277760Z  'pid_type': 'persistent_blocked',
2026-02-21T11:31:14.0278348Z  'range_flattens': [False, True],
2026-02-21T11:31:14.0278845Z  'range_multi_buffers': [False, False],
2026-02-21T11:31:14.0279416Z  'range_num_stages': [4, 3],
2026-02-21T11:31:14.0279880Z  'range_unroll_factors': [1, 2],
2026-02-21T11:31:14.0280406Z  'range_warp_specializes': []}
2026-02-21T11:31:14.0299036Z [119s] Fitting surrogate: 286 points, 286 targets
2026-02-21T11:31:15.2177468Z [120s] Generation 3 starting: 75 neighbors, 5 active search path(s)
2026-02-21T11:31:33.1967555Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76/76 1.1 configs/s
2026-02-21T11:31:37.9110188Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 76/76 16.3 configs/s
2026-02-21T11:31:46.4332809Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.9         
2026-02-21T11:31:46.4336513Z                                                                   configs/s     
2026-02-21T11:31:47.1396155Z [152s] Generation 3 complete: 
2026-02-21T11:31:47.1396583Z ok=81
2026-02-21T11:31:47.1396814Z min=0.0233
2026-02-21T11:31:47.1397065Z mid=0.0304
2026-02-21T11:31:47.1397288Z max=0.0580
2026-02-21T11:31:47.1397548Z best={'block_sizes': [1, 4096],
2026-02-21T11:31:47.1397931Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:31:47.1398360Z  'load_eviction_policies': ['', ''],
2026-02-21T11:31:47.1398680Z  'num_stages': 2,
2026-02-21T11:31:47.1398960Z  'num_warps': 4,
2026-02-21T11:31:47.1399224Z  'pid_type': 'flat',
2026-02-21T11:31:47.1399531Z  'range_flattens': [None, False],
2026-02-21T11:31:47.1399880Z  'range_multi_buffers': [None, True],
2026-02-21T11:31:47.1400194Z  'range_num_stages': [0, 2],
2026-02-21T11:31:47.1400518Z  'range_unroll_factors': [0, 0],
2026-02-21T11:31:47.1400820Z  'range_warp_specializes': []}
2026-02-21T11:31:47.1427400Z [152s] Fitting surrogate: 367 points, 367 targets
2026-02-21T11:31:48.2399899Z [153s] Generation 4 starting: 71 neighbors, 5 active search path(s)
2026-02-21T11:32:04.5140118Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75/75 1.1 configs/s
2026-02-21T11:32:09.1721883Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 75/75 16.2 configs/s
2026-02-21T11:32:15.6460663Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 174.2         
2026-02-21T11:32:15.6461229Z                                                                   configs/s     
2026-02-21T11:32:16.1430081Z [181s] Generation 4 complete: 
2026-02-21T11:32:16.1430489Z ok=77
2026-02-21T11:32:16.1430725Z min=0.0232
2026-02-21T11:32:16.1430994Z mid=0.0315
2026-02-21T11:32:16.1431229Z max=0.0573
2026-02-21T11:32:16.1431510Z best={'block_sizes': [1, 4096],
2026-02-21T11:32:16.1431938Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:32:16.1432358Z  'load_eviction_policies': ['', ''],
2026-02-21T11:32:16.1432743Z  'num_stages': 1,
2026-02-21T11:32:16.1432998Z  'num_warps': 2,
2026-02-21T11:32:16.1433288Z  'pid_type': 'flat',
2026-02-21T11:32:16.1433568Z  'range_flattens': [None, False],
2026-02-21T11:32:16.1435186Z  'range_multi_buffers': [None, True],
2026-02-21T11:32:16.1435519Z  'range_num_stages': [0, 2],
2026-02-21T11:32:16.1435852Z  'range_unroll_factors': [0, 0],
2026-02-21T11:32:16.1436165Z  'range_warp_specializes': []}
2026-02-21T11:32:16.1457866Z [181s] Fitting surrogate: 444 points, 444 targets
2026-02-21T11:32:17.2052128Z [182s] Generation 5 starting: 68 neighbors, 5 active search path(s)
2026-02-21T11:32:29.5783821Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73/73 7.5 configs/s
2026-02-21T11:32:34.1140000Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 73/73 16.2 configs/s
2026-02-21T11:32:40.3489958Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 162.6         
2026-02-21T11:32:40.3493031Z                                                                   configs/s     
2026-02-21T11:32:40.8836337Z [206s] Generation 5 complete: 
2026-02-21T11:32:40.8836701Z ok=74
2026-02-21T11:32:40.8836931Z min=0.0229
2026-02-21T11:32:40.8837227Z mid=0.0301
2026-02-21T11:32:40.8837448Z max=0.1489
2026-02-21T11:32:40.8837721Z best={'block_sizes': [1, 4096],
2026-02-21T11:32:40.8838094Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:32:40.8838522Z  'load_eviction_policies': ['', ''],
2026-02-21T11:32:40.8838836Z  'num_stages': 1,
2026-02-21T11:32:40.8839117Z  'num_warps': 2,
2026-02-21T11:32:40.8839365Z  'pid_type': 'flat',
2026-02-21T11:32:40.8839674Z  'range_flattens': [None, False],
2026-02-21T11:32:40.8840026Z  'range_multi_buffers': [None, True],
2026-02-21T11:32:40.8840357Z  'range_num_stages': [0, 2],
2026-02-21T11:32:40.8840696Z  'range_unroll_factors': [0, 0],
2026-02-21T11:32:40.8840999Z  'range_warp_specializes': []}
2026-02-21T11:32:40.8871613Z [206s] Fitting surrogate: 518 points, 518 targets
2026-02-21T11:32:41.8882384Z [207s] Generation 6 starting: 63 neighbors, 5 active search path(s)
2026-02-21T11:32:56.5184418Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 1.5 configs/s
2026-02-21T11:33:00.5785004Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.4 configs/s
2026-02-21T11:33:07.4830251Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 161.0         
2026-02-21T11:33:07.4830884Z                                                                   configs/s     
2026-02-21T11:33:08.0286118Z [233s] Generation 6 complete: 
2026-02-21T11:33:08.0286477Z ok=69
2026-02-21T11:33:08.0286740Z min=0.0228
2026-02-21T11:33:08.0286965Z mid=0.0265
2026-02-21T11:33:08.0287192Z max=0.1811
2026-02-21T11:33:08.0287418Z best={'block_sizes': [1, 4096],
2026-02-21T11:33:08.0287839Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:33:08.0288244Z  'load_eviction_policies': ['', ''],
2026-02-21T11:33:08.0288587Z  'num_stages': 1,
2026-02-21T11:33:08.0288853Z  'num_warps': 2,
2026-02-21T11:33:08.0289274Z  'pid_type': 'flat',
2026-02-21T11:33:08.0289589Z  'range_flattens': [None, False],
2026-02-21T11:33:08.0290093Z  'range_multi_buffers': [None, True],
2026-02-21T11:33:08.0290548Z  'range_num_stages': [0, 2],
2026-02-21T11:33:08.0290944Z  'range_unroll_factors': [0, 0],
2026-02-21T11:33:08.0291338Z  'range_warp_specializes': []}
2026-02-21T11:33:08.0325456Z [233s] Fitting surrogate: 587 points, 587 targets
2026-02-21T11:33:09.0052787Z [234s] Generation 7 starting: 59 neighbors, 5 active search path(s)
2026-02-21T11:33:22.0725038Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 1.7 configs/s
2026-02-21T11:33:25.8801440Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 16.5 configs/s
2026-02-21T11:33:31.5673908Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 178.3         
2026-02-21T11:33:31.5675117Z                                                                   configs/s     
2026-02-21T11:33:32.0642834Z [257s] Generation 7 complete: 
2026-02-21T11:33:32.0643387Z ok=64
2026-02-21T11:33:32.0643750Z min=0.0228
2026-02-21T11:33:32.0644460Z mid=0.0244
2026-02-21T11:33:32.0644816Z max=0.3947
2026-02-21T11:33:32.0646125Z best={'block_sizes': [1, 4096],
2026-02-21T11:33:32.0647192Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:33:32.0647926Z  'load_eviction_policies': ['', ''],
2026-02-21T11:33:32.0648445Z  'num_stages': 7,
2026-02-21T11:33:32.0648767Z  'num_warps': 2,
2026-02-21T11:33:32.0649086Z  'pid_type': 'flat',
2026-02-21T11:33:32.0649439Z  'range_flattens': [None, True],
2026-02-21T11:33:32.0650004Z  'range_multi_buffers': [None, False],
2026-02-21T11:33:32.0650422Z  'range_num_stages': [0, 2],
2026-02-21T11:33:32.0650633Z  'range_unroll_factors': [0, 3],
2026-02-21T11:33:32.0650848Z  'range_warp_specializes': []}
2026-02-21T11:33:32.0680053Z [257s] Fitting surrogate: 651 points, 651 targets
2026-02-21T11:33:32.9643804Z [258s] Generation 8 starting: 58 neighbors, 5 active search path(s)
2026-02-21T11:33:46.5230643Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 0.8 configs/s
2026-02-21T11:33:50.1874779Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.6 configs/s
2026-02-21T11:33:55.9356531Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 198.5         
2026-02-21T11:33:55.9358707Z                                                                   configs/s     
2026-02-21T11:33:56.3843312Z [281s] Generation 8 complete: 
2026-02-21T11:33:56.3843580Z ok=63
2026-02-21T11:33:56.3843751Z min=0.0228
2026-02-21T11:33:56.3844345Z mid=0.0246
2026-02-21T11:33:56.3844532Z max=0.1988
2026-02-21T11:33:56.3844743Z best={'block_sizes': [1, 4096],
2026-02-21T11:33:56.3845067Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:33:56.3845415Z  'load_eviction_policies': ['', ''],
2026-02-21T11:33:56.3845684Z  'num_stages': 1,
2026-02-21T11:33:56.3845885Z  'num_warps': 2,
2026-02-21T11:33:56.3846093Z  'pid_type': 'flat',
2026-02-21T11:33:56.3846334Z  'range_flattens': [None, None],
2026-02-21T11:33:56.3846616Z  'range_multi_buffers': [None, False],
2026-02-21T11:33:56.3846907Z  'range_num_stages': [0, 1],
2026-02-21T11:33:56.3847145Z  'range_unroll_factors': [0, 0],
2026-02-21T11:33:56.3847360Z  'range_warp_specializes': []}
2026-02-21T11:33:56.3879079Z [281s] Fitting surrogate: 714 points, 714 targets
2026-02-21T11:33:57.1456027Z [282s] Generation 9 starting: 43 neighbors, 4 active search path(s)
2026-02-21T11:34:04.8022588Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 18.1 configs/s
2026-02-21T11:34:07.6503803Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 16.4 configs/s
2026-02-21T11:34:11.6147401Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 255.1         
2026-02-21T11:34:11.6147894Z                                                                   configs/s     
2026-02-21T11:34:11.9661836Z [297s] Generation 9 complete: 
2026-02-21T11:34:11.9662084Z ok=48
2026-02-21T11:34:11.9662277Z min=0.0231
2026-02-21T11:34:11.9662448Z mid=0.0260
2026-02-21T11:34:11.9662618Z max=0.0977
2026-02-21T11:34:11.9662824Z best={'block_sizes': [1, 4096],
2026-02-21T11:34:11.9663153Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:34:11.9663497Z  'load_eviction_policies': ['', ''],
2026-02-21T11:34:11.9663757Z  'num_stages': 1,
2026-02-21T11:34:11.9663951Z  'num_warps': 2,
2026-02-21T11:34:11.9664405Z  'pid_type': 'flat',
2026-02-21T11:34:11.9664623Z  'range_flattens': [None, None],
2026-02-21T11:34:11.9664874Z  'range_multi_buffers': [None, False],
2026-02-21T11:34:11.9665156Z  'range_num_stages': [0, 1],
2026-02-21T11:34:11.9665429Z  'range_unroll_factors': [0, 0],
2026-02-21T11:34:11.9665676Z  'range_warp_specializes': []}
2026-02-21T11:34:11.9702913Z [297s] Fitting surrogate: 762 points, 762 targets
2026-02-21T11:34:12.5354347Z [297s] Generation 10 starting: 31 neighbors, 3 active search path(s)
2026-02-21T11:34:20.4423282Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 1.3 configs/s
2026-02-21T11:34:22.5406550Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 16.5 configs/s
2026-02-21T11:34:26.0217603Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 290.2         
2026-02-21T11:34:26.0218648Z                                                                   configs/s     
2026-02-21T11:34:26.3359522Z [311s] Generation 10 complete: 
2026-02-21T11:34:26.3359844Z ok=35
2026-02-21T11:34:26.3360023Z min=0.0227
2026-02-21T11:34:26.3360213Z mid=0.0231
2026-02-21T11:34:26.3360382Z max=0.1854
2026-02-21T11:34:26.3360573Z best={'block_sizes': [1, 4096],
2026-02-21T11:34:26.3360930Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:34:26.3361318Z  'load_eviction_policies': ['', ''],
2026-02-21T11:34:26.3361570Z  'num_stages': 8,
2026-02-21T11:34:26.3361771Z  'num_warps': 2,
2026-02-21T11:34:26.3361967Z  'pid_type': 'flat',
2026-02-21T11:34:26.3362198Z  'range_flattens': [None, None],
2026-02-21T11:34:26.3362981Z  'range_multi_buffers': [None, True],
2026-02-21T11:34:26.3363280Z  'range_num_stages': [0, 3],
2026-02-21T11:34:26.3363529Z  'range_unroll_factors': [0, 2],
2026-02-21T11:34:26.3363803Z  'range_warp_specializes': []}
2026-02-21T11:34:26.3399210Z [311s] Fitting surrogate: 797 points, 797 targets
2026-02-21T11:34:26.9541344Z [312s] Generation 11 starting: 32 neighbors, 3 active search path(s)
2026-02-21T11:34:34.7606994Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 2.2 configs/s
2026-02-21T11:34:36.7871773Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 33/33 16.6 configs/s
2026-02-21T11:34:41.0831373Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 278.1         
2026-02-21T11:34:41.0831921Z                                                                   configs/s     
2026-02-21T11:34:41.4076846Z [326s] Generation 11 complete: 
2026-02-21T11:34:41.4077154Z ok=35
2026-02-21T11:34:41.4077341Z min=0.0232
2026-02-21T11:34:41.4077527Z mid=0.0235
2026-02-21T11:34:41.4077738Z max=0.1818
2026-02-21T11:34:41.4077922Z best={'block_sizes': [1, 4096],
2026-02-21T11:34:41.4078259Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:34:41.4078641Z  'load_eviction_policies': ['', ''],
2026-02-21T11:34:41.4078900Z  'num_stages': 1,
2026-02-21T11:34:41.4079095Z  'num_warps': 2,
2026-02-21T11:34:41.4079297Z  'pid_type': 'flat',
2026-02-21T11:34:41.4079521Z  'range_flattens': [None, False],
2026-02-21T11:34:41.4079788Z  'range_multi_buffers': [None, None],
2026-02-21T11:34:41.4080066Z  'range_num_stages': [0, 1],
2026-02-21T11:34:41.4080311Z  'range_unroll_factors': [0, 1],
2026-02-21T11:34:41.4080571Z  'range_warp_specializes': []}
2026-02-21T11:34:41.4112889Z [326s] Fitting surrogate: 832 points, 832 targets
2026-02-21T11:34:42.0235433Z [327s] Generation 12 starting: 34 neighbors, 3 active search path(s)
2026-02-21T11:34:48.2627433Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 4.5 configs/s
2026-02-21T11:34:50.4148700Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.6 configs/s
2026-02-21T11:34:54.0273792Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 279.8         
2026-02-21T11:34:54.0274934Z                                                                   configs/s     
2026-02-21T11:34:54.3492652Z [339s] Generation 12 complete: 
2026-02-21T11:34:54.3493107Z ok=37
2026-02-21T11:34:54.3493395Z min=0.0227
2026-02-21T11:34:54.3493671Z mid=0.0232
2026-02-21T11:34:54.3493950Z max=0.1070
2026-02-21T11:34:54.3494586Z best={'block_sizes': [1, 4096],
2026-02-21T11:34:54.3495115Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:34:54.3495684Z  'load_eviction_policies': ['', ''],
2026-02-21T11:34:54.3496094Z  'num_stages': 7,
2026-02-21T11:34:54.3496433Z  'num_warps': 2,
2026-02-21T11:34:54.3496792Z  'pid_type': 'flat',
2026-02-21T11:34:54.3497276Z  'range_flattens': [None, None],
2026-02-21T11:34:54.3497868Z  'range_multi_buffers': [None, None],
2026-02-21T11:34:54.3498797Z  'range_num_stages': [0, 3],
2026-02-21T11:34:54.3499061Z  'range_unroll_factors': [0, 2],
2026-02-21T11:34:54.3499318Z  'range_warp_specializes': []}
2026-02-21T11:34:54.3536978Z [339s] Fitting surrogate: 869 points, 869 targets
2026-02-21T11:34:54.9965631Z [340s] Generation 13 starting: 36 neighbors, 3 active search path(s)
2026-02-21T11:35:01.2539770Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 17.3 configs/s
2026-02-21T11:35:03.5044229Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.8 configs/s
2026-02-21T11:35:07.5937285Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 247.3         
2026-02-21T11:35:07.5938127Z                                                                   configs/s     
2026-02-21T11:35:07.9592584Z [353s] Generation 13 complete: 
2026-02-21T11:35:07.9592893Z ok=39
2026-02-21T11:35:07.9593083Z min=0.0227
2026-02-21T11:35:07.9593262Z mid=0.0232
2026-02-21T11:35:07.9593437Z max=0.0794
2026-02-21T11:35:07.9593662Z best={'block_sizes': [1, 4096],
2026-02-21T11:35:07.9594558Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:35:07.9594943Z  'load_eviction_policies': ['', ''],
2026-02-21T11:35:07.9595228Z  'num_stages': 1,
2026-02-21T11:35:07.9595435Z  'num_warps': 2,
2026-02-21T11:35:07.9595634Z  'pid_type': 'flat',
2026-02-21T11:35:07.9595861Z  'range_flattens': [None, False],
2026-02-21T11:35:07.9596122Z  'range_multi_buffers': [None, None],
2026-02-21T11:35:07.9596401Z  'range_num_stages': [0, 1],
2026-02-21T11:35:07.9596658Z  'range_unroll_factors': [0, 1],
2026-02-21T11:35:07.9596932Z  'range_warp_specializes': []}
2026-02-21T11:35:07.9645343Z [353s] Fitting surrogate: 908 points, 908 targets
2026-02-21T11:35:08.5475354Z [353s] Generation 14 starting: 28 neighbors, 3 active search path(s)
2026-02-21T11:35:16.5362372Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29/29 1.0 configs/s
2026-02-21T11:35:18.3097134Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 29/29 16.8 configs/s
2026-02-21T11:35:21.1222275Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 358.9         
2026-02-21T11:35:21.1222766Z                                                                   configs/s     
2026-02-21T11:35:21.3803797Z [366s] Generation 14 complete: 
2026-02-21T11:35:21.3805477Z ok=31
2026-02-21T11:35:21.3805671Z min=0.0230
2026-02-21T11:35:21.3805857Z mid=0.0233
2026-02-21T11:35:21.3806050Z max=0.0741
2026-02-21T11:35:21.3806223Z best={'block_sizes': [1, 4096],
2026-02-21T11:35:21.3806503Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:35:21.3806807Z  'load_eviction_policies': ['', ''],
2026-02-21T11:35:21.3807024Z  'num_stages': 7,
2026-02-21T11:35:21.3807196Z  'num_warps': 2,
2026-02-21T11:35:21.3807364Z  'pid_type': 'flat',
2026-02-21T11:35:21.3807552Z  'range_flattens': [None, None],
2026-02-21T11:35:21.3807776Z  'range_multi_buffers': [None, None],
2026-02-21T11:35:21.3808013Z  'range_num_stages': [0, 3],
2026-02-21T11:35:21.3808245Z  'range_unroll_factors': [0, 2],
2026-02-21T11:35:21.3808471Z  'range_warp_specializes': []}
2026-02-21T11:35:21.3848988Z [366s] Fitting surrogate: 939 points, 939 targets
2026-02-21T11:35:21.8067607Z [367s] Generation 15 starting: 19 neighbors, 2 active search path(s)
2026-02-21T11:35:29.2751388Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 1.2 configs/s
2026-02-21T11:35:30.5124320Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.7 configs/s
2026-02-21T11:35:33.4748145Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 443.6         
2026-02-21T11:35:33.4748666Z                                                                   configs/s     
2026-02-21T11:35:33.6863011Z [378s] Generation 15 complete: 
2026-02-21T11:35:33.6863285Z ok=22
2026-02-21T11:35:33.6863459Z min=0.0229
2026-02-21T11:35:33.6863631Z mid=0.0253
2026-02-21T11:35:33.6863808Z max=0.1810
2026-02-21T11:35:33.6864531Z best={'block_sizes': [1, 4096],
2026-02-21T11:35:33.6865650Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:35:33.6866062Z  'load_eviction_policies': ['', ''],
2026-02-21T11:35:33.6866341Z  'num_stages': 1,
2026-02-21T11:35:33.6866570Z  'num_warps': 2,
2026-02-21T11:35:33.6866766Z  'pid_type': 'flat',
2026-02-21T11:35:33.6866991Z  'range_flattens': [None, False],
2026-02-21T11:35:33.6867257Z  'range_multi_buffers': [None, None],
2026-02-21T11:35:33.6867529Z  'range_num_stages': [0, 1],
2026-02-21T11:35:33.6867766Z  'range_unroll_factors': [0, 1],
2026-02-21T11:35:33.6868018Z  'range_warp_specializes': []}
2026-02-21T11:35:33.6901050Z [378s] Fitting surrogate: 961 points, 961 targets
2026-02-21T11:35:33.9968930Z [379s] Generation 16 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:35:37.1154195Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 4.2 configs/s
2026-02-21T11:35:37.8060956Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.0 configs/s
2026-02-21T11:35:39.0594509Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 795.0         
2026-02-21T11:35:39.0595046Z                                                                   configs/s     
2026-02-21T11:35:39.1878596Z [384s] Generation 16 complete: 
2026-02-21T11:35:39.1878878Z ok=12
2026-02-21T11:35:39.1879059Z min=0.0230
2026-02-21T11:35:39.1879246Z mid=0.0287
2026-02-21T11:35:39.1879418Z max=0.0481
2026-02-21T11:35:39.1879611Z best={'block_sizes': [1, 4096],
2026-02-21T11:35:39.1879937Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:35:39.1880295Z  'load_eviction_policies': ['', ''],
2026-02-21T11:35:39.1880553Z  'num_stages': 2,
2026-02-21T11:35:39.1880750Z  'num_warps': 2,
2026-02-21T11:35:39.1880953Z  'pid_type': 'flat',
2026-02-21T11:35:39.1881175Z  'range_flattens': [None, True],
2026-02-21T11:35:39.1881439Z  'range_multi_buffers': [None, False],
2026-02-21T11:35:39.1881707Z  'range_num_stages': [0, 2],
2026-02-21T11:35:39.1881952Z  'range_unroll_factors': [0, 0],
2026-02-21T11:35:39.1882223Z  'range_warp_specializes': []}
2026-02-21T11:35:39.1922814Z [384s] Fitting surrogate: 973 points, 973 targets
2026-02-21T11:35:39.5249971Z [384s] Generation 17 starting: 12 neighbors, 1 active search path(s)
2026-02-21T11:35:41.9197316Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 12.7 configs/s
2026-02-21T11:35:42.6667558Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.1 configs/s
2026-02-21T11:35:44.1157191Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 690.1         
2026-02-21T11:35:44.1158236Z                                                                   configs/s     
2026-02-21T11:35:44.2613134Z [389s] Generation 17 complete: 
2026-02-21T11:35:44.2613472Z ok=13
2026-02-21T11:35:44.2613654Z min=0.0232
2026-02-21T11:35:44.2613840Z mid=0.0234
2026-02-21T11:35:44.2614479Z max=0.0327
2026-02-21T11:35:44.2614698Z best={'block_sizes': [1, 4096],
2026-02-21T11:35:44.2615075Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:35:44.2615519Z  'load_eviction_policies': ['', ''],
2026-02-21T11:35:44.2615795Z  'num_stages': 2,
2026-02-21T11:35:44.2615992Z  'num_warps': 2,
2026-02-21T11:35:44.2616193Z  'pid_type': 'flat',
2026-02-21T11:35:44.2617068Z  'range_flattens': [None, True],
2026-02-21T11:35:44.2617342Z  'range_multi_buffers': [None, False],
2026-02-21T11:35:44.2617612Z  'range_num_stages': [0, 2],
2026-02-21T11:35:44.2617853Z  'range_unroll_factors': [0, 0],
2026-02-21T11:35:44.2618096Z  'range_warp_specializes': []}
2026-02-21T11:35:44.2657794Z [389s] Fitting surrogate: 986 points, 986 targets
2026-02-21T11:35:44.5497134Z [389s] Generation 18 starting: 11 neighbors, 1 active search path(s)
2026-02-21T11:35:47.1881939Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 4.2 configs/s
2026-02-21T11:35:47.8606429Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.6 configs/s
2026-02-21T11:35:49.2252305Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 731.5         
2026-02-21T11:35:49.2253317Z                                                                   configs/s     
2026-02-21T11:35:49.3617508Z [394s] Generation 18 complete: 
2026-02-21T11:35:49.3617792Z ok=12
2026-02-21T11:35:49.3617956Z min=0.0262
2026-02-21T11:35:49.3618128Z mid=0.0265
2026-02-21T11:35:49.3618289Z max=0.0322
2026-02-21T11:35:49.3618477Z best={'block_sizes': [1, 4096],
2026-02-21T11:35:49.3618816Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:35:49.3619191Z  'load_eviction_policies': ['', ''],
2026-02-21T11:35:49.3619437Z  'num_stages': 2,
2026-02-21T11:35:49.3619629Z  'num_warps': 2,
2026-02-21T11:35:49.3619826Z  'pid_type': 'flat',
2026-02-21T11:35:49.3620042Z  'range_flattens': [None, True],
2026-02-21T11:35:49.3620300Z  'range_multi_buffers': [None, None],
2026-02-21T11:35:49.3620568Z  'range_num_stages': [0, 2],
2026-02-21T11:35:49.3620809Z  'range_unroll_factors': [0, 1],
2026-02-21T11:35:49.3621054Z  'range_warp_specializes': []}
2026-02-21T11:35:49.3670691Z [394s] Fitting surrogate: 998 points, 998 targets
2026-02-21T11:35:49.6919642Z [394s] Generation 19 starting: 11 neighbors, 1 active search path(s)
2026-02-21T11:35:53.4876310Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.4 configs/s
2026-02-21T11:35:54.2348215Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.1 configs/s
2026-02-21T11:35:55.4704588Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 806.7         
2026-02-21T11:35:55.4705082Z                                                                   configs/s     
2026-02-21T11:35:55.5975146Z [400s] Generation 19 complete: 
2026-02-21T11:35:55.5975449Z ok=13
2026-02-21T11:35:55.5975627Z min=0.0232
2026-02-21T11:35:55.5975807Z mid=0.0256
2026-02-21T11:35:55.5975980Z max=0.0456
2026-02-21T11:35:55.5976162Z best={'block_sizes': [1, 4096],
2026-02-21T11:35:55.5976528Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:35:55.5976907Z  'load_eviction_policies': ['', ''],
2026-02-21T11:35:55.5977199Z  'num_stages': 2,
2026-02-21T11:35:55.5977407Z  'num_warps': 2,
2026-02-21T11:35:55.5977616Z  'pid_type': 'flat',
2026-02-21T11:35:55.5977831Z  'range_flattens': [None, True],
2026-02-21T11:35:55.5978640Z  'range_multi_buffers': [None, None],
2026-02-21T11:35:55.5978920Z  'range_num_stages': [0, 2],
2026-02-21T11:35:55.5979166Z  'range_unroll_factors': [0, 1],
2026-02-21T11:35:55.5979416Z  'range_warp_specializes': []}
2026-02-21T11:35:55.6020434Z [400s] Fitting surrogate: 1011 points, 1011 targets
2026-02-21T11:35:55.9129279Z [401s] Generation 20 starting: 11 neighbors, 1 active search path(s)
2026-02-21T11:35:58.3667521Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 14.3 configs/s
2026-02-21T11:35:59.1237297Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 16.8 configs/s
2026-02-21T11:36:00.3584789Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 807.0         
2026-02-21T11:36:00.3585715Z                                                                   configs/s     
2026-02-21T11:36:00.4855212Z [405s] Generation 20 complete: 
2026-02-21T11:36:00.4855475Z ok=13
2026-02-21T11:36:00.4855644Z min=0.0231
2026-02-21T11:36:00.4855855Z mid=0.0259
2026-02-21T11:36:00.4856034Z max=0.0368
2026-02-21T11:36:00.4856218Z best={'block_sizes': [1, 4096],
2026-02-21T11:36:00.4856583Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:36:00.4856964Z  'load_eviction_policies': ['', ''],
2026-02-21T11:36:00.4857234Z  'num_stages': 2,
2026-02-21T11:36:00.4857448Z  'num_warps': 2,
2026-02-21T11:36:00.4857667Z  'pid_type': 'flat',
2026-02-21T11:36:00.4857889Z  'range_flattens': [None, True],
2026-02-21T11:36:00.4858156Z  'range_multi_buffers': [None, None],
2026-02-21T11:36:00.4858425Z  'range_num_stages': [0, 2],
2026-02-21T11:36:00.4858672Z  'range_unroll_factors': [0, 1],
2026-02-21T11:36:00.4858928Z  'range_warp_specializes': []}
2026-02-21T11:36:00.4901646Z [405s] Fitting surrogate: 1024 points, 1024 targets
2026-02-21T11:36:00.6580843Z [405s] Autotuning complete in 405.9s after searching 976 configs.
2026-02-21T11:36:00.6581342Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:36:00.6582871Z     @helion.kernel(config=helion.Config(block_sizes=[1, 4096], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=2, num_warps=2, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 2], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:36:00.6586008Z 
2026-02-21T11:36:00.6586421Z [405s] Code of selected kernel: /tmp/torchinductor_root/eh/cehpe6ezrkic7knivzcainozutjjrif7f42fkavilvlh37t3wzgd.py
2026-02-21T11:36:00.6905565Z from __future__ import annotations
2026-02-21T11:36:00.6905771Z 
2026-02-21T11:36:00.6905846Z import torch
2026-02-21T11:36:00.6906041Z import triton
2026-02-21T11:36:00.6906252Z import triton.language as tl
2026-02-21T11:36:00.6906553Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:36:00.6906943Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:36:00.6907379Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:36:00.6907678Z 
2026-02-21T11:36:00.6907766Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:36:00.6908010Z _BLOCK_SIZE_1 = tl.constexpr(4096)
2026-02-21T11:36:00.6908183Z 
2026-02-21T11:36:00.6908253Z @triton.jit
2026-02-21T11:36:00.6908445Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:36:00.6908826Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:36:00.6909203Z     pid_0 = tl.program_id(0)
2026-02-21T11:36:00.6909425Z     offset_0 = pid_0
2026-02-21T11:36:00.6909660Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:36:00.6910069Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:36:00.6910503Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:36:00.6910905Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:36:00.6911275Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:36:00.6912139Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:36:00.6912546Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:36:00.6912919Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:36:00.6913265Z     # src[softmax.py:82-89]: ...
2026-02-21T11:36:00.6913698Z     for offset_2 in tl.range(0, 3584, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=2, flatten=True):
2026-02-21T11:36:00.6914396Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:36:00.6914749Z         mask_1 = indices_2 < 3584
2026-02-21T11:36:00.6914983Z         mi_copy = mi
2026-02-21T11:36:00.6915169Z         di_copy = di
2026-02-21T11:36:00.6915363Z         mi_copy_0 = mi_copy
2026-02-21T11:36:00.6915812Z         di_copy_0 = di_copy
2026-02-21T11:36:00.6916081Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:36:00.6916564Z         values = tl.load(x + (indices_0[:, None] * 3584 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:36:00.6917095Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:36:00.6917742Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:36:00.6918370Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:36:00.6918759Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:36:00.6927687Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:36:00.6928053Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:36:00.6928406Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:36:00.6928719Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:36:00.6928943Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:36:00.6929141Z         v_4 = di_copy_0 * v_3
2026-02-21T11:36:00.6929371Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:36:00.6929624Z         subscript = v_1[:, None]
2026-02-21T11:36:00.6929838Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:36:00.6930212Z         v_6 = v_5 - subscript
2026-02-21T11:36:00.6930482Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:36:00.6930832Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:36:00.6931107Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:36:00.6931336Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:36:00.6931749Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:36:00.6932229Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:36:00.6932480Z         di = v_4 + sum_1
2026-02-21T11:36:00.6932665Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:36:00.6932877Z         mi = v_1
2026-02-21T11:36:00.6933116Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:36:00.6933462Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:36:00.6933834Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:36:00.6934494Z     for offset_2 in tl.range(0, 3584, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=2, flatten=True):
2026-02-21T11:36:00.6934944Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:36:00.6935239Z         mask_2 = indices_2 < 3584
2026-02-21T11:36:00.6935436Z         mi_copy_1 = mi
2026-02-21T11:36:00.6935633Z         di_copy_1 = di
2026-02-21T11:36:00.6935812Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:36:00.6936014Z         di_copy_1_0 = di_copy_1
2026-02-21T11:36:00.6936239Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:36:00.6936648Z         values_1 = tl.load(x + (indices_0[:, None] * 3584 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T11:36:00.6937445Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:36:00.6937805Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:36:00.6938043Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:36:00.6938268Z         v_10 = v_9 - subscript_1
2026-02-21T11:36:00.6938477Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:36:00.6938687Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:36:00.6938913Z         v_12 = v_11 / subscript_2
2026-02-21T11:36:00.6939117Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:36:00.6939456Z         tl.store(out + (indices_0[:, None] * 3584 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:36:00.6939735Z 
2026-02-21T11:36:00.6939907Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:36:00.6940388Z     """
2026-02-21T11:36:00.6940661Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:36:00.6941049Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:36:00.6941333Z     Args:
2026-02-21T11:36:00.6941522Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:36:00.6941764Z     Returns:
2026-02-21T11:36:00.6941980Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:36:00.6942234Z     """
2026-02-21T11:36:00.6942394Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:36:00.6942605Z     m, n = x.size()
2026-02-21T11:36:00.6942802Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:36:00.6943053Z     out = torch.empty_like(x)
2026-02-21T11:36:00.6943345Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:36:00.6943754Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:36:00.6944301Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:36:00.6944611Z     # src[softmax.py:79-92]: ...
2026-02-21T11:36:00.6944918Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=2, num_stages=2)
2026-02-21T11:36:00.6945261Z     # src[softmax.py:93]: return out
2026-02-21T11:36:00.6945476Z     return out
2026-02-21T11:36:01.2991847Z WARNING:tritonbench.utils.triton_op:Completed input ID 26:
2026-02-21T11:36:01.2992231Z (M, N)
2026-02-21T11:36:01.2992407Z ------------
2026-02-21T11:36:01.2992604Z (4096, 3584)
2026-02-21T11:36:01.2992737Z 
2026-02-21T11:36:01.3014526Z  30%|███       | 6/20 [32:56<1:20:24, 344.64s/it]WARNING:tritonbench.utils.triton_op:Running input ID 31:
2026-02-21T11:36:01.3014982Z (M, N)
2026-02-21T11:36:01.3015152Z ------------
2026-02-21T11:36:01.3015323Z (4096, 4224)
2026-02-21T11:36:01.3017711Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T11:36:02.8400981Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:36:04.5728178Z INFO:tritonbench.utils.triton_op:Took 3.28ms to get benchmark function for torch_compile_softmax
2026-02-21T11:36:05.9480378Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:36:05.9480742Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:36:05.9481026Z               'dtype': 'torch.float16',
2026-02-21T11:36:05.9481314Z               'shape': (4096, 4224),
2026-02-21T11:36:05.9481573Z               'stride': (4224, 1)},),
2026-02-21T11:36:05.9481822Z   'kwargs': {}}
2026-02-21T11:36:05.9525578Z INFO:tritonbench.utils.triton_op:Took 4.76ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:36:06.2479072Z [0s] Autotune random seed: 2145258556
2026-02-21T11:36:06.2836360Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:36:40.4490945Z [34s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:36:40.6553061Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:36:43.8042796Z [37s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T11:36:45.3358171Z [39s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:36:45.9973777Z [39s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:36:46.1752171Z [39s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T11:36:51.3186946Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T11:36:58.2437037Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.5 configs/s
2026-02-21T11:36:58.2451179Z [51s] Adaptive compile timeout: 30s (90% percentile=18.1s, bounds=[30.0s, 30s])
2026-02-21T11:37:00.0796601Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 543.1 configs/s
2026-02-21T11:37:00.2331484Z [53s] Initial random population of 100, 5 starting points: 
2026-02-21T11:37:00.2331847Z error=4
2026-02-21T11:37:00.2332076Z timeout=6
2026-02-21T11:37:00.2332257Z ok=90
2026-02-21T11:37:00.2332436Z min=0.0432
2026-02-21T11:37:00.2332606Z mid=0.3447
2026-02-21T11:37:00.2332779Z max=54.9668
2026-02-21T11:37:00.2333007Z best={'block_sizes': [2, 512],
2026-02-21T11:37:00.2333364Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:37:00.2333775Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:37:00.2334279Z  'maxnreg': 256,
2026-02-21T11:37:00.2334512Z  'num_sm_multiplier': 32,
2026-02-21T11:37:00.2334778Z  'num_stages': 1,
2026-02-21T11:37:00.2335008Z  'num_warps': 2,
2026-02-21T11:37:00.2335254Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:37:00.2335527Z  'range_flattens': [True, None],
2026-02-21T11:37:00.2335775Z  'range_multi_buffers': [True, False],
2026-02-21T11:37:00.2336040Z  'range_num_stages': [3, 0],
2026-02-21T11:37:00.2336277Z  'range_unroll_factors': [1, 0],
2026-02-21T11:37:00.2336519Z  'range_warp_specializes': []}
2026-02-21T11:37:00.2350264Z [53s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:37:01.6677349Z [55s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T11:37:21.9661233Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 3.0 configs/s
2026-02-21T11:37:27.7592953Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.0 configs/s
2026-02-21T11:37:36.7055078Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 113.0         
2026-02-21T11:37:36.7055894Z                                                                   configs/s     
2026-02-21T11:37:37.3511696Z [91s] Generation 1 complete: 
2026-02-21T11:37:37.3511953Z ok=94
2026-02-21T11:37:37.3512129Z min=0.0388
2026-02-21T11:37:37.3512308Z mid=0.0537
2026-02-21T11:37:37.3512478Z max=0.2453
2026-02-21T11:37:37.3512663Z best={'block_sizes': [1, 512],
2026-02-21T11:37:37.3512972Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:37:37.3513317Z  'load_eviction_policies': ['', 'last'],
2026-02-21T11:37:37.3514409Z  'maxnreg': 128,
2026-02-21T11:37:37.3514639Z  'num_sm_multiplier': 16,
2026-02-21T11:37:37.3514868Z  'num_stages': 5,
2026-02-21T11:37:37.3515053Z  'num_warps': 1,
2026-02-21T11:37:37.3515289Z  'pid_type': 'persistent_blocked',
2026-02-21T11:37:37.3515550Z  'range_flattens': [False, False],
2026-02-21T11:37:37.3515809Z  'range_multi_buffers': [None, None],
2026-02-21T11:37:37.3516066Z  'range_num_stages': [2, 2],
2026-02-21T11:37:37.3516304Z  'range_unroll_factors': [2, 3],
2026-02-21T11:37:37.3516547Z  'range_warp_specializes': []}
2026-02-21T11:37:37.3537575Z [91s] Fitting surrogate: 194 points, 194 targets
2026-02-21T11:37:38.9275645Z [92s] Generation 2 starting: 86 neighbors, 5 active search path(s)
2026-02-21T11:37:57.3196968Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 2.4 configs/s
2026-02-21T11:38:02.9242228Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 16.2 configs/s
2026-02-21T11:38:13.1497168Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.0         
2026-02-21T11:38:13.1497654Z                                                                   configs/s     
2026-02-21T11:38:13.8773477Z [127s] Generation 2 complete: 
2026-02-21T11:38:13.8773776Z ok=92
2026-02-21T11:38:13.8773948Z min=0.0359
2026-02-21T11:38:13.8774465Z mid=0.0436
2026-02-21T11:38:13.8774640Z max=0.2414
2026-02-21T11:38:13.8774839Z best={'block_sizes': [1, 512],
2026-02-21T11:38:13.8775175Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:38:13.8775555Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T11:38:13.8775859Z  'num_stages': 8,
2026-02-21T11:38:13.8776092Z  'num_warps': 1,
2026-02-21T11:38:13.8776337Z  'pid_type': 'flat',
2026-02-21T11:38:13.8776614Z  'range_flattens': [None, False],
2026-02-21T11:38:13.8776893Z  'range_multi_buffers': [None, None],
2026-02-21T11:38:13.8777159Z  'range_num_stages': [0, 1],
2026-02-21T11:38:13.8777401Z  'range_unroll_factors': [0, 3],
2026-02-21T11:38:13.8777654Z  'range_warp_specializes': []}
2026-02-21T11:38:13.8797676Z [127s] Fitting surrogate: 286 points, 286 targets
2026-02-21T11:38:15.2775379Z [128s] Generation 3 starting: 86 neighbors, 5 active search path(s)
2026-02-21T11:38:52.9006001Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 0.4 configs/s
2026-02-21T11:38:58.5635831Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 16.0 configs/s
2026-02-21T11:39:07.7132082Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 110.7         
2026-02-21T11:39:07.7137373Z                                                                   configs/s     
2026-02-21T11:39:08.4247928Z [182s] Generation 3 complete: 
2026-02-21T11:39:08.4248340Z ok=92
2026-02-21T11:39:08.4248625Z min=0.0314
2026-02-21T11:39:08.4248911Z mid=0.0387
2026-02-21T11:39:08.4249197Z max=0.5114
2026-02-21T11:39:08.4249499Z best={'block_sizes': [1, 4096],
2026-02-21T11:39:08.4250245Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:39:08.4250968Z  'load_eviction_policies': ['', 'first'],
2026-02-21T11:39:08.4251400Z  'num_stages': 5,
2026-02-21T11:39:08.4251716Z  'num_warps': 2,
2026-02-21T11:39:08.4252028Z  'pid_type': 'flat',
2026-02-21T11:39:08.4253109Z  'range_flattens': [None, False],
2026-02-21T11:39:08.4253526Z  'range_multi_buffers': [None, None],
2026-02-21T11:39:08.4253964Z  'range_num_stages': [0, 0],
2026-02-21T11:39:08.4254687Z  'range_unroll_factors': [0, 2],
2026-02-21T11:39:08.4255075Z  'range_warp_specializes': []}
2026-02-21T11:39:08.4278626Z [182s] Fitting surrogate: 378 points, 378 targets
2026-02-21T11:39:09.7022230Z [183s] Generation 4 starting: 72 neighbors, 5 active search path(s)
2026-02-21T11:39:27.9009734Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74/74 0.9 configs/s
2026-02-21T11:39:33.1398898Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 74/74 14.2 configs/s
2026-02-21T11:39:41.7138351Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.1         
2026-02-21T11:39:41.7139530Z                                                                   configs/s     
2026-02-21T11:39:42.3849539Z [216s] Generation 4 complete: 
2026-02-21T11:39:42.3850095Z ok=78
2026-02-21T11:39:42.3850418Z min=0.0302
2026-02-21T11:39:42.3850707Z mid=0.0375
2026-02-21T11:39:42.3850979Z max=0.1003
2026-02-21T11:39:42.3851277Z best={'block_sizes': [1, 8192],
2026-02-21T11:39:42.3851830Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:39:42.3852444Z  'load_eviction_policies': ['', 'first'],
2026-02-21T11:39:42.3852865Z  'num_stages': 5,
2026-02-21T11:39:42.3853183Z  'num_warps': 2,
2026-02-21T11:39:42.3853501Z  'pid_type': 'flat',
2026-02-21T11:39:42.3853890Z  'range_flattens': [None, False],
2026-02-21T11:39:42.3854870Z  'range_multi_buffers': [None, None],
2026-02-21T11:39:42.3855322Z  'range_num_stages': [0, 0],
2026-02-21T11:39:42.3855712Z  'range_unroll_factors': [0, 2],
2026-02-21T11:39:42.3856108Z  'range_warp_specializes': []}
2026-02-21T11:39:42.3878818Z [216s] Fitting surrogate: 456 points, 456 targets
2026-02-21T11:39:43.4364264Z [217s] Generation 5 starting: 64 neighbors, 5 active search path(s)
2026-02-21T11:39:56.6116643Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 6.1 configs/s
2026-02-21T11:40:00.6112260Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 16.4 configs/s
2026-02-21T11:40:08.0571275Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 136.0         
2026-02-21T11:40:08.0571792Z                                                                   configs/s     
2026-02-21T11:40:08.6505441Z [242s] Generation 5 complete: 
2026-02-21T11:40:08.6505710Z ok=69
2026-02-21T11:40:08.6505878Z min=0.0270
2026-02-21T11:40:08.6506052Z mid=0.0361
2026-02-21T11:40:08.6506216Z max=0.0663
2026-02-21T11:40:08.6506408Z best={'block_sizes': [1, 8192],
2026-02-21T11:40:08.6506937Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:40:08.6507693Z  'load_eviction_policies': ['', ''],
2026-02-21T11:40:08.6508139Z  'num_stages': 5,
2026-02-21T11:40:08.6508456Z  'num_warps': 2,
2026-02-21T11:40:08.6508773Z  'pid_type': 'flat',
2026-02-21T11:40:08.6509120Z  'range_flattens': [None, False],
2026-02-21T11:40:08.6509616Z  'range_multi_buffers': [None, None],
2026-02-21T11:40:08.6510076Z  'range_num_stages': [0, 0],
2026-02-21T11:40:08.6510476Z  'range_unroll_factors': [0, 2],
2026-02-21T11:40:08.6510880Z  'range_warp_specializes': []}
2026-02-21T11:40:08.6543578Z [242s] Fitting surrogate: 525 points, 525 targets
2026-02-21T11:40:09.5607566Z [243s] Generation 6 starting: 55 neighbors, 4 active search path(s)
2026-02-21T11:40:24.7362657Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 1.4 configs/s
2026-02-21T11:40:28.2462134Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 16.4 configs/s
2026-02-21T11:40:32.7527890Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 224.1         
2026-02-21T11:40:32.7529145Z                                                                   configs/s     
2026-02-21T11:40:33.1277304Z [266s] Generation 6 complete: 
2026-02-21T11:40:33.1277759Z ok=59
2026-02-21T11:40:33.1278052Z min=0.0270
2026-02-21T11:40:33.1278895Z mid=0.0360
2026-02-21T11:40:33.1279166Z max=0.0720
2026-02-21T11:40:33.1279462Z best={'block_sizes': [1, 8192],
2026-02-21T11:40:33.1280021Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:40:33.1280631Z  'load_eviction_policies': ['', ''],
2026-02-21T11:40:33.1281038Z  'num_stages': 5,
2026-02-21T11:40:33.1281344Z  'num_warps': 2,
2026-02-21T11:40:33.1281663Z  'pid_type': 'flat',
2026-02-21T11:40:33.1282013Z  'range_flattens': [None, False],
2026-02-21T11:40:33.1282443Z  'range_multi_buffers': [None, None],
2026-02-21T11:40:33.1282880Z  'range_num_stages': [0, 0],
2026-02-21T11:40:33.1283257Z  'range_unroll_factors': [0, 2],
2026-02-21T11:40:33.1283663Z  'range_warp_specializes': []}
2026-02-21T11:40:33.1316166Z [266s] Fitting surrogate: 584 points, 584 targets
2026-02-21T11:40:34.0371331Z [267s] Generation 7 starting: 48 neighbors, 4 active search path(s)
2026-02-21T11:40:43.9103426Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 9.0 configs/s
2026-02-21T11:40:46.9168241Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.5 configs/s
2026-02-21T11:40:51.2402772Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 233.6         
2026-02-21T11:40:51.2403295Z                                                                   configs/s     
2026-02-21T11:40:51.6046122Z [285s] Generation 7 complete: 
2026-02-21T11:40:51.6046588Z ok=52
2026-02-21T11:40:51.6046881Z min=0.0265
2026-02-21T11:40:51.6047171Z mid=0.0341
2026-02-21T11:40:51.6047441Z max=0.1779
2026-02-21T11:40:51.6047743Z best={'block_sizes': [1, 8192],
2026-02-21T11:40:51.6048306Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:40:51.6048954Z  'load_eviction_policies': ['', ''],
2026-02-21T11:40:51.6049362Z  'num_stages': 5,
2026-02-21T11:40:51.6049711Z  'num_warps': 4,
2026-02-21T11:40:51.6050021Z  'pid_type': 'flat',
2026-02-21T11:40:51.6050509Z  'range_flattens': [None, None],
2026-02-21T11:40:51.6050925Z  'range_multi_buffers': [None, True],
2026-02-21T11:40:51.6051373Z  'range_num_stages': [0, 0],
2026-02-21T11:40:51.6051754Z  'range_unroll_factors': [0, 2],
2026-02-21T11:40:51.6052146Z  'range_warp_specializes': []}
2026-02-21T11:40:51.6082246Z [285s] Fitting surrogate: 636 points, 636 targets
2026-02-21T11:40:52.4933760Z [286s] Generation 8 starting: 47 neighbors, 4 active search path(s)
2026-02-21T11:41:02.6259383Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 4.0 configs/s
2026-02-21T11:41:05.5762883Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.5 configs/s
2026-02-21T11:41:09.9978059Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 228.7         
2026-02-21T11:41:09.9978599Z                                                                   configs/s     
2026-02-21T11:41:10.3800441Z [304s] Generation 8 complete: 
2026-02-21T11:41:10.3800727Z ok=51
2026-02-21T11:41:10.3800912Z min=0.0262
2026-02-21T11:41:10.3801084Z mid=0.0272
2026-02-21T11:41:10.3801255Z max=0.0757
2026-02-21T11:41:10.3802127Z best={'block_sizes': [1, 8192],
2026-02-21T11:41:10.3802489Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:41:10.3802872Z  'load_eviction_policies': ['', ''],
2026-02-21T11:41:10.3803120Z  'num_stages': 6,
2026-02-21T11:41:10.3803319Z  'num_warps': 4,
2026-02-21T11:41:10.3803513Z  'pid_type': 'flat',
2026-02-21T11:41:10.3803734Z  'range_flattens': [None, False],
2026-02-21T11:41:10.3804435Z  'range_multi_buffers': [None, False],
2026-02-21T11:41:10.3804736Z  'range_num_stages': [0, 1],
2026-02-21T11:41:10.3804971Z  'range_unroll_factors': [0, 2],
2026-02-21T11:41:10.3805223Z  'range_warp_specializes': []}
2026-02-21T11:41:10.3838418Z [304s] Fitting surrogate: 687 points, 687 targets
2026-02-21T11:41:11.8500845Z [305s] Generation 9 starting: 43 neighbors, 4 active search path(s)
2026-02-21T11:41:20.8085537Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 8.2 configs/s
2026-02-21T11:41:23.5032876Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.6 configs/s
2026-02-21T11:41:27.7960540Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 235.5         
2026-02-21T11:41:27.7961093Z                                                                   configs/s     
2026-02-21T11:41:28.1699071Z [321s] Generation 9 complete: 
2026-02-21T11:41:28.1699403Z ok=47
2026-02-21T11:41:28.1699600Z min=0.0266
2026-02-21T11:41:28.1699783Z mid=0.0269
2026-02-21T11:41:28.1699958Z max=0.0659
2026-02-21T11:41:28.1700145Z best={'block_sizes': [1, 8192],
2026-02-21T11:41:28.1700506Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:41:28.1700905Z  'load_eviction_policies': ['', ''],
2026-02-21T11:41:28.1701167Z  'num_stages': 6,
2026-02-21T11:41:28.1701364Z  'num_warps': 4,
2026-02-21T11:41:28.1701606Z  'pid_type': 'flat',
2026-02-21T11:41:28.1701878Z  'range_flattens': [None, True],
2026-02-21T11:41:28.1702189Z  'range_multi_buffers': [None, False],
2026-02-21T11:41:28.1702531Z  'range_num_stages': [0, 1],
2026-02-21T11:41:28.1702783Z  'range_unroll_factors': [0, 2],
2026-02-21T11:41:28.1703037Z  'range_warp_specializes': []}
2026-02-21T11:41:28.1737011Z [321s] Fitting surrogate: 734 points, 734 targets
2026-02-21T11:41:28.8528936Z [322s] Generation 10 starting: 41 neighbors, 3 active search path(s)
2026-02-21T11:41:37.9189383Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42/42 5.9 configs/s
2026-02-21T11:41:40.5160294Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 42/42 16.4 configs/s
2026-02-21T11:41:43.7448816Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 312.2         
2026-02-21T11:41:43.7449328Z                                                                   configs/s     
2026-02-21T11:41:44.0248421Z [337s] Generation 10 complete: 
2026-02-21T11:41:44.0248739Z ok=44
2026-02-21T11:41:44.0248938Z min=0.0302
2026-02-21T11:41:44.0249117Z mid=0.0322
2026-02-21T11:41:44.0249287Z max=0.0633
2026-02-21T11:41:44.0249477Z best={'block_sizes': [1, 8192],
2026-02-21T11:41:44.0249935Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:41:44.0250341Z  'load_eviction_policies': ['', ''],
2026-02-21T11:41:44.0250600Z  'num_stages': 6,
2026-02-21T11:41:44.0250802Z  'num_warps': 4,
2026-02-21T11:41:44.0250997Z  'pid_type': 'flat',
2026-02-21T11:41:44.0251223Z  'range_flattens': [None, None],
2026-02-21T11:41:44.0251481Z  'range_multi_buffers': [None, False],
2026-02-21T11:41:44.0251761Z  'range_num_stages': [0, 1],
2026-02-21T11:41:44.0252007Z  'range_unroll_factors': [0, 2],
2026-02-21T11:41:44.0252253Z  'range_warp_specializes': []}
2026-02-21T11:41:44.0288783Z [337s] Fitting surrogate: 778 points, 778 targets
2026-02-21T11:41:44.5583310Z [338s] Generation 11 starting: 28 neighbors, 3 active search path(s)
2026-02-21T11:41:51.4077058Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 2.9 configs/s
2026-02-21T11:41:53.2198410Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 17.0 configs/s
2026-02-21T11:41:55.7187349Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 402.3         
2026-02-21T11:41:55.7187847Z                                                                   configs/s     
2026-02-21T11:41:55.9404689Z [349s] Generation 11 complete: 
2026-02-21T11:41:55.9404957Z ok=31
2026-02-21T11:41:55.9405147Z min=0.0299
2026-02-21T11:41:55.9405324Z mid=0.0321
2026-02-21T11:41:55.9405507Z max=0.0496
2026-02-21T11:41:55.9405700Z best={'block_sizes': [1, 8192],
2026-02-21T11:41:55.9406055Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:41:55.9406435Z  'load_eviction_policies': ['', ''],
2026-02-21T11:41:55.9406687Z  'num_stages': 6,
2026-02-21T11:41:55.9406899Z  'num_warps': 4,
2026-02-21T11:41:55.9407106Z  'pid_type': 'flat',
2026-02-21T11:41:55.9407975Z  'range_flattens': [None, None],
2026-02-21T11:41:55.9408264Z  'range_multi_buffers': [None, False],
2026-02-21T11:41:55.9408539Z  'range_num_stages': [0, 2],
2026-02-21T11:41:55.9408774Z  'range_unroll_factors': [0, 2],
2026-02-21T11:41:55.9409042Z  'range_warp_specializes': []}
2026-02-21T11:41:55.9443936Z [349s] Fitting surrogate: 809 points, 809 targets
2026-02-21T11:41:56.5893357Z [350s] Generation 12 starting: 34 neighbors, 3 active search path(s)
2026-02-21T11:42:10.0526264Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 0.4 configs/s
2026-02-21T11:42:12.1991266Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.6 configs/s
2026-02-21T11:42:14.7767995Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 390.5         
2026-02-21T11:42:14.7768513Z                                                                   configs/s     
2026-02-21T11:42:15.0078452Z [368s] Generation 12 complete: 
2026-02-21T11:42:15.0078747Z ok=37
2026-02-21T11:42:15.0078919Z min=0.0267
2026-02-21T11:42:15.0079140Z mid=0.0358
2026-02-21T11:42:15.0079321Z max=0.0665
2026-02-21T11:42:15.0079516Z best={'block_sizes': [1, 8192],
2026-02-21T11:42:15.0079839Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:42:15.0080221Z  'load_eviction_policies': ['', ''],
2026-02-21T11:42:15.0080483Z  'num_stages': 5,
2026-02-21T11:42:15.0080689Z  'num_warps': 4,
2026-02-21T11:42:15.0080886Z  'pid_type': 'flat',
2026-02-21T11:42:15.0081114Z  'range_flattens': [None, False],
2026-02-21T11:42:15.0081382Z  'range_multi_buffers': [None, False],
2026-02-21T11:42:15.0081652Z  'range_num_stages': [0, 0],
2026-02-21T11:42:15.0081910Z  'range_unroll_factors': [0, 2],
2026-02-21T11:42:15.0082169Z  'range_warp_specializes': []}
2026-02-21T11:42:15.0122044Z [368s] Fitting surrogate: 846 points, 846 targets
2026-02-21T11:42:15.5131344Z [369s] Generation 13 starting: 24 neighbors, 2 active search path(s)
2026-02-21T11:42:21.6200637Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 2.1 configs/s
2026-02-21T11:42:23.1348842Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 17.0 configs/s
2026-02-21T11:42:25.1007342Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 510.8         
2026-02-21T11:42:25.1008169Z                                                                   configs/s     
2026-02-21T11:42:25.2842850Z [379s] Generation 13 complete: 
2026-02-21T11:42:25.2843153Z ok=27
2026-02-21T11:42:25.2843333Z min=0.0268
2026-02-21T11:42:25.2843524Z mid=0.0272
2026-02-21T11:42:25.2843697Z max=0.0664
2026-02-21T11:42:25.2843887Z best={'block_sizes': [1, 8192],
2026-02-21T11:42:25.2844713Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:42:25.2845149Z  'load_eviction_policies': ['', ''],
2026-02-21T11:42:25.2845416Z  'num_stages': 6,
2026-02-21T11:42:25.2845613Z  'num_warps': 4,
2026-02-21T11:42:25.2845819Z  'pid_type': 'flat',
2026-02-21T11:42:25.2846044Z  'range_flattens': [None, None],
2026-02-21T11:42:25.2846331Z  'range_multi_buffers': [None, None],
2026-02-21T11:42:25.2846596Z  'range_num_stages': [0, 3],
2026-02-21T11:42:25.2846855Z  'range_unroll_factors': [0, 2],
2026-02-21T11:42:25.2847808Z  'range_warp_specializes': []}
2026-02-21T11:42:25.2882295Z [379s] Fitting surrogate: 873 points, 873 targets
2026-02-21T11:42:25.8229919Z [379s] Generation 14 starting: 25 neighbors, 2 active search path(s)
2026-02-21T11:42:31.2479366Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 6.1 configs/s
2026-02-21T11:42:32.8351576Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 16.8 configs/s
2026-02-21T11:42:34.6847361Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 541.7         
2026-02-21T11:42:34.6847876Z                                                                   configs/s     
2026-02-21T11:42:34.8588717Z [388s] Generation 14 complete: 
2026-02-21T11:42:34.8589055Z ok=27
2026-02-21T11:42:34.8589267Z min=0.0263
2026-02-21T11:42:34.8589474Z mid=0.0303
2026-02-21T11:42:34.8590334Z max=0.0569
2026-02-21T11:42:34.8590557Z best={'block_sizes': [1, 8192],
2026-02-21T11:42:34.8590951Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:42:34.8591401Z  'load_eviction_policies': ['', ''],
2026-02-21T11:42:34.8591664Z  'num_stages': 6,
2026-02-21T11:42:34.8591861Z  'num_warps': 4,
2026-02-21T11:42:34.8592067Z  'pid_type': 'flat',
2026-02-21T11:42:34.8592313Z  'range_flattens': [None, None],
2026-02-21T11:42:34.8592598Z  'range_multi_buffers': [None, None],
2026-02-21T11:42:34.8592876Z  'range_num_stages': [0, 3],
2026-02-21T11:42:34.8593119Z  'range_unroll_factors': [0, 2],
2026-02-21T11:42:34.8593376Z  'range_warp_specializes': []}
2026-02-21T11:42:34.8632737Z [388s] Fitting surrogate: 900 points, 900 targets
2026-02-21T11:42:35.2873223Z [389s] Generation 15 starting: 20 neighbors, 2 active search path(s)
2026-02-21T11:42:40.3412304Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 3.4 configs/s
2026-02-21T11:42:41.6417779Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 16.7 configs/s
2026-02-21T11:42:42.6874822Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 947.8         
2026-02-21T11:42:42.6875761Z                                                                   configs/s     
2026-02-21T11:42:42.7976022Z [396s] Generation 15 complete: 
2026-02-21T11:42:42.7976260Z ok=22
2026-02-21T11:42:42.7976428Z min=0.0298
2026-02-21T11:42:42.7976593Z mid=0.0408
2026-02-21T11:42:42.7976760Z max=0.0659
2026-02-21T11:42:42.7976935Z best={'block_sizes': [1, 8192],
2026-02-21T11:42:42.7977272Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:42:42.7977640Z  'load_eviction_policies': ['', ''],
2026-02-21T11:42:42.7977894Z  'num_stages': 6,
2026-02-21T11:42:42.7978089Z  'num_warps': 4,
2026-02-21T11:42:42.7978291Z  'pid_type': 'flat',
2026-02-21T11:42:42.7978516Z  'range_flattens': [None, None],
2026-02-21T11:42:42.7978769Z  'range_multi_buffers': [None, None],
2026-02-21T11:42:42.7979047Z  'range_num_stages': [0, 2],
2026-02-21T11:42:42.7979281Z  'range_unroll_factors': [0, 2],
2026-02-21T11:42:42.7979532Z  'range_warp_specializes': []}
2026-02-21T11:42:42.8017885Z [396s] Fitting surrogate: 922 points, 922 targets
2026-02-21T11:42:43.2794923Z [396s] Generation 16 starting: 25 neighbors, 2 active search path(s)
2026-02-21T11:42:50.9788487Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27/27 1.2 configs/s
2026-02-21T11:42:52.6320736Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 27/27 16.8 configs/s
2026-02-21T11:42:54.1519999Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 657.1         
2026-02-21T11:42:54.1520503Z                                                                   configs/s     
2026-02-21T11:42:54.2983749Z [408s] Generation 16 complete: 
2026-02-21T11:42:54.2984426Z ok=28
2026-02-21T11:42:54.2984595Z min=0.0269
2026-02-21T11:42:54.2984773Z mid=0.0408
2026-02-21T11:42:54.2984942Z max=0.0705
2026-02-21T11:42:54.2985681Z best={'block_sizes': [1, 8192],
2026-02-21T11:42:54.2986032Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:42:54.2986415Z  'load_eviction_policies': ['', ''],
2026-02-21T11:42:54.2986686Z  'num_stages': 6,
2026-02-21T11:42:54.2986892Z  'num_warps': 4,
2026-02-21T11:42:54.2987086Z  'pid_type': 'flat',
2026-02-21T11:42:54.2987300Z  'range_flattens': [None, None],
2026-02-21T11:42:54.2987557Z  'range_multi_buffers': [None, True],
2026-02-21T11:42:54.2987821Z  'range_num_stages': [0, 2],
2026-02-21T11:42:54.2988060Z  'range_unroll_factors': [0, 2],
2026-02-21T11:42:54.2988305Z  'range_warp_specializes': []}
2026-02-21T11:42:54.3027139Z [408s] Fitting surrogate: 950 points, 950 targets
2026-02-21T11:42:54.8751142Z [408s] Generation 17 starting: 31 neighbors, 2 active search path(s)
2026-02-21T11:43:01.2308279Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 13.7 configs/s
2026-02-21T11:43:03.1878592Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 16.7 configs/s
2026-02-21T11:43:05.3008513Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 475.4         
2026-02-21T11:43:05.3009195Z                                                                   configs/s     
2026-02-21T11:43:05.4940574Z [419s] Generation 17 complete: 
2026-02-21T11:43:05.4940833Z ok=33
2026-02-21T11:43:05.4941003Z min=0.0265
2026-02-21T11:43:05.4941175Z mid=0.0383
2026-02-21T11:43:05.4941339Z max=0.0904
2026-02-21T11:43:05.4941527Z best={'block_sizes': [1, 8192],
2026-02-21T11:43:05.4941891Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:43:05.4942302Z  'load_eviction_policies': ['', ''],
2026-02-21T11:43:05.4942549Z  'num_stages': 6,
2026-02-21T11:43:05.4942754Z  'num_warps': 4,
2026-02-21T11:43:05.4942944Z  'pid_type': 'flat',
2026-02-21T11:43:05.4943159Z  'range_flattens': [None, None],
2026-02-21T11:43:05.4943414Z  'range_multi_buffers': [None, True],
2026-02-21T11:43:05.4943701Z  'range_num_stages': [0, 1],
2026-02-21T11:43:05.4943938Z  'range_unroll_factors': [0, 2],
2026-02-21T11:43:05.4944517Z  'range_warp_specializes': []}
2026-02-21T11:43:05.4986167Z [419s] Fitting surrogate: 983 points, 983 targets
2026-02-21T11:43:06.0644559Z [419s] Generation 18 starting: 30 neighbors, 2 active search path(s)
2026-02-21T11:43:12.6842674Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 6.1 configs/s
2026-02-21T11:43:14.5652240Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.9 configs/s
2026-02-21T11:43:16.1866013Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 617.3         
2026-02-21T11:43:16.1867868Z                                                                   configs/s     
2026-02-21T11:43:16.3432156Z [430s] Generation 18 complete: 
2026-02-21T11:43:16.3432406Z ok=32
2026-02-21T11:43:16.3432584Z min=0.0267
2026-02-21T11:43:16.3432757Z mid=0.0403
2026-02-21T11:43:16.3432929Z max=0.0660
2026-02-21T11:43:16.3433144Z best={'block_sizes': [1, 8192],
2026-02-21T11:43:16.3433541Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:43:16.3434322Z  'load_eviction_policies': ['', ''],
2026-02-21T11:43:16.3435237Z  'num_stages': 6,
2026-02-21T11:43:16.3435442Z  'num_warps': 4,
2026-02-21T11:43:16.3435641Z  'pid_type': 'flat',
2026-02-21T11:43:16.3435868Z  'range_flattens': [None, None],
2026-02-21T11:43:16.3436127Z  'range_multi_buffers': [None, None],
2026-02-21T11:43:16.3436397Z  'range_num_stages': [0, 1],
2026-02-21T11:43:16.3436630Z  'range_unroll_factors': [0, 2],
2026-02-21T11:43:16.3436876Z  'range_warp_specializes': []}
2026-02-21T11:43:16.3478641Z [430s] Fitting surrogate: 1015 points, 1015 targets
2026-02-21T11:43:16.8342675Z [430s] Generation 19 starting: 24 neighbors, 2 active search path(s)
2026-02-21T11:43:22.8240006Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 3.0 configs/s
2026-02-21T11:43:24.3552596Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 16.8 configs/s
2026-02-21T11:43:26.1301548Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 564.2         
2026-02-21T11:43:26.1302220Z                                                                   configs/s     
2026-02-21T11:43:26.2956313Z [440s] Generation 19 complete: 
2026-02-21T11:43:26.2956591Z ok=26
2026-02-21T11:43:26.2956767Z min=0.0269
2026-02-21T11:43:26.2956948Z mid=0.0391
2026-02-21T11:43:26.2957110Z max=0.0714
2026-02-21T11:43:26.2957300Z best={'block_sizes': [1, 8192],
2026-02-21T11:43:26.2957682Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:43:26.2958121Z  'load_eviction_policies': ['', ''],
2026-02-21T11:43:26.2958379Z  'num_stages': 6,
2026-02-21T11:43:26.2958581Z  'num_warps': 4,
2026-02-21T11:43:26.2958778Z  'pid_type': 'flat',
2026-02-21T11:43:26.2959004Z  'range_flattens': [None, None],
2026-02-21T11:43:26.2959274Z  'range_multi_buffers': [None, None],
2026-02-21T11:43:26.2959542Z  'range_num_stages': [0, 1],
2026-02-21T11:43:26.2959809Z  'range_unroll_factors': [0, 2],
2026-02-21T11:43:26.2960063Z  'range_warp_specializes': []}
2026-02-21T11:43:26.3002421Z [440s] Fitting surrogate: 1041 points, 1041 targets
2026-02-21T11:43:26.5822374Z [440s] Generation 20 starting: 10 neighbors, 1 active search path(s)
2026-02-21T11:43:30.1403342Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 3.8 configs/s
2026-02-21T11:43:30.8230467Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.2 configs/s
2026-02-21T11:43:31.0406460Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 4144.7        
2026-02-21T11:43:31.0406964Z                                                                   configs/s     
2026-02-21T11:43:31.0884646Z [444s] Generation 20 complete: 
2026-02-21T11:43:31.0884901Z ok=12
2026-02-21T11:43:31.0885091Z min=0.0297
2026-02-21T11:43:31.0885272Z mid=0.0480
2026-02-21T11:43:31.0885445Z max=0.1078
2026-02-21T11:43:31.0885633Z best={'block_sizes': [1, 8192],
2026-02-21T11:43:31.0886069Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:43:31.0886486Z  'load_eviction_policies': ['', ''],
2026-02-21T11:43:31.0886760Z  'num_stages': 6,
2026-02-21T11:43:31.0886987Z  'num_warps': 4,
2026-02-21T11:43:31.0887211Z  'pid_type': 'flat',
2026-02-21T11:43:31.0887445Z  'range_flattens': [None, None],
2026-02-21T11:43:31.0887718Z  'range_multi_buffers': [None, None],
2026-02-21T11:43:31.0887989Z  'range_num_stages': [0, 1],
2026-02-21T11:43:31.0888195Z  'range_unroll_factors': [0, 2],
2026-02-21T11:43:31.0888412Z  'range_warp_specializes': []}
2026-02-21T11:43:31.0928278Z [444s] Fitting surrogate: 1053 points, 1053 targets
2026-02-21T11:43:31.2558497Z [444s] Autotuning complete in 445.0s after searching 1008 configs.
2026-02-21T11:43:31.2559007Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:43:31.2560556Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=6, num_warps=4, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:43:31.2562455Z 
2026-02-21T11:43:31.2562871Z [444s] Code of selected kernel: /tmp/torchinductor_root/gm/cgmmzpap23dzfz6cwafyxb3frhe7apntlgkfly7gwj2xhhmoxeec.py
2026-02-21T11:43:31.2888006Z from __future__ import annotations
2026-02-21T11:43:31.2888211Z 
2026-02-21T11:43:31.2888318Z import torch
2026-02-21T11:43:31.2888507Z import triton
2026-02-21T11:43:31.2888717Z import triton.language as tl
2026-02-21T11:43:31.2889028Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:43:31.2889429Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:43:31.2889865Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:43:31.2890280Z 
2026-02-21T11:43:31.2890377Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:43:31.2890957Z _BLOCK_SIZE_1 = tl.constexpr(8192)
2026-02-21T11:43:31.2891142Z 
2026-02-21T11:43:31.2891219Z @triton.jit
2026-02-21T11:43:31.2891431Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:43:31.2891822Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:43:31.2892227Z     pid_0 = tl.program_id(0)
2026-02-21T11:43:31.2892465Z     offset_0 = pid_0
2026-02-21T11:43:31.2892715Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:43:31.2893144Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:43:31.2893596Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:43:31.2894205Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:43:31.2894604Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:43:31.2895013Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:43:31.2895435Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:43:31.2895813Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:43:31.2920810Z     # src[softmax.py:82-89]: ...
2026-02-21T11:43:31.2921212Z     for offset_2 in tl.range(0, 4224, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1):
2026-02-21T11:43:31.2921651Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:43:31.2921960Z         mask_1 = indices_2 < 4224
2026-02-21T11:43:31.2922165Z         mi_copy = mi
2026-02-21T11:43:31.2922329Z         di_copy = di
2026-02-21T11:43:31.2922498Z         mi_copy_0 = mi_copy
2026-02-21T11:43:31.2922679Z         di_copy_0 = di_copy
2026-02-21T11:43:31.2922905Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:43:31.2923323Z         values = tl.load(x + (indices_0[:, None] * 4224 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:43:31.2923775Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:43:31.2924456Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:43:31.2924970Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:43:31.2925305Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:43:31.2925600Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:43:31.2925861Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:43:31.2926174Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:43:31.2926493Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:43:31.2926697Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:43:31.2926887Z         v_4 = di_copy_0 * v_3
2026-02-21T11:43:31.2927110Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:43:31.2927352Z         subscript = v_1[:, None]
2026-02-21T11:43:31.2927560Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:43:31.2927779Z         v_6 = v_5 - subscript
2026-02-21T11:43:31.2928040Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:43:31.2928385Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:43:31.2928927Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:43:31.2929159Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:43:31.2929623Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:43:31.2930181Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:43:31.2930434Z         di = v_4 + sum_1
2026-02-21T11:43:31.2930618Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:43:31.2930838Z         mi = v_1
2026-02-21T11:43:31.2931081Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:43:31.2931422Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:43:31.2931977Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:43:31.2932453Z     for offset_2 in tl.range(0, 4224, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1):
2026-02-21T11:43:31.2932870Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:43:31.2933167Z         mask_2 = indices_2 < 4224
2026-02-21T11:43:31.2933377Z         mi_copy_1 = mi
2026-02-21T11:43:31.2933549Z         di_copy_1 = di
2026-02-21T11:43:31.2933724Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:43:31.2933922Z         di_copy_1_0 = di_copy_1
2026-02-21T11:43:31.2934280Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:43:31.2934691Z         values_1 = tl.load(x + (indices_0[:, None] * 4224 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T11:43:31.2935211Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:43:31.2935580Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:43:31.2935819Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:43:31.2936055Z         v_10 = v_9 - subscript_1
2026-02-21T11:43:31.2936272Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:43:31.2936492Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:43:31.2936715Z         v_12 = v_11 / subscript_2
2026-02-21T11:43:31.2936917Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:43:31.2937264Z         tl.store(out + (indices_0[:, None] * 4224 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:43:31.2937549Z 
2026-02-21T11:43:31.2937709Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:43:31.2938006Z     """
2026-02-21T11:43:31.2938261Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:43:31.2938677Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:43:31.2938961Z     Args:
2026-02-21T11:43:31.2939151Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:43:31.2939399Z     Returns:
2026-02-21T11:43:31.2939613Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:43:31.2939890Z     """
2026-02-21T11:43:31.2940048Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:43:31.2940264Z     m, n = x.size()
2026-02-21T11:43:31.2940458Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:43:31.2940703Z     out = torch.empty_like(x)
2026-02-21T11:43:31.2940987Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:43:31.2941396Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:43:31.2941832Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:43:31.2942135Z     # src[softmax.py:79-92]: ...
2026-02-21T11:43:31.2942460Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=4, num_stages=6)
2026-02-21T11:43:31.2942806Z     # src[softmax.py:93]: return out
2026-02-21T11:43:31.2943013Z     return out
2026-02-21T11:43:32.4812625Z WARNING:tritonbench.utils.triton_op:Completed input ID 31:
2026-02-21T11:43:32.4813008Z (M, N)
2026-02-21T11:43:32.4813186Z ------------
2026-02-21T11:43:32.4813840Z (4096, 4224)
2026-02-21T11:43:32.4813960Z 
2026-02-21T11:43:32.4830467Z  35%|███▌      | 7/20 [40:27<1:22:13, 379.47s/it]WARNING:tritonbench.utils.triton_op:Running input ID 36:
2026-02-21T11:43:32.4830861Z (M, N)
2026-02-21T11:43:32.4831007Z ------------
2026-02-21T11:43:32.4831168Z (4096, 4864)
2026-02-21T11:43:32.4832630Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T11:43:34.0300278Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:43:35.7558537Z INFO:tritonbench.utils.triton_op:Took 3.12ms to get benchmark function for torch_compile_softmax
2026-02-21T11:43:37.1521216Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:43:37.1521583Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:43:37.1522327Z               'dtype': 'torch.float16',
2026-02-21T11:43:37.1522645Z               'shape': (4096, 4864),
2026-02-21T11:43:37.1522924Z               'stride': (4864, 1)},),
2026-02-21T11:43:37.1523196Z   'kwargs': {}}
2026-02-21T11:43:37.1562778Z INFO:tritonbench.utils.triton_op:Took 4.45ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:43:37.4482763Z [0s] Autotune random seed: 2145258556
2026-02-21T11:43:37.4841635Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:44:11.8636102Z [34s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:44:12.0944180Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:44:15.8412685Z [38s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T11:44:17.6952324Z [40s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:44:18.4840729Z [40s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:44:18.6936559Z [41s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T11:44:25.7698139Z [48s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T11:44:25.7719429Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T11:44:32.7915076Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 14.3 configs/s
2026-02-21T11:44:32.7929365Z [55s] Adaptive compile timeout: 30s (90% percentile=17.1s, bounds=[30.0s, 30s])
2026-02-21T11:44:34.5287517Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 572.8 configs/s
2026-02-21T11:44:34.6737111Z [57s] Initial random population of 100, 5 starting points: 
2026-02-21T11:44:34.6738341Z error=4
2026-02-21T11:44:34.6738571Z timeout=7
2026-02-21T11:44:34.6738753Z ok=89
2026-02-21T11:44:34.6738940Z min=0.0474
2026-02-21T11:44:34.6739113Z mid=0.3661
2026-02-21T11:44:34.6739326Z max=61.7885
2026-02-21T11:44:34.6739528Z best={'block_sizes': [2, 512],
2026-02-21T11:44:34.6739890Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:44:34.6740304Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:44:34.6740601Z  'maxnreg': 256,
2026-02-21T11:44:34.6740810Z  'num_sm_multiplier': 32,
2026-02-21T11:44:34.6741047Z  'num_stages': 1,
2026-02-21T11:44:34.6741240Z  'num_warps': 2,
2026-02-21T11:44:34.6741473Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:44:34.6741789Z  'range_flattens': [True, None],
2026-02-21T11:44:34.6742105Z  'range_multi_buffers': [True, False],
2026-02-21T11:44:34.6742432Z  'range_num_stages': [3, 0],
2026-02-21T11:44:34.6742668Z  'range_unroll_factors': [1, 0],
2026-02-21T11:44:34.6742927Z  'range_warp_specializes': []}
2026-02-21T11:44:34.6755489Z [57s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:44:36.0569847Z [58s] Generation 1 starting: 87 neighbors, 5 active search path(s)
2026-02-21T11:44:54.8981432Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 9.2 configs/s
2026-02-21T11:45:00.3032318Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 17.2 configs/s
2026-02-21T11:45:04.9863811Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 215.4         
2026-02-21T11:45:04.9864483Z                                                                   configs/s     
2026-02-21T11:45:05.3443863Z [87s] Generation 1 complete: 
2026-02-21T11:45:05.3444401Z error=5
2026-02-21T11:45:05.3444586Z ok=88
2026-02-21T11:45:05.3444761Z min=0.0364
2026-02-21T11:45:05.3444936Z mid=0.0656
2026-02-21T11:45:05.3445110Z max=0.2543
2026-02-21T11:45:05.3445299Z best={'block_sizes': [1, 8192],
2026-02-21T11:45:05.3445714Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:45:05.3446105Z  'load_eviction_policies': ['', 'first'],
2026-02-21T11:45:05.3446385Z  'num_stages': 1,
2026-02-21T11:45:05.3446593Z  'num_warps': 8,
2026-02-21T11:45:05.3446816Z  'pid_type': 'flat',
2026-02-21T11:45:05.3447046Z  'range_flattens': [None, False],
2026-02-21T11:45:05.3447312Z  'range_multi_buffers': [None, None],
2026-02-21T11:45:05.3447587Z  'range_num_stages': [0, 1],
2026-02-21T11:45:05.3447838Z  'range_unroll_factors': [0, 3],
2026-02-21T11:45:05.3448116Z  'range_warp_specializes': []}
2026-02-21T11:45:05.3465785Z [87s] Fitting surrogate: 193 points, 193 targets
2026-02-21T11:45:06.8722842Z [89s] Generation 2 starting: 88 neighbors, 5 active search path(s)
2026-02-21T11:45:31.7511811Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 0.8 configs/s
2026-02-21T11:45:38.1437562Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 91/91 14.3 configs/s
2026-02-21T11:45:45.0073481Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 147.3         
2026-02-21T11:45:45.0074301Z                                                                   configs/s     
2026-02-21T11:45:45.5370088Z [128s] Generation 2 complete: 
2026-02-21T11:45:45.5371027Z ok=93
2026-02-21T11:45:45.5371217Z min=0.0322
2026-02-21T11:45:45.5371408Z mid=0.0478
2026-02-21T11:45:45.5371578Z max=0.5053
2026-02-21T11:45:45.5371776Z best={'block_sizes': [2, 8192],
2026-02-21T11:45:45.5372104Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:45:45.5372456Z  'load_eviction_policies': ['', ''],
2026-02-21T11:45:45.5372714Z  'num_stages': 2,
2026-02-21T11:45:45.5372914Z  'num_warps': 4,
2026-02-21T11:45:45.5373108Z  'pid_type': 'flat',
2026-02-21T11:45:45.5373334Z  'range_flattens': [None, True],
2026-02-21T11:45:45.5373595Z  'range_multi_buffers': [None, True],
2026-02-21T11:45:45.5373882Z  'range_num_stages': [0, 2],
2026-02-21T11:45:45.5374542Z  'range_unroll_factors': [0, 0],
2026-02-21T11:45:45.5374792Z  'range_warp_specializes': []}
2026-02-21T11:45:45.5392462Z [128s] Fitting surrogate: 286 points, 286 targets
2026-02-21T11:45:46.7431471Z [129s] Generation 3 starting: 76 neighbors, 5 active search path(s)
2026-02-21T11:46:03.7861423Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76/76 5.7 configs/s
2026-02-21T11:46:08.4976589Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 76/76 16.3 configs/s
2026-02-21T11:46:17.1602462Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 116.9         
2026-02-21T11:46:17.1608209Z                                                                   configs/s     
2026-02-21T11:46:17.8281419Z [160s] Generation 3 complete: 
2026-02-21T11:46:17.8281730Z ok=81
2026-02-21T11:46:17.8281914Z min=0.0308
2026-02-21T11:46:17.8282102Z mid=0.0389
2026-02-21T11:46:17.8282270Z max=0.2375
2026-02-21T11:46:17.8282466Z best={'block_sizes': [1, 8192],
2026-02-21T11:46:17.8282790Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:46:17.8283157Z  'load_eviction_policies': ['', ''],
2026-02-21T11:46:17.8283459Z  'num_stages': 2,
2026-02-21T11:46:17.8283656Z  'num_warps': 4,
2026-02-21T11:46:17.8283863Z  'pid_type': 'flat',
2026-02-21T11:46:17.8284510Z  'range_flattens': [None, False],
2026-02-21T11:46:17.8284753Z  'range_multi_buffers': [None, True],
2026-02-21T11:46:17.8284969Z  'range_num_stages': [0, 2],
2026-02-21T11:46:17.8285171Z  'range_unroll_factors': [0, 0],
2026-02-21T11:46:17.8285374Z  'range_warp_specializes': []}
2026-02-21T11:46:17.8309485Z [160s] Fitting surrogate: 367 points, 367 targets
2026-02-21T11:46:18.7705226Z [161s] Generation 4 starting: 56 neighbors, 5 active search path(s)
2026-02-21T11:46:44.8943431Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 0.4 configs/s
2026-02-21T11:46:48.4902273Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 16.3 configs/s
2026-02-21T11:46:52.9549271Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 226.2         
2026-02-21T11:46:52.9549856Z                                                                   configs/s     
2026-02-21T11:46:53.3181256Z [195s] Generation 4 complete: 
2026-02-21T11:46:53.3181538Z ok=61
2026-02-21T11:46:53.3181716Z min=0.0307
2026-02-21T11:46:53.3182515Z mid=0.0408
2026-02-21T11:46:53.3182677Z max=0.2330
2026-02-21T11:46:53.3182862Z best={'block_sizes': [1, 8192],
2026-02-21T11:46:53.3183196Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:46:53.3183572Z  'load_eviction_policies': ['', ''],
2026-02-21T11:46:53.3183817Z  'num_stages': 2,
2026-02-21T11:46:53.3184360Z  'num_warps': 4,
2026-02-21T11:46:53.3184553Z  'pid_type': 'flat',
2026-02-21T11:46:53.3184777Z  'range_flattens': [None, False],
2026-02-21T11:46:53.3185033Z  'range_multi_buffers': [None, True],
2026-02-21T11:46:53.3185299Z  'range_num_stages': [0, 2],
2026-02-21T11:46:53.3210794Z  'range_unroll_factors': [0, 0],
2026-02-21T11:46:53.3211066Z  'range_warp_specializes': []}
2026-02-21T11:46:53.3211374Z [195s] Fitting surrogate: 428 points, 428 targets
2026-02-21T11:46:54.3612470Z [196s] Generation 5 starting: 64 neighbors, 5 active search path(s)
2026-02-21T11:47:10.4120268Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 3.3 configs/s
2026-02-21T11:47:14.5729144Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.3 configs/s
2026-02-21T11:47:20.7654810Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 163.4         
2026-02-21T11:47:20.7655339Z                                                                   configs/s     
2026-02-21T11:47:21.2632405Z [223s] Generation 5 complete: 
2026-02-21T11:47:21.2632710Z ok=69
2026-02-21T11:47:21.2632895Z min=0.0306
2026-02-21T11:47:21.2633070Z mid=0.0362
2026-02-21T11:47:21.2633241Z max=0.1350
2026-02-21T11:47:21.2633427Z best={'block_sizes': [1, 8192],
2026-02-21T11:47:21.2633791Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:47:21.2634595Z  'load_eviction_policies': ['', ''],
2026-02-21T11:47:21.2634859Z  'num_stages': 1,
2026-02-21T11:47:21.2635096Z  'num_warps': 4,
2026-02-21T11:47:21.2635320Z  'pid_type': 'flat',
2026-02-21T11:47:21.2635539Z  'range_flattens': [None, False],
2026-02-21T11:47:21.2635804Z  'range_multi_buffers': [None, None],
2026-02-21T11:47:21.2636094Z  'range_num_stages': [0, 2],
2026-02-21T11:47:21.2636329Z  'range_unroll_factors': [0, 3],
2026-02-21T11:47:21.2636585Z  'range_warp_specializes': []}
2026-02-21T11:47:21.2664837Z [223s] Fitting surrogate: 497 points, 497 targets
2026-02-21T11:47:22.2884668Z [224s] Generation 6 starting: 63 neighbors, 5 active search path(s)
2026-02-21T11:47:36.9021260Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 4.2 configs/s
2026-02-21T11:47:40.9133267Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 16.4 configs/s
2026-02-21T11:47:48.7266348Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 144.0         
2026-02-21T11:47:48.7269348Z                                                                   configs/s     
2026-02-21T11:47:49.2948335Z [251s] Generation 6 complete: 
2026-02-21T11:47:49.2948748Z ok=68
2026-02-21T11:47:49.2949007Z min=0.0304
2026-02-21T11:47:49.2949262Z mid=0.0344
2026-02-21T11:47:49.2949519Z max=0.1519
2026-02-21T11:47:49.2949755Z best={'block_sizes': [1, 8192],
2026-02-21T11:47:49.2950095Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:47:49.2950435Z  'load_eviction_policies': ['', ''],
2026-02-21T11:47:49.2950702Z  'num_stages': 5,
2026-02-21T11:47:49.2950908Z  'num_warps': 4,
2026-02-21T11:47:49.2951116Z  'pid_type': 'flat',
2026-02-21T11:47:49.2951340Z  'range_flattens': [None, None],
2026-02-21T11:47:49.2951607Z  'range_multi_buffers': [None, None],
2026-02-21T11:47:49.2951873Z  'range_num_stages': [0, 1],
2026-02-21T11:47:49.2952124Z  'range_unroll_factors': [0, 2],
2026-02-21T11:47:49.2952387Z  'range_warp_specializes': []}
2026-02-21T11:47:49.2980107Z [251s] Fitting surrogate: 565 points, 565 targets
2026-02-21T11:47:50.0790504Z [252s] Generation 7 starting: 45 neighbors, 3 active search path(s)
2026-02-21T11:48:01.3349230Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 3.7 configs/s
2026-02-21T11:48:04.2508771Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 47/47 16.4 configs/s
2026-02-21T11:48:09.0556084Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 210.3         
2026-02-21T11:48:09.0556644Z                                                                   configs/s     
2026-02-21T11:48:09.4549348Z [271s] Generation 7 complete: 
2026-02-21T11:48:09.4549632Z ok=48
2026-02-21T11:48:09.4549805Z min=0.0299
2026-02-21T11:48:09.4549976Z mid=0.0370
2026-02-21T11:48:09.4550160Z max=0.1041
2026-02-21T11:48:09.4550341Z best={'block_sizes': [1, 8192],
2026-02-21T11:48:09.4550631Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:48:09.4550936Z  'load_eviction_policies': ['', ''],
2026-02-21T11:48:09.4551189Z  'num_stages': 5,
2026-02-21T11:48:09.4551378Z  'num_warps': 4,
2026-02-21T11:48:09.4551578Z  'pid_type': 'flat',
2026-02-21T11:48:09.4552499Z  'range_flattens': [None, None],
2026-02-21T11:48:09.4552767Z  'range_multi_buffers': [None, None],
2026-02-21T11:48:09.4553039Z  'range_num_stages': [0, 2],
2026-02-21T11:48:09.4553300Z  'range_unroll_factors': [0, 2],
2026-02-21T11:48:09.4553532Z  'range_warp_specializes': []}
2026-02-21T11:48:09.4588550Z [271s] Fitting surrogate: 613 points, 613 targets
2026-02-21T11:48:10.2036440Z [272s] Generation 8 starting: 42 neighbors, 3 active search path(s)
2026-02-21T11:48:20.0655307Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 4.3 configs/s
2026-02-21T11:48:22.7157337Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 43/43 16.5 configs/s
2026-02-21T11:48:26.7273270Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 251.7         
2026-02-21T11:48:26.7273820Z                                                                   configs/s     
2026-02-21T11:48:27.0613635Z [289s] Generation 8 complete: 
2026-02-21T11:48:27.0613898Z ok=45
2026-02-21T11:48:27.0614297Z min=0.0300
2026-02-21T11:48:27.0614512Z mid=0.0319
2026-02-21T11:48:27.0614728Z max=0.0859
2026-02-21T11:48:27.0614923Z best={'block_sizes': [1, 8192],
2026-02-21T11:48:27.0615249Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:48:27.0615577Z  'load_eviction_policies': ['', ''],
2026-02-21T11:48:27.0615827Z  'num_stages': 2,
2026-02-21T11:48:27.0616012Z  'num_warps': 4,
2026-02-21T11:48:27.0616206Z  'pid_type': 'flat',
2026-02-21T11:48:27.0616415Z  'range_flattens': [None, False],
2026-02-21T11:48:27.0616673Z  'range_multi_buffers': [None, None],
2026-02-21T11:48:27.0616933Z  'range_num_stages': [0, 1],
2026-02-21T11:48:27.0617162Z  'range_unroll_factors': [0, 1],
2026-02-21T11:48:27.0617410Z  'range_warp_specializes': []}
2026-02-21T11:48:27.0652117Z [289s] Fitting surrogate: 658 points, 658 targets
2026-02-21T11:48:27.8070751Z [290s] Generation 9 starting: 43 neighbors, 3 active search path(s)
2026-02-21T11:48:37.9033897Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 5.7 configs/s
2026-02-21T11:48:40.6071933Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.5 configs/s
2026-02-21T11:48:45.1009755Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 224.7         
2026-02-21T11:48:45.1010426Z                                                                   configs/s     
2026-02-21T11:48:45.4667157Z [307s] Generation 9 complete: 
2026-02-21T11:48:45.4667453Z ok=46
2026-02-21T11:48:45.4667625Z min=0.0338
2026-02-21T11:48:45.4667803Z mid=0.0385
2026-02-21T11:48:45.4667966Z max=0.1360
2026-02-21T11:48:45.4668154Z best={'block_sizes': [1, 8192],
2026-02-21T11:48:45.4668459Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:48:45.4668774Z  'load_eviction_policies': ['', ''],
2026-02-21T11:48:45.4669014Z  'num_stages': 3,
2026-02-21T11:48:45.4669189Z  'num_warps': 4,
2026-02-21T11:48:45.4669373Z  'pid_type': 'flat',
2026-02-21T11:48:45.4669574Z  'range_flattens': [None, False],
2026-02-21T11:48:45.4669846Z  'range_multi_buffers': [None, None],
2026-02-21T11:48:45.4670084Z  'range_num_stages': [0, 1],
2026-02-21T11:48:45.4670307Z  'range_unroll_factors': [0, 1],
2026-02-21T11:48:45.4671190Z  'range_warp_specializes': []}
2026-02-21T11:48:45.4711561Z [307s] Fitting surrogate: 704 points, 704 targets
2026-02-21T11:48:46.2552974Z [308s] Generation 10 starting: 41 neighbors, 3 active search path(s)
2026-02-21T11:48:57.5567479Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 5.1 configs/s
2026-02-21T11:49:00.2688731Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 44/44 16.5 configs/s
2026-02-21T11:49:04.2789765Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 251.5         
2026-02-21T11:49:04.2790253Z                                                                   configs/s     
2026-02-21T11:49:04.6067909Z [327s] Generation 10 complete: 
2026-02-21T11:49:04.6068200Z ok=45
2026-02-21T11:49:04.6068378Z min=0.0305
2026-02-21T11:49:04.6068549Z mid=0.0407
2026-02-21T11:49:04.6069328Z max=0.7085
2026-02-21T11:49:04.6069521Z best={'block_sizes': [1, 8192],
2026-02-21T11:49:04.6069808Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:49:04.6070150Z  'load_eviction_policies': ['', ''],
2026-02-21T11:49:04.6070397Z  'num_stages': 5,
2026-02-21T11:49:04.6070625Z  'num_warps': 4,
2026-02-21T11:49:04.6070855Z  'pid_type': 'flat',
2026-02-21T11:49:04.6071121Z  'range_flattens': [None, None],
2026-02-21T11:49:04.6071432Z  'range_multi_buffers': [None, False],
2026-02-21T11:49:04.6071757Z  'range_num_stages': [0, 3],
2026-02-21T11:49:04.6072004Z  'range_unroll_factors': [0, 3],
2026-02-21T11:49:04.6072281Z  'range_warp_specializes': []}
2026-02-21T11:49:04.6106270Z [327s] Fitting surrogate: 749 points, 749 targets
2026-02-21T11:49:05.2515180Z [327s] Generation 11 starting: 36 neighbors, 3 active search path(s)
2026-02-21T11:49:14.1291967Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 4.5 configs/s
2026-02-21T11:49:16.3722087Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.8 configs/s
2026-02-21T11:49:19.7224519Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 300.8         
2026-02-21T11:49:19.7226250Z                                                                   configs/s     
2026-02-21T11:49:20.0043287Z [342s] Generation 11 complete: 
2026-02-21T11:49:20.0043587Z ok=39
2026-02-21T11:49:20.0043765Z min=0.0335
2026-02-21T11:49:20.0043938Z mid=0.0354
2026-02-21T11:49:20.0044512Z max=0.2348
2026-02-21T11:49:20.0044721Z best={'block_sizes': [1, 8192],
2026-02-21T11:49:20.0045043Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:49:20.0045389Z  'load_eviction_policies': ['', ''],
2026-02-21T11:49:20.0045659Z  'num_stages': 5,
2026-02-21T11:49:20.0045858Z  'num_warps': 4,
2026-02-21T11:49:20.0046054Z  'pid_type': 'flat',
2026-02-21T11:49:20.0046276Z  'range_flattens': [None, None],
2026-02-21T11:49:20.0046531Z  'range_multi_buffers': [None, False],
2026-02-21T11:49:20.0046842Z  'range_num_stages': [0, 3],
2026-02-21T11:49:20.0047080Z  'range_unroll_factors': [0, 3],
2026-02-21T11:49:20.0047332Z  'range_warp_specializes': []}
2026-02-21T11:49:20.0083368Z [342s] Fitting surrogate: 788 points, 788 targets
2026-02-21T11:49:20.7695529Z [343s] Generation 12 starting: 44 neighbors, 3 active search path(s)
2026-02-21T11:49:35.4292424Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 1.1 configs/s
2026-02-21T11:49:38.3237819Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 47/47 16.5 configs/s
2026-02-21T11:49:42.0231216Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 272.7         
2026-02-21T11:49:42.0231756Z                                                                   configs/s     
2026-02-21T11:49:42.3286264Z [364s] Generation 12 complete: 
2026-02-21T11:49:42.3286581Z ok=48
2026-02-21T11:49:42.3286765Z min=0.0303
2026-02-21T11:49:42.3286949Z mid=0.0403
2026-02-21T11:49:42.3287127Z max=0.1538
2026-02-21T11:49:42.3288085Z best={'block_sizes': [1, 8192],
2026-02-21T11:49:42.3288460Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T11:49:42.3288875Z  'load_eviction_policies': ['', ''],
2026-02-21T11:49:42.3289158Z  'num_stages': 2,
2026-02-21T11:49:42.3289363Z  'num_warps': 4,
2026-02-21T11:49:42.3289562Z  'pid_type': 'flat',
2026-02-21T11:49:42.3289785Z  'range_flattens': [None, True],
2026-02-21T11:49:42.3290159Z  'range_multi_buffers': [None, None],
2026-02-21T11:49:42.3290426Z  'range_num_stages': [0, 1],
2026-02-21T11:49:42.3290677Z  'range_unroll_factors': [0, 1],
2026-02-21T11:49:42.3290928Z  'range_warp_specializes': []}
2026-02-21T11:49:42.3330845Z [364s] Fitting surrogate: 836 points, 836 targets
2026-02-21T11:49:43.0809574Z [365s] Generation 13 starting: 43 neighbors, 3 active search path(s)
2026-02-21T11:49:53.1885908Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 7.2 configs/s
2026-02-21T11:49:55.9108857Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 44/44 16.4 configs/s
2026-02-21T11:50:00.9248559Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 242.8         
2026-02-21T11:50:00.9249008Z                                                                   configs/s     
2026-02-21T11:50:01.2703858Z [383s] Generation 13 complete: 
2026-02-21T11:50:01.2704273Z ok=46
2026-02-21T11:50:01.2704446Z min=0.0304
2026-02-21T11:50:01.2704619Z mid=0.0369
2026-02-21T11:50:01.2704784Z max=0.2180
2026-02-21T11:50:01.2704971Z best={'block_sizes': [1, 8192],
2026-02-21T11:50:01.2705271Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:50:01.2705617Z  'load_eviction_policies': ['', ''],
2026-02-21T11:50:01.2705864Z  'num_stages': 4,
2026-02-21T11:50:01.2706056Z  'num_warps': 4,
2026-02-21T11:50:01.2706243Z  'pid_type': 'flat',
2026-02-21T11:50:01.2706457Z  'range_flattens': [None, True],
2026-02-21T11:50:01.2706736Z  'range_multi_buffers': [None, None],
2026-02-21T11:50:01.2706997Z  'range_num_stages': [0, 3],
2026-02-21T11:50:01.2707245Z  'range_unroll_factors': [0, 3],
2026-02-21T11:50:01.2707486Z  'range_warp_specializes': []}
2026-02-21T11:50:01.2744469Z [383s] Fitting surrogate: 882 points, 882 targets
2026-02-21T11:50:02.0217323Z [384s] Generation 14 starting: 40 neighbors, 3 active search path(s)
2026-02-21T11:50:11.8857047Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 3.4 configs/s
2026-02-21T11:50:14.4084412Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 41/41 16.5 configs/s
2026-02-21T11:50:17.8386972Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 293.8         
2026-02-21T11:50:17.8387488Z                                                                   configs/s     
2026-02-21T11:50:18.1251472Z [400s] Generation 14 complete: 
2026-02-21T11:50:18.1251910Z ok=43
2026-02-21T11:50:18.1252210Z min=0.0301
2026-02-21T11:50:18.1252496Z mid=0.0401
2026-02-21T11:50:18.1252773Z max=0.1494
2026-02-21T11:50:18.1253091Z best={'block_sizes': [1, 8192],
2026-02-21T11:50:18.1253748Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:50:18.1254705Z  'load_eviction_policies': ['', ''],
2026-02-21T11:50:18.1255121Z  'num_stages': 2,
2026-02-21T11:50:18.1256104Z  'num_warps': 4,
2026-02-21T11:50:18.1256424Z  'pid_type': 'flat',
2026-02-21T11:50:18.1256777Z  'range_flattens': [None, True],
2026-02-21T11:50:18.1257184Z  'range_multi_buffers': [None, None],
2026-02-21T11:50:18.1257611Z  'range_num_stages': [0, 1],
2026-02-21T11:50:18.1257987Z  'range_unroll_factors': [0, 1],
2026-02-21T11:50:18.1258400Z  'range_warp_specializes': []}
2026-02-21T11:50:18.1305177Z [400s] Fitting surrogate: 925 points, 925 targets
2026-02-21T11:50:18.7536150Z [401s] Generation 15 starting: 34 neighbors, 3 active search path(s)
2026-02-21T11:50:26.9309135Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 5.9 configs/s
2026-02-21T11:50:29.0472661Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.9 configs/s
2026-02-21T11:50:32.8207718Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 267.6         
2026-02-21T11:50:32.8208250Z                                                                   configs/s     
2026-02-21T11:50:33.1420170Z [415s] Generation 15 complete: 
2026-02-21T11:50:33.1420607Z ok=37
2026-02-21T11:50:33.1420881Z min=0.0299
2026-02-21T11:50:33.1421171Z mid=0.0315
2026-02-21T11:50:33.1421435Z max=0.0537
2026-02-21T11:50:33.1421741Z best={'block_sizes': [1, 8192],
2026-02-21T11:50:33.1422370Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:50:33.1423229Z  'load_eviction_policies': ['', ''],
2026-02-21T11:50:33.1423628Z  'num_stages': 2,
2026-02-21T11:50:33.1423814Z  'num_warps': 4,
2026-02-21T11:50:33.1424147Z  'pid_type': 'flat',
2026-02-21T11:50:33.1424374Z  'range_flattens': [None, True],
2026-02-21T11:50:33.1424633Z  'range_multi_buffers': [None, None],
2026-02-21T11:50:33.1424900Z  'range_num_stages': [0, 1],
2026-02-21T11:50:33.1425137Z  'range_unroll_factors': [0, 1],
2026-02-21T11:50:33.1425392Z  'range_warp_specializes': []}
2026-02-21T11:50:33.1473035Z [415s] Fitting surrogate: 962 points, 962 targets
2026-02-21T11:50:33.7044477Z [416s] Generation 16 starting: 30 neighbors, 2 active search path(s)
2026-02-21T11:50:41.0878442Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 6.3 configs/s
2026-02-21T11:50:42.9812806Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.8 configs/s
2026-02-21T11:50:45.8142544Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 355.2         
2026-02-21T11:50:45.8143052Z                                                                   configs/s     
2026-02-21T11:50:46.0580844Z [428s] Generation 16 complete: 
2026-02-21T11:50:46.0581142Z ok=33
2026-02-21T11:50:46.0581355Z min=0.0300
2026-02-21T11:50:46.0581613Z mid=0.0421
2026-02-21T11:50:46.0581853Z max=0.1427
2026-02-21T11:50:46.0582109Z best={'block_sizes': [1, 8192],
2026-02-21T11:50:46.0582524Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T11:50:46.0582954Z  'load_eviction_policies': ['', ''],
2026-02-21T11:50:46.0583252Z  'num_stages': 4,
2026-02-21T11:50:46.0583439Z  'num_warps': 4,
2026-02-21T11:50:46.0583653Z  'pid_type': 'flat',
2026-02-21T11:50:46.0583871Z  'range_flattens': [None, True],
2026-02-21T11:50:46.0587538Z  'range_multi_buffers': [None, False],
2026-02-21T11:50:46.0587807Z  'range_num_stages': [0, 2],
2026-02-21T11:50:46.0588048Z  'range_unroll_factors': [0, 3],
2026-02-21T11:50:46.0588294Z  'range_warp_specializes': []}
2026-02-21T11:50:46.0630445Z [428s] Fitting surrogate: 995 points, 995 targets
2026-02-21T11:50:46.6451388Z [429s] Generation 17 starting: 31 neighbors, 2 active search path(s)
2026-02-21T11:50:54.3812252Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 4.3 configs/s
2026-02-21T11:50:56.3282252Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 16.8 configs/s
2026-02-21T11:50:58.5171469Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 458.7         
2026-02-21T11:50:58.5172272Z                                                                   configs/s     
2026-02-21T11:50:58.7111886Z [441s] Generation 17 complete: 
2026-02-21T11:50:58.7112697Z ok=33
2026-02-21T11:50:58.7112886Z min=0.0298
2026-02-21T11:50:58.7113071Z mid=0.0425
2026-02-21T11:50:58.7113254Z max=0.1524
2026-02-21T11:50:58.7113444Z best={'block_sizes': [1, 8192],
2026-02-21T11:50:58.7113758Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T11:50:58.7114454Z  'load_eviction_policies': ['', ''],
2026-02-21T11:50:58.7114722Z  'num_stages': 4,
2026-02-21T11:50:58.7114919Z  'num_warps': 4,
2026-02-21T11:50:58.7115130Z  'pid_type': 'flat',
2026-02-21T11:50:58.7115361Z  'range_flattens': [None, True],
2026-02-21T11:50:58.7115617Z  'range_multi_buffers': [None, False],
2026-02-21T11:50:58.7115891Z  'range_num_stages': [0, 2],
2026-02-21T11:50:58.7116126Z  'range_unroll_factors': [0, 3],
2026-02-21T11:50:58.7116382Z  'range_warp_specializes': []}
2026-02-21T11:50:58.7160069Z [441s] Fitting surrogate: 1028 points, 1028 targets
2026-02-21T11:50:59.2831135Z [441s] Generation 18 starting: 31 neighbors, 2 active search path(s)
2026-02-21T11:51:06.7815677Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 6.3 configs/s
2026-02-21T11:51:08.7374669Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 16.7 configs/s
2026-02-21T11:51:10.5290863Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 559.2         
2026-02-21T11:51:10.5291388Z                                                                   configs/s     
2026-02-21T11:51:10.6940437Z [453s] Generation 18 complete: 
2026-02-21T11:51:10.6940686Z ok=33
2026-02-21T11:51:10.6940854Z min=0.0299
2026-02-21T11:51:10.6941028Z mid=0.0452
2026-02-21T11:51:10.6941194Z max=0.1460
2026-02-21T11:51:10.6941371Z best={'block_sizes': [1, 8192],
2026-02-21T11:51:10.6941678Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:51:10.6942013Z  'load_eviction_policies': ['', ''],
2026-02-21T11:51:10.6942302Z  'num_stages': 4,
2026-02-21T11:51:10.6942508Z  'num_warps': 4,
2026-02-21T11:51:10.6942695Z  'pid_type': 'flat',
2026-02-21T11:51:10.6942909Z  'range_flattens': [None, True],
2026-02-21T11:51:10.6943186Z  'range_multi_buffers': [None, False],
2026-02-21T11:51:10.6943454Z  'range_num_stages': [0, 2],
2026-02-21T11:51:10.6943686Z  'range_unroll_factors': [0, 3],
2026-02-21T11:51:10.6943945Z  'range_warp_specializes': []}
2026-02-21T11:51:10.6989514Z [453s] Fitting surrogate: 1061 points, 1061 targets
2026-02-21T11:51:11.2451407Z [453s] Generation 19 starting: 29 neighbors, 2 active search path(s)
2026-02-21T11:51:18.9119354Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 30/30 16.9 configs/s
2026-02-21T11:51:20.7409251Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 30/30 16.8 configs/s
2026-02-21T11:51:22.7988668Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 487.3         
2026-02-21T11:51:22.7989232Z                                                                   configs/s     
2026-02-21T11:51:22.9831989Z [465s] Generation 19 complete: 
2026-02-21T11:51:22.9832438Z ok=31
2026-02-21T11:51:22.9832721Z min=0.0302
2026-02-21T11:51:22.9833656Z mid=0.0423
2026-02-21T11:51:22.9833935Z max=0.0696
2026-02-21T11:51:22.9834527Z best={'block_sizes': [1, 8192],
2026-02-21T11:51:22.9835048Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:51:22.9835616Z  'load_eviction_policies': ['', ''],
2026-02-21T11:51:22.9836036Z  'num_stages': 4,
2026-02-21T11:51:22.9836343Z  'num_warps': 4,
2026-02-21T11:51:22.9836656Z  'pid_type': 'flat',
2026-02-21T11:51:22.9837000Z  'range_flattens': [None, True],
2026-02-21T11:51:22.9837466Z  'range_multi_buffers': [None, False],
2026-02-21T11:51:22.9837935Z  'range_num_stages': [0, 3],
2026-02-21T11:51:22.9838174Z  'range_unroll_factors': [0, 2],
2026-02-21T11:51:22.9838399Z  'range_warp_specializes': []}
2026-02-21T11:51:22.9880102Z [465s] Fitting surrogate: 1092 points, 1092 targets
2026-02-21T11:51:23.5817411Z [466s] Generation 20 starting: 30 neighbors, 2 active search path(s)
2026-02-21T11:51:31.5659037Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 1.8 configs/s
2026-02-21T11:51:33.4699366Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 16.7 configs/s
2026-02-21T11:51:35.5478080Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 482.6         
2026-02-21T11:51:35.5478519Z                                                                   configs/s     
2026-02-21T11:51:35.7321087Z [478s] Generation 20 complete: 
2026-02-21T11:51:35.7321371Z ok=32
2026-02-21T11:51:35.7321549Z min=0.0301
2026-02-21T11:51:35.7321748Z mid=0.0435
2026-02-21T11:51:35.7321923Z max=0.1423
2026-02-21T11:51:35.7322124Z best={'block_sizes': [1, 8192],
2026-02-21T11:51:35.7322458Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:51:35.7322817Z  'load_eviction_policies': ['', ''],
2026-02-21T11:51:35.7323076Z  'num_stages': 4,
2026-02-21T11:51:35.7323725Z  'num_warps': 4,
2026-02-21T11:51:35.7323949Z  'pid_type': 'flat',
2026-02-21T11:51:35.7324495Z  'range_flattens': [None, True],
2026-02-21T11:51:35.7324765Z  'range_multi_buffers': [None, False],
2026-02-21T11:51:35.7325069Z  'range_num_stages': [0, 3],
2026-02-21T11:51:35.7330719Z  'range_unroll_factors': [0, 2],
2026-02-21T11:51:35.7331037Z  'range_warp_specializes': []}
2026-02-21T11:51:35.7377826Z [478s] Fitting surrogate: 1124 points, 1124 targets
2026-02-21T11:51:35.9092420Z [478s] Autotuning complete in 478.4s after searching 1080 configs.
2026-02-21T11:51:35.9092946Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:51:35.9094653Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', ''], num_stages=4, num_warps=4, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:51:35.9096002Z 
2026-02-21T11:51:35.9096510Z [478s] Code of selected kernel: /tmp/torchinductor_root/re/cre7hzxutcapeo3vaxzpgrvfnshpctj5jemuoe2gsw3ictj2nxkh.py
2026-02-21T11:51:35.9439082Z from __future__ import annotations
2026-02-21T11:51:35.9439306Z 
2026-02-21T11:51:35.9439392Z import torch
2026-02-21T11:51:35.9439601Z import triton
2026-02-21T11:51:35.9439817Z import triton.language as tl
2026-02-21T11:51:35.9440132Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:51:35.9440532Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:51:35.9440994Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:51:35.9441289Z 
2026-02-21T11:51:35.9441397Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:51:35.9441661Z _BLOCK_SIZE_1 = tl.constexpr(8192)
2026-02-21T11:51:35.9441836Z 
2026-02-21T11:51:35.9441919Z @triton.jit
2026-02-21T11:51:35.9442122Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:51:35.9442531Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:51:35.9442942Z     pid_0 = tl.program_id(0)
2026-02-21T11:51:35.9443207Z     offset_0 = pid_0
2026-02-21T11:51:35.9444257Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:51:35.9444711Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:51:35.9445186Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:51:35.9445604Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:51:35.9445986Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:51:35.9446441Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:51:35.9446822Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:51:35.9447176Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:51:35.9447507Z     # src[softmax.py:82-89]: ...
2026-02-21T11:51:35.9448292Z     for offset_2 in tl.range(0, 4864, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True, flatten=True):
2026-02-21T11:51:35.9448955Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:51:35.9449297Z         mask_1 = indices_2 < 4864
2026-02-21T11:51:35.9449527Z         mi_copy = mi
2026-02-21T11:51:35.9449728Z         di_copy = di
2026-02-21T11:51:35.9450004Z         mi_copy_0 = mi_copy
2026-02-21T11:51:35.9450216Z         di_copy_0 = di_copy
2026-02-21T11:51:35.9450465Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:51:35.9450922Z         values = tl.load(x + (indices_0[:, None] * 4864 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:51:35.9451417Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:51:35.9452015Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:51:35.9452615Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:51:35.9452987Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:51:35.9453328Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:51:35.9453616Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:51:35.9454107Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:51:35.9454465Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:51:35.9454688Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:51:35.9454914Z         v_4 = di_copy_0 * v_3
2026-02-21T11:51:35.9455168Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:51:35.9455455Z         subscript = v_1[:, None]
2026-02-21T11:51:35.9455682Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:51:35.9455934Z         v_6 = v_5 - subscript
2026-02-21T11:51:35.9456239Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:51:35.9456636Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:51:35.9456936Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:51:35.9457183Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:51:35.9457627Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:51:35.9458090Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:51:35.9458339Z         di = v_4 + sum_1
2026-02-21T11:51:35.9458521Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:51:35.9458735Z         mi = v_1
2026-02-21T11:51:35.9458981Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:51:35.9459313Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:51:35.9459701Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:51:35.9460302Z     for offset_2 in tl.range(0, 4864, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True, flatten=True):
2026-02-21T11:51:35.9460846Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:51:35.9461133Z         mask_2 = indices_2 < 4864
2026-02-21T11:51:35.9461515Z         mi_copy_1 = mi
2026-02-21T11:51:35.9461692Z         di_copy_1 = di
2026-02-21T11:51:35.9461863Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:51:35.9462063Z         di_copy_1_0 = di_copy_1
2026-02-21T11:51:35.9462291Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:51:35.9462703Z         values_1 = tl.load(x + (indices_0[:, None] * 4864 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T11:51:35.9463214Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:51:35.9463577Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:51:35.9463814Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:51:35.9464195Z         v_10 = v_9 - subscript_1
2026-02-21T11:51:35.9464750Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:51:35.9464974Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:51:35.9465208Z         v_12 = v_11 / subscript_2
2026-02-21T11:51:35.9465417Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:51:35.9465760Z         tl.store(out + (indices_0[:, None] * 4864 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:51:35.9466042Z 
2026-02-21T11:51:35.9466206Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:51:35.9466505Z     """
2026-02-21T11:51:35.9466752Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:51:35.9467140Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:51:35.9467418Z     Args:
2026-02-21T11:51:35.9467602Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:51:35.9467845Z     Returns:
2026-02-21T11:51:35.9468052Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:51:35.9468323Z     """
2026-02-21T11:51:35.9468480Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:51:35.9468688Z     m, n = x.size()
2026-02-21T11:51:35.9468882Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:51:35.9469129Z     out = torch.empty_like(x)
2026-02-21T11:51:35.9469423Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:51:35.9469823Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:51:35.9470223Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:51:35.9470515Z     # src[softmax.py:79-92]: ...
2026-02-21T11:51:35.9470828Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=4, num_stages=4)
2026-02-21T11:51:35.9471175Z     # src[softmax.py:93]: return out
2026-02-21T11:51:35.9471376Z     return out
2026-02-21T11:51:37.0554875Z WARNING:tritonbench.utils.triton_op:Completed input ID 36:
2026-02-21T11:51:37.0555262Z (M, N)
2026-02-21T11:51:37.0555470Z ------------
2026-02-21T11:51:37.0555669Z (4096, 4864)
2026-02-21T11:51:37.0556085Z 
2026-02-21T11:51:37.0579553Z  40%|████      | 8/20 [48:32<1:22:35, 412.93s/it]WARNING:tritonbench.utils.triton_op:Running input ID 41:
2026-02-21T11:51:37.0580059Z (M, N)
2026-02-21T11:51:37.0580227Z ------------
2026-02-21T11:51:37.0580413Z (4096, 5504)
2026-02-21T11:51:37.0582526Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T11:51:38.5725205Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:51:40.2793653Z INFO:tritonbench.utils.triton_op:Took 3.60ms to get benchmark function for torch_compile_softmax
2026-02-21T11:51:41.7091893Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:51:41.7092223Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:51:41.7092502Z               'dtype': 'torch.float16',
2026-02-21T11:51:41.7092771Z               'shape': (4096, 5504),
2026-02-21T11:51:41.7093080Z               'stride': (5504, 1)},),
2026-02-21T11:51:41.7093327Z   'kwargs': {}}
2026-02-21T11:51:41.7144573Z INFO:tritonbench.utils.triton_op:Took 5.60ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:51:42.0025926Z [0s] Autotune random seed: 2145258556
2026-02-21T11:51:42.0386095Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:52:16.6136719Z [34s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:52:16.9038061Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:52:21.2030887Z [39s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T11:52:23.3951664Z [41s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:52:24.3342591Z [42s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:52:24.5705393Z [42s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T11:52:25.3643880Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.9 configs/s
2026-02-21T11:52:32.7721399Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.6 configs/s
2026-02-21T11:52:32.7736028Z [50s] Adaptive compile timeout: 30s (90% percentile=19.9s, bounds=[30.0s, 30s])
2026-02-21T11:52:34.4038682Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 608.6 configs/s
2026-02-21T11:52:34.5407698Z [52s] Initial random population of 100, 5 starting points: 
2026-02-21T11:52:34.5408074Z error=4
2026-02-21T11:52:34.5408273Z timeout=6
2026-02-21T11:52:34.5408450Z ok=90
2026-02-21T11:52:34.5408627Z min=0.0537
2026-02-21T11:52:34.5408800Z mid=0.4480
2026-02-21T11:52:34.5408979Z max=72.9881
2026-02-21T11:52:34.5409180Z best={'block_sizes': [2, 512],
2026-02-21T11:52:34.5409542Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T11:52:34.5410166Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:52:34.5410515Z  'maxnreg': 256,
2026-02-21T11:52:34.5410746Z  'num_sm_multiplier': 32,
2026-02-21T11:52:34.5411016Z  'num_stages': 1,
2026-02-21T11:52:34.5411222Z  'num_warps': 2,
2026-02-21T11:52:34.5411443Z  'pid_type': 'persistent_interleaved',
2026-02-21T11:52:34.5411737Z  'range_flattens': [True, None],
2026-02-21T11:52:34.5412644Z  'range_multi_buffers': [True, False],
2026-02-21T11:52:34.5412916Z  'range_num_stages': [3, 0],
2026-02-21T11:52:34.5416228Z  'range_unroll_factors': [1, 0],
2026-02-21T11:52:34.5416500Z  'range_warp_specializes': []}
2026-02-21T11:52:34.5427337Z [52s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:52:36.1641942Z [54s] Generation 1 starting: 96 neighbors, 5 active search path(s)
2026-02-21T11:53:01.6948426Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 101/101 4.0 configs/s
2026-02-21T11:53:07.7161022Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━ 101/101 16.9 configs/s
2026-02-21T11:53:11.8744882Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 242.2         
2026-02-21T11:53:11.8746065Z                                                                   configs/s     
2026-02-21T11:53:12.1839992Z [90s] Generation 1 complete: 
2026-02-21T11:53:12.1840404Z error=4
2026-02-21T11:53:12.1840696Z ok=98
2026-02-21T11:53:12.1841018Z min=0.0370
2026-02-21T11:53:12.1841315Z mid=0.0691
2026-02-21T11:53:12.1841590Z max=0.2898
2026-02-21T11:53:12.1841894Z best={'block_sizes': [1, 8192],
2026-02-21T11:53:12.1842412Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:53:12.1842963Z  'load_eviction_policies': ['', 'first'],
2026-02-21T11:53:12.1843402Z  'num_stages': 1,
2026-02-21T11:53:12.1843723Z  'num_warps': 8,
2026-02-21T11:53:12.1844250Z  'pid_type': 'flat',
2026-02-21T11:53:12.1844440Z  'range_flattens': [None, None],
2026-02-21T11:53:12.1844666Z  'range_multi_buffers': [None, None],
2026-02-21T11:53:12.1848436Z  'range_num_stages': [0, 1],
2026-02-21T11:53:12.1848694Z  'range_unroll_factors': [0, 3],
2026-02-21T11:53:12.1848940Z  'range_warp_specializes': []}
2026-02-21T11:53:12.1862676Z [90s] Fitting surrogate: 202 points, 202 targets
2026-02-21T11:53:13.8348275Z [91s] Generation 2 starting: 87 neighbors, 5 active search path(s)
2026-02-21T11:53:36.0799799Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90/90 6.7 configs/s
2026-02-21T11:53:41.5918648Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 90/90 16.5 configs/s
2026-02-21T11:53:49.9196005Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.4         
2026-02-21T11:53:49.9198314Z                                                                   configs/s     
2026-02-21T11:53:50.5334655Z [128s] Generation 2 complete: 
2026-02-21T11:53:50.5335143Z error=1
2026-02-21T11:53:50.5335424Z ok=91
2026-02-21T11:53:50.5335685Z min=0.0368
2026-02-21T11:53:50.5335964Z mid=0.0524
2026-02-21T11:53:50.5336223Z max=0.1912
2026-02-21T11:53:50.5336524Z best={'block_sizes': [1, 8192],
2026-02-21T11:53:50.5337042Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:53:50.5337698Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T11:53:50.5338155Z  'maxnreg': 64,
2026-02-21T11:53:50.5338473Z  'num_sm_multiplier': 8,
2026-02-21T11:53:50.5338827Z  'num_stages': 1,
2026-02-21T11:53:50.5339138Z  'num_warps': 8,
2026-02-21T11:53:50.5339549Z  'pid_type': 'persistent_blocked',
2026-02-21T11:53:50.5339983Z  'range_flattens': [False, True],
2026-02-21T11:53:50.5340495Z  'range_multi_buffers': [False, False],
2026-02-21T11:53:50.5341022Z  'range_num_stages': [4, 3],
2026-02-21T11:53:50.5341443Z  'range_unroll_factors': [1, 3],
2026-02-21T11:53:50.5341684Z  'range_warp_specializes': []}
2026-02-21T11:53:50.5358915Z [128s] Fitting surrogate: 294 points, 294 targets
2026-02-21T11:53:51.8159453Z [129s] Generation 3 starting: 81 neighbors, 5 active search path(s)
2026-02-21T11:54:11.6419708Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81/81 5.1 configs/s
2026-02-21T11:54:16.6831943Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 81/81 16.2 configs/s
2026-02-21T11:54:26.8039733Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 109.2         
2026-02-21T11:54:26.8040242Z                                                                   configs/s     
2026-02-21T11:54:27.5002064Z [165s] Generation 3 complete: 
2026-02-21T11:54:27.5002491Z ok=86
2026-02-21T11:54:27.5002761Z min=0.0353
2026-02-21T11:54:27.5003044Z mid=0.0464
2026-02-21T11:54:27.5003306Z max=0.0894
2026-02-21T11:54:27.5003609Z best={'block_sizes': [1, 8192],
2026-02-21T11:54:27.5004629Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:54:27.5005256Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T11:54:27.5005706Z  'num_stages': 1,
2026-02-21T11:54:27.5006032Z  'num_warps': 8,
2026-02-21T11:54:27.5006363Z  'pid_type': 'flat',
2026-02-21T11:54:27.5006755Z  'range_flattens': [None, None],
2026-02-21T11:54:27.5007162Z  'range_multi_buffers': [None, None],
2026-02-21T11:54:27.5007388Z  'range_num_stages': [0, 1],
2026-02-21T11:54:27.5007596Z  'range_unroll_factors': [0, 3],
2026-02-21T11:54:27.5008230Z  'range_warp_specializes': []}
2026-02-21T11:54:27.5029051Z [165s] Fitting surrogate: 380 points, 380 targets
2026-02-21T11:54:28.5449338Z [166s] Generation 4 starting: 63 neighbors, 5 active search path(s)
2026-02-21T11:54:46.2107917Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65/65 1.3 configs/s
2026-02-21T11:54:50.2377055Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 65/65 16.3 configs/s
2026-02-21T11:54:57.7011095Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 135.6         
2026-02-21T11:54:57.7011516Z                                                                   configs/s     
2026-02-21T11:54:58.2816494Z [196s] Generation 4 complete: 
2026-02-21T11:54:58.2816930Z ok=68
2026-02-21T11:54:58.2817200Z min=0.0336
2026-02-21T11:54:58.2817500Z mid=0.0388
2026-02-21T11:54:58.2817817Z max=0.2337
2026-02-21T11:54:58.2818179Z best={'block_sizes': [1, 8192],
2026-02-21T11:54:58.2818590Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:54:58.2818964Z  'load_eviction_policies': ['', ''],
2026-02-21T11:54:58.2819215Z  'num_stages': 2,
2026-02-21T11:54:58.2819405Z  'num_warps': 4,
2026-02-21T11:54:58.2819590Z  'pid_type': 'flat',
2026-02-21T11:54:58.2819828Z  'range_flattens': [None, False],
2026-02-21T11:54:58.2820083Z  'range_multi_buffers': [None, None],
2026-02-21T11:54:58.2820339Z  'range_num_stages': [0, 2],
2026-02-21T11:54:58.2820574Z  'range_unroll_factors': [0, 2],
2026-02-21T11:54:58.2820818Z  'range_warp_specializes': []}
2026-02-21T11:54:58.2853566Z [196s] Fitting surrogate: 448 points, 448 targets
2026-02-21T11:54:59.1125116Z [197s] Generation 5 starting: 46 neighbors, 4 active search path(s)
2026-02-21T11:55:10.3792060Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 9.7 configs/s
2026-02-21T11:55:13.2142868Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 16.5 configs/s
2026-02-21T11:55:19.3041454Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 166.1         
2026-02-21T11:55:19.3043872Z                                                                   configs/s     
2026-02-21T11:55:19.7862599Z [217s] Generation 5 complete: 
2026-02-21T11:55:19.7863175Z ok=50
2026-02-21T11:55:19.7863453Z min=0.0340
2026-02-21T11:55:19.7863637Z mid=0.0374
2026-02-21T11:55:19.7863800Z max=0.0603
2026-02-21T11:55:19.7864255Z best={'block_sizes': [1, 8192],
2026-02-21T11:55:19.7864565Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:55:19.7864905Z  'load_eviction_policies': ['', ''],
2026-02-21T11:55:19.7865153Z  'num_stages': 2,
2026-02-21T11:55:19.7865365Z  'num_warps': 4,
2026-02-21T11:55:19.7865561Z  'pid_type': 'flat',
2026-02-21T11:55:19.7865774Z  'range_flattens': [None, False],
2026-02-21T11:55:19.7866038Z  'range_multi_buffers': [None, False],
2026-02-21T11:55:19.7866303Z  'range_num_stages': [0, 2],
2026-02-21T11:55:19.7866543Z  'range_unroll_factors': [0, 2],
2026-02-21T11:55:19.7866785Z  'range_warp_specializes': []}
2026-02-21T11:55:19.7900532Z [217s] Fitting surrogate: 498 points, 498 targets
2026-02-21T11:55:20.7380612Z [218s] Generation 6 starting: 57 neighbors, 4 active search path(s)
2026-02-21T11:55:37.2496960Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 1.8 configs/s
2026-02-21T11:55:40.8179489Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 16.4 configs/s
2026-02-21T11:55:48.9407353Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 140.7         
2026-02-21T11:55:48.9407865Z                                                                   configs/s     
2026-02-21T11:55:49.5122647Z [247s] Generation 6 complete: 
2026-02-21T11:55:49.5122948Z ok=62
2026-02-21T11:55:49.5123129Z min=0.0337
2026-02-21T11:55:49.5123310Z mid=0.0369
2026-02-21T11:55:49.5123475Z max=0.7564
2026-02-21T11:55:49.5123664Z best={'block_sizes': [1, 8192],
2026-02-21T11:55:49.5124630Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:55:49.5125225Z  'load_eviction_policies': ['', ''],
2026-02-21T11:55:49.5126268Z  'num_stages': 2,
2026-02-21T11:55:49.5126643Z  'num_warps': 4,
2026-02-21T11:55:49.5126957Z  'pid_type': 'flat',
2026-02-21T11:55:49.5127307Z  'range_flattens': [None, False],
2026-02-21T11:55:49.5127806Z  'range_multi_buffers': [None, False],
2026-02-21T11:55:49.5128236Z  'range_num_stages': [0, 2],
2026-02-21T11:55:49.5128631Z  'range_unroll_factors': [0, 3],
2026-02-21T11:55:49.5129028Z  'range_warp_specializes': []}
2026-02-21T11:55:49.5153425Z [247s] Fitting surrogate: 560 points, 560 targets
2026-02-21T11:55:50.4389580Z [248s] Generation 7 starting: 54 neighbors, 4 active search path(s)
2026-02-21T11:56:05.8053955Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54/54 2.1 configs/s
2026-02-21T11:56:09.1341908Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 54/54 16.4 configs/s
2026-02-21T11:56:15.0733219Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 170.3         
2026-02-21T11:56:15.0733763Z                                                                   configs/s     
2026-02-21T11:56:15.5463723Z [273s] Generation 7 complete: 
2026-02-21T11:56:15.5464249Z ok=58
2026-02-21T11:56:15.5464432Z min=0.0342
2026-02-21T11:56:15.5464626Z mid=0.0374
2026-02-21T11:56:15.5464787Z max=0.5169
2026-02-21T11:56:15.5464975Z best={'block_sizes': [1, 8192],
2026-02-21T11:56:15.5465276Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:56:15.5465616Z  'load_eviction_policies': ['', ''],
2026-02-21T11:56:15.5465862Z  'num_stages': 2,
2026-02-21T11:56:15.5466054Z  'num_warps': 4,
2026-02-21T11:56:15.5466240Z  'pid_type': 'flat',
2026-02-21T11:56:15.5466452Z  'range_flattens': [None, False],
2026-02-21T11:56:15.5466712Z  'range_multi_buffers': [None, False],
2026-02-21T11:56:15.5466987Z  'range_num_stages': [0, 2],
2026-02-21T11:56:15.5467233Z  'range_unroll_factors': [0, 3],
2026-02-21T11:56:15.5467479Z  'range_warp_specializes': []}
2026-02-21T11:56:15.5510228Z [273s] Fitting surrogate: 618 points, 618 targets
2026-02-21T11:56:16.1945438Z [274s] Generation 8 starting: 33 neighbors, 3 active search path(s)
2026-02-21T11:56:25.8881577Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 2.3 configs/s
2026-02-21T11:56:27.9131496Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 33/33 16.6 configs/s
2026-02-21T11:56:31.4006250Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 289.1         
2026-02-21T11:56:31.4006692Z                                                                   configs/s     
2026-02-21T11:56:31.6889145Z [289s] Generation 8 complete: 
2026-02-21T11:56:31.6889594Z ok=36
2026-02-21T11:56:31.6890032Z min=0.0336
2026-02-21T11:56:31.6890326Z mid=0.0362
2026-02-21T11:56:31.6890611Z max=0.5161
2026-02-21T11:56:31.6890944Z best={'block_sizes': [1, 8192],
2026-02-21T11:56:31.6891486Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:56:31.6892054Z  'load_eviction_policies': ['', ''],
2026-02-21T11:56:31.6892461Z  'num_stages': 2,
2026-02-21T11:56:31.6892782Z  'num_warps': 4,
2026-02-21T11:56:31.6893843Z  'pid_type': 'flat',
2026-02-21T11:56:31.6894397Z  'range_flattens': [None, False],
2026-02-21T11:56:31.6894626Z  'range_multi_buffers': [None, False],
2026-02-21T11:56:31.6894873Z  'range_num_stages': [0, 2],
2026-02-21T11:56:31.6895079Z  'range_unroll_factors': [0, 3],
2026-02-21T11:56:31.6895290Z  'range_warp_specializes': []}
2026-02-21T11:56:31.6924493Z [289s] Fitting surrogate: 654 points, 654 targets
2026-02-21T11:56:32.1069372Z [290s] Generation 9 starting: 18 neighbors, 1 active search path(s)
2026-02-21T11:56:52.0998381Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 0.3 configs/s
2026-02-21T11:56:53.2375120Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 18/18 16.4 configs/s
2026-02-21T11:56:54.9855199Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 571.6         
2026-02-21T11:56:54.9855626Z                                                                   configs/s     
2026-02-21T11:56:55.1448731Z [313s] Generation 9 complete: 
2026-02-21T11:56:55.1449183Z ok=20
2026-02-21T11:56:55.1449470Z min=0.0342
2026-02-21T11:56:55.1449753Z mid=0.0401
2026-02-21T11:56:55.1450156Z max=1.0751
2026-02-21T11:56:55.1450499Z best={'block_sizes': [1, 8192],
2026-02-21T11:56:55.1451021Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:56:55.1451589Z  'load_eviction_policies': ['', ''],
2026-02-21T11:56:55.1451992Z  'num_stages': 2,
2026-02-21T11:56:55.1452320Z  'num_warps': 4,
2026-02-21T11:56:55.1452632Z  'pid_type': 'flat',
2026-02-21T11:56:55.1452981Z  'range_flattens': [None, False],
2026-02-21T11:56:55.1453397Z  'range_multi_buffers': [None, False],
2026-02-21T11:56:55.1453855Z  'range_num_stages': [0, 2],
2026-02-21T11:56:55.1454794Z  'range_unroll_factors': [0, 3],
2026-02-21T11:56:55.1455202Z  'range_warp_specializes': []}
2026-02-21T11:56:55.1484615Z [313s] Fitting surrogate: 674 points, 674 targets
2026-02-21T11:56:55.5337492Z [313s] Generation 10 starting: 17 neighbors, 1 active search path(s)
2026-02-21T11:57:09.1136318Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 0.6 configs/s
2026-02-21T11:57:10.1732975Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 16.7 configs/s
2026-02-21T11:57:11.1455561Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 1015.4        
2026-02-21T11:57:11.1456055Z                                                                   configs/s     
2026-02-21T11:57:11.2474209Z [329s] Generation 10 complete: 
2026-02-21T11:57:11.2474665Z ok=19
2026-02-21T11:57:11.2474944Z min=0.0341
2026-02-21T11:57:11.2475228Z mid=0.0914
2026-02-21T11:57:11.2475503Z max=0.7628
2026-02-21T11:57:11.2475808Z best={'block_sizes': [1, 8192],
2026-02-21T11:57:11.2476310Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:57:11.2476886Z  'load_eviction_policies': ['', ''],
2026-02-21T11:57:11.2477302Z  'num_stages': 2,
2026-02-21T11:57:11.2477612Z  'num_warps': 4,
2026-02-21T11:57:11.2477937Z  'pid_type': 'flat',
2026-02-21T11:57:11.2478328Z  'range_flattens': [None, False],
2026-02-21T11:57:11.2478784Z  'range_multi_buffers': [None, False],
2026-02-21T11:57:11.2479247Z  'range_num_stages': [0, 2],
2026-02-21T11:57:11.2480236Z  'range_unroll_factors': [0, 3],
2026-02-21T11:57:11.2480668Z  'range_warp_specializes': []}
2026-02-21T11:57:11.2511554Z [329s] Fitting surrogate: 693 points, 693 targets
2026-02-21T11:57:11.6828744Z [329s] Generation 11 starting: 19 neighbors, 1 active search path(s)
2026-02-21T11:57:17.5157429Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 3.4 configs/s
2026-02-21T11:57:18.6987516Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.7 configs/s
2026-02-21T11:57:21.0839752Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 420.7         
2026-02-21T11:57:21.0840274Z                                                                   configs/s     
2026-02-21T11:57:21.2898283Z [339s] Generation 11 complete: 
2026-02-21T11:57:21.2898873Z ok=21
2026-02-21T11:57:21.2899548Z min=0.0341
2026-02-21T11:57:21.2899743Z mid=0.0364
2026-02-21T11:57:21.2899907Z max=0.0987
2026-02-21T11:57:21.2900090Z best={'block_sizes': [1, 8192],
2026-02-21T11:57:21.2900393Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:57:21.2900753Z  'load_eviction_policies': ['', ''],
2026-02-21T11:57:21.2900999Z  'num_stages': 2,
2026-02-21T11:57:21.2901192Z  'num_warps': 4,
2026-02-21T11:57:21.2901382Z  'pid_type': 'flat',
2026-02-21T11:57:21.2901598Z  'range_flattens': [None, False],
2026-02-21T11:57:21.2901851Z  'range_multi_buffers': [None, False],
2026-02-21T11:57:21.2902128Z  'range_num_stages': [0, 2],
2026-02-21T11:57:21.2902366Z  'range_unroll_factors': [0, 3],
2026-02-21T11:57:21.2902611Z  'range_warp_specializes': []}
2026-02-21T11:57:21.2940087Z [339s] Fitting surrogate: 714 points, 714 targets
2026-02-21T11:57:21.6724783Z [339s] Generation 12 starting: 16 neighbors, 1 active search path(s)
2026-02-21T11:57:29.3480432Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16/16 1.1 configs/s
2026-02-21T11:57:30.3535170Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 16/16 16.6 configs/s
2026-02-21T11:57:32.8930101Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 624.6         
2026-02-21T11:57:32.8930646Z                                                                   configs/s     
2026-02-21T11:57:33.0455187Z [351s] Generation 12 complete: 
2026-02-21T11:57:33.0455411Z ok=18
2026-02-21T11:57:33.0455572Z min=0.0345
2026-02-21T11:57:33.0455742Z mid=0.0365
2026-02-21T11:57:33.0455911Z max=0.7125
2026-02-21T11:57:33.0456094Z best={'block_sizes': [1, 8192],
2026-02-21T11:57:33.0456395Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:57:33.0456721Z  'load_eviction_policies': ['', ''],
2026-02-21T11:57:33.0456974Z  'num_stages': 2,
2026-02-21T11:57:33.0457157Z  'num_warps': 4,
2026-02-21T11:57:33.0457358Z  'pid_type': 'flat',
2026-02-21T11:57:33.0457565Z  'range_flattens': [None, False],
2026-02-21T11:57:33.0457834Z  'range_multi_buffers': [None, False],
2026-02-21T11:57:33.0458092Z  'range_num_stages': [0, 2],
2026-02-21T11:57:33.0458329Z  'range_unroll_factors': [0, 3],
2026-02-21T11:57:33.0458574Z  'range_warp_specializes': []}
2026-02-21T11:57:33.0486049Z [351s] Fitting surrogate: 732 points, 732 targets
2026-02-21T11:57:33.4409309Z [351s] Generation 13 starting: 17 neighbors, 1 active search path(s)
2026-02-21T11:57:39.0183937Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 3.5 configs/s
2026-02-21T11:57:40.0846093Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 16.6 configs/s
2026-02-21T11:57:41.6879945Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 622.7         
2026-02-21T11:57:41.6880779Z                                                                   configs/s     
2026-02-21T11:57:41.8367860Z [359s] Generation 13 complete: 
2026-02-21T11:57:41.8368147Z ok=19
2026-02-21T11:57:41.8368339Z min=0.0337
2026-02-21T11:57:41.8368519Z mid=0.0359
2026-02-21T11:57:41.8368725Z max=0.1824
2026-02-21T11:57:41.8368917Z best={'block_sizes': [1, 8192],
2026-02-21T11:57:41.8369239Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:57:41.8370162Z  'load_eviction_policies': ['', ''],
2026-02-21T11:57:41.8370434Z  'num_stages': 2,
2026-02-21T11:57:41.8370641Z  'num_warps': 4,
2026-02-21T11:57:41.8370839Z  'pid_type': 'flat',
2026-02-21T11:57:41.8371066Z  'range_flattens': [None, False],
2026-02-21T11:57:41.8371328Z  'range_multi_buffers': [None, False],
2026-02-21T11:57:41.8371602Z  'range_num_stages': [0, 2],
2026-02-21T11:57:41.8371856Z  'range_unroll_factors': [0, 3],
2026-02-21T11:57:41.8372100Z  'range_warp_specializes': []}
2026-02-21T11:57:41.8404820Z [359s] Fitting surrogate: 751 points, 751 targets
2026-02-21T11:57:42.1696853Z [360s] Generation 14 starting: 13 neighbors, 1 active search path(s)
2026-02-21T11:57:46.6998223Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 4.5 configs/s
2026-02-21T11:57:47.5175745Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 16.8 configs/s
2026-02-21T11:57:48.8652687Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 738.4         
2026-02-21T11:57:48.8653146Z                                                                   configs/s     
2026-02-21T11:57:48.9950218Z [366s] Generation 14 complete: 
2026-02-21T11:57:48.9950456Z ok=15
2026-02-21T11:57:48.9950616Z min=0.0340
2026-02-21T11:57:48.9950771Z mid=0.0353
2026-02-21T11:57:48.9950930Z max=0.0986
2026-02-21T11:57:48.9951098Z best={'block_sizes': [1, 8192],
2026-02-21T11:57:48.9951384Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T11:57:48.9951695Z  'load_eviction_policies': ['', ''],
2026-02-21T11:57:48.9951926Z  'num_stages': 2,
2026-02-21T11:57:48.9952107Z  'num_warps': 4,
2026-02-21T11:57:48.9952281Z  'pid_type': 'flat',
2026-02-21T11:57:48.9952487Z  'range_flattens': [None, False],
2026-02-21T11:57:48.9952733Z  'range_multi_buffers': [None, False],
2026-02-21T11:57:48.9952990Z  'range_num_stages': [0, 2],
2026-02-21T11:57:48.9953209Z  'range_unroll_factors': [0, 3],
2026-02-21T11:57:48.9953447Z  'range_warp_specializes': []}
2026-02-21T11:57:48.9988833Z [366s] Fitting surrogate: 766 points, 766 targets
2026-02-21T11:57:49.1559211Z [367s] Autotuning complete in 367.1s after searching 722 configs.
2026-02-21T11:57:49.1559653Z One can hardcode the best config and skip autotuning with:
2026-02-21T11:57:49.1561021Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['', ''], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[0, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T11:57:49.1562248Z 
2026-02-21T11:57:49.1562618Z [367s] Code of selected kernel: /tmp/torchinductor_root/6n/c6nwcrly575khi5ehh4fy44ckyficnl2dbga6uklvjubzalgunvz.py
2026-02-21T11:57:49.1883617Z from __future__ import annotations
2026-02-21T11:57:49.1883795Z 
2026-02-21T11:57:49.1883874Z import torch
2026-02-21T11:57:49.1884174Z import triton
2026-02-21T11:57:49.1884371Z import triton.language as tl
2026-02-21T11:57:49.1884638Z from torch._inductor.runtime import triton_helpers
2026-02-21T11:57:49.1885001Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T11:57:49.1885396Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T11:57:49.1885654Z 
2026-02-21T11:57:49.1885737Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T11:57:49.1886004Z _BLOCK_SIZE_1 = tl.constexpr(8192)
2026-02-21T11:57:49.1886160Z 
2026-02-21T11:57:49.1886226Z @triton.jit
2026-02-21T11:57:49.1886412Z def _helion_softmax_two_pass(x, out):
2026-02-21T11:57:49.1886752Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:57:49.1887104Z     pid_0 = tl.program_id(0)
2026-02-21T11:57:49.1887320Z     offset_0 = pid_0
2026-02-21T11:57:49.1887537Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T11:57:49.1887917Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:57:49.1888324Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T11:57:49.1889161Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:57:49.1889512Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T11:57:49.1889936Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:57:49.1890328Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T11:57:49.1890670Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T11:57:49.1890987Z     # src[softmax.py:82-89]: ...
2026-02-21T11:57:49.1891497Z     for offset_2 in tl.range(0, 5504, _BLOCK_SIZE_1, loop_unroll_factor=3, num_stages=1, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T11:57:49.1892114Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:57:49.1892669Z         mask_1 = indices_2 < 5504
2026-02-21T11:57:49.1892890Z         mi_copy = mi
2026-02-21T11:57:49.1893071Z         di_copy = di
2026-02-21T11:57:49.1893248Z         mi_copy_0 = mi_copy
2026-02-21T11:57:49.1893458Z         di_copy_0 = di_copy
2026-02-21T11:57:49.1893692Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T11:57:49.1894289Z         values = tl.load(x + (indices_0[:, None] * 5504 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T11:57:49.1894799Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T11:57:49.1895415Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T11:57:49.1896016Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T11:57:49.1896380Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T11:57:49.1896719Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T11:57:49.1897013Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T11:57:49.1897397Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:57:49.1897743Z         v_2 = mi_copy_0 - v_1
2026-02-21T11:57:49.1897955Z         v_3 = libdevice.exp(v_2)
2026-02-21T11:57:49.1898174Z         v_4 = di_copy_0 * v_3
2026-02-21T11:57:49.1898391Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T11:57:49.1898642Z         subscript = v_1[:, None]
2026-02-21T11:57:49.1898840Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T11:57:49.1899055Z         v_6 = v_5 - subscript
2026-02-21T11:57:49.1899311Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T11:57:49.1899653Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T11:57:49.1899917Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T11:57:49.1900139Z         v_7 = libdevice.exp(v_6)
2026-02-21T11:57:49.1900566Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T11:57:49.1901038Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T11:57:49.1901293Z         di = v_4 + sum_1
2026-02-21T11:57:49.1901481Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T11:57:49.1901692Z         mi = v_1
2026-02-21T11:57:49.1901934Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T11:57:49.1902265Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T11:57:49.1902652Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:57:49.1903243Z     for offset_2 in tl.range(0, 5504, _BLOCK_SIZE_1, loop_unroll_factor=3, num_stages=1, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T11:57:49.1903787Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T11:57:49.1904203Z         mask_2 = indices_2 < 5504
2026-02-21T11:57:49.1904414Z         mi_copy_1 = mi
2026-02-21T11:57:49.1904586Z         di_copy_1 = di
2026-02-21T11:57:49.1904751Z         mi_copy_1_0 = mi_copy_1
2026-02-21T11:57:49.1905116Z         di_copy_1_0 = di_copy_1
2026-02-21T11:57:49.1905337Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T11:57:49.1905737Z         values_1 = tl.load(x + (indices_0[:, None] * 5504 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T11:57:49.1906233Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T11:57:49.1906595Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T11:57:49.1906825Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T11:57:49.1907051Z         v_10 = v_9 - subscript_1
2026-02-21T11:57:49.1907253Z         v_11 = libdevice.exp(v_10)
2026-02-21T11:57:49.1907458Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T11:57:49.1907672Z         v_12 = v_11 / subscript_2
2026-02-21T11:57:49.1908013Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T11:57:49.1908366Z         tl.store(out + (indices_0[:, None] * 5504 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T11:57:49.1908646Z 
2026-02-21T11:57:49.1908810Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T11:57:49.1909101Z     """
2026-02-21T11:57:49.1909360Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T11:57:49.1909745Z     This version uses fewer passes but is less numerically stable.
2026-02-21T11:57:49.1910033Z     Args:
2026-02-21T11:57:49.1910213Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T11:57:49.1910451Z     Returns:
2026-02-21T11:57:49.1910654Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T11:57:49.1910911Z     """
2026-02-21T11:57:49.1911061Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T11:57:49.1911274Z     m, n = x.size()
2026-02-21T11:57:49.1911467Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T11:57:49.1911715Z     out = torch.empty_like(x)
2026-02-21T11:57:49.1911988Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T11:57:49.1912381Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T11:57:49.1912778Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T11:57:49.1913069Z     # src[softmax.py:79-92]: ...
2026-02-21T11:57:49.1913390Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=4, num_stages=2)
2026-02-21T11:57:49.1913730Z     # src[softmax.py:93]: return out
2026-02-21T11:57:49.1913928Z     return out
2026-02-21T11:57:50.3958851Z WARNING:tritonbench.utils.triton_op:Completed input ID 41:
2026-02-21T11:57:50.3959493Z (M, N)
2026-02-21T11:57:50.3959772Z ------------
2026-02-21T11:57:50.3960072Z (4096, 5504)
2026-02-21T11:57:50.3960235Z 
2026-02-21T11:57:50.3978590Z  45%|████▌     | 9/20 [54:45<1:13:26, 400.55s/it]WARNING:tritonbench.utils.triton_op:Running input ID 46:
2026-02-21T11:57:50.3979045Z (M, N)
2026-02-21T11:57:50.3979211Z ------------
2026-02-21T11:57:50.3979394Z (4096, 6144)
2026-02-21T11:57:50.3981062Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T11:57:51.8959718Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T11:57:53.5846941Z INFO:tritonbench.utils.triton_op:Took 3.13ms to get benchmark function for torch_compile_softmax
2026-02-21T11:57:55.0275334Z WARNING:__main__:Input tensor metadata:
2026-02-21T11:57:55.0275865Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T11:57:55.0276295Z               'dtype': 'torch.float16',
2026-02-21T11:57:55.0276743Z               'shape': (4096, 6144),
2026-02-21T11:57:55.0277160Z               'stride': (6144, 1)},),
2026-02-21T11:57:55.0277561Z   'kwargs': {}}
2026-02-21T11:57:55.0312559Z INFO:tritonbench.utils.triton_op:Took 4.06ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T11:57:55.3277387Z [0s] Autotune random seed: 2145258556
2026-02-21T11:57:55.3641271Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T11:58:29.9976786Z [34s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:58:30.2787356Z [34s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T11:58:35.0857958Z [39s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T11:58:37.3953780Z [42s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T11:58:38.4204951Z [43s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T11:58:38.6765175Z [43s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T11:58:41.0375764Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T11:58:48.6874284Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 13.1 configs/s
2026-02-21T11:58:48.6888379Z [53s] Adaptive compile timeout: 30s (90% percentile=21.1s, bounds=[30.0s, 30s])
2026-02-21T11:58:50.1732429Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 666.7 configs/s
2026-02-21T11:58:50.3022249Z [54s] Initial random population of 100, 5 starting points: 
2026-02-21T11:58:50.3023034Z error=4
2026-02-21T11:58:50.3023207Z timeout=6
2026-02-21T11:58:50.3023371Z ok=90
2026-02-21T11:58:50.3023541Z min=0.0543
2026-02-21T11:58:50.3023707Z mid=0.5006
2026-02-21T11:58:50.3023877Z max=82.3355
2026-02-21T11:58:50.3024254Z best={'block_sizes': [1, 2048],
2026-02-21T11:58:50.3024572Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T11:58:50.3024908Z  'load_eviction_policies': ['', 'last'],
2026-02-21T11:58:50.3025171Z  'maxnreg': 64,
2026-02-21T11:58:50.3025387Z  'num_sm_multiplier': 8,
2026-02-21T11:58:50.3025611Z  'num_stages': 1,
2026-02-21T11:58:50.3025805Z  'num_warps': 8,
2026-02-21T11:58:50.3026019Z  'pid_type': 'persistent_blocked',
2026-02-21T11:58:50.3026281Z  'range_flattens': [True, True],
2026-02-21T11:58:50.3026836Z  'range_multi_buffers': [False, False],
2026-02-21T11:58:50.3027121Z  'range_num_stages': [4, 3],
2026-02-21T11:58:50.3027365Z  'range_unroll_factors': [1, 2],
2026-02-21T11:58:50.3027623Z  'range_warp_specializes': []}
2026-02-21T11:58:50.3041867Z [54s] Fitting surrogate: 100 points, 100 targets
2026-02-21T11:58:51.7964702Z [56s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T11:59:19.3523522Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 1.3 configs/s
2026-02-21T11:59:24.8585191Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 16.8 configs/s
2026-02-21T11:59:29.6996928Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 208.1         
2026-02-21T11:59:29.7002397Z                                                                   configs/s     
2026-02-21T11:59:30.0522919Z [94s] Generation 1 complete: 
2026-02-21T11:59:30.0523355Z error=4
2026-02-21T11:59:30.0523656Z ok=91
2026-02-21T11:59:30.0523938Z min=0.0381
2026-02-21T11:59:30.0524756Z mid=0.0692
2026-02-21T11:59:30.0525023Z max=0.3672
2026-02-21T11:59:30.0525327Z best={'block_sizes': [1, 8192],
2026-02-21T11:59:30.0525891Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T11:59:30.0526579Z  'load_eviction_policies': ['', 'first'],
2026-02-21T11:59:30.0527007Z  'num_stages': 1,
2026-02-21T11:59:30.0527336Z  'num_warps': 8,
2026-02-21T11:59:30.0527662Z  'pid_type': 'flat',
2026-02-21T11:59:30.0528053Z  'range_flattens': [None, None],
2026-02-21T11:59:30.0528374Z  'range_multi_buffers': [None, None],
2026-02-21T11:59:30.0528607Z  'range_num_stages': [0, 1],
2026-02-21T11:59:30.0528820Z  'range_unroll_factors': [0, 3],
2026-02-21T11:59:30.0529036Z  'range_warp_specializes': []}
2026-02-21T11:59:30.0544955Z [94s] Fitting surrogate: 195 points, 195 targets
2026-02-21T11:59:31.4096446Z [96s] Generation 2 starting: 85 neighbors, 5 active search path(s)
2026-02-21T11:59:53.4617235Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 5.5 configs/s
2026-02-21T11:59:59.6961110Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 14.0 configs/s
2026-02-21T12:00:06.9586084Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 139.2         
2026-02-21T12:00:06.9586847Z                                                                   configs/s     
2026-02-21T12:00:07.4925009Z [132s] Generation 2 complete: 
2026-02-21T12:00:07.4927158Z error=1
2026-02-21T12:00:07.4927414Z ok=89
2026-02-21T12:00:07.4927610Z min=0.0371
2026-02-21T12:00:07.4927800Z mid=0.0543
2026-02-21T12:00:07.4927973Z max=0.7408
2026-02-21T12:00:07.4928168Z best={'block_sizes': [1, 8192],
2026-02-21T12:00:07.4928494Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:00:07.4928844Z  'load_eviction_policies': ['', ''],
2026-02-21T12:00:07.4929120Z  'num_stages': 2,
2026-02-21T12:00:07.4929325Z  'num_warps': 8,
2026-02-21T12:00:07.4929530Z  'pid_type': 'flat',
2026-02-21T12:00:07.4929836Z  'range_flattens': [None, True],
2026-02-21T12:00:07.4930126Z  'range_multi_buffers': [None, None],
2026-02-21T12:00:07.4930405Z  'range_num_stages': [0, 2],
2026-02-21T12:00:07.4930662Z  'range_unroll_factors': [0, 1],
2026-02-21T12:00:07.4930914Z  'range_warp_specializes': []}
2026-02-21T12:00:07.4946130Z [132s] Fitting surrogate: 285 points, 285 targets
2026-02-21T12:00:08.9700046Z [133s] Generation 3 starting: 79 neighbors, 5 active search path(s)
2026-02-21T12:00:38.1255206Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 1.2 configs/s
2026-02-21T12:00:42.9138692Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 16.9 configs/s
2026-02-21T12:00:50.9591084Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.7         
2026-02-21T12:00:50.9596177Z                                                                   configs/s     
2026-02-21T12:00:51.5689917Z [176s] Generation 3 complete: 
2026-02-21T12:00:51.5690416Z error=3
2026-02-21T12:00:51.5690705Z ok=81
2026-02-21T12:00:51.5690976Z min=0.0368
2026-02-21T12:00:51.5691935Z mid=0.0462
2026-02-21T12:00:51.5692268Z max=0.5466
2026-02-21T12:00:51.5692585Z best={'block_sizes': [1, 8192],
2026-02-21T12:00:51.5693096Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:00:51.5693727Z  'load_eviction_policies': ['', ''],
2026-02-21T12:00:51.5694492Z  'num_stages': 1,
2026-02-21T12:00:51.5694872Z  'num_warps': 4,
2026-02-21T12:00:51.5695254Z  'pid_type': 'flat',
2026-02-21T12:00:51.5695628Z  'range_flattens': [None, True],
2026-02-21T12:00:51.5695881Z  'range_multi_buffers': [None, None],
2026-02-21T12:00:51.5696138Z  'range_num_stages': [0, 2],
2026-02-21T12:00:51.5696375Z  'range_unroll_factors': [0, 0],
2026-02-21T12:00:51.5696618Z  'range_warp_specializes': []}
2026-02-21T12:00:51.5718220Z [176s] Fitting surrogate: 369 points, 369 targets
2026-02-21T12:00:52.6972230Z [177s] Generation 4 starting: 62 neighbors, 5 active search path(s)
2026-02-21T12:01:09.2377435Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 5.3 configs/s
2026-02-21T12:01:13.0539290Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 17.0 configs/s
2026-02-21T12:01:20.4445362Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 156.3         
2026-02-21T12:01:20.4445924Z                                                                   configs/s     
2026-02-21T12:01:20.9448397Z [205s] Generation 4 complete: 
2026-02-21T12:01:20.9448838Z error=2
2026-02-21T12:01:20.9449107Z ok=66
2026-02-21T12:01:20.9449377Z min=0.0367
2026-02-21T12:01:20.9449655Z mid=0.0412
2026-02-21T12:01:20.9449928Z max=0.1013
2026-02-21T12:01:20.9450347Z best={'block_sizes': [1, 8192],
2026-02-21T12:01:20.9450873Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:01:20.9451424Z  'load_eviction_policies': ['', ''],
2026-02-21T12:01:20.9451844Z  'num_stages': 1,
2026-02-21T12:01:20.9452161Z  'num_warps': 4,
2026-02-21T12:01:20.9452472Z  'pid_type': 'flat',
2026-02-21T12:01:20.9452832Z  'range_flattens': [None, True],
2026-02-21T12:01:20.9453266Z  'range_multi_buffers': [None, None],
2026-02-21T12:01:20.9453702Z  'range_num_stages': [0, 2],
2026-02-21T12:01:20.9454651Z  'range_unroll_factors': [0, 0],
2026-02-21T12:01:20.9455086Z  'range_warp_specializes': []}
2026-02-21T12:01:20.9473084Z [205s] Fitting surrogate: 437 points, 437 targets
2026-02-21T12:01:21.8790815Z [206s] Generation 5 starting: 57 neighbors, 5 active search path(s)
2026-02-21T12:01:39.4607923Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 1.3 configs/s
2026-02-21T12:01:43.0138504Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 16.5 configs/s
2026-02-21T12:01:49.1640891Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 164.4         
2026-02-21T12:01:49.1646117Z                                                                   configs/s     
2026-02-21T12:01:49.6438681Z [234s] Generation 5 complete: 
2026-02-21T12:01:49.6438999Z ok=63
2026-02-21T12:01:49.6439183Z min=0.0370
2026-02-21T12:01:49.6439366Z mid=0.0392
2026-02-21T12:01:49.6439589Z max=0.2498
2026-02-21T12:01:49.6439800Z best={'block_sizes': [1, 8192],
2026-02-21T12:01:49.6440130Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:01:49.6441134Z  'load_eviction_policies': ['', ''],
2026-02-21T12:01:49.6441402Z  'num_stages': 2,
2026-02-21T12:01:49.6441617Z  'num_warps': 8,
2026-02-21T12:01:49.6441828Z  'pid_type': 'flat',
2026-02-21T12:01:49.6442053Z  'range_flattens': [None, True],
2026-02-21T12:01:49.6442324Z  'range_multi_buffers': [None, False],
2026-02-21T12:01:49.6442596Z  'range_num_stages': [0, 2],
2026-02-21T12:01:49.6442840Z  'range_unroll_factors': [0, 2],
2026-02-21T12:01:49.6443110Z  'range_warp_specializes': []}
2026-02-21T12:01:49.6473868Z [234s] Fitting surrogate: 500 points, 500 targets
2026-02-21T12:01:50.3953108Z [235s] Generation 6 starting: 45 neighbors, 4 active search path(s)
2026-02-21T12:02:02.4199647Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46/46 5.6 configs/s
2026-02-21T12:02:05.2242808Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 46/46 16.7 configs/s
2026-02-21T12:02:11.2106631Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 168.9         
2026-02-21T12:02:11.2107187Z                                                                   configs/s     
2026-02-21T12:02:11.6726214Z [256s] Generation 6 complete: 
2026-02-21T12:02:11.6726512Z ok=49
2026-02-21T12:02:11.6726691Z min=0.0403
2026-02-21T12:02:11.6726879Z mid=0.0415
2026-02-21T12:02:11.6727045Z max=0.0634
2026-02-21T12:02:11.6727239Z best={'block_sizes': [1, 8192],
2026-02-21T12:02:11.6727533Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:02:11.6727853Z  'load_eviction_policies': ['', ''],
2026-02-21T12:02:11.6728113Z  'num_stages': 5,
2026-02-21T12:02:11.6728331Z  'num_warps': 4,
2026-02-21T12:02:11.6728529Z  'pid_type': 'flat',
2026-02-21T12:02:11.6728756Z  'range_flattens': [None, False],
2026-02-21T12:02:11.6729025Z  'range_multi_buffers': [None, None],
2026-02-21T12:02:11.6729288Z  'range_num_stages': [0, 0],
2026-02-21T12:02:11.6729558Z  'range_unroll_factors': [0, 2],
2026-02-21T12:02:11.6729805Z  'range_warp_specializes': []}
2026-02-21T12:02:11.6758887Z [256s] Fitting surrogate: 549 points, 549 targets
2026-02-21T12:02:12.4516384Z [257s] Generation 7 starting: 46 neighbors, 4 active search path(s)
2026-02-21T12:02:25.8599672Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 3.6 configs/s
2026-02-21T12:02:28.8834618Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.4 configs/s
2026-02-21T12:02:35.2967868Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 186.4         
2026-02-21T12:02:35.2970536Z                                                                   configs/s     
2026-02-21T12:02:35.7171300Z [280s] Generation 7 complete: 
2026-02-21T12:02:35.7171588Z ok=51
2026-02-21T12:02:35.7171783Z min=0.0369
2026-02-21T12:02:35.7171965Z mid=0.0396
2026-02-21T12:02:35.7172145Z max=0.2442
2026-02-21T12:02:35.7172344Z best={'block_sizes': [1, 8192],
2026-02-21T12:02:35.7172783Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:02:35.7173220Z  'load_eviction_policies': ['', ''],
2026-02-21T12:02:35.7173504Z  'num_stages': 1,
2026-02-21T12:02:35.7173705Z  'num_warps': 4,
2026-02-21T12:02:35.7173904Z  'pid_type': 'flat',
2026-02-21T12:02:35.7174332Z  'range_flattens': [None, True],
2026-02-21T12:02:35.7174588Z  'range_multi_buffers': [None, True],
2026-02-21T12:02:35.7174859Z  'range_num_stages': [0, 2],
2026-02-21T12:02:35.7175096Z  'range_unroll_factors': [0, 0],
2026-02-21T12:02:35.7175347Z  'range_warp_specializes': []}
2026-02-21T12:02:35.7204117Z [280s] Fitting surrogate: 600 points, 600 targets
2026-02-21T12:02:36.4911710Z [281s] Generation 8 starting: 45 neighbors, 4 active search path(s)
2026-02-21T12:02:48.1578381Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 6.0 configs/s
2026-02-21T12:02:50.9094913Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 45/45 16.6 configs/s
2026-02-21T12:02:57.0295490Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 165.2         
2026-02-21T12:02:57.0297035Z                                                                   configs/s     
2026-02-21T12:02:57.5097621Z [302s] Generation 8 complete: 
2026-02-21T12:02:57.5097920Z ok=49
2026-02-21T12:02:57.5098114Z min=0.0369
2026-02-21T12:02:57.5098293Z mid=0.0372
2026-02-21T12:02:57.5098466Z max=0.0568
2026-02-21T12:02:57.5098649Z best={'block_sizes': [1, 8192],
2026-02-21T12:02:57.5099040Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:02:57.5099470Z  'load_eviction_policies': ['', ''],
2026-02-21T12:02:57.5099734Z  'num_stages': 1,
2026-02-21T12:02:57.5099940Z  'num_warps': 4,
2026-02-21T12:02:57.5100135Z  'pid_type': 'flat',
2026-02-21T12:02:57.5100364Z  'range_flattens': [None, True],
2026-02-21T12:02:57.5100620Z  'range_multi_buffers': [None, True],
2026-02-21T12:02:57.5100887Z  'range_num_stages': [0, 1],
2026-02-21T12:02:57.5101787Z  'range_unroll_factors': [0, 0],
2026-02-21T12:02:57.5102064Z  'range_warp_specializes': []}
2026-02-21T12:02:57.5131757Z [302s] Fitting surrogate: 649 points, 649 targets
2026-02-21T12:02:58.3181720Z [302s] Generation 9 starting: 48 neighbors, 4 active search path(s)
2026-02-21T12:03:11.1882663Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 2.6 configs/s
2026-02-21T12:03:14.1454670Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.5 configs/s
2026-02-21T12:03:20.5786657Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 157.3         
2026-02-21T12:03:20.5787154Z                                                                   configs/s     
2026-02-21T12:03:21.0894326Z [325s] Generation 9 complete: 
2026-02-21T12:03:21.0894637Z ok=52
2026-02-21T12:03:21.0894819Z min=0.0371
2026-02-21T12:03:21.0895000Z mid=0.0372
2026-02-21T12:03:21.0895176Z max=0.0554
2026-02-21T12:03:21.0895371Z best={'block_sizes': [1, 8192],
2026-02-21T12:03:21.0895789Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:03:21.0896211Z  'load_eviction_policies': ['', ''],
2026-02-21T12:03:21.0896462Z  'num_stages': 1,
2026-02-21T12:03:21.0896683Z  'num_warps': 4,
2026-02-21T12:03:21.0896893Z  'pid_type': 'flat',
2026-02-21T12:03:21.0897128Z  'range_flattens': [None, True],
2026-02-21T12:03:21.0897400Z  'range_multi_buffers': [None, True],
2026-02-21T12:03:21.0897665Z  'range_num_stages': [0, 1],
2026-02-21T12:03:21.0897906Z  'range_unroll_factors': [0, 0],
2026-02-21T12:03:21.0898153Z  'range_warp_specializes': []}
2026-02-21T12:03:21.0932908Z [325s] Fitting surrogate: 701 points, 701 targets
2026-02-21T12:03:21.4971837Z [326s] Generation 10 starting: 17 neighbors, 2 active search path(s)
2026-02-21T12:03:26.5127474Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 7.6 configs/s
2026-02-21T12:03:27.5670746Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 16.8 configs/s
2026-02-21T12:03:30.1408321Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 390.1         
2026-02-21T12:03:30.1408812Z                                                                   configs/s     
2026-02-21T12:03:30.3549276Z [334s] Generation 10 complete: 
2026-02-21T12:03:30.3549715Z ok=20
2026-02-21T12:03:30.3549995Z min=0.0400
2026-02-21T12:03:30.3550280Z mid=0.0403
2026-02-21T12:03:30.3550547Z max=0.0516
2026-02-21T12:03:30.3550874Z best={'block_sizes': [1, 8192],
2026-02-21T12:03:30.3551380Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T12:03:30.3551940Z  'load_eviction_policies': ['', ''],
2026-02-21T12:03:30.3552342Z  'num_stages': 2,
2026-02-21T12:03:30.3552660Z  'num_warps': 4,
2026-02-21T12:03:30.3553006Z  'pid_type': 'flat',
2026-02-21T12:03:30.3553364Z  'range_flattens': [None, None],
2026-02-21T12:03:30.3553784Z  'range_multi_buffers': [None, False],
2026-02-21T12:03:30.3554929Z  'range_num_stages': [0, 1],
2026-02-21T12:03:30.3555333Z  'range_unroll_factors': [0, 0],
2026-02-21T12:03:30.3556262Z  'range_warp_specializes': []}
2026-02-21T12:03:30.3583289Z [334s] Fitting surrogate: 721 points, 721 targets
2026-02-21T12:03:30.8713972Z [335s] Generation 11 starting: 23 neighbors, 2 active search path(s)
2026-02-21T12:03:52.5234579Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 0.2 configs/s
2026-02-21T12:03:54.0617855Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 16.7 configs/s
2026-02-21T12:03:57.1391721Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 326.9         
2026-02-21T12:03:57.1392239Z                                                                   configs/s     
2026-02-21T12:03:57.3918791Z [362s] Generation 11 complete: 
2026-02-21T12:03:57.3919250Z ok=26
2026-02-21T12:03:57.3919528Z min=0.0369
2026-02-21T12:03:57.3919814Z mid=0.0393
2026-02-21T12:03:57.3920076Z max=0.7034
2026-02-21T12:03:57.3920395Z best={'block_sizes': [1, 8192],
2026-02-21T12:03:57.3920897Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:03:57.3921447Z  'load_eviction_policies': ['', ''],
2026-02-21T12:03:57.3921870Z  'num_stages': 2,
2026-02-21T12:03:57.3922176Z  'num_warps': 4,
2026-02-21T12:03:57.3922502Z  'pid_type': 'flat',
2026-02-21T12:03:57.3922893Z  'range_flattens': [None, None],
2026-02-21T12:03:57.3923300Z  'range_multi_buffers': [None, False],
2026-02-21T12:03:57.3923733Z  'range_num_stages': [0, 1],
2026-02-21T12:03:57.3924624Z  'range_unroll_factors': [0, 0],
2026-02-21T12:03:57.3925056Z  'range_warp_specializes': []}
2026-02-21T12:03:57.3959302Z [362s] Fitting surrogate: 747 points, 747 targets
2026-02-21T12:03:57.9075415Z [362s] Generation 12 starting: 23 neighbors, 2 active search path(s)
2026-02-21T12:04:05.0326536Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 4.8 configs/s
2026-02-21T12:04:06.4364856Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 23/23 16.9 configs/s
2026-02-21T12:04:10.6035362Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 318.7         
2026-02-21T12:04:10.6035899Z                                                                   configs/s     
2026-02-21T12:04:10.8654950Z [375s] Generation 12 complete: 
2026-02-21T12:04:10.8655190Z ok=25
2026-02-21T12:04:10.8655387Z min=0.0370
2026-02-21T12:04:10.8655550Z mid=0.0372
2026-02-21T12:04:10.8655718Z max=0.0522
2026-02-21T12:04:10.8655904Z best={'block_sizes': [1, 8192],
2026-02-21T12:04:10.8656213Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:04:10.8656547Z  'load_eviction_policies': ['', ''],
2026-02-21T12:04:10.8656793Z  'num_stages': 2,
2026-02-21T12:04:10.8656985Z  'num_warps': 4,
2026-02-21T12:04:10.8657173Z  'pid_type': 'flat',
2026-02-21T12:04:10.8657386Z  'range_flattens': [None, None],
2026-02-21T12:04:10.8657637Z  'range_multi_buffers': [None, False],
2026-02-21T12:04:10.8657902Z  'range_num_stages': [0, 0],
2026-02-21T12:04:10.8658130Z  'range_unroll_factors': [0, 0],
2026-02-21T12:04:10.8658377Z  'range_warp_specializes': []}
2026-02-21T12:04:10.8686799Z [375s] Fitting surrogate: 772 points, 772 targets
2026-02-21T12:04:11.3548676Z [375s] Generation 13 starting: 24 neighbors, 2 active search path(s)
2026-02-21T12:04:18.7022590Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 2.4 configs/s
2026-02-21T12:04:20.1678689Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 16.9 configs/s
2026-02-21T12:04:23.4541698Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 306.4         
2026-02-21T12:04:23.4542982Z                                                                   configs/s     
2026-02-21T12:04:23.7266888Z [388s] Generation 13 complete: 
2026-02-21T12:04:23.7267143Z ok=26
2026-02-21T12:04:23.7267333Z min=0.0370
2026-02-21T12:04:23.7267509Z mid=0.0372
2026-02-21T12:04:23.7267671Z max=0.0462
2026-02-21T12:04:23.7267860Z best={'block_sizes': [1, 8192],
2026-02-21T12:04:23.7268189Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:04:23.7268558Z  'load_eviction_policies': ['', ''],
2026-02-21T12:04:23.7269234Z  'num_stages': 2,
2026-02-21T12:04:23.7269440Z  'num_warps': 4,
2026-02-21T12:04:23.7269628Z  'pid_type': 'flat',
2026-02-21T12:04:23.7269843Z  'range_flattens': [None, None],
2026-02-21T12:04:23.7270131Z  'range_multi_buffers': [None, False],
2026-02-21T12:04:23.7270393Z  'range_num_stages': [0, 0],
2026-02-21T12:04:23.7270625Z  'range_unroll_factors': [0, 0],
2026-02-21T12:04:23.7270864Z  'range_warp_specializes': []}
2026-02-21T12:04:23.7307278Z [388s] Fitting surrogate: 798 points, 798 targets
2026-02-21T12:04:24.0430332Z [388s] Generation 14 starting: 12 neighbors, 1 active search path(s)
2026-02-21T12:04:27.8426126Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 5.8 configs/s
2026-02-21T12:04:28.5957769Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 16.9 configs/s
2026-02-21T12:04:30.2579987Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 600.1         
2026-02-21T12:04:30.2581482Z                                                                   configs/s     
2026-02-21T12:04:30.4069487Z [395s] Generation 14 complete: 
2026-02-21T12:04:30.4069899Z ok=13
2026-02-21T12:04:30.4070195Z min=0.0400
2026-02-21T12:04:30.4070513Z mid=0.0402
2026-02-21T12:04:30.4070772Z max=0.0501
2026-02-21T12:04:30.4071095Z best={'block_sizes': [1, 8192],
2026-02-21T12:04:30.4071655Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:04:30.4072282Z  'load_eviction_policies': ['', ''],
2026-02-21T12:04:30.4072704Z  'num_stages': 2,
2026-02-21T12:04:30.4073013Z  'num_warps': 4,
2026-02-21T12:04:30.4073331Z  'pid_type': 'flat',
2026-02-21T12:04:30.4073684Z  'range_flattens': [None, None],
2026-02-21T12:04:30.4074599Z  'range_multi_buffers': [None, False],
2026-02-21T12:04:30.4075051Z  'range_num_stages': [0, 0],
2026-02-21T12:04:30.4075441Z  'range_unroll_factors': [0, 1],
2026-02-21T12:04:30.4075828Z  'range_warp_specializes': []}
2026-02-21T12:04:30.4110583Z [395s] Fitting surrogate: 811 points, 811 targets
2026-02-21T12:04:30.7062757Z [395s] Generation 15 starting: 11 neighbors, 1 active search path(s)
2026-02-21T12:04:35.9270455Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 4.7 configs/s
2026-02-21T12:04:36.6600906Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.5 configs/s
2026-02-21T12:04:38.0659230Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 707.3         
2026-02-21T12:04:38.0659737Z                                                                   configs/s     
2026-02-21T12:04:38.1969432Z [402s] Generation 15 complete: 
2026-02-21T12:04:38.1969691Z ok=13
2026-02-21T12:04:38.1969875Z min=0.0400
2026-02-21T12:04:38.1970160Z mid=0.0419
2026-02-21T12:04:38.1970360Z max=0.1924
2026-02-21T12:04:38.1970562Z best={'block_sizes': [1, 8192],
2026-02-21T12:04:38.1970891Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:04:38.1971243Z  'load_eviction_policies': ['', ''],
2026-02-21T12:04:38.1971495Z  'num_stages': 2,
2026-02-21T12:04:38.1971727Z  'num_warps': 4,
2026-02-21T12:04:38.1971924Z  'pid_type': 'flat',
2026-02-21T12:04:38.1972151Z  'range_flattens': [None, None],
2026-02-21T12:04:38.1972404Z  'range_multi_buffers': [None, False],
2026-02-21T12:04:38.1973202Z  'range_num_stages': [0, 0],
2026-02-21T12:04:38.1973470Z  'range_unroll_factors': [0, 1],
2026-02-21T12:04:38.1973681Z  'range_warp_specializes': []}
2026-02-21T12:04:38.2006533Z [402s] Fitting surrogate: 824 points, 824 targets
2026-02-21T12:04:38.5476995Z [403s] Generation 16 starting: 13 neighbors, 1 active search path(s)
2026-02-21T12:04:43.7849981Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 3.7 configs/s
2026-02-21T12:04:44.6410719Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 17.3 configs/s
2026-02-21T12:04:46.5630077Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 520.4         
2026-02-21T12:04:46.5630554Z                                                                   configs/s     
2026-02-21T12:04:46.7307713Z [411s] Generation 16 complete: 
2026-02-21T12:04:46.7307976Z ok=15
2026-02-21T12:04:46.7308143Z min=0.0368
2026-02-21T12:04:46.7308313Z mid=0.0390
2026-02-21T12:04:46.7308483Z max=0.0536
2026-02-21T12:04:46.7308684Z best={'block_sizes': [1, 8192],
2026-02-21T12:04:46.7309108Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:04:46.7309814Z  'load_eviction_policies': ['', ''],
2026-02-21T12:04:46.7310384Z  'num_stages': 2,
2026-02-21T12:04:46.7310767Z  'num_warps': 4,
2026-02-21T12:04:46.7311115Z  'pid_type': 'flat',
2026-02-21T12:04:46.7311469Z  'range_flattens': [None, None],
2026-02-21T12:04:46.7311876Z  'range_multi_buffers': [None, False],
2026-02-21T12:04:46.7312340Z  'range_num_stages': [0, 0],
2026-02-21T12:04:46.7312721Z  'range_unroll_factors': [0, 1],
2026-02-21T12:04:46.7313122Z  'range_warp_specializes': []}
2026-02-21T12:04:46.7345944Z [411s] Fitting surrogate: 839 points, 839 targets
2026-02-21T12:04:47.0281800Z [411s] Generation 17 starting: 10 neighbors, 1 active search path(s)
2026-02-21T12:04:50.7369138Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 2.7 configs/s
2026-02-21T12:04:51.3425745Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.9 configs/s
2026-02-21T12:04:52.7447324Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 709.2         
2026-02-21T12:04:52.7447825Z                                                                   configs/s     
2026-02-21T12:04:52.8760242Z [417s] Generation 17 complete: 
2026-02-21T12:04:52.8760686Z ok=11
2026-02-21T12:04:52.8760959Z min=0.0402
2026-02-21T12:04:52.8761239Z mid=0.0402
2026-02-21T12:04:52.8761506Z max=0.0476
2026-02-21T12:04:52.8761814Z best={'block_sizes': [1, 8192],
2026-02-21T12:04:52.8762381Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:04:52.8762994Z  'load_eviction_policies': ['', ''],
2026-02-21T12:04:52.8763487Z  'num_stages': 1,
2026-02-21T12:04:52.8763865Z  'num_warps': 4,
2026-02-21T12:04:52.8764798Z  'pid_type': 'flat',
2026-02-21T12:04:52.8765019Z  'range_flattens': [None, None],
2026-02-21T12:04:52.8765277Z  'range_multi_buffers': [None, False],
2026-02-21T12:04:52.8765511Z  'range_num_stages': [0, 0],
2026-02-21T12:04:52.8766146Z  'range_unroll_factors': [0, 1],
2026-02-21T12:04:52.8766358Z  'range_warp_specializes': []}
2026-02-21T12:04:52.8798688Z [417s] Fitting surrogate: 850 points, 850 targets
2026-02-21T12:04:53.2041427Z [417s] Generation 18 starting: 12 neighbors, 1 active search path(s)
2026-02-21T12:04:57.9198478Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 2.2 configs/s
2026-02-21T12:04:58.7196275Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.2 configs/s
2026-02-21T12:05:00.4980140Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 561.4         
2026-02-21T12:05:00.4980667Z                                                                   configs/s     
2026-02-21T12:05:00.6560202Z [425s] Generation 18 complete: 
2026-02-21T12:05:00.6561334Z ok=14
2026-02-21T12:05:00.6561649Z min=0.0365
2026-02-21T12:05:00.6561922Z mid=0.0370
2026-02-21T12:05:00.6562217Z max=0.0499
2026-02-21T12:05:00.6562503Z best={'block_sizes': [1, 8192],
2026-02-21T12:05:00.6563129Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:05:00.6563799Z  'load_eviction_policies': ['', ''],
2026-02-21T12:05:00.6564702Z  'num_stages': 1,
2026-02-21T12:05:00.6565043Z  'num_warps': 4,
2026-02-21T12:05:00.6565375Z  'pid_type': 'flat',
2026-02-21T12:05:00.6565737Z  'range_flattens': [None, None],
2026-02-21T12:05:00.6566146Z  'range_multi_buffers': [None, False],
2026-02-21T12:05:00.6566576Z  'range_num_stages': [0, 0],
2026-02-21T12:05:00.6566953Z  'range_unroll_factors': [0, 1],
2026-02-21T12:05:00.6567355Z  'range_warp_specializes': []}
2026-02-21T12:05:00.6599190Z [425s] Fitting surrogate: 864 points, 864 targets
2026-02-21T12:05:00.9717161Z [425s] Generation 19 starting: 12 neighbors, 1 active search path(s)
2026-02-21T12:05:05.4204910Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.2 configs/s
2026-02-21T12:05:06.1494645Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.6 configs/s
2026-02-21T12:05:07.7926079Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 606.7         
2026-02-21T12:05:07.7926622Z                                                                   configs/s     
2026-02-21T12:05:07.9418941Z [432s] Generation 19 complete: 
2026-02-21T12:05:07.9419206Z ok=13
2026-02-21T12:05:07.9419378Z min=0.0370
2026-02-21T12:05:07.9419549Z mid=0.0372
2026-02-21T12:05:07.9419721Z max=0.0505
2026-02-21T12:05:07.9419898Z best={'block_sizes': [1, 8192],
2026-02-21T12:05:07.9420242Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:05:07.9420609Z  'load_eviction_policies': ['', ''],
2026-02-21T12:05:07.9420859Z  'num_stages': 1,
2026-02-21T12:05:07.9421048Z  'num_warps': 4,
2026-02-21T12:05:07.9421243Z  'pid_type': 'flat',
2026-02-21T12:05:07.9421496Z  'range_flattens': [None, None],
2026-02-21T12:05:07.9421749Z  'range_multi_buffers': [None, False],
2026-02-21T12:05:07.9422015Z  'range_num_stages': [0, 0],
2026-02-21T12:05:07.9422245Z  'range_unroll_factors': [0, 1],
2026-02-21T12:05:07.9422512Z  'range_warp_specializes': []}
2026-02-21T12:05:07.9458749Z [432s] Fitting surrogate: 877 points, 877 targets
2026-02-21T12:05:08.2612205Z [432s] Generation 20 starting: 13 neighbors, 1 active search path(s)
2026-02-21T12:05:12.0429288Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 7.1 configs/s
2026-02-21T12:05:12.8197667Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.8 configs/s
2026-02-21T12:05:14.5988100Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 561.3         
2026-02-21T12:05:14.5988692Z                                                                   configs/s     
2026-02-21T12:05:14.7568952Z [439s] Generation 20 complete: 
2026-02-21T12:05:14.7569241Z ok=14
2026-02-21T12:05:14.7569461Z min=0.0398
2026-02-21T12:05:14.7569648Z mid=0.0402
2026-02-21T12:05:14.7569911Z max=0.0444
2026-02-21T12:05:14.7570104Z best={'block_sizes': [1, 8192],
2026-02-21T12:05:14.7570463Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:05:14.7571461Z  'load_eviction_policies': ['', ''],
2026-02-21T12:05:14.7571720Z  'num_stages': 1,
2026-02-21T12:05:14.7571919Z  'num_warps': 4,
2026-02-21T12:05:14.7572121Z  'pid_type': 'flat',
2026-02-21T12:05:14.7572350Z  'range_flattens': [None, None],
2026-02-21T12:05:14.7572622Z  'range_multi_buffers': [None, False],
2026-02-21T12:05:14.7572891Z  'range_num_stages': [0, 1],
2026-02-21T12:05:14.7573137Z  'range_unroll_factors': [0, 1],
2026-02-21T12:05:14.7573385Z  'range_warp_specializes': []}
2026-02-21T12:05:14.7609581Z [439s] Fitting surrogate: 891 points, 891 targets
2026-02-21T12:05:14.9272416Z [439s] Autotuning complete in 439.6s after searching 839 configs.
2026-02-21T12:05:14.9273265Z One can hardcode the best config and skip autotuning with:
2026-02-21T12:05:14.9275124Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=1, num_warps=4, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T12:05:14.9276496Z 
2026-02-21T12:05:14.9276908Z [439s] Code of selected kernel: /tmp/torchinductor_root/k2/ck2zwz2xajaky32wgzfwizldglqmof3qwnxr35g44ttefwrvma3l.py
2026-02-21T12:05:14.9593529Z from __future__ import annotations
2026-02-21T12:05:14.9593730Z 
2026-02-21T12:05:14.9593809Z import torch
2026-02-21T12:05:14.9594168Z import triton
2026-02-21T12:05:14.9594389Z import triton.language as tl
2026-02-21T12:05:14.9594692Z from torch._inductor.runtime import triton_helpers
2026-02-21T12:05:14.9595116Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T12:05:14.9595594Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T12:05:14.9595879Z 
2026-02-21T12:05:14.9595973Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T12:05:14.9596236Z _BLOCK_SIZE_1 = tl.constexpr(8192)
2026-02-21T12:05:14.9596411Z 
2026-02-21T12:05:14.9596484Z @triton.jit
2026-02-21T12:05:14.9596690Z def _helion_softmax_two_pass(x, out):
2026-02-21T12:05:14.9597071Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:05:14.9597472Z     pid_0 = tl.program_id(0)
2026-02-21T12:05:14.9597712Z     offset_0 = pid_0
2026-02-21T12:05:14.9597955Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T12:05:14.9598408Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:05:14.9598907Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T12:05:14.9599258Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:05:14.9599587Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T12:05:14.9599924Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:05:14.9600284Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T12:05:14.9600616Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T12:05:14.9600915Z     # src[softmax.py:82-89]: ...
2026-02-21T12:05:14.9601360Z     for offset_2 in tl.range(0, 6144, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T12:05:14.9601894Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:05:14.9602205Z         mask_1 = indices_2 < 6144
2026-02-21T12:05:14.9602409Z         mi_copy = mi
2026-02-21T12:05:14.9602582Z         di_copy = di
2026-02-21T12:05:14.9602750Z         mi_copy_0 = mi_copy
2026-02-21T12:05:14.9602953Z         di_copy_0 = di_copy
2026-02-21T12:05:14.9603183Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T12:05:14.9603604Z         values = tl.load(x + (indices_0[:, None] * 6144 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T12:05:14.9604224Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T12:05:14.9605060Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T12:05:14.9605623Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T12:05:14.9605986Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T12:05:14.9606301Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T12:05:14.9606574Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T12:05:14.9606908Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:05:14.9607236Z         v_2 = mi_copy_0 - v_1
2026-02-21T12:05:14.9607453Z         v_3 = libdevice.exp(v_2)
2026-02-21T12:05:14.9607671Z         v_4 = di_copy_0 * v_3
2026-02-21T12:05:14.9608049Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T12:05:14.9608317Z         subscript = v_1[:, None]
2026-02-21T12:05:14.9608531Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T12:05:14.9608764Z         v_6 = v_5 - subscript
2026-02-21T12:05:14.9609036Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:05:14.9609378Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T12:05:14.9609663Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T12:05:14.9609982Z         v_7 = libdevice.exp(v_6)
2026-02-21T12:05:14.9610392Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T12:05:14.9610861Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T12:05:14.9611101Z         di = v_4 + sum_1
2026-02-21T12:05:14.9611288Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T12:05:14.9611491Z         mi = v_1
2026-02-21T12:05:14.9611738Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:05:14.9612070Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T12:05:14.9612444Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:05:14.9613003Z     for offset_2 in tl.range(0, 6144, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T12:05:14.9613497Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:05:14.9613790Z         mask_2 = indices_2 < 6144
2026-02-21T12:05:14.9614115Z         mi_copy_1 = mi
2026-02-21T12:05:14.9614294Z         di_copy_1 = di
2026-02-21T12:05:14.9614461Z         mi_copy_1_0 = mi_copy_1
2026-02-21T12:05:14.9614654Z         di_copy_1_0 = di_copy_1
2026-02-21T12:05:14.9614869Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T12:05:14.9615271Z         values_1 = tl.load(x + (indices_0[:, None] * 6144 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T12:05:14.9615777Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:05:14.9616130Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T12:05:14.9616367Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T12:05:14.9616584Z         v_10 = v_9 - subscript_1
2026-02-21T12:05:14.9616788Z         v_11 = libdevice.exp(v_10)
2026-02-21T12:05:14.9616995Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T12:05:14.9617215Z         v_12 = v_11 / subscript_2
2026-02-21T12:05:14.9617414Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T12:05:14.9617743Z         tl.store(out + (indices_0[:, None] * 6144 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T12:05:14.9618020Z 
2026-02-21T12:05:14.9618180Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T12:05:14.9618466Z     """
2026-02-21T12:05:14.9618722Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T12:05:14.9619105Z     This version uses fewer passes but is less numerically stable.
2026-02-21T12:05:14.9619385Z     Args:
2026-02-21T12:05:14.9619571Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T12:05:14.9619970Z     Returns:
2026-02-21T12:05:14.9620186Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T12:05:14.9620440Z     """
2026-02-21T12:05:14.9620599Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T12:05:14.9620807Z     m, n = x.size()
2026-02-21T12:05:14.9621008Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T12:05:14.9621251Z     out = torch.empty_like(x)
2026-02-21T12:05:14.9621532Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:05:14.9621944Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:05:14.9622334Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:05:14.9622759Z     # src[softmax.py:79-92]: ...
2026-02-21T12:05:14.9623068Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=4, num_stages=1)
2026-02-21T12:05:14.9623416Z     # src[softmax.py:93]: return out
2026-02-21T12:05:14.9623619Z     return out
2026-02-21T12:05:16.1158478Z WARNING:tritonbench.utils.triton_op:Completed input ID 46:
2026-02-21T12:05:16.1158873Z (M, N)
2026-02-21T12:05:16.1159057Z ------------
2026-02-21T12:05:16.1159242Z (4096, 6144)
2026-02-21T12:05:16.1159723Z 
2026-02-21T12:05:16.1181925Z  50%|█████     | 10/20 [1:02:11<1:09:04, 414.50s/it]WARNING:tritonbench.utils.triton_op:Running input ID 51:
2026-02-21T12:05:16.1182375Z (M, N)
2026-02-21T12:05:16.1182540Z ------------
2026-02-21T12:05:16.1182733Z (4096, 6784)
2026-02-21T12:05:16.1184684Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T12:05:17.5270453Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T12:05:19.1913536Z INFO:tritonbench.utils.triton_op:Took 3.40ms to get benchmark function for torch_compile_softmax
2026-02-21T12:05:20.7701788Z WARNING:__main__:Input tensor metadata:
2026-02-21T12:05:20.7702164Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T12:05:20.7702529Z               'dtype': 'torch.float16',
2026-02-21T12:05:20.7702867Z               'shape': (4096, 6784),
2026-02-21T12:05:20.7703172Z               'stride': (6784, 1)},),
2026-02-21T12:05:20.7703413Z   'kwargs': {}}
2026-02-21T12:05:20.7746381Z INFO:tritonbench.utils.triton_op:Took 4.77ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T12:05:21.0589611Z [0s] Autotune random seed: 2145258556
2026-02-21T12:05:21.0944961Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T12:05:55.8698717Z [34s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:05:56.2270881Z [35s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T12:06:01.3082143Z [40s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T12:06:03.7879651Z [42s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T12:06:04.9056676Z [43s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:06:05.1806762Z [44s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T12:06:14.4299597Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.6 configs/s
2026-02-21T12:06:22.3113469Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.7 configs/s
2026-02-21T12:06:22.3127298Z [61s] Adaptive compile timeout: 30s (90% percentile=23.2s, bounds=[30.0s, 30s])
2026-02-21T12:06:23.7279998Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 696.4 configs/s
2026-02-21T12:06:23.8488556Z [62s] Initial random population of 100, 5 starting points: 
2026-02-21T12:06:23.8492185Z error=4
2026-02-21T12:06:23.8492520Z timeout=6
2026-02-21T12:06:23.8492826Z ok=90
2026-02-21T12:06:23.8493113Z min=0.0572
2026-02-21T12:06:23.8493396Z mid=0.5525
2026-02-21T12:06:23.8493726Z max=90.7344
2026-02-21T12:06:23.8494595Z best={'block_sizes': [1, 8192],
2026-02-21T12:06:23.8495204Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:06:23.8495912Z  'load_eviction_policies': ['', 'first'],
2026-02-21T12:06:23.8496348Z  'maxnreg': 64,
2026-02-21T12:06:23.8496717Z  'num_sm_multiplier': 4,
2026-02-21T12:06:23.8497139Z  'num_stages': 1,
2026-02-21T12:06:23.8497518Z  'num_warps': 16,
2026-02-21T12:06:23.8497908Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:06:23.8498195Z  'range_flattens': [False, None],
2026-02-21T12:06:23.8498461Z  'range_multi_buffers': [True, None],
2026-02-21T12:06:23.8498716Z  'range_num_stages': [3, 1],
2026-02-21T12:06:23.8498954Z  'range_unroll_factors': [1, 3],
2026-02-21T12:06:23.8499200Z  'range_warp_specializes': []}
2026-02-21T12:06:23.8510361Z [62s] Fitting surrogate: 100 points, 100 targets
2026-02-21T12:06:25.2641816Z [64s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T12:07:04.9418077Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 0.4 configs/s
2026-02-21T12:07:10.2918326Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 17.5 configs/s
2026-02-21T12:07:17.4182271Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 141.5         
2026-02-21T12:07:17.4185886Z                                                                   configs/s     
2026-02-21T12:07:17.8982719Z [116s] Generation 1 complete: 
2026-02-21T12:07:17.8983028Z error=7
2026-02-21T12:07:17.8983211Z ok=87
2026-02-21T12:07:17.8983404Z min=0.0500
2026-02-21T12:07:17.8983581Z mid=0.0756
2026-02-21T12:07:17.8983744Z max=0.4688
2026-02-21T12:07:17.8983934Z best={'block_sizes': [1, 2048],
2026-02-21T12:07:17.8984693Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:07:17.8985094Z  'load_eviction_policies': ['', 'first'],
2026-02-21T12:07:17.8985366Z  'num_stages': 1,
2026-02-21T12:07:17.8985559Z  'num_warps': 4,
2026-02-21T12:07:17.8985792Z  'pid_type': 'flat',
2026-02-21T12:07:17.8985984Z  'range_flattens': [None, None],
2026-02-21T12:07:17.8986212Z  'range_multi_buffers': [None, None],
2026-02-21T12:07:17.8986445Z  'range_num_stages': [0, 1],
2026-02-21T12:07:17.8987363Z  'range_unroll_factors': [0, 3],
2026-02-21T12:07:17.8987582Z  'range_warp_specializes': []}
2026-02-21T12:07:17.9005120Z [116s] Fitting surrogate: 194 points, 194 targets
2026-02-21T12:07:19.1210780Z [118s] Generation 2 starting: 76 neighbors, 5 active search path(s)
2026-02-21T12:07:40.4501294Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 4.5 configs/s
2026-02-21T12:07:45.2172901Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 16.5 configs/s
2026-02-21T12:07:53.0618589Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.7         
2026-02-21T12:07:53.0619128Z                                                                   configs/s     
2026-02-21T12:07:53.6032675Z [152s] Generation 2 complete: 
2026-02-21T12:07:53.6033682Z error=1
2026-02-21T12:07:53.6034450Z ok=81
2026-02-21T12:07:53.6034748Z min=0.0416
2026-02-21T12:07:53.6035023Z mid=0.0615
2026-02-21T12:07:53.6035294Z max=0.2792
2026-02-21T12:07:53.6035642Z best={'block_sizes': [1, 8192],
2026-02-21T12:07:53.6036104Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:07:53.6036600Z  'load_eviction_policies': ['', ''],
2026-02-21T12:07:53.6037008Z  'num_stages': 2,
2026-02-21T12:07:53.6037314Z  'num_warps': 16,
2026-02-21T12:07:53.6037662Z  'pid_type': 'flat',
2026-02-21T12:07:53.6038037Z  'range_flattens': [None, False],
2026-02-21T12:07:53.6038450Z  'range_multi_buffers': [None, None],
2026-02-21T12:07:53.6038881Z  'range_num_stages': [0, 2],
2026-02-21T12:07:53.6039263Z  'range_unroll_factors': [0, 0],
2026-02-21T12:07:53.6039676Z  'range_warp_specializes': []}
2026-02-21T12:07:53.6059489Z [152s] Fitting surrogate: 276 points, 276 targets
2026-02-21T12:07:54.7085350Z [153s] Generation 3 starting: 70 neighbors, 5 active search path(s)
2026-02-21T12:08:16.7695538Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74/74 2.3 configs/s
2026-02-21T12:08:21.3223053Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 74/74 16.4 configs/s
2026-02-21T12:08:30.2527037Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 127.2         
2026-02-21T12:08:30.2527554Z                                                                   configs/s     
2026-02-21T12:08:30.8286396Z [189s] Generation 3 complete: 
2026-02-21T12:08:30.8286823Z ok=76
2026-02-21T12:08:30.8287126Z min=0.0408
2026-02-21T12:08:30.8287416Z mid=0.0506
2026-02-21T12:08:30.8287679Z max=0.3578
2026-02-21T12:08:30.8287982Z best={'block_sizes': [1, 8192],
2026-02-21T12:08:30.8288539Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:08:30.8289153Z  'load_eviction_policies': ['', ''],
2026-02-21T12:08:30.8289564Z  'num_stages': 1,
2026-02-21T12:08:30.8290033Z  'num_warps': 4,
2026-02-21T12:08:30.8290387Z  'pid_type': 'flat',
2026-02-21T12:08:30.8290771Z  'range_flattens': [None, False],
2026-02-21T12:08:30.8291199Z  'range_multi_buffers': [None, None],
2026-02-21T12:08:30.8291618Z  'range_num_stages': [0, 1],
2026-02-21T12:08:30.8292031Z  'range_unroll_factors': [0, 3],
2026-02-21T12:08:30.8292429Z  'range_warp_specializes': []}
2026-02-21T12:08:30.8309223Z [189s] Fitting surrogate: 352 points, 352 targets
2026-02-21T12:08:31.9975841Z [190s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T12:08:54.9346713Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 1.0 configs/s
2026-02-21T12:08:59.0097213Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.6 configs/s
2026-02-21T12:09:05.8644324Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 147.4         
2026-02-21T12:09:05.8644828Z                                                                   configs/s     
2026-02-21T12:09:06.3760476Z [225s] Generation 4 complete: 
2026-02-21T12:09:06.3760905Z error=1
2026-02-21T12:09:06.3761238Z ok=70
2026-02-21T12:09:06.3761505Z min=0.0409
2026-02-21T12:09:06.3761786Z mid=0.0476
2026-02-21T12:09:06.3762047Z max=1.0586
2026-02-21T12:09:06.3762359Z best={'block_sizes': [1, 8192],
2026-02-21T12:09:06.3763660Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:09:06.3764768Z  'load_eviction_policies': ['', ''],
2026-02-21T12:09:06.3765180Z  'num_stages': 1,
2026-02-21T12:09:06.3765484Z  'num_warps': 4,
2026-02-21T12:09:06.3765819Z  'pid_type': 'flat',
2026-02-21T12:09:06.3766166Z  'range_flattens': [None, False],
2026-02-21T12:09:06.3766593Z  'range_multi_buffers': [None, None],
2026-02-21T12:09:06.3767047Z  'range_num_stages': [0, 1],
2026-02-21T12:09:06.3767445Z  'range_unroll_factors': [0, 3],
2026-02-21T12:09:06.3767851Z  'range_warp_specializes': []}
2026-02-21T12:09:06.3791653Z [225s] Fitting surrogate: 423 points, 423 targets
2026-02-21T12:09:07.5634843Z [226s] Generation 5 starting: 65 neighbors, 5 active search path(s)
2026-02-21T12:09:27.0401771Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 3.6 configs/s
2026-02-21T12:09:31.2159195Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 16.5 configs/s
2026-02-21T12:09:38.2884375Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 142.9         
2026-02-21T12:09:38.2886490Z                                                                   configs/s     
2026-02-21T12:09:38.8171360Z [257s] Generation 5 complete: 
2026-02-21T12:09:38.8171804Z ok=71
2026-02-21T12:09:38.8172087Z min=0.0407
2026-02-21T12:09:38.8172375Z mid=0.0443
2026-02-21T12:09:38.8172642Z max=0.9508
2026-02-21T12:09:38.8172958Z best={'block_sizes': [1, 8192],
2026-02-21T12:09:38.8173600Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:09:38.8174746Z  'load_eviction_policies': ['', ''],
2026-02-21T12:09:38.8175024Z  'num_stages': 2,
2026-02-21T12:09:38.8175220Z  'num_warps': 4,
2026-02-21T12:09:38.8175396Z  'pid_type': 'flat',
2026-02-21T12:09:38.8175619Z  'range_flattens': [None, False],
2026-02-21T12:09:38.8175856Z  'range_multi_buffers': [None, None],
2026-02-21T12:09:38.8176095Z  'range_num_stages': [0, 2],
2026-02-21T12:09:38.8176327Z  'range_unroll_factors': [0, 0],
2026-02-21T12:09:38.8176572Z  'range_warp_specializes': []}
2026-02-21T12:09:38.8203906Z [257s] Fitting surrogate: 494 points, 494 targets
2026-02-21T12:09:39.9746151Z [258s] Generation 6 starting: 72 neighbors, 5 active search path(s)
2026-02-21T12:10:19.1621206Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74/74 0.4 configs/s
2026-02-21T12:10:23.6723023Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 74/74 16.6 configs/s
2026-02-21T12:10:31.8279535Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 124.0         
2026-02-21T12:10:31.8280089Z                                                                   configs/s     
2026-02-21T12:10:32.4353323Z [311s] Generation 6 complete: 
2026-02-21T12:10:32.4353671Z error=1
2026-02-21T12:10:32.4353854Z ok=76
2026-02-21T12:10:32.4354526Z min=0.0408
2026-02-21T12:10:32.4354722Z mid=0.0438
2026-02-21T12:10:32.4354901Z max=0.9621
2026-02-21T12:10:32.4355093Z best={'block_sizes': [1, 8192],
2026-02-21T12:10:32.4356146Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:10:32.4356499Z  'load_eviction_policies': ['', ''],
2026-02-21T12:10:32.4356766Z  'num_stages': 2,
2026-02-21T12:10:32.4356967Z  'num_warps': 4,
2026-02-21T12:10:32.4357156Z  'pid_type': 'flat',
2026-02-21T12:10:32.4357385Z  'range_flattens': [None, False],
2026-02-21T12:10:32.4357639Z  'range_multi_buffers': [None, None],
2026-02-21T12:10:32.4357909Z  'range_num_stages': [0, 2],
2026-02-21T12:10:32.4358147Z  'range_unroll_factors': [0, 0],
2026-02-21T12:10:32.4358428Z  'range_warp_specializes': []}
2026-02-21T12:10:32.4388619Z [311s] Fitting surrogate: 571 points, 571 targets
2026-02-21T12:10:33.4355106Z [312s] Generation 7 starting: 60 neighbors, 4 active search path(s)
2026-02-21T12:11:02.8706174Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 0.4 configs/s
2026-02-21T12:11:06.6197574Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.5 configs/s
2026-02-21T12:11:13.8478643Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 139.9         
2026-02-21T12:11:13.8481204Z                                                                   configs/s     
2026-02-21T12:11:14.3832402Z [353s] Generation 7 complete: 
2026-02-21T12:11:14.3832869Z ok=65
2026-02-21T12:11:14.3833154Z min=0.0407
2026-02-21T12:11:14.3833443Z mid=0.0435
2026-02-21T12:11:14.3833708Z max=0.9298
2026-02-21T12:11:14.3834508Z best={'block_sizes': [1, 8192],
2026-02-21T12:11:14.3835098Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:11:14.3835710Z  'load_eviction_policies': ['', ''],
2026-02-21T12:11:14.3836111Z  'num_stages': 2,
2026-02-21T12:11:14.3836427Z  'num_warps': 4,
2026-02-21T12:11:14.3836741Z  'pid_type': 'flat',
2026-02-21T12:11:14.3837118Z  'range_flattens': [None, False],
2026-02-21T12:11:14.3837574Z  'range_multi_buffers': [None, None],
2026-02-21T12:11:14.3838003Z  'range_num_stages': [0, 1],
2026-02-21T12:11:14.3838404Z  'range_unroll_factors': [0, 3],
2026-02-21T12:11:14.3838845Z  'range_warp_specializes': []}
2026-02-21T12:11:14.3868474Z [353s] Fitting surrogate: 636 points, 636 targets
2026-02-21T12:11:15.3934581Z [354s] Generation 8 starting: 61 neighbors, 4 active search path(s)
2026-02-21T12:11:44.8923020Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 0.6 configs/s
2026-02-21T12:11:48.6917202Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 62/62 16.5 configs/s
2026-02-21T12:11:56.6514303Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 145.9         
2026-02-21T12:11:56.6519385Z                                                                   configs/s     
2026-02-21T12:11:57.1699433Z [396s] Generation 8 complete: 
2026-02-21T12:11:57.1699893Z ok=65
2026-02-21T12:11:57.1700297Z min=0.0408
2026-02-21T12:11:57.1700684Z mid=0.0464
2026-02-21T12:11:57.1701118Z max=1.8150
2026-02-21T12:11:57.1701438Z best={'block_sizes': [1, 8192],
2026-02-21T12:11:57.1701840Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:11:57.1702229Z  'load_eviction_policies': ['', ''],
2026-02-21T12:11:57.1702491Z  'num_stages': 3,
2026-02-21T12:11:57.1702675Z  'num_warps': 4,
2026-02-21T12:11:57.1702866Z  'pid_type': 'flat',
2026-02-21T12:11:57.1703071Z  'range_flattens': [None, False],
2026-02-21T12:11:57.1703340Z  'range_multi_buffers': [None, None],
2026-02-21T12:11:57.1703612Z  'range_num_stages': [0, 2],
2026-02-21T12:11:57.1703842Z  'range_unroll_factors': [0, 3],
2026-02-21T12:11:57.1704429Z  'range_warp_specializes': []}
2026-02-21T12:11:57.1733659Z [396s] Fitting surrogate: 701 points, 701 targets
2026-02-21T12:11:58.1365239Z [397s] Generation 9 starting: 57 neighbors, 4 active search path(s)
2026-02-21T12:12:17.6845607Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 1.1 configs/s
2026-02-21T12:12:21.2563956Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 58/58 16.4 configs/s
2026-02-21T12:12:27.9276569Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 151.4         
2026-02-21T12:12:27.9278707Z                                                                   configs/s     
2026-02-21T12:12:28.4249949Z [427s] Generation 9 complete: 
2026-02-21T12:12:28.4250231Z ok=61
2026-02-21T12:12:28.4250417Z min=0.0408
2026-02-21T12:12:28.4250601Z mid=0.0435
2026-02-21T12:12:28.4250774Z max=0.9695
2026-02-21T12:12:28.4250970Z best={'block_sizes': [1, 8192],
2026-02-21T12:12:28.4251320Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:12:28.4251714Z  'load_eviction_policies': ['', ''],
2026-02-21T12:12:28.4251975Z  'num_stages': 3,
2026-02-21T12:12:28.4252186Z  'num_warps': 4,
2026-02-21T12:12:28.4252397Z  'pid_type': 'flat',
2026-02-21T12:12:28.4252623Z  'range_flattens': [None, None],
2026-02-21T12:12:28.4252893Z  'range_multi_buffers': [None, None],
2026-02-21T12:12:28.4254470Z  'range_num_stages': [0, 2],
2026-02-21T12:12:28.4254782Z  'range_unroll_factors': [0, 3],
2026-02-21T12:12:28.4255047Z  'range_warp_specializes': []}
2026-02-21T12:12:28.4291564Z [427s] Fitting surrogate: 762 points, 762 targets
2026-02-21T12:12:29.3507111Z [428s] Generation 10 starting: 55 neighbors, 4 active search path(s)
2026-02-21T12:12:45.7522936Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 5.0 configs/s
2026-02-21T12:12:49.1827831Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 57/57 16.8 configs/s
2026-02-21T12:12:55.2605862Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 166.1         
2026-02-21T12:12:55.2606369Z                                                                   configs/s     
2026-02-21T12:12:55.7292483Z [454s] Generation 10 complete: 
2026-02-21T12:12:55.7292923Z error=1
2026-02-21T12:12:55.7293208Z ok=58
2026-02-21T12:12:55.7293483Z min=0.0407
2026-02-21T12:12:55.7293766Z mid=0.0432
2026-02-21T12:12:55.7294648Z max=0.9186
2026-02-21T12:12:55.7294990Z best={'block_sizes': [1, 8192],
2026-02-21T12:12:55.7295601Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:12:55.7296309Z  'load_eviction_policies': ['', ''],
2026-02-21T12:12:55.7296727Z  'num_stages': 3,
2026-02-21T12:12:55.7297033Z  'num_warps': 4,
2026-02-21T12:12:55.7297351Z  'pid_type': 'flat',
2026-02-21T12:12:55.7297744Z  'range_flattens': [None, None],
2026-02-21T12:12:55.7298166Z  'range_multi_buffers': [None, None],
2026-02-21T12:12:55.7298601Z  'range_num_stages': [0, 2],
2026-02-21T12:12:55.7298978Z  'range_unroll_factors': [0, 3],
2026-02-21T12:12:55.7299386Z  'range_warp_specializes': []}
2026-02-21T12:12:55.7342273Z [454s] Fitting surrogate: 821 points, 821 targets
2026-02-21T12:12:56.5549098Z [455s] Generation 11 starting: 48 neighbors, 3 active search path(s)
2026-02-21T12:13:11.4136403Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 3.0 configs/s
2026-02-21T12:13:14.3829248Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 48/48 16.4 configs/s
2026-02-21T12:13:20.3927779Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 168.0         
2026-02-21T12:13:20.3928338Z                                                                   configs/s     
2026-02-21T12:13:20.8482882Z [479s] Generation 11 complete: 
2026-02-21T12:13:20.8483367Z ok=51
2026-02-21T12:13:20.8483654Z min=0.0407
2026-02-21T12:13:20.8483948Z mid=0.0433
2026-02-21T12:13:20.8484718Z max=0.2304
2026-02-21T12:13:20.8485054Z best={'block_sizes': [1, 8192],
2026-02-21T12:13:20.8485620Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:13:20.8486257Z  'load_eviction_policies': ['', ''],
2026-02-21T12:13:20.8486677Z  'num_stages': 3,
2026-02-21T12:13:20.8487003Z  'num_warps': 4,
2026-02-21T12:13:20.8487325Z  'pid_type': 'flat',
2026-02-21T12:13:20.8487704Z  'range_flattens': [None, None],
2026-02-21T12:13:20.8488126Z  'range_multi_buffers': [None, None],
2026-02-21T12:13:20.8488580Z  'range_num_stages': [0, 2],
2026-02-21T12:13:20.8488990Z  'range_unroll_factors': [0, 3],
2026-02-21T12:13:20.8489398Z  'range_warp_specializes': []}
2026-02-21T12:13:20.8535441Z [479s] Fitting surrogate: 872 points, 872 targets
2026-02-21T12:13:21.6827474Z [480s] Generation 12 starting: 48 neighbors, 3 active search path(s)
2026-02-21T12:13:42.0066154Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 1.1 configs/s
2026-02-21T12:13:44.9051472Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 49/49 17.2 configs/s
2026-02-21T12:13:50.5560597Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 178.7         
2026-02-21T12:13:50.5561064Z                                                                   configs/s     
2026-02-21T12:13:50.9780060Z [509s] Generation 12 complete: 
2026-02-21T12:13:50.9780670Z error=2
2026-02-21T12:13:50.9781033Z ok=49
2026-02-21T12:13:50.9781225Z min=0.0407
2026-02-21T12:13:50.9781426Z mid=0.0450
2026-02-21T12:13:50.9782032Z max=1.0851
2026-02-21T12:13:50.9782236Z best={'block_sizes': [1, 8192],
2026-02-21T12:13:50.9782597Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:13:50.9782994Z  'load_eviction_policies': ['', ''],
2026-02-21T12:13:50.9783245Z  'num_stages': 3,
2026-02-21T12:13:50.9783440Z  'num_warps': 4,
2026-02-21T12:13:50.9783638Z  'pid_type': 'flat',
2026-02-21T12:13:50.9783846Z  'range_flattens': [None, None],
2026-02-21T12:13:50.9784397Z  'range_multi_buffers': [None, None],
2026-02-21T12:13:50.9784670Z  'range_num_stages': [0, 2],
2026-02-21T12:13:50.9784909Z  'range_unroll_factors': [0, 3],
2026-02-21T12:13:50.9785153Z  'range_warp_specializes': []}
2026-02-21T12:13:50.9827930Z [509s] Fitting surrogate: 923 points, 923 targets
2026-02-21T12:13:51.7275381Z [510s] Generation 13 starting: 38 neighbors, 2 active search path(s)
2026-02-21T12:14:03.1077979Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 7.3 configs/s
2026-02-21T12:14:05.4676548Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 39/39 16.8 configs/s
2026-02-21T12:14:09.1057631Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 276.8         
2026-02-21T12:14:09.1058206Z                                                                   configs/s     
2026-02-21T12:14:09.3905586Z [528s] Generation 13 complete: 
2026-02-21T12:14:09.3905839Z error=1
2026-02-21T12:14:09.3906028Z ok=40
2026-02-21T12:14:09.3906189Z min=0.0408
2026-02-21T12:14:09.3906358Z mid=0.0548
2026-02-21T12:14:09.3906519Z max=0.1405
2026-02-21T12:14:09.3906699Z best={'block_sizes': [1, 8192],
2026-02-21T12:14:09.3907029Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:14:09.3907399Z  'load_eviction_policies': ['', ''],
2026-02-21T12:14:09.3907652Z  'num_stages': 3,
2026-02-21T12:14:09.3907846Z  'num_warps': 4,
2026-02-21T12:14:09.3908035Z  'pid_type': 'flat',
2026-02-21T12:14:09.3908250Z  'range_flattens': [None, None],
2026-02-21T12:14:09.3908518Z  'range_multi_buffers': [None, None],
2026-02-21T12:14:09.3908776Z  'range_num_stages': [0, 2],
2026-02-21T12:14:09.3909011Z  'range_unroll_factors': [0, 3],
2026-02-21T12:14:09.3909252Z  'range_warp_specializes': []}
2026-02-21T12:14:09.3951063Z [528s] Fitting surrogate: 964 points, 964 targets
2026-02-21T12:14:09.8347411Z [528s] Generation 14 starting: 20 neighbors, 1 active search path(s)
2026-02-21T12:14:29.4126630Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 0.4 configs/s
2026-02-21T12:14:30.6110065Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 18.3 configs/s
2026-02-21T12:14:32.0818277Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 675.5         
2026-02-21T12:14:32.0818834Z                                                                   configs/s     
2026-02-21T12:14:32.2142599Z [551s] Generation 14 complete: 
2026-02-21T12:14:32.2142868Z error=2
2026-02-21T12:14:32.2143034Z ok=20
2026-02-21T12:14:32.2143203Z min=0.0409
2026-02-21T12:14:32.2143373Z mid=0.0605
2026-02-21T12:14:32.2144256Z max=1.7917
2026-02-21T12:14:32.2144459Z best={'block_sizes': [1, 8192],
2026-02-21T12:14:32.2144816Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:14:32.2145218Z  'load_eviction_policies': ['', ''],
2026-02-21T12:14:32.2145475Z  'num_stages': 3,
2026-02-21T12:14:32.2145680Z  'num_warps': 4,
2026-02-21T12:14:32.2145872Z  'pid_type': 'flat',
2026-02-21T12:14:32.2146087Z  'range_flattens': [None, None],
2026-02-21T12:14:32.2146338Z  'range_multi_buffers': [None, None],
2026-02-21T12:14:32.2146601Z  'range_num_stages': [0, 2],
2026-02-21T12:14:32.2146835Z  'range_unroll_factors': [0, 3],
2026-02-21T12:14:32.2147092Z  'range_warp_specializes': []}
2026-02-21T12:14:32.2190777Z [551s] Fitting surrogate: 986 points, 986 targets
2026-02-21T12:14:32.6960135Z [551s] Generation 15 starting: 19 neighbors, 1 active search path(s)
2026-02-21T12:14:38.9523730Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20/20 3.5 configs/s
2026-02-21T12:14:40.2011698Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 20/20 16.6 configs/s
2026-02-21T12:14:42.3532541Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 464.7         
2026-02-21T12:14:42.3533104Z                                                                   configs/s     
2026-02-21T12:14:42.5369373Z [561s] Generation 15 complete: 
2026-02-21T12:14:42.5369686Z ok=21
2026-02-21T12:14:42.5369954Z min=0.0412
2026-02-21T12:14:42.5370144Z mid=0.0501
2026-02-21T12:14:42.5370314Z max=0.1016
2026-02-21T12:14:42.5370511Z best={'block_sizes': [1, 8192],
2026-02-21T12:14:42.5370814Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:14:42.5371158Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T12:14:42.5371464Z  'num_sm_multiplier': 16,
2026-02-21T12:14:42.5371694Z  'num_stages': 2,
2026-02-21T12:14:42.5371891Z  'num_warps': 4,
2026-02-21T12:14:42.5372106Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:14:42.5372394Z  'range_flattens': [True, False],
2026-02-21T12:14:42.5372685Z  'range_multi_buffers': [None, False],
2026-02-21T12:14:42.5372954Z  'range_num_stages': [3, 3],
2026-02-21T12:14:42.5373189Z  'range_unroll_factors': [1, 3],
2026-02-21T12:14:42.5373458Z  'range_warp_specializes': []}
2026-02-21T12:14:42.5417680Z [561s] Fitting surrogate: 1007 points, 1007 targets
2026-02-21T12:14:42.9349255Z [561s] Generation 16 starting: 17 neighbors, 1 active search path(s)
2026-02-21T12:14:49.2058870Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17/17 3.5 configs/s
2026-02-21T12:14:50.2658789Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 17/17 16.7 configs/s
2026-02-21T12:14:52.2236641Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 510.9         
2026-02-21T12:14:52.2237215Z                                                                   configs/s     
2026-02-21T12:14:52.3926316Z [571s] Generation 16 complete: 
2026-02-21T12:14:52.3926626Z ok=18
2026-02-21T12:14:52.3926812Z min=0.0414
2026-02-21T12:14:52.3927013Z mid=0.0425
2026-02-21T12:14:52.3927223Z max=0.0815
2026-02-21T12:14:52.3927416Z best={'block_sizes': [1, 8192],
2026-02-21T12:14:52.3927711Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:14:52.3928739Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T12:14:52.3929035Z  'num_sm_multiplier': 32,
2026-02-21T12:14:52.3929259Z  'num_stages': 2,
2026-02-21T12:14:52.3929458Z  'num_warps': 4,
2026-02-21T12:14:52.3929674Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:14:52.3930064Z  'range_flattens': [True, False],
2026-02-21T12:14:52.3930319Z  'range_multi_buffers': [None, False],
2026-02-21T12:14:52.3930582Z  'range_num_stages': [2, 3],
2026-02-21T12:14:52.3930817Z  'range_unroll_factors': [1, 3],
2026-02-21T12:14:52.3931066Z  'range_warp_specializes': []}
2026-02-21T12:14:52.3972615Z [571s] Fitting surrogate: 1025 points, 1025 targets
2026-02-21T12:14:52.8253403Z [571s] Generation 17 starting: 17 neighbors, 1 active search path(s)
2026-02-21T12:15:01.3465010Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 1.5 configs/s
2026-02-21T12:15:02.4680876Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 18/18 16.7 configs/s
2026-02-21T12:15:04.3578588Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 528.4         
2026-02-21T12:15:04.3579122Z                                                                   configs/s     
2026-02-21T12:15:04.5181131Z [583s] Generation 17 complete: 
2026-02-21T12:15:04.5181508Z ok=19
2026-02-21T12:15:04.5181744Z min=0.0412
2026-02-21T12:15:04.5182004Z mid=0.0528
2026-02-21T12:15:04.5182205Z max=0.0795
2026-02-21T12:15:04.5182423Z best={'block_sizes': [1, 8192],
2026-02-21T12:15:04.5182789Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:15:04.5183161Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T12:15:04.5183441Z  'num_sm_multiplier': 32,
2026-02-21T12:15:04.5183656Z  'num_stages': 2,
2026-02-21T12:15:04.5183849Z  'num_warps': 4,
2026-02-21T12:15:04.5184469Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:15:04.5184754Z  'range_flattens': [True, False],
2026-02-21T12:15:04.5185004Z  'range_multi_buffers': [None, False],
2026-02-21T12:15:04.5185268Z  'range_num_stages': [2, 3],
2026-02-21T12:15:04.5185515Z  'range_unroll_factors': [1, 3],
2026-02-21T12:15:04.5185768Z  'range_warp_specializes': []}
2026-02-21T12:15:04.5227967Z [583s] Fitting surrogate: 1044 points, 1044 targets
2026-02-21T12:15:05.0102415Z [583s] Generation 18 starting: 19 neighbors, 1 active search path(s)
2026-02-21T12:15:11.2108186Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19/19 4.1 configs/s
2026-02-21T12:15:12.3861587Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 19/19 16.8 configs/s
2026-02-21T12:15:15.0060465Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 383.4         
2026-02-21T12:15:15.0060962Z                                                                   configs/s     
2026-02-21T12:15:15.2220319Z [594s] Generation 18 complete: 
2026-02-21T12:15:15.2220643Z ok=20
2026-02-21T12:15:15.2220823Z min=0.0409
2026-02-21T12:15:15.2220991Z mid=0.0424
2026-02-21T12:15:15.2221154Z max=0.0519
2026-02-21T12:15:15.2221336Z best={'block_sizes': [1, 8192],
2026-02-21T12:15:15.2221663Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:15:15.2222014Z  'load_eviction_policies': ['last', 'last'],
2026-02-21T12:15:15.2222290Z  'num_sm_multiplier': 32,
2026-02-21T12:15:15.2222515Z  'num_stages': 2,
2026-02-21T12:15:15.2222712Z  'num_warps': 4,
2026-02-21T12:15:15.2222928Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:15:15.2223197Z  'range_flattens': [True, False],
2026-02-21T12:15:15.2223451Z  'range_multi_buffers': [None, False],
2026-02-21T12:15:15.2223710Z  'range_num_stages': [2, 3],
2026-02-21T12:15:15.2223941Z  'range_unroll_factors': [1, 3],
2026-02-21T12:15:15.2224571Z  'range_warp_specializes': []}
2026-02-21T12:15:15.2275344Z [594s] Fitting surrogate: 1064 points, 1064 targets
2026-02-21T12:15:15.4000483Z [594s] Autotuning complete in 594.3s after searching 1017 configs.
2026-02-21T12:15:15.4001011Z One can hardcode the best config and skip autotuning with:
2026-02-21T12:15:15.4002673Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'last'], num_sm_multiplier=32, num_stages=2, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, False], range_multi_buffers=[None, False], range_num_stages=[2, 3], range_unroll_factors=[1, 3], range_warp_specializes=[]), static_shapes=True)
2026-02-21T12:15:15.4005062Z 
2026-02-21T12:15:15.4005478Z [594s] Code of selected kernel: /tmp/torchinductor_root/oj/cojl3gfdofb74ozlqdr3s2mlz2oyripja4rpchstfy4yvxvvndgk.py
2026-02-21T12:15:15.4362446Z from __future__ import annotations
2026-02-21T12:15:15.4362683Z 
2026-02-21T12:15:15.4362767Z import torch
2026-02-21T12:15:15.4362962Z import helion
2026-02-21T12:15:15.4363164Z import triton
2026-02-21T12:15:15.4363365Z import triton.language as tl
2026-02-21T12:15:15.4364318Z from torch._inductor.runtime import triton_helpers
2026-02-21T12:15:15.4364785Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T12:15:15.4365245Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T12:15:15.4365544Z 
2026-02-21T12:15:15.4365649Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T12:15:15.4365908Z _BLOCK_SIZE_1 = tl.constexpr(8192)
2026-02-21T12:15:15.4366088Z 
2026-02-21T12:15:15.4366161Z @triton.jit
2026-02-21T12:15:15.4366427Z def _helion_softmax_two_pass(x, out, _NUM_SM: tl.constexpr):
2026-02-21T12:15:15.4366910Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:15:15.4367426Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:15:15.4367927Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:15:15.4368304Z     # src[softmax.py:79-92]: ...
2026-02-21T12:15:15.4368562Z     total_pids = 4096
2026-02-21T12:15:15.4369101Z     for virtual_pid in tl.range(tl.program_id(0), total_pids, _NUM_SM * 32, loop_unroll_factor=1, num_stages=2, flatten=True):
2026-02-21T12:15:15.4369745Z         # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:15:15.4370217Z         pid_0 = virtual_pid
2026-02-21T12:15:15.4370416Z         offset_0 = pid_0
2026-02-21T12:15:15.4370634Z         indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T12:15:15.4370998Z         # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:15:15.4371383Z         mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T12:15:15.4371740Z         # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:15:15.4372067Z         di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T12:15:15.4372421Z         # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:15:15.4372787Z         # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T12:15:15.4373116Z         # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T12:15:15.4373424Z         # src[softmax.py:82-89]: ...
2026-02-21T12:15:15.4373937Z         for offset_2 in tl.range(0, 6784, _BLOCK_SIZE_1, loop_unroll_factor=3, num_stages=1, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T12:15:15.4374691Z             indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:15:15.4375001Z             mask_1 = indices_2 < 6784
2026-02-21T12:15:15.4375218Z             mi_copy = mi
2026-02-21T12:15:15.4375405Z             di_copy = di
2026-02-21T12:15:15.4375581Z             mi_copy_0 = mi_copy
2026-02-21T12:15:15.4375781Z             di_copy_0 = di_copy
2026-02-21T12:15:15.4376012Z             # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T12:15:15.4376539Z             values = tl.load(x + (indices_0[:, None] * 6784 + indices_2[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_last')
2026-02-21T12:15:15.4377087Z             # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T12:15:15.4377661Z             _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T12:15:15.4378429Z             local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T12:15:15.4378781Z             # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T12:15:15.4379095Z             v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T12:15:15.4379376Z             v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T12:15:15.4379715Z             # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:15:15.4380037Z             v_2 = mi_copy_0 - v_1
2026-02-21T12:15:15.4380240Z             v_3 = libdevice.exp(v_2)
2026-02-21T12:15:15.4380447Z             v_4 = di_copy_0 * v_3
2026-02-21T12:15:15.4380674Z             # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T12:15:15.4381072Z             subscript = v_1[:, None]
2026-02-21T12:15:15.4381304Z             v_5 = tl.cast(values, tl.float32)
2026-02-21T12:15:15.4381523Z             v_6 = v_5 - subscript
2026-02-21T12:15:15.4381801Z             # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:15:15.4382141Z             # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T12:15:15.4382416Z             # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T12:15:15.4382636Z             v_7 = libdevice.exp(v_6)
2026-02-21T12:15:15.4383064Z             _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T12:15:15.4383554Z             sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T12:15:15.4383807Z             di = v_4 + sum_1
2026-02-21T12:15:15.4384163Z             # src[softmax.py:89]: mi = mi_next
2026-02-21T12:15:15.4384386Z             mi = v_1
2026-02-21T12:15:15.4384645Z         # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:15:15.4384996Z         # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T12:15:15.4385385Z         # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:15:15.4386001Z         for offset_2 in tl.range(0, 6784, _BLOCK_SIZE_1, loop_unroll_factor=3, num_stages=1, disallow_acc_multi_buffer=True, flatten=False):
2026-02-21T12:15:15.4386552Z             indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:15:15.4386851Z             mask_2 = indices_2 < 6784
2026-02-21T12:15:15.4387053Z             mi_copy_1 = mi
2026-02-21T12:15:15.4387236Z             di_copy_1 = di
2026-02-21T12:15:15.4387418Z             mi_copy_1_0 = mi_copy_1
2026-02-21T12:15:15.4387626Z             di_copy_1_0 = di_copy_1
2026-02-21T12:15:15.4387881Z             # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T12:15:15.4388370Z             values_1 = tl.load(x + (indices_0[:, None] * 6784 + indices_2[None, :] * 1), mask_2[None, :], other=0, eviction_policy='evict_last')
2026-02-21T12:15:15.4388969Z             # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:15:15.4389337Z             subscript_1 = mi_copy_1_0[:, None]
2026-02-21T12:15:15.4389576Z             v_9 = tl.cast(values_1, tl.float32)
2026-02-21T12:15:15.4389799Z             v_10 = v_9 - subscript_1
2026-02-21T12:15:15.4390013Z             v_11 = libdevice.exp(v_10)
2026-02-21T12:15:15.4390233Z             subscript_2 = di_copy_1_0[:, None]
2026-02-21T12:15:15.4390448Z             v_12 = v_11 / subscript_2
2026-02-21T12:15:15.4390659Z             v_13 = tl.cast(v_12, tl.float16)
2026-02-21T12:15:15.4390998Z             tl.store(out + (indices_0[:, None] * 6784 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T12:15:15.4391286Z 
2026-02-21T12:15:15.4391440Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T12:15:15.4391729Z     """
2026-02-21T12:15:15.4391990Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T12:15:15.4392381Z     This version uses fewer passes but is less numerically stable.
2026-02-21T12:15:15.4392796Z     Args:
2026-02-21T12:15:15.4392985Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T12:15:15.4393223Z     Returns:
2026-02-21T12:15:15.4393435Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T12:15:15.4393686Z     """
2026-02-21T12:15:15.4393856Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T12:15:15.4394180Z     m, n = x.size()
2026-02-21T12:15:15.4394374Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T12:15:15.4394621Z     out = torch.empty_like(x)
2026-02-21T12:15:15.4394891Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:15:15.4395219Z     _NUM_SM = helion.runtime.get_num_sm(x.device)
2026-02-21T12:15:15.4395675Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:15:15.4396089Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:15:15.4396486Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:15:15.4396786Z     # src[softmax.py:79-92]: ...
2026-02-21T12:15:15.4397146Z     _launcher(_helion_softmax_two_pass, (_NUM_SM * 32,), x, out, _NUM_SM, num_warps=4, num_stages=2)
2026-02-21T12:15:15.4397538Z     # src[softmax.py:93]: return out
2026-02-21T12:15:15.4397745Z     return out
2026-02-21T12:15:16.4387524Z WARNING:tritonbench.utils.triton_op:Completed input ID 51:
2026-02-21T12:15:16.4387904Z (M, N)
2026-02-21T12:15:16.4388073Z ------------
2026-02-21T12:15:16.4388256Z (4096, 6784)
2026-02-21T12:15:16.4388457Z 
2026-02-21T12:15:16.4411211Z  55%|█████▌    | 11/20 [1:12:11<1:10:42, 471.37s/it]WARNING:tritonbench.utils.triton_op:Running input ID 56:
2026-02-21T12:15:16.4411685Z (M, N)
2026-02-21T12:15:16.4411880Z ------------
2026-02-21T12:15:16.4412073Z (4096, 7424)
2026-02-21T12:15:16.4414854Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T12:15:17.8218776Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T12:15:19.4700259Z INFO:tritonbench.utils.triton_op:Took 3.62ms to get benchmark function for torch_compile_softmax
2026-02-21T12:15:20.9971390Z WARNING:__main__:Input tensor metadata:
2026-02-21T12:15:20.9971749Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T12:15:20.9972024Z               'dtype': 'torch.float16',
2026-02-21T12:15:20.9972298Z               'shape': (4096, 7424),
2026-02-21T12:15:20.9972568Z               'stride': (7424, 1)},),
2026-02-21T12:15:20.9972813Z   'kwargs': {}}
2026-02-21T12:15:21.0028399Z INFO:tritonbench.utils.triton_op:Took 6.02ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T12:15:21.2880692Z [0s] Autotune random seed: 2145258556
2026-02-21T12:15:21.3241739Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T12:15:57.3629050Z [36s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:15:57.7471681Z [36s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T12:16:03.3153791Z [41s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T12:16:06.0786147Z [44s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T12:16:07.3278091Z [46s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:16:07.6277192Z [46s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T12:16:18.4116513Z [57s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T12:16:18.4139211Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T12:16:26.4809022Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 12.4 configs/s
2026-02-21T12:16:26.4823610Z [65s] Adaptive compile timeout: 30s (90% percentile=25.5s, bounds=[30.0s, 30s])
2026-02-21T12:16:27.2356260Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1281.8 configs/s
2026-02-21T12:16:27.3191341Z [65s] Initial random population of 100, 5 starting points: 
2026-02-21T12:16:27.3191698Z error=4
2026-02-21T12:16:27.3191885Z timeout=7
2026-02-21T12:16:27.3192064Z ok=89
2026-02-21T12:16:27.3192239Z min=0.0578
2026-02-21T12:16:27.3192411Z mid=0.5760
2026-02-21T12:16:27.3192588Z max=101.8259
2026-02-21T12:16:27.3192792Z best={'block_sizes': [1, 8192],
2026-02-21T12:16:27.3193157Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:16:27.3193548Z  'load_eviction_policies': ['', 'first'],
2026-02-21T12:16:27.3193846Z  'maxnreg': 64,
2026-02-21T12:16:27.3194279Z  'num_sm_multiplier': 4,
2026-02-21T12:16:27.3194516Z  'num_stages': 1,
2026-02-21T12:16:27.3194726Z  'num_warps': 16,
2026-02-21T12:16:27.3194963Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:16:27.3195262Z  'range_flattens': [False, None],
2026-02-21T12:16:27.3195523Z  'range_multi_buffers': [True, None],
2026-02-21T12:16:27.3195793Z  'range_num_stages': [3, 1],
2026-02-21T12:16:27.3196053Z  'range_unroll_factors': [1, 3],
2026-02-21T12:16:27.3196306Z  'range_warp_specializes': []}
2026-02-21T12:16:27.3213604Z [65s] Fitting surrogate: 100 points, 100 targets
2026-02-21T12:16:28.7384203Z [67s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T12:17:07.1525874Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92/92 0.3 configs/s
2026-02-21T12:17:12.7242046Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 92/92 16.6 configs/s
2026-02-21T12:17:18.3050441Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 180.6         
2026-02-21T12:17:18.3050962Z                                                                   configs/s     
2026-02-21T12:17:18.6889092Z [117s] Generation 1 complete: 
2026-02-21T12:17:18.6890233Z error=2
2026-02-21T12:17:18.6890412Z ok=91
2026-02-21T12:17:18.6890600Z min=0.0482
2026-02-21T12:17:18.6890775Z mid=0.0771
2026-02-21T12:17:18.6890950Z max=0.4267
2026-02-21T12:17:18.6891136Z best={'block_sizes': [1, 8192],
2026-02-21T12:17:18.6891494Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:17:18.6891899Z  'load_eviction_policies': ['', 'first'],
2026-02-21T12:17:18.6892191Z  'num_stages': 1,
2026-02-21T12:17:18.6892389Z  'num_warps': 4,
2026-02-21T12:17:18.6892594Z  'pid_type': 'flat',
2026-02-21T12:17:18.6892827Z  'range_flattens': [None, None],
2026-02-21T12:17:18.6893088Z  'range_multi_buffers': [None, None],
2026-02-21T12:17:18.6893372Z  'range_num_stages': [0, 2],
2026-02-21T12:17:18.6893959Z  'range_unroll_factors': [0, 3],
2026-02-21T12:17:18.6894679Z  'range_warp_specializes': []}
2026-02-21T12:17:18.6910294Z [117s] Fitting surrogate: 193 points, 193 targets
2026-02-21T12:17:19.9306088Z [118s] Generation 2 starting: 72 neighbors, 5 active search path(s)
2026-02-21T12:17:48.2075424Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74/74 0.7 configs/s
2026-02-21T12:17:52.6665222Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 74/74 16.8 configs/s
2026-02-21T12:17:59.2084909Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 154.1         
2026-02-21T12:17:59.2088464Z                                                                   configs/s     
2026-02-21T12:17:59.6688671Z [158s] Generation 2 complete: 
2026-02-21T12:17:59.6688974Z error=2
2026-02-21T12:17:59.6689151Z ok=75
2026-02-21T12:17:59.6689329Z min=0.0477
2026-02-21T12:17:59.6689502Z mid=0.0649
2026-02-21T12:17:59.6689681Z max=0.3637
2026-02-21T12:17:59.6689876Z best={'block_sizes': [2, 8192],
2026-02-21T12:17:59.6690310Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:17:59.6690637Z  'load_eviction_policies': ['', ''],
2026-02-21T12:17:59.6690901Z  'num_stages': 2,
2026-02-21T12:17:59.6691122Z  'num_warps': 8,
2026-02-21T12:17:59.6691331Z  'pid_type': 'flat',
2026-02-21T12:17:59.6691559Z  'range_flattens': [None, False],
2026-02-21T12:17:59.6691817Z  'range_multi_buffers': [None, True],
2026-02-21T12:17:59.6692088Z  'range_num_stages': [0, 2],
2026-02-21T12:17:59.6692326Z  'range_unroll_factors': [0, 0],
2026-02-21T12:17:59.6692588Z  'range_warp_specializes': []}
2026-02-21T12:17:59.6712664Z [158s] Fitting surrogate: 270 points, 270 targets
2026-02-21T12:18:00.9556049Z [159s] Generation 3 starting: 68 neighbors, 5 active search path(s)
2026-02-21T12:18:27.6567896Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 0.8 configs/s
2026-02-21T12:18:32.0344878Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 16.4 configs/s
2026-02-21T12:18:41.2661506Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 122.9         
2026-02-21T12:18:41.2663755Z                                                                   configs/s     
2026-02-21T12:18:41.8397986Z [200s] Generation 3 complete: 
2026-02-21T12:18:41.8398946Z ok=73
2026-02-21T12:18:41.8399145Z min=0.0450
2026-02-21T12:18:41.8399324Z mid=0.0593
2026-02-21T12:18:41.8399500Z max=0.1369
2026-02-21T12:18:41.8399688Z best={'block_sizes': [1, 8192],
2026-02-21T12:18:41.8400036Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T12:18:41.8400419Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:18:41.8400722Z  'num_stages': 1,
2026-02-21T12:18:41.8400923Z  'num_warps': 16,
2026-02-21T12:18:41.8401119Z  'pid_type': 'flat',
2026-02-21T12:18:41.8401344Z  'range_flattens': [None, None],
2026-02-21T12:18:41.8401602Z  'range_multi_buffers': [None, True],
2026-02-21T12:18:41.8401873Z  'range_num_stages': [0, 1],
2026-02-21T12:18:41.8402112Z  'range_unroll_factors': [0, 0],
2026-02-21T12:18:41.8402704Z  'range_warp_specializes': []}
2026-02-21T12:18:41.8420633Z [200s] Fitting surrogate: 343 points, 343 targets
2026-02-21T12:18:42.7920527Z [201s] Generation 4 starting: 58 neighbors, 5 active search path(s)
2026-02-21T12:19:01.1645535Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 4.5 configs/s
2026-02-21T12:19:04.9194951Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.4 configs/s
2026-02-21T12:19:12.8069326Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.1         
2026-02-21T12:19:12.8071164Z                                                                   configs/s     
2026-02-21T12:19:13.3797675Z [232s] Generation 4 complete: 
2026-02-21T12:19:13.3797974Z ok=63
2026-02-21T12:19:13.3798164Z min=0.0447
2026-02-21T12:19:13.3798347Z mid=0.0486
2026-02-21T12:19:13.3798514Z max=0.1995
2026-02-21T12:19:13.3798707Z best={'block_sizes': [1, 8192],
2026-02-21T12:19:13.3799059Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:19:13.3799499Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:19:13.3799791Z  'num_stages': 2,
2026-02-21T12:19:13.3799997Z  'num_warps': 16,
2026-02-21T12:19:13.3800231Z  'pid_type': 'flat',
2026-02-21T12:19:13.3800468Z  'range_flattens': [None, None],
2026-02-21T12:19:13.3800731Z  'range_multi_buffers': [None, None],
2026-02-21T12:19:13.3801003Z  'range_num_stages': [0, 2],
2026-02-21T12:19:13.3801244Z  'range_unroll_factors': [0, 3],
2026-02-21T12:19:13.3801493Z  'range_warp_specializes': []}
2026-02-21T12:19:13.3829746Z [232s] Fitting surrogate: 406 points, 406 targets
2026-02-21T12:19:14.4023293Z [233s] Generation 5 starting: 58 neighbors, 5 active search path(s)
2026-02-21T12:19:33.5958791Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59/59 1.1 configs/s
2026-02-21T12:19:37.1825173Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 59/59 16.7 configs/s
2026-02-21T12:19:45.0301372Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.8         
2026-02-21T12:19:45.0304324Z                                                                   configs/s     
2026-02-21T12:19:45.6032756Z [264s] Generation 5 complete: 
2026-02-21T12:19:45.6033112Z error=1
2026-02-21T12:19:45.6033291Z ok=62
2026-02-21T12:19:45.6033464Z min=0.0444
2026-02-21T12:19:45.6033635Z mid=0.0469
2026-02-21T12:19:45.6033808Z max=0.8474
2026-02-21T12:19:45.6034448Z best={'block_sizes': [1, 8192],
2026-02-21T12:19:45.6034829Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:19:45.6035233Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:19:45.6035523Z  'num_stages': 2,
2026-02-21T12:19:45.6035727Z  'num_warps': 16,
2026-02-21T12:19:45.6035921Z  'pid_type': 'flat',
2026-02-21T12:19:45.6036146Z  'range_flattens': [None, None],
2026-02-21T12:19:45.6036398Z  'range_multi_buffers': [None, None],
2026-02-21T12:19:45.6036667Z  'range_num_stages': [0, 2],
2026-02-21T12:19:45.6036904Z  'range_unroll_factors': [0, 3],
2026-02-21T12:19:45.6037174Z  'range_warp_specializes': []}
2026-02-21T12:19:45.6065975Z [264s] Fitting surrogate: 469 points, 469 targets
2026-02-21T12:19:46.3423428Z [265s] Generation 6 starting: 39 neighbors, 4 active search path(s)
2026-02-21T12:19:59.4120399Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 2.7 configs/s
2026-02-21T12:20:01.8242682Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 39/39 16.5 configs/s
2026-02-21T12:20:08.5898749Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 178.7         
2026-02-21T12:20:08.5900789Z                                                                   configs/s     
2026-02-21T12:20:09.0165444Z [287s] Generation 6 complete: 
2026-02-21T12:20:09.0165763Z ok=44
2026-02-21T12:20:09.0165945Z min=0.0447
2026-02-21T12:20:09.0166131Z mid=0.0452
2026-02-21T12:20:09.0166299Z max=0.0793
2026-02-21T12:20:09.0166500Z best={'block_sizes': [1, 8192],
2026-02-21T12:20:09.0166866Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:20:09.0167923Z  'load_eviction_policies': ['', ''],
2026-02-21T12:20:09.0168211Z  'num_stages': 5,
2026-02-21T12:20:09.0168420Z  'num_warps': 4,
2026-02-21T12:20:09.0168618Z  'pid_type': 'flat',
2026-02-21T12:20:09.0168870Z  'range_flattens': [None, False],
2026-02-21T12:20:09.0169155Z  'range_multi_buffers': [None, None],
2026-02-21T12:20:09.0169423Z  'range_num_stages': [0, 1],
2026-02-21T12:20:09.0169667Z  'range_unroll_factors': [0, 1],
2026-02-21T12:20:09.0169917Z  'range_warp_specializes': []}
2026-02-21T12:20:09.0195650Z [287s] Fitting surrogate: 513 points, 513 targets
2026-02-21T12:20:09.6899709Z [288s] Generation 7 starting: 33 neighbors, 3 active search path(s)
2026-02-21T12:20:22.2892384Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 0.7 configs/s
2026-02-21T12:20:24.2699761Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 33/33 17.0 configs/s
2026-02-21T12:20:28.6493319Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 230.2         
2026-02-21T12:20:28.6494669Z                                                                   configs/s     
2026-02-21T12:20:28.9962069Z [307s] Generation 7 complete: 
2026-02-21T12:20:28.9962417Z ok=36
2026-02-21T12:20:28.9962606Z min=0.0476
2026-02-21T12:20:28.9962796Z mid=0.0488
2026-02-21T12:20:28.9962962Z max=0.0989
2026-02-21T12:20:28.9963154Z best={'block_sizes': [1, 8192],
2026-02-21T12:20:28.9963478Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T12:20:28.9963830Z  'load_eviction_policies': ['', ''],
2026-02-21T12:20:28.9964519Z  'num_stages': 1,
2026-02-21T12:20:28.9964730Z  'num_warps': 16,
2026-02-21T12:20:28.9964925Z  'pid_type': 'flat',
2026-02-21T12:20:28.9965164Z  'range_flattens': [None, False],
2026-02-21T12:20:28.9965441Z  'range_multi_buffers': [None, None],
2026-02-21T12:20:28.9965721Z  'range_num_stages': [0, 3],
2026-02-21T12:20:28.9965969Z  'range_unroll_factors': [0, 0],
2026-02-21T12:20:28.9966225Z  'range_warp_specializes': []}
2026-02-21T12:20:28.9997005Z [307s] Fitting surrogate: 549 points, 549 targets
2026-02-21T12:20:29.4773310Z [308s] Generation 8 starting: 20 neighbors, 2 active search path(s)
2026-02-21T12:20:36.4794513Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 6.7 configs/s
2026-02-21T12:20:37.8136875Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 22/22 17.1 configs/s
2026-02-21T12:20:40.9530796Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 320.1         
2026-02-21T12:20:40.9531347Z                                                                   configs/s     
2026-02-21T12:20:41.1993486Z [319s] Generation 8 complete: 
2026-02-21T12:20:41.1993789Z ok=23
2026-02-21T12:20:41.1994396Z min=0.0450
2026-02-21T12:20:41.1994589Z mid=0.0452
2026-02-21T12:20:41.1994766Z max=0.0651
2026-02-21T12:20:41.1994957Z best={'block_sizes': [1, 8192],
2026-02-21T12:20:41.1995306Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T12:20:41.1995657Z  'load_eviction_policies': ['', ''],
2026-02-21T12:20:41.1995950Z  'num_stages': 1,
2026-02-21T12:20:41.1996145Z  'num_warps': 16,
2026-02-21T12:20:41.1996345Z  'pid_type': 'flat',
2026-02-21T12:20:41.1996575Z  'range_flattens': [None, False],
2026-02-21T12:20:41.1997344Z  'range_multi_buffers': [None, None],
2026-02-21T12:20:41.1997576Z  'range_num_stages': [0, 3],
2026-02-21T12:20:41.1997780Z  'range_unroll_factors': [0, 0],
2026-02-21T12:20:41.1998002Z  'range_warp_specializes': []}
2026-02-21T12:20:41.2025897Z [319s] Fitting surrogate: 572 points, 572 targets
2026-02-21T12:20:41.7241845Z [320s] Generation 9 starting: 24 neighbors, 2 active search path(s)
2026-02-21T12:20:50.0952155Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 2.5 configs/s
2026-02-21T12:20:51.5497831Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 24/24 17.0 configs/s
2026-02-21T12:20:55.1321345Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 280.8         
2026-02-21T12:20:55.1323072Z                                                                   configs/s     
2026-02-21T12:20:55.4065281Z [334s] Generation 9 complete: 
2026-02-21T12:20:55.4065539Z ok=27
2026-02-21T12:20:55.4065704Z min=0.0477
2026-02-21T12:20:55.4065906Z mid=0.0487
2026-02-21T12:20:55.4066070Z max=0.0802
2026-02-21T12:20:55.4066255Z best={'block_sizes': [1, 8192],
2026-02-21T12:20:55.4066761Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:20:55.4067531Z  'load_eviction_policies': ['', ''],
2026-02-21T12:20:55.4067966Z  'num_stages': 3,
2026-02-21T12:20:55.4068282Z  'num_warps': 16,
2026-02-21T12:20:55.4068601Z  'pid_type': 'flat',
2026-02-21T12:20:55.4068951Z  'range_flattens': [None, False],
2026-02-21T12:20:55.4069380Z  'range_multi_buffers': [None, None],
2026-02-21T12:20:55.4069800Z  'range_num_stages': [0, 3],
2026-02-21T12:20:55.4070187Z  'range_unroll_factors': [0, 1],
2026-02-21T12:20:55.4070612Z  'range_warp_specializes': []}
2026-02-21T12:20:55.4097626Z [334s] Fitting surrogate: 599 points, 599 targets
2026-02-21T12:20:55.8634701Z [334s] Generation 10 starting: 24 neighbors, 2 active search path(s)
2026-02-21T12:21:08.5639636Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 1.7 configs/s
2026-02-21T12:21:10.8702218Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 11.3 configs/s
2026-02-21T12:21:14.0691651Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 313.9         
2026-02-21T12:21:14.0696689Z                                                                   configs/s     
2026-02-21T12:21:14.3144543Z [352s] Generation 10 complete: 
2026-02-21T12:21:14.3144780Z ok=27
2026-02-21T12:21:14.3144950Z min=0.0478
2026-02-21T12:21:14.3145117Z mid=0.0490
2026-02-21T12:21:14.3145284Z max=0.1110
2026-02-21T12:21:14.3145462Z best={'block_sizes': [1, 8192],
2026-02-21T12:21:14.3145778Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:21:14.3146117Z  'load_eviction_policies': ['', ''],
2026-02-21T12:21:14.3146361Z  'num_stages': 3,
2026-02-21T12:21:14.3146577Z  'num_warps': 16,
2026-02-21T12:21:14.3146764Z  'pid_type': 'flat',
2026-02-21T12:21:14.3146975Z  'range_flattens': [None, False],
2026-02-21T12:21:14.3147224Z  'range_multi_buffers': [None, None],
2026-02-21T12:21:14.5071873Z  'range_num_stages': [0, 3],
2026-02-21T12:21:14.5072107Z  'range_unroll_factors': [0, 1],
2026-02-21T12:21:14.5072349Z  'range_warp_specializes': []}
2026-02-21T12:21:14.5072626Z [352s] Fitting surrogate: 626 points, 626 targets
2026-02-21T12:21:14.7811022Z [353s] Generation 11 starting: 22 neighbors, 2 active search path(s)
2026-02-21T12:21:22.3803616Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 3.2 configs/s
2026-02-21T12:21:23.8436139Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 16.9 configs/s
2026-02-21T12:21:27.0391488Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 314.2         
2026-02-21T12:21:27.0392009Z                                                                   configs/s     
2026-02-21T12:21:27.2837103Z [365s] Generation 11 complete: 
2026-02-21T12:21:27.2837562Z ok=25
2026-02-21T12:21:27.2837833Z min=0.0478
2026-02-21T12:21:27.2838159Z mid=0.0489
2026-02-21T12:21:27.2838420Z max=0.1759
2026-02-21T12:21:27.2838750Z best={'block_sizes': [1, 8192],
2026-02-21T12:21:27.2839269Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:21:27.2839623Z  'load_eviction_policies': ['', ''],
2026-02-21T12:21:27.2839882Z  'num_stages': 3,
2026-02-21T12:21:27.2840074Z  'num_warps': 16,
2026-02-21T12:21:27.2840289Z  'pid_type': 'flat',
2026-02-21T12:21:27.2840516Z  'range_flattens': [None, False],
2026-02-21T12:21:27.2840784Z  'range_multi_buffers': [None, False],
2026-02-21T12:21:27.2841052Z  'range_num_stages': [0, 3],
2026-02-21T12:21:27.2841296Z  'range_unroll_factors': [0, 1],
2026-02-21T12:21:27.2841550Z  'range_warp_specializes': []}
2026-02-21T12:21:27.2869991Z [365s] Fitting surrogate: 651 points, 651 targets
2026-02-21T12:21:27.7158358Z [366s] Generation 12 starting: 19 neighbors, 2 active search path(s)
2026-02-21T12:21:34.6189939Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21/21 7.1 configs/s
2026-02-21T12:21:35.9053110Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 21/21 16.9 configs/s
2026-02-21T12:21:38.3692672Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 406.5         
2026-02-21T12:21:38.3693163Z                                                                   configs/s     
2026-02-21T12:21:38.5667939Z [377s] Generation 12 complete: 
2026-02-21T12:21:38.5668375Z ok=22
2026-02-21T12:21:38.5668667Z min=0.0446
2026-02-21T12:21:38.5668948Z mid=0.0479
2026-02-21T12:21:38.5669220Z max=0.0989
2026-02-21T12:21:38.5669522Z best={'block_sizes': [1, 8192],
2026-02-21T12:21:38.5670023Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:21:38.5670582Z  'load_eviction_policies': ['', ''],
2026-02-21T12:21:38.5670993Z  'num_stages': 3,
2026-02-21T12:21:38.5671308Z  'num_warps': 16,
2026-02-21T12:21:38.5671618Z  'pid_type': 'flat',
2026-02-21T12:21:38.5672043Z  'range_flattens': [None, False],
2026-02-21T12:21:38.5672465Z  'range_multi_buffers': [None, False],
2026-02-21T12:21:38.5672901Z  'range_num_stages': [0, 3],
2026-02-21T12:21:38.5673303Z  'range_unroll_factors': [0, 1],
2026-02-21T12:21:38.5673712Z  'range_warp_specializes': []}
2026-02-21T12:21:38.5701976Z [377s] Fitting surrogate: 673 points, 673 targets
2026-02-21T12:21:38.8760934Z [377s] Generation 13 starting: 11 neighbors, 1 active search path(s)
2026-02-21T12:21:43.3016682Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 3.3 configs/s
2026-02-21T12:21:43.9707316Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.7 configs/s
2026-02-21T12:21:45.7280072Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 567.0         
2026-02-21T12:21:45.7280604Z                                                                   configs/s     
2026-02-21T12:21:45.8814586Z [384s] Generation 13 complete: 
2026-02-21T12:21:45.8815049Z ok=13
2026-02-21T12:21:45.8815387Z min=0.0478
2026-02-21T12:21:45.8815666Z mid=0.0489
2026-02-21T12:21:45.8815932Z max=0.0532
2026-02-21T12:21:45.8816220Z best={'block_sizes': [1, 8192],
2026-02-21T12:21:45.8817473Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:21:45.8818028Z  'load_eviction_policies': ['', ''],
2026-02-21T12:21:45.8818438Z  'num_stages': 5,
2026-02-21T12:21:45.8818761Z  'num_warps': 16,
2026-02-21T12:21:45.8819068Z  'pid_type': 'flat',
2026-02-21T12:21:45.8819423Z  'range_flattens': [None, False],
2026-02-21T12:21:45.8819840Z  'range_multi_buffers': [None, False],
2026-02-21T12:21:45.8820276Z  'range_num_stages': [0, 2],
2026-02-21T12:21:45.8820653Z  'range_unroll_factors': [0, 0],
2026-02-21T12:21:45.8821069Z  'range_warp_specializes': []}
2026-02-21T12:21:45.8848878Z [384s] Fitting surrogate: 686 points, 686 targets
2026-02-21T12:21:46.1841236Z [384s] Generation 14 starting: 11 neighbors, 1 active search path(s)
2026-02-21T12:21:52.7084665Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.7 configs/s
2026-02-21T12:21:53.4498580Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.2 configs/s
2026-02-21T12:21:54.9822487Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 648.1         
2026-02-21T12:21:54.9822990Z                                                                   configs/s     
2026-02-21T12:21:55.1163748Z [393s] Generation 14 complete: 
2026-02-21T12:21:55.1164458Z ok=13
2026-02-21T12:21:55.1164751Z min=0.0479
2026-02-21T12:21:55.1165024Z mid=0.0492
2026-02-21T12:21:55.1165292Z max=0.1757
2026-02-21T12:21:55.1165592Z best={'block_sizes': [1, 8192],
2026-02-21T12:21:55.1166114Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:21:55.1166667Z  'load_eviction_policies': ['', ''],
2026-02-21T12:21:55.1167081Z  'num_stages': 5,
2026-02-21T12:21:55.1167392Z  'num_warps': 16,
2026-02-21T12:21:55.1167713Z  'pid_type': 'flat',
2026-02-21T12:21:55.1168064Z  'range_flattens': [None, False],
2026-02-21T12:21:55.1168546Z  'range_multi_buffers': [None, False],
2026-02-21T12:21:55.1169025Z  'range_num_stages': [0, 2],
2026-02-21T12:21:55.1169277Z  'range_unroll_factors': [0, 0],
2026-02-21T12:21:55.1169508Z  'range_warp_specializes': []}
2026-02-21T12:21:55.1197445Z [393s] Fitting surrogate: 699 points, 699 targets
2026-02-21T12:21:55.4370918Z [394s] Generation 15 starting: 12 neighbors, 1 active search path(s)
2026-02-21T12:21:59.7781956Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 7.3 configs/s
2026-02-21T12:22:00.5784673Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.2 configs/s
2026-02-21T12:22:02.0394760Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 680.4         
2026-02-21T12:22:02.0395316Z                                                                   configs/s     
2026-02-21T12:22:02.1722412Z [400s] Generation 15 complete: 
2026-02-21T12:22:02.1722839Z ok=14
2026-02-21T12:22:02.1723125Z min=0.0449
2026-02-21T12:22:02.1723465Z mid=0.0455
2026-02-21T12:22:02.1723660Z max=0.0738
2026-02-21T12:22:02.1723825Z best={'block_sizes': [1, 8192],
2026-02-21T12:22:02.1724437Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:22:02.1724841Z  'load_eviction_policies': ['', ''],
2026-02-21T12:22:02.1725062Z  'num_stages': 5,
2026-02-21T12:22:02.1725242Z  'num_warps': 16,
2026-02-21T12:22:02.1725407Z  'pid_type': 'flat',
2026-02-21T12:22:02.1725596Z  'range_flattens': [None, False],
2026-02-21T12:22:02.1725824Z  'range_multi_buffers': [None, False],
2026-02-21T12:22:02.1726061Z  'range_num_stages': [0, 1],
2026-02-21T12:22:02.1726268Z  'range_unroll_factors': [0, 0],
2026-02-21T12:22:02.1726481Z  'range_warp_specializes': []}
2026-02-21T12:22:02.1759616Z [400s] Fitting surrogate: 713 points, 713 targets
2026-02-21T12:22:02.4772942Z [401s] Generation 16 starting: 10 neighbors, 1 active search path(s)
2026-02-21T12:22:05.7437150Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━ 10/10 10.4 configs/s
2026-02-21T12:22:06.3531634Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 10/10 17.8 configs/s
2026-02-21T12:22:07.8371927Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 669.7         
2026-02-21T12:22:07.8373013Z                                                                   configs/s     
2026-02-21T12:22:07.9720141Z [406s] Generation 16 complete: 
2026-02-21T12:22:07.9720420Z ok=11
2026-02-21T12:22:07.9720599Z min=0.0478
2026-02-21T12:22:07.9720799Z mid=0.0478
2026-02-21T12:22:07.9720969Z max=0.0603
2026-02-21T12:22:07.9721160Z best={'block_sizes': [1, 8192],
2026-02-21T12:22:07.9721539Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:22:07.9721968Z  'load_eviction_policies': ['', ''],
2026-02-21T12:22:07.9722230Z  'num_stages': 5,
2026-02-21T12:22:07.9722425Z  'num_warps': 16,
2026-02-21T12:22:07.9722624Z  'pid_type': 'flat',
2026-02-21T12:22:07.9722846Z  'range_flattens': [None, None],
2026-02-21T12:22:07.9723558Z  'range_multi_buffers': [None, False],
2026-02-21T12:22:07.9723864Z  'range_num_stages': [0, 1],
2026-02-21T12:22:07.9724510Z  'range_unroll_factors': [0, 0],
2026-02-21T12:22:07.9724764Z  'range_warp_specializes': []}
2026-02-21T12:22:07.9754792Z [406s] Fitting surrogate: 724 points, 724 targets
2026-02-21T12:22:08.2650297Z [406s] Generation 17 starting: 10 neighbors, 1 active search path(s)
2026-02-21T12:22:12.0117056Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 7.3 configs/s
2026-02-21T12:22:12.6847710Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.5 configs/s
2026-02-21T12:22:13.9121032Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 805.3         
2026-02-21T12:22:13.9121855Z                                                                   configs/s     
2026-02-21T12:22:14.0275531Z [412s] Generation 17 complete: 
2026-02-21T12:22:14.0275792Z ok=12
2026-02-21T12:22:14.0275970Z min=0.0478
2026-02-21T12:22:14.0276158Z mid=0.0495
2026-02-21T12:22:14.0276360Z max=0.0858
2026-02-21T12:22:14.0276557Z best={'block_sizes': [1, 8192],
2026-02-21T12:22:14.0276949Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:22:14.0277392Z  'load_eviction_policies': ['', ''],
2026-02-21T12:22:14.0277649Z  'num_stages': 5,
2026-02-21T12:22:14.0277848Z  'num_warps': 16,
2026-02-21T12:22:14.0278043Z  'pid_type': 'flat',
2026-02-21T12:22:14.0278281Z  'range_flattens': [None, None],
2026-02-21T12:22:14.0278538Z  'range_multi_buffers': [None, False],
2026-02-21T12:22:14.0278810Z  'range_num_stages': [0, 1],
2026-02-21T12:22:14.0279053Z  'range_unroll_factors': [0, 0],
2026-02-21T12:22:14.0279305Z  'range_warp_specializes': []}
2026-02-21T12:22:14.0311219Z [412s] Fitting surrogate: 736 points, 736 targets
2026-02-21T12:22:14.1937513Z [412s] Autotuning complete in 412.9s after searching 696 configs.
2026-02-21T12:22:14.1937942Z One can hardcode the best config and skip autotuning with:
2026-02-21T12:22:14.1939394Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['tensor_descriptor', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=5, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[]), static_shapes=True)
2026-02-21T12:22:14.1940744Z 
2026-02-21T12:22:14.1941117Z [412s] Code of selected kernel: /tmp/torchinductor_root/f7/cf743fzxkmpfv6ceesolia6gafat4edewwdtdh75g3dpmzd7mcnr.py
2026-02-21T12:22:14.2265290Z from __future__ import annotations
2026-02-21T12:22:14.2265480Z 
2026-02-21T12:22:14.2265556Z import torch
2026-02-21T12:22:14.2265750Z import triton
2026-02-21T12:22:14.2265942Z import triton.language as tl
2026-02-21T12:22:14.2266232Z from torch._inductor.runtime import triton_helpers
2026-02-21T12:22:14.2266619Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T12:22:14.2267050Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T12:22:14.2267331Z 
2026-02-21T12:22:14.2267418Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T12:22:14.2267660Z _BLOCK_SIZE_1 = tl.constexpr(8192)
2026-02-21T12:22:14.2268304Z 
2026-02-21T12:22:14.2268378Z @triton.jit
2026-02-21T12:22:14.2268599Z def _helion_softmax_two_pass(x, out):
2026-02-21T12:22:14.2268968Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:22:14.2269353Z     pid_0 = tl.program_id(0)
2026-02-21T12:22:14.2269578Z     offset_0 = pid_0
2026-02-21T12:22:14.2269816Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T12:22:14.2270224Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:22:14.2270662Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T12:22:14.2271063Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:22:14.2271455Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T12:22:14.2272131Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:22:14.2272548Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T12:22:14.2272908Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T12:22:14.2273255Z     # src[softmax.py:82-89]: ...
2026-02-21T12:22:14.2273653Z     for offset_2 in tl.range(0, 7424, _BLOCK_SIZE_1, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T12:22:14.2274612Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:22:14.2274948Z         mask_1 = indices_2 < 7424
2026-02-21T12:22:14.2275169Z         mi_copy = mi
2026-02-21T12:22:14.2275349Z         di_copy = di
2026-02-21T12:22:14.2275531Z         mi_copy_0 = mi_copy
2026-02-21T12:22:14.2275727Z         di_copy_0 = di_copy
2026-02-21T12:22:14.2275965Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T12:22:14.2276413Z         values = tl.load(x + (indices_0[:, None] * 7424 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T12:22:14.2276897Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T12:22:14.2277492Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T12:22:14.2278086Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T12:22:14.2278454Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T12:22:14.2278782Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T12:22:14.2279056Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T12:22:14.2279412Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:22:14.2279744Z         v_2 = mi_copy_0 - v_1
2026-02-21T12:22:14.2279962Z         v_3 = libdevice.exp(v_2)
2026-02-21T12:22:14.2280172Z         v_4 = di_copy_0 * v_3
2026-02-21T12:22:14.2280414Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T12:22:14.2280686Z         subscript = v_1[:, None]
2026-02-21T12:22:14.2280911Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T12:22:14.2281153Z         v_6 = v_5 - subscript
2026-02-21T12:22:14.2281442Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:22:14.2281820Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T12:22:14.2282111Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T12:22:14.2282348Z         v_7 = libdevice.exp(v_6)
2026-02-21T12:22:14.2282765Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T12:22:14.2283231Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T12:22:14.2283478Z         di = v_4 + sum_1
2026-02-21T12:22:14.2283661Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T12:22:14.2283873Z         mi = v_1
2026-02-21T12:22:14.2284261Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:22:14.2284635Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T12:22:14.2285032Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:22:14.2285710Z     for offset_2 in tl.range(0, 7424, _BLOCK_SIZE_1, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T12:22:14.2286169Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:22:14.2286464Z         mask_2 = indices_2 < 7424
2026-02-21T12:22:14.2286672Z         mi_copy_1 = mi
2026-02-21T12:22:14.2286834Z         di_copy_1 = di
2026-02-21T12:22:14.2287015Z         mi_copy_1_0 = mi_copy_1
2026-02-21T12:22:14.2287204Z         di_copy_1_0 = di_copy_1
2026-02-21T12:22:14.2287434Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T12:22:14.2287833Z         values_1 = tl.load(x + (indices_0[:, None] * 7424 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T12:22:14.2288481Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:22:14.2288861Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T12:22:14.2289096Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T12:22:14.2289333Z         v_10 = v_9 - subscript_1
2026-02-21T12:22:14.2289537Z         v_11 = libdevice.exp(v_10)
2026-02-21T12:22:14.2289754Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T12:22:14.2290058Z         v_12 = v_11 / subscript_2
2026-02-21T12:22:14.2290270Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T12:22:14.2290611Z         tl.store(out + (indices_0[:, None] * 7424 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T12:22:14.2290891Z 
2026-02-21T12:22:14.2291048Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T12:22:14.2291340Z     """
2026-02-21T12:22:14.2291587Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T12:22:14.2291984Z     This version uses fewer passes but is less numerically stable.
2026-02-21T12:22:14.2292256Z     Args:
2026-02-21T12:22:14.2292444Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T12:22:14.2292699Z     Returns:
2026-02-21T12:22:14.2292913Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T12:22:14.2293169Z     """
2026-02-21T12:22:14.2293320Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T12:22:14.2293543Z     m, n = x.size()
2026-02-21T12:22:14.2293734Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T12:22:14.2294112Z     out = torch.empty_like(x)
2026-02-21T12:22:14.2294389Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:22:14.2294793Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:22:14.2295203Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:22:14.2295495Z     # src[softmax.py:79-92]: ...
2026-02-21T12:22:14.2295808Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=16, num_stages=5)
2026-02-21T12:22:14.2296141Z     # src[softmax.py:93]: return out
2026-02-21T12:22:14.2296342Z     return out
2026-02-21T12:22:15.4795315Z WARNING:tritonbench.utils.triton_op:Completed input ID 56:
2026-02-21T12:22:15.4795761Z (M, N)
2026-02-21T12:22:15.4795948Z ------------
2026-02-21T12:22:15.4796142Z (4096, 7424)
2026-02-21T12:22:15.4796274Z 
2026-02-21T12:22:15.4817182Z  60%|██████    | 12/20 [1:19:10<1:00:43, 455.45s/it]WARNING:tritonbench.utils.triton_op:Running input ID 61:
2026-02-21T12:22:15.4817667Z (M, N)
2026-02-21T12:22:15.4817837Z ------------
2026-02-21T12:22:15.4818020Z (4096, 8064)
2026-02-21T12:22:15.4819715Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T12:22:16.8577673Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T12:22:18.4846536Z INFO:tritonbench.utils.triton_op:Took 3.10ms to get benchmark function for torch_compile_softmax
2026-02-21T12:22:20.0434760Z WARNING:__main__:Input tensor metadata:
2026-02-21T12:22:20.0435329Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T12:22:20.0435776Z               'dtype': 'torch.float16',
2026-02-21T12:22:20.0436766Z               'shape': (4096, 8064),
2026-02-21T12:22:20.0437024Z               'stride': (8064, 1)},),
2026-02-21T12:22:20.0437263Z   'kwargs': {}}
2026-02-21T12:22:20.0477291Z INFO:tritonbench.utils.triton_op:Took 4.59ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T12:22:20.3363048Z [0s] Autotune random seed: 2145258556
2026-02-21T12:22:20.3720341Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T12:22:55.6549213Z [35s] Timeout after 30s compiling Config(block_sizes=[64, 256], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=128, num_stages=3, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, True], range_multi_buffers=[True, True], range_num_stages=[0, 4], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:22:56.0522653Z [35s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[True, True], range_num_stages=[2, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T12:23:02.0485924Z [41s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T12:23:05.0199946Z [44s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T12:23:06.3064649Z [45s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:23:06.6240456Z [46s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T12:23:10.6152584Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T12:23:20.8006326Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━━ 100/100 9.8 configs/s
2026-02-21T12:23:20.8019524Z [60s] Adaptive compile timeout: 30s (90% percentile=26.7s, bounds=[30.0s, 30s])
2026-02-21T12:23:21.5717504Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 1254.8 configs/s
2026-02-21T12:23:21.6561318Z [61s] Initial random population of 100, 5 starting points: 
2026-02-21T12:23:21.6561927Z error=4
2026-02-21T12:23:21.6562202Z timeout=6
2026-02-21T12:23:21.6562481Z ok=90
2026-02-21T12:23:21.6562744Z min=0.0588
2026-02-21T12:23:21.6563015Z mid=0.6513
2026-02-21T12:23:21.6571249Z max=107.4105
2026-02-21T12:23:21.6571490Z best={'block_sizes': [1, 8192],
2026-02-21T12:23:21.6571828Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:23:21.6572162Z  'load_eviction_policies': ['', 'first'],
2026-02-21T12:23:21.6719622Z  'maxnreg': 64,
2026-02-21T12:23:21.6719960Z  'num_sm_multiplier': 4,
2026-02-21T12:23:21.6720323Z  'num_stages': 1,
2026-02-21T12:23:21.6720627Z  'num_warps': 16,
2026-02-21T12:23:21.6720982Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:23:21.6721445Z  'range_flattens': [False, None],
2026-02-21T12:23:21.6721872Z  'range_multi_buffers': [True, None],
2026-02-21T12:23:21.6722298Z  'range_num_stages': [3, 1],
2026-02-21T12:23:21.6722686Z  'range_unroll_factors': [1, 3],
2026-02-21T12:23:21.6723118Z  'range_warp_specializes': []}
2026-02-21T12:23:21.6723593Z [61s] Fitting surrogate: 100 points, 100 targets
2026-02-21T12:23:23.0806737Z [62s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T12:23:53.6460459Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 3.3 configs/s
2026-02-21T12:24:00.6473594Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 13.3 configs/s
2026-02-21T12:24:08.1528952Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 134.3         
2026-02-21T12:24:08.1529494Z                                                                   configs/s     
2026-02-21T12:24:08.6401024Z [108s] Generation 1 complete: 
2026-02-21T12:24:08.6401326Z error=4
2026-02-21T12:24:08.6401513Z ok=90
2026-02-21T12:24:08.6401703Z min=0.0516
2026-02-21T12:24:08.6401889Z mid=0.0783
2026-02-21T12:24:08.6402068Z max=0.4778
2026-02-21T12:24:08.6402264Z best={'block_sizes': [2, 8192],
2026-02-21T12:24:08.6402622Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:24:08.6403039Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:24:08.6403324Z  'maxnreg': 64,
2026-02-21T12:24:08.6403536Z  'num_sm_multiplier': 4,
2026-02-21T12:24:08.6403764Z  'num_stages': 1,
2026-02-21T12:24:08.6404340Z  'num_warps': 16,
2026-02-21T12:24:08.6404610Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:24:08.6404910Z  'range_flattens': [False, None],
2026-02-21T12:24:08.6405179Z  'range_multi_buffers': [True, None],
2026-02-21T12:24:08.6405458Z  'range_num_stages': [3, 1],
2026-02-21T12:24:08.6405707Z  'range_unroll_factors': [1, 3],
2026-02-21T12:24:08.6405961Z  'range_warp_specializes': []}
2026-02-21T12:24:08.6422782Z [108s] Fitting surrogate: 194 points, 194 targets
2026-02-21T12:24:10.1413883Z [109s] Generation 2 starting: 93 neighbors, 5 active search path(s)
2026-02-21T12:24:43.6810941Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96/96 1.6 configs/s
2026-02-21T12:24:49.5940703Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 96/96 16.4 configs/s
2026-02-21T12:24:59.6927048Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 112.6         
2026-02-21T12:24:59.6928742Z                                                                   configs/s     
2026-02-21T12:25:00.2887245Z [159s] Generation 2 complete: 
2026-02-21T12:25:00.2887581Z error=1
2026-02-21T12:25:00.2887763Z ok=98
2026-02-21T12:25:00.2887941Z min=0.0519
2026-02-21T12:25:00.2888115Z mid=0.0726
2026-02-21T12:25:00.9991176Z max=1.7138
2026-02-21T12:25:00.9991406Z best={'block_sizes': [1, 8192],
2026-02-21T12:25:00.9991799Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:25:00.9992199Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:25:00.9992495Z  'num_stages': 1,
2026-02-21T12:25:00.9992696Z  'num_warps': 16,
2026-02-21T12:25:00.9992905Z  'pid_type': 'flat',
2026-02-21T12:25:00.9993134Z  'range_flattens': [None, None],
2026-02-21T12:25:00.9993393Z  'range_multi_buffers': [None, None],
2026-02-21T12:25:00.9993666Z  'range_num_stages': [0, 1],
2026-02-21T12:25:00.9993901Z  'range_unroll_factors': [0, 3],
2026-02-21T12:25:00.9994378Z  'range_warp_specializes': []}
2026-02-21T12:25:00.9994681Z [159s] Fitting surrogate: 293 points, 293 targets
2026-02-21T12:25:01.4677678Z [161s] Generation 3 starting: 71 neighbors, 5 active search path(s)
2026-02-21T12:25:29.0163583Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71/71 1.7 configs/s
2026-02-21T12:25:33.5664608Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 71/71 15.7 configs/s
2026-02-21T12:25:41.8658584Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 121.7         
2026-02-21T12:25:41.8659091Z                                                                   configs/s     
2026-02-21T12:25:42.4401927Z [202s] Generation 3 complete: 
2026-02-21T12:25:42.4402257Z error=1
2026-02-21T12:25:42.4402436Z ok=75
2026-02-21T12:25:42.4402625Z min=0.0481
2026-02-21T12:25:42.4402805Z mid=0.0585
2026-02-21T12:25:42.4402985Z max=0.1718
2026-02-21T12:25:42.4403175Z best={'block_sizes': [1, 8192],
2026-02-21T12:25:42.4403560Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:25:42.4404454Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:25:42.4404758Z  'num_stages': 1,
2026-02-21T12:25:42.4404998Z  'num_warps': 16,
2026-02-21T12:25:42.4405220Z  'pid_type': 'flat',
2026-02-21T12:25:42.4405461Z  'range_flattens': [None, None],
2026-02-21T12:25:42.4405728Z  'range_multi_buffers': [None, True],
2026-02-21T12:25:42.4406037Z  'range_num_stages': [0, 1],
2026-02-21T12:25:42.4406283Z  'range_unroll_factors': [0, 3],
2026-02-21T12:25:42.4406555Z  'range_warp_specializes': []}
2026-02-21T12:25:42.4431492Z [202s] Fitting surrogate: 369 points, 369 targets
2026-02-21T12:25:43.3164573Z [202s] Generation 4 starting: 54 neighbors, 5 active search path(s)
2026-02-21T12:26:05.0077387Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 3.6 configs/s
2026-02-21T12:26:09.8867067Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 11.5 configs/s
2026-02-21T12:26:18.1247069Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 122.6         
2026-02-21T12:26:18.1249118Z                                                                   configs/s     
2026-02-21T12:26:18.7098411Z [238s] Generation 4 complete: 
2026-02-21T12:26:18.7098746Z ok=59
2026-02-21T12:26:18.7098926Z min=0.0479
2026-02-21T12:26:18.7099110Z mid=0.0512
2026-02-21T12:26:18.7099303Z max=0.0820
2026-02-21T12:26:18.7099500Z best={'block_sizes': [1, 8192],
2026-02-21T12:26:18.7099829Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:26:18.7100190Z  'load_eviction_policies': ['', ''],
2026-02-21T12:26:18.7100466Z  'num_stages': 1,
2026-02-21T12:26:18.7100675Z  'num_warps': 16,
2026-02-21T12:26:18.7100867Z  'pid_type': 'flat',
2026-02-21T12:26:18.7101101Z  'range_flattens': [None, None],
2026-02-21T12:26:18.7101367Z  'range_multi_buffers': [None, None],
2026-02-21T12:26:18.7101636Z  'range_num_stages': [0, 1],
2026-02-21T12:26:18.7101888Z  'range_unroll_factors': [0, 0],
2026-02-21T12:26:18.7102188Z  'range_warp_specializes': []}
2026-02-21T12:26:18.7128103Z [238s] Fitting surrogate: 428 points, 428 targets
2026-02-21T12:26:19.5800110Z [239s] Generation 5 starting: 54 neighbors, 5 active search path(s)
2026-02-21T12:26:40.7668862Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 6.2 configs/s
2026-02-21T12:26:50.4075292Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 57/57 6.1 configs/s
2026-02-21T12:26:59.8878489Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 120.8         
2026-02-21T12:26:59.8879002Z                                                                   configs/s     
2026-02-21T12:27:00.4938411Z [280s] Generation 5 complete: 
2026-02-21T12:27:00.4938730Z ok=60
2026-02-21T12:27:00.4938918Z min=0.0481
2026-02-21T12:27:00.4939098Z mid=0.0498
2026-02-21T12:27:00.4939279Z max=0.0644
2026-02-21T12:27:00.4939465Z best={'block_sizes': [1, 8192],
2026-02-21T12:27:00.4939799Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:27:00.4940151Z  'load_eviction_policies': ['', ''],
2026-02-21T12:27:00.4940415Z  'num_stages': 1,
2026-02-21T12:27:00.4940618Z  'num_warps': 16,
2026-02-21T12:27:00.6410776Z  'pid_type': 'flat',
2026-02-21T12:27:00.6411581Z  'range_flattens': [None, None],
2026-02-21T12:27:00.6412055Z  'range_multi_buffers': [None, None],
2026-02-21T12:27:00.6412540Z  'range_num_stages': [0, 2],
2026-02-21T12:27:00.6412990Z  'range_unroll_factors': [0, 0],
2026-02-21T12:27:00.6413448Z  'range_warp_specializes': []}
2026-02-21T12:27:00.6414665Z [280s] Fitting surrogate: 488 points, 488 targets
2026-02-21T12:27:01.2505770Z [280s] Generation 6 starting: 45 neighbors, 4 active search path(s)
2026-02-21T12:27:23.7768772Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 4.8 configs/s
2026-02-21T12:27:30.3195460Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 47/47 7.1 configs/s
2026-02-21T12:27:36.7782683Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 156.3         
2026-02-21T12:27:36.7783177Z                                                                   configs/s     
2026-02-21T12:27:37.2472116Z [316s] Generation 6 complete: 
2026-02-21T12:27:37.2472504Z error=1
2026-02-21T12:27:37.2472697Z ok=49
2026-02-21T12:27:37.2472890Z min=0.0481
2026-02-21T12:27:37.2473081Z mid=0.0492
2026-02-21T12:27:37.2473272Z max=0.4028
2026-02-21T12:27:37.2473511Z best={'block_sizes': [1, 8192],
2026-02-21T12:27:37.2473910Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:27:37.2474641Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:27:37.2474966Z  'num_stages': 1,
2026-02-21T12:27:37.2475187Z  'num_warps': 16,
2026-02-21T12:27:37.2475405Z  'pid_type': 'flat',
2026-02-21T12:27:37.2475650Z  'range_flattens': [None, None],
2026-02-21T12:27:37.2475936Z  'range_multi_buffers': [None, False],
2026-02-21T12:27:37.2476256Z  'range_num_stages': [0, 2],
2026-02-21T12:27:37.2476522Z  'range_unroll_factors': [0, 0],
2026-02-21T12:27:37.2476833Z  'range_warp_specializes': []}
2026-02-21T12:27:37.2510441Z [316s] Fitting surrogate: 538 points, 538 targets
2026-02-21T12:27:38.1266261Z [317s] Generation 7 starting: 47 neighbors, 4 active search path(s)
2026-02-21T12:27:59.1889550Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 3.0 configs/s
2026-02-21T12:28:10.9608841Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 47/47 3.9 configs/s
2026-02-21T12:28:17.6970782Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 149.8         
2026-02-21T12:28:17.6971308Z                                                                   configs/s     
2026-02-21T12:28:18.1943297Z [357s] Generation 7 complete: 
2026-02-21T12:28:18.1943610Z ok=51
2026-02-21T12:28:18.1943795Z min=0.0479
2026-02-21T12:28:18.1944311Z mid=0.0484
2026-02-21T12:28:18.1944484Z max=0.0818
2026-02-21T12:28:18.1944670Z best={'block_sizes': [1, 8192],
2026-02-21T12:28:18.1944988Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:28:18.1945357Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:28:18.1945634Z  'num_stages': 5,
2026-02-21T12:28:18.1945829Z  'num_warps': 16,
2026-02-21T12:28:18.1946017Z  'pid_type': 'flat',
2026-02-21T12:28:18.1946271Z  'range_flattens': [None, True],
2026-02-21T12:28:18.1946525Z  'range_multi_buffers': [None, None],
2026-02-21T12:28:18.1946779Z  'range_num_stages': [0, 0],
2026-02-21T12:28:19.1138555Z  'range_unroll_factors': [0, 2],
2026-02-21T12:28:19.1138819Z  'range_warp_specializes': []}
2026-02-21T12:28:19.1139126Z [357s] Fitting surrogate: 589 points, 589 targets
2026-02-21T12:28:19.1139532Z [358s] Generation 8 starting: 31 neighbors, 3 active search path(s)
2026-02-21T12:28:39.6608038Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 2.5 configs/s
2026-02-21T12:28:49.3980027Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 31/31 3.1 configs/s
2026-02-21T12:28:54.0399971Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 217.1         
2026-02-21T12:28:54.0400587Z                                                                   configs/s     
2026-02-21T12:28:54.3895254Z [394s] Generation 8 complete: 
2026-02-21T12:28:54.3895617Z ok=34
2026-02-21T12:28:55.1022004Z min=0.0512
2026-02-21T12:28:55.1022592Z mid=0.0519
2026-02-21T12:28:55.1022781Z max=0.0817
2026-02-21T12:28:55.1022979Z best={'block_sizes': [1, 8192],
2026-02-21T12:28:55.1023351Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:28:55.1023690Z  'load_eviction_policies': ['', ''],
2026-02-21T12:28:55.1023946Z  'num_stages': 2,
2026-02-21T12:28:55.1024606Z  'num_warps': 16,
2026-02-21T12:28:55.1024804Z  'pid_type': 'flat',
2026-02-21T12:28:55.1025019Z  'range_flattens': [None, True],
2026-02-21T12:28:55.1025274Z  'range_multi_buffers': [None, False],
2026-02-21T12:28:55.1025539Z  'range_num_stages': [0, 4],
2026-02-21T12:28:55.1025776Z  'range_unroll_factors': [0, 2],
2026-02-21T12:28:55.1026033Z  'range_warp_specializes': []}
2026-02-21T12:28:55.1026328Z [394s] Fitting surrogate: 623 points, 623 targets
2026-02-21T12:28:55.1026731Z [394s] Generation 9 starting: 10 neighbors, 1 active search path(s)
2026-02-21T12:29:05.1478698Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 1.5 configs/s
2026-02-21T12:29:08.0850067Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 11/11 3.5 configs/s
2026-02-21T12:29:09.7811697Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 586.3         
2026-02-21T12:29:09.7812192Z                                                                   configs/s     
2026-02-21T12:29:09.9270425Z [409s] Generation 9 complete: 
2026-02-21T12:29:09.9270730Z ok=12
2026-02-21T12:29:09.9270898Z min=0.0513
2026-02-21T12:29:09.9271074Z mid=0.0521
2026-02-21T12:29:09.9271243Z max=0.0665
2026-02-21T12:29:09.9271421Z best={'block_sizes': [1, 8192],
2026-02-21T12:29:09.9271803Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:29:09.9272228Z  'load_eviction_policies': ['', ''],
2026-02-21T12:29:09.9272542Z  'num_stages': 1,
2026-02-21T12:29:09.9272770Z  'num_warps': 16,
2026-02-21T12:29:09.9272973Z  'pid_type': 'flat',
2026-02-21T12:29:09.9273194Z  'range_flattens': [None, False],
2026-02-21T12:29:09.9273513Z  'range_multi_buffers': [None, None],
2026-02-21T12:29:09.9273788Z  'range_num_stages': [0, 3],
2026-02-21T12:29:09.9274403Z  'range_unroll_factors': [0, 0],
2026-02-21T12:29:10.9080600Z  'range_warp_specializes': []}
2026-02-21T12:29:10.9081109Z [409s] Fitting surrogate: 635 points, 635 targets
2026-02-21T12:29:10.9095138Z [410s] Autotuning complete in 410.5s after searching 603 configs.
2026-02-21T12:29:10.9095556Z One can hardcode the best config and skip autotuning with:
2026-02-21T12:29:10.9096910Z     @helion.kernel(config=helion.Config(block_sizes=[1, 8192], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=1, num_warps=16, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 0], range_warp_specializes=[]), static_shapes=True)
2026-02-21T12:29:10.9098139Z 
2026-02-21T12:29:10.9098521Z [410s] Code of selected kernel: /tmp/torchinductor_root/2v/c2vxdeljwrqo72me2xgxytmsi2dyspgy465dup7mhkkfgor3arj7.py
2026-02-21T12:29:10.9416892Z from __future__ import annotations
2026-02-21T12:29:10.9417110Z 
2026-02-21T12:29:10.9417195Z import torch
2026-02-21T12:29:10.9417416Z import triton
2026-02-21T12:29:10.9417629Z import triton.language as tl
2026-02-21T12:29:10.9417934Z from torch._inductor.runtime import triton_helpers
2026-02-21T12:29:10.9418352Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T12:29:10.9418826Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T12:29:10.9419106Z 
2026-02-21T12:29:10.9419208Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T12:29:10.9419469Z _BLOCK_SIZE_1 = tl.constexpr(8192)
2026-02-21T12:29:10.9419644Z 
2026-02-21T12:29:10.9419726Z @triton.jit
2026-02-21T12:29:10.9419932Z def _helion_softmax_two_pass(x, out):
2026-02-21T12:29:10.9420318Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:29:10.9420714Z     pid_0 = tl.program_id(0)
2026-02-21T12:29:10.9421340Z     offset_0 = pid_0
2026-02-21T12:29:10.9421601Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T12:29:10.9422043Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:29:10.9422616Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T12:29:10.9423014Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:29:10.9423398Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T12:29:10.9423780Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:29:10.9424658Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T12:29:10.9425041Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T12:29:10.9425385Z     # src[softmax.py:82-89]: ...
2026-02-21T12:29:10.9425740Z     for offset_2 in tl.range(0, 8064, _BLOCK_SIZE_1, num_stages=3, flatten=False):
2026-02-21T12:29:10.9426217Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:29:10.9426566Z         mask_1 = indices_2 < 8064
2026-02-21T12:29:10.9426800Z         mi_copy = mi
2026-02-21T12:29:10.9426988Z         di_copy = di
2026-02-21T12:29:10.9427188Z         mi_copy_0 = mi_copy
2026-02-21T12:29:10.9427400Z         di_copy_0 = di_copy
2026-02-21T12:29:10.9427655Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T12:29:10.9428132Z         values = tl.load(x + (indices_0[:, None] * 8064 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T12:29:10.9428655Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T12:29:10.9429304Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T12:29:10.9429946Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T12:29:10.9430340Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T12:29:10.9430712Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T12:29:10.9431024Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T12:29:10.9431413Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:29:10.9432008Z         v_2 = mi_copy_0 - v_1
2026-02-21T12:29:10.9432241Z         v_3 = libdevice.exp(v_2)
2026-02-21T12:29:10.9432488Z         v_4 = di_copy_0 * v_3
2026-02-21T12:29:10.9432749Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T12:29:10.9433051Z         subscript = v_1[:, None]
2026-02-21T12:29:10.9433258Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T12:29:10.9433477Z         v_6 = v_5 - subscript
2026-02-21T12:29:10.9433730Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:29:10.9434258Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T12:29:10.9434527Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T12:29:10.9434745Z         v_7 = libdevice.exp(v_6)
2026-02-21T12:29:10.9435160Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T12:29:10.9435620Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T12:29:10.9435874Z         di = v_4 + sum_1
2026-02-21T12:29:10.9436070Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T12:29:10.9436285Z         mi = v_1
2026-02-21T12:29:10.9436529Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:29:10.9436873Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T12:29:10.9437245Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:29:10.9437689Z     for offset_2 in tl.range(0, 8064, _BLOCK_SIZE_1, num_stages=3, flatten=False):
2026-02-21T12:29:10.9438081Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:29:10.9438365Z         mask_2 = indices_2 < 8064
2026-02-21T12:29:10.9438705Z         mi_copy_1 = mi
2026-02-21T12:29:10.9438878Z         di_copy_1 = di
2026-02-21T12:29:10.9439052Z         mi_copy_1_0 = mi_copy_1
2026-02-21T12:29:10.9439245Z         di_copy_1_0 = di_copy_1
2026-02-21T12:29:10.9439469Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T12:29:10.9439870Z         values_1 = tl.load(x + (indices_0[:, None] * 8064 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T12:29:10.9440361Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:29:10.9440717Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T12:29:10.9440944Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T12:29:10.9441173Z         v_10 = v_9 - subscript_1
2026-02-21T12:29:10.9441378Z         v_11 = libdevice.exp(v_10)
2026-02-21T12:29:10.9441584Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T12:29:10.9441803Z         v_12 = v_11 / subscript_2
2026-02-21T12:29:10.9442003Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T12:29:10.9442348Z         tl.store(out + (indices_0[:, None] * 8064 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T12:29:10.9442629Z 
2026-02-21T12:29:10.9442791Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T12:29:10.9443082Z     """
2026-02-21T12:29:10.9443330Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T12:29:10.9443713Z     This version uses fewer passes but is less numerically stable.
2026-02-21T12:29:10.9444164Z     Args:
2026-02-21T12:29:10.9444353Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T12:29:10.9444597Z     Returns:
2026-02-21T12:29:10.9444814Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T12:29:10.9445088Z     """
2026-02-21T12:29:10.9445246Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T12:29:10.9445464Z     m, n = x.size()
2026-02-21T12:29:10.9445660Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T12:29:10.9445913Z     out = torch.empty_like(x)
2026-02-21T12:29:10.9446202Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:29:10.9446609Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:29:10.9447165Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:29:10.9447460Z     # src[softmax.py:79-92]: ...
2026-02-21T12:29:10.9447777Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=16, num_stages=1)
2026-02-21T12:29:10.9448120Z     # src[softmax.py:93]: return out
2026-02-21T12:29:10.9448338Z     return out
2026-02-21T12:29:12.1450785Z WARNING:tritonbench.utils.triton_op:Completed input ID 61:
2026-02-21T12:29:12.1451178Z (M, N)
2026-02-21T12:29:12.1451362Z ------------
2026-02-21T12:29:12.1451545Z (4096, 8064)
2026-02-21T12:29:12.1451811Z 
2026-02-21T12:29:12.1473330Z  65%|██████▌   | 13/20 [1:26:07<51:45, 443.70s/it]  WARNING:tritonbench.utils.triton_op:Running input ID 66:
2026-02-21T12:29:12.1473948Z (M, N)
2026-02-21T12:29:12.1474476Z ------------
2026-02-21T12:29:12.1474659Z (4096, 8704)
2026-02-21T12:29:12.1476715Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T12:29:13.5130409Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T12:29:15.3998578Z INFO:tritonbench.utils.triton_op:Took 4.28ms to get benchmark function for torch_compile_softmax
2026-02-21T12:29:18.1380937Z WARNING:__main__:Input tensor metadata:
2026-02-21T12:29:18.1381294Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T12:29:18.1381560Z               'dtype': 'torch.float16',
2026-02-21T12:29:18.1381828Z               'shape': (4096, 8704),
2026-02-21T12:29:18.1382071Z               'stride': (8704, 1)},),
2026-02-21T12:29:18.1382314Z   'kwargs': {}}
2026-02-21T12:29:18.1422541Z INFO:tritonbench.utils.triton_op:Took 4.52ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T12:29:19.5585432Z [0s] Autotune random seed: 2145258556
2026-02-21T12:29:19.5689083Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T12:30:10.6389111Z [51s] Timeout after 31s compiling Config(block_sizes=[256, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[False, True], range_num_stages=[4, 2], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T12:30:16.0872707Z [56s] Timeout after 30s compiling Config(block_sizes=[128, 32], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'last'], maxnreg=32, num_sm_multiplier=32, num_stages=5, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[None, True], range_num_stages=[4, 3], range_unroll_factors=[4, 3], range_warp_specializes=[])
2026-02-21T12:30:16.4773513Z [56s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T12:30:19.4553508Z [59s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T12:30:20.8735346Z [61s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:30:21.2183549Z [61s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T12:30:29.0357988Z [69s] Timeout after 30s compiling Config(block_sizes=[256, 512], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', ''], maxnreg=256, num_sm_multiplier=64, num_stages=6, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, False], range_multi_buffers=[None, False], range_num_stages=[2, 1], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:30:32.5044775Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 1.1 configs/s
2026-02-21T12:31:02.3998858Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━━ 100/100 3.3 configs/s
2026-02-21T12:31:02.4013311Z [102s] Adaptive compile timeout: 30s (90% percentile=28.6s, bounds=[30.0s, 30s])
2026-02-21T12:31:04.4459698Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 483.8 configs/s
2026-02-21T12:31:04.5928975Z [105s] Initial random population of 100, 5 starting points: 
2026-02-21T12:31:04.5929355Z error=6
2026-02-21T12:31:04.5929531Z timeout=7
2026-02-21T12:31:04.5929686Z ok=87
2026-02-21T12:31:04.5929832Z min=0.0818
2026-02-21T12:31:04.5930112Z mid=0.5785
2026-02-21T12:31:04.5930264Z max=118.3552
2026-02-21T12:31:04.5930443Z best={'block_sizes': [2, 512],
2026-02-21T12:31:04.5930752Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:31:04.5931741Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T12:31:04.5932022Z  'maxnreg': 256,
2026-02-21T12:31:04.5932213Z  'num_sm_multiplier': 32,
2026-02-21T12:31:04.5932431Z  'num_stages': 1,
2026-02-21T12:31:04.5932622Z  'num_warps': 2,
2026-02-21T12:31:04.5932820Z  'pid_type': 'persistent_interleaved',
2026-02-21T12:31:04.5933071Z  'range_flattens': [True, None],
2026-02-21T12:31:04.5933308Z  'range_multi_buffers': [True, False],
2026-02-21T12:31:04.5933542Z  'range_num_stages': [3, 0],
2026-02-21T12:31:04.5933761Z  'range_unroll_factors': [1, 0],
2026-02-21T12:31:04.5934440Z  'range_warp_specializes': []}
2026-02-21T12:31:04.5947207Z [105s] Fitting surrogate: 100 points, 100 targets
2026-02-21T12:31:06.0466899Z [106s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T12:32:02.3615187Z [162s] Timeout after 30s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[False, None], range_num_stages=[3, 3], range_unroll_factors=[3, 4], range_warp_specializes=[])
2026-02-21T12:32:14.7662418Z [175s] Timeout after 30s compiling Config(block_sizes=[8, 8192], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], num_stages=1, num_warps=2, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T12:32:14.7681950Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 1.1 configs/s
2026-02-21T12:32:43.4750113Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 93/93 3.3 configs/s
2026-02-21T12:32:50.1139830Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 151.7         
2026-02-21T12:32:50.1141943Z                                                                   configs/s     
2026-02-21T12:32:50.5263947Z [210s] Generation 1 complete: 
2026-02-21T12:32:50.5264626Z error=2
2026-02-21T12:32:50.5264801Z timeout=2
2026-02-21T12:32:50.5264988Z ok=91
2026-02-21T12:32:51.7664640Z min=0.0683
2026-02-21T12:32:51.7664869Z mid=0.0951
2026-02-21T12:32:51.7665085Z max=0.3782
2026-02-21T12:32:51.7665320Z best={'block_sizes': [1, 2048],
2026-02-21T12:32:51.7665727Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:32:51.7666167Z  'load_eviction_policies': ['', 'first'],
2026-02-21T12:32:51.7666497Z  'maxnreg': 64,
2026-02-21T12:32:51.7666742Z  'num_sm_multiplier': 8,
2026-02-21T12:32:51.7667001Z  'num_stages': 1,
2026-02-21T12:32:51.7667233Z  'num_warps': 4,
2026-02-21T12:32:51.7667479Z  'pid_type': 'persistent_blocked',
2026-02-21T12:32:51.7667799Z  'range_flattens': [True, True],
2026-02-21T12:32:51.7668107Z  'range_multi_buffers': [False, None],
2026-02-21T12:32:51.7668427Z  'range_num_stages': [4, 3],
2026-02-21T12:32:51.7669006Z  'range_unroll_factors': [1, 2],
2026-02-21T12:32:51.7669271Z  'range_warp_specializes': []}
2026-02-21T12:32:51.7669561Z [210s] Fitting surrogate: 195 points, 195 targets
2026-02-21T12:32:51.9419177Z [212s] Generation 2 starting: 89 neighbors, 5 active search path(s)
2026-02-21T12:33:40.5706612Z [261s] Timeout after 31s compiling Config(block_sizes=[4, 16384], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[False, True], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:33:44.1231161Z [264s] Timeout after 30s compiling Config(block_sizes=[4, 16384], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:33:47.2403687Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91/91 2.2 configs/s
2026-02-21T12:34:14.4541892Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 91/91 3.3 configs/s
2026-02-21T12:34:25.9871908Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 87.5 configs/s
2026-02-21T12:34:26.6821243Z [307s] Generation 2 complete: 
2026-02-21T12:34:26.6821542Z timeout=2
2026-02-21T12:34:26.6821685Z ok=92
2026-02-21T12:34:26.6821836Z min=0.0660
2026-02-21T12:34:26.6822029Z mid=0.0789
2026-02-21T12:34:26.6822183Z max=0.4535
2026-02-21T12:34:26.6822388Z best={'block_sizes': [1, 2048],
2026-02-21T12:34:26.6822686Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:34:26.6823094Z  'load_eviction_policies': ['', 'first'],
2026-02-21T12:34:26.6823476Z  'num_stages': 1,
2026-02-21T12:34:26.6823691Z  'num_warps': 4,
2026-02-21T12:34:26.6823857Z  'pid_type': 'flat',
2026-02-21T12:34:26.6826833Z  'range_flattens': [None, True],
2026-02-21T12:34:26.6827242Z  'range_multi_buffers': [None, None],
2026-02-21T12:34:26.6827643Z  'range_num_stages': [0, 3],
2026-02-21T12:34:26.6827959Z  'range_unroll_factors': [0, 2],
2026-02-21T12:34:26.6828185Z  'range_warp_specializes': []}
2026-02-21T12:34:26.6852096Z [307s] Fitting surrogate: 289 points, 289 targets
2026-02-21T12:34:27.9723261Z [308s] Generation 3 starting: 81 neighbors, 5 active search path(s)
2026-02-21T12:35:03.6469249Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83/83 3.8 configs/s
2026-02-21T12:35:09.9746527Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 83/83 13.2 configs/s
2026-02-21T12:35:20.4185429Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 96.7 configs/s
2026-02-21T12:35:21.0939511Z [361s] Generation 3 complete: 
2026-02-21T12:35:21.0939834Z ok=86
2026-02-21T12:35:21.0940051Z min=0.0634
2026-02-21T12:35:21.0940266Z mid=0.0740
2026-02-21T12:35:21.0940474Z max=0.1872
2026-02-21T12:35:21.0940696Z best={'block_sizes': [1, 2048],
2026-02-21T12:35:21.0941009Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:35:21.0941366Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T12:35:21.9582317Z  'num_stages': 2,
2026-02-21T12:35:21.9582552Z  'num_warps': 4,
2026-02-21T12:35:21.9582757Z  'pid_type': 'flat',
2026-02-21T12:35:21.9582986Z  'range_flattens': [None, True],
2026-02-21T12:35:21.9583239Z  'range_multi_buffers': [None, None],
2026-02-21T12:35:21.9583508Z  'range_num_stages': [0, 3],
2026-02-21T12:35:21.9583746Z  'range_unroll_factors': [0, 2],
2026-02-21T12:35:21.9584480Z  'range_warp_specializes': []}
2026-02-21T12:35:21.9584801Z [361s] Fitting surrogate: 375 points, 375 targets
2026-02-21T12:35:22.3209162Z [362s] Generation 4 starting: 78 neighbors, 5 active search path(s)
2026-02-21T12:36:10.1247801Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79/79 4.7 configs/s
2026-02-21T12:36:16.3479686Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 79/79 12.7 configs/s
2026-02-21T12:36:26.4624571Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 99.8 configs/s
2026-02-21T12:36:27.1138617Z [427s] Generation 4 complete: 
2026-02-21T12:36:27.1138924Z ok=83
2026-02-21T12:36:27.1139101Z min=0.0585
2026-02-21T12:36:27.1139280Z mid=0.0696
2026-02-21T12:36:27.1139444Z max=0.3612
2026-02-21T12:36:27.1139632Z best={'block_sizes': [1, 8192],
2026-02-21T12:36:27.1139913Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:36:27.1140247Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T12:36:27.1140517Z  'num_stages': 2,
2026-02-21T12:36:27.1140712Z  'num_warps': 4,
2026-02-21T12:36:27.1140908Z  'pid_type': 'flat',
2026-02-21T12:36:27.1141135Z  'range_flattens': [None, True],
2026-02-21T12:36:27.1141396Z  'range_multi_buffers': [None, None],
2026-02-21T12:36:27.1141660Z  'range_num_stages': [0, 3],
2026-02-21T12:36:27.1141899Z  'range_unroll_factors': [0, 2],
2026-02-21T12:36:27.1142161Z  'range_warp_specializes': []}
2026-02-21T12:36:27.1166227Z [427s] Fitting surrogate: 458 points, 458 targets
2026-02-21T12:36:28.2803790Z [428s] Generation 5 starting: 74 neighbors, 5 active search path(s)
2026-02-21T12:36:59.8974537Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77/77 5.2 configs/s
2026-02-21T12:37:06.1619823Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 77/77 12.3 configs/s
2026-02-21T12:37:15.8925596Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 117.5         
2026-02-21T12:37:15.8926154Z                                                                   configs/s     
2026-02-21T12:37:16.4610354Z [476s] Generation 5 complete: 
2026-02-21T12:37:16.4610796Z ok=79
2026-02-21T12:37:16.4611078Z min=0.0532
2026-02-21T12:37:16.4611369Z mid=0.0713
2026-02-21T12:37:16.4611651Z max=0.3317
2026-02-21T12:37:16.4611983Z best={'block_sizes': [1, 16384],
2026-02-21T12:37:16.4612505Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:37:16.4613089Z  'load_eviction_policies': ['', ''],
2026-02-21T12:37:16.4613492Z  'maxnreg': 64,
2026-02-21T12:37:16.4613855Z  'num_sm_multiplier': 32,
2026-02-21T12:37:16.4614486Z  'num_stages': 7,
2026-02-21T12:37:16.4614826Z  'num_warps': 8,
2026-02-21T12:37:16.4615203Z  'pid_type': 'persistent_blocked',
2026-02-21T12:37:16.4615648Z  'range_flattens': [False, False],
2026-02-21T12:37:16.4616097Z  'range_multi_buffers': [None, None],
2026-02-21T12:37:16.4616521Z  'range_num_stages': [3, 3],
2026-02-21T12:37:16.4616912Z  'range_unroll_factors': [2, 2],
2026-02-21T12:37:16.4617310Z  'range_warp_specializes': []}
2026-02-21T12:37:16.4642225Z [476s] Fitting surrogate: 537 points, 537 targets
2026-02-21T12:37:17.8583185Z [478s] Generation 6 starting: 77 neighbors, 5 active search path(s)
2026-02-21T12:37:50.7863102Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 4.4 configs/s
2026-02-21T12:37:56.9878347Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 13.0 configs/s
2026-02-21T12:38:03.3393641Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 158.8         
2026-02-21T12:38:03.3394578Z                                                                   configs/s     
2026-02-21T12:38:03.7836828Z [524s] Generation 6 complete: 
2026-02-21T12:38:03.7837170Z ok=83
2026-02-21T12:38:03.7837365Z min=0.0519
2026-02-21T12:38:03.7837562Z mid=0.0771
2026-02-21T12:38:03.7837738Z max=0.4810
2026-02-21T12:38:03.7837940Z best={'block_sizes': [1, 16384],
2026-02-21T12:38:03.7838280Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:38:03.7838642Z  'load_eviction_policies': ['', ''],
2026-02-21T12:38:03.7838901Z  'num_stages': 8,
2026-02-21T12:38:03.7839106Z  'num_warps': 8,
2026-02-21T12:38:03.7839315Z  'pid_type': 'flat',
2026-02-21T12:38:03.7839540Z  'range_flattens': [None, False],
2026-02-21T12:38:03.7839811Z  'range_multi_buffers': [None, None],
2026-02-21T12:38:03.7840084Z  'range_num_stages': [0, 3],
2026-02-21T12:38:03.7840333Z  'range_unroll_factors': [0, 2],
2026-02-21T12:38:03.7841332Z  'range_warp_specializes': []}
2026-02-21T12:38:03.7871762Z [524s] Fitting surrogate: 620 points, 620 targets
2026-02-21T12:38:04.8535792Z [525s] Generation 7 starting: 65 neighbors, 5 active search path(s)
2026-02-21T12:38:31.6065974Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 5.9 configs/s
2026-02-21T12:38:35.7692800Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.3 configs/s
2026-02-21T12:38:41.5059973Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 175.6         
2026-02-21T12:38:41.5060470Z                                                                   configs/s     
2026-02-21T12:38:41.9126470Z [562s] Generation 7 complete: 
2026-02-21T12:38:41.9126816Z ok=70
2026-02-21T12:38:41.9127007Z min=0.0514
2026-02-21T12:38:41.9127182Z mid=0.0735
2026-02-21T12:38:41.9127359Z max=0.2934
2026-02-21T12:38:41.9127556Z best={'block_sizes': [1, 16384],
2026-02-21T12:38:41.9127854Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:38:41.9128210Z  'load_eviction_policies': ['', ''],
2026-02-21T12:38:41.9128475Z  'num_stages': 8,
2026-02-21T12:38:41.9128683Z  'num_warps': 8,
2026-02-21T12:38:41.9128892Z  'pid_type': 'flat',
2026-02-21T12:38:41.9129155Z  'range_flattens': [None, False],
2026-02-21T12:38:41.9129433Z  'range_multi_buffers': [None, None],
2026-02-21T12:38:41.9129710Z  'range_num_stages': [0, 3],
2026-02-21T12:38:41.9130066Z  'range_unroll_factors': [0, 2],
2026-02-21T12:38:41.9130357Z  'range_warp_specializes': []}
2026-02-21T12:38:41.9162329Z [562s] Fitting surrogate: 690 points, 690 targets
2026-02-21T12:38:42.9581883Z [563s] Generation 8 starting: 63 neighbors, 5 active search path(s)
2026-02-21T12:39:12.0447914Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 3.8 configs/s
2026-02-21T12:39:16.0847945Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.8 configs/s
2026-02-21T12:39:23.5297777Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 135.6         
2026-02-21T12:39:23.5298337Z                                                                   configs/s     
2026-02-21T12:39:24.0509036Z [604s] Generation 8 complete: 
2026-02-21T12:39:24.0510139Z error=1
2026-02-21T12:39:24.0510474Z ok=68
2026-02-21T12:39:24.0510742Z min=0.0514
2026-02-21T12:39:24.0511025Z mid=0.0596
2026-02-21T12:39:24.0511289Z max=0.4685
2026-02-21T12:39:24.0511596Z best={'block_sizes': [1, 16384],
2026-02-21T12:39:24.0512070Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:39:24.0512572Z  'load_eviction_policies': ['', ''],
2026-02-21T12:39:24.0512979Z  'num_stages': 8,
2026-02-21T12:39:24.0513295Z  'num_warps': 8,
2026-02-21T12:39:24.0513602Z  'pid_type': 'flat',
2026-02-21T12:39:24.0513957Z  'range_flattens': [None, False],
2026-02-21T12:39:24.0514932Z  'range_multi_buffers': [None, None],
2026-02-21T12:39:24.0515359Z  'range_num_stages': [0, 4],
2026-02-21T12:39:24.0515779Z  'range_unroll_factors': [0, 2],
2026-02-21T12:39:24.0516181Z  'range_warp_specializes': []}
2026-02-21T12:39:24.0556678Z [604s] Fitting surrogate: 759 points, 759 targets
2026-02-21T12:39:25.0104770Z [605s] Generation 9 starting: 59 neighbors, 5 active search path(s)
2026-02-21T12:39:53.4576278Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 3.4 configs/s
2026-02-21T12:39:59.2933075Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 10.3 configs/s
2026-02-21T12:40:07.1382679Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 128.7         
2026-02-21T12:40:07.1383189Z                                                                   configs/s     
2026-02-21T12:40:07.6881353Z [648s] Generation 9 complete: 
2026-02-21T12:40:07.6881670Z ok=64
2026-02-21T12:40:07.6881861Z min=0.0516
2026-02-21T12:40:07.6882037Z mid=0.0558
2026-02-21T12:40:07.6882223Z max=0.3131
2026-02-21T12:40:07.6882418Z best={'block_sizes': [1, 16384],
2026-02-21T12:40:07.6882719Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:40:07.6883031Z  'load_eviction_policies': ['', ''],
2026-02-21T12:40:07.6883328Z  'num_stages': 7,
2026-02-21T12:40:07.6883527Z  'num_warps': 8,
2026-02-21T12:40:07.6883730Z  'pid_type': 'flat',
2026-02-21T12:40:07.6883954Z  'range_flattens': [None, False],
2026-02-21T12:40:07.6884732Z  'range_multi_buffers': [None, False],
2026-02-21T12:40:07.6885013Z  'range_num_stages': [0, 4],
2026-02-21T12:40:07.6885264Z  'range_unroll_factors': [0, 2],
2026-02-21T12:40:07.6885525Z  'range_warp_specializes': []}
2026-02-21T12:40:07.6918343Z [648s] Fitting surrogate: 823 points, 823 targets
2026-02-21T12:40:08.6501910Z [649s] Generation 10 starting: 60 neighbors, 5 active search path(s)
2026-02-21T12:40:38.8525084Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 3.6 configs/s
2026-02-21T12:40:42.6668539Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 62/62 16.4 configs/s
2026-02-21T12:40:51.8101063Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 110.4         
2026-02-21T12:40:51.8101623Z                                                                   configs/s     
2026-02-21T12:40:52.4400963Z [692s] Generation 10 complete: 
2026-02-21T12:40:52.4401423Z ok=66
2026-02-21T12:40:52.4401729Z min=0.0555
2026-02-21T12:40:52.4401962Z mid=0.0572
2026-02-21T12:40:52.4402143Z max=0.1149
2026-02-21T12:40:52.4402333Z best={'block_sizes': [1, 16384],
2026-02-21T12:40:52.4402644Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:40:52.4402966Z  'load_eviction_policies': ['', ''],
2026-02-21T12:40:52.4403232Z  'num_stages': 7,
2026-02-21T12:40:52.4403431Z  'num_warps': 8,
2026-02-21T12:40:52.4403643Z  'pid_type': 'flat',
2026-02-21T12:40:52.4403871Z  'range_flattens': [None, None],
2026-02-21T12:40:52.4404569Z  'range_multi_buffers': [None, False],
2026-02-21T12:40:52.4404862Z  'range_num_stages': [0, 4],
2026-02-21T12:40:52.4405115Z  'range_unroll_factors': [0, 2],
2026-02-21T12:40:52.4405377Z  'range_warp_specializes': []}
2026-02-21T12:40:52.4445720Z [692s] Fitting surrogate: 889 points, 889 targets
2026-02-21T12:40:53.3984919Z [693s] Generation 11 starting: 58 neighbors, 5 active search path(s)
2026-02-21T12:41:21.5621188Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 4.4 configs/s
2026-02-21T12:41:25.3630580Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 62/62 16.5 configs/s
2026-02-21T12:41:32.8872240Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 134.1         
2026-02-21T12:41:32.8872710Z                                                                   configs/s     
2026-02-21T12:41:33.4129946Z [733s] Generation 11 complete: 
2026-02-21T12:41:33.4130276Z ok=64
2026-02-21T12:41:33.4130459Z min=0.0522
2026-02-21T12:41:33.4130643Z mid=0.0613
2026-02-21T12:41:33.4130819Z max=0.7182
2026-02-21T12:41:33.4131006Z best={'block_sizes': [1, 16384],
2026-02-21T12:41:33.4131309Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:41:33.4131632Z  'load_eviction_policies': ['', ''],
2026-02-21T12:41:33.4131900Z  'num_stages': 7,
2026-02-21T12:41:33.4132568Z  'num_warps': 8,
2026-02-21T12:41:33.4132807Z  'pid_type': 'flat',
2026-02-21T12:41:33.4133055Z  'range_flattens': [None, None],
2026-02-21T12:41:33.4133341Z  'range_multi_buffers': [None, False],
2026-02-21T12:41:33.4133634Z  'range_num_stages': [0, 4],
2026-02-21T12:41:33.4133882Z  'range_unroll_factors': [0, 2],
2026-02-21T12:41:33.4134544Z  'range_warp_specializes': []}
2026-02-21T12:41:33.4176362Z [733s] Fitting surrogate: 953 points, 953 targets
2026-02-21T12:41:34.1707176Z [734s] Generation 12 starting: 44 neighbors, 4 active search path(s)
2026-02-21T12:41:57.7817758Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45/45 2.1 configs/s
2026-02-21T12:42:00.5543490Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 45/45 16.5 configs/s
2026-02-21T12:42:08.1449699Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 159.1         
2026-02-21T12:42:08.1450350Z                                                                   configs/s     
2026-02-21T12:42:08.5956007Z [769s] Generation 12 complete: 
2026-02-21T12:42:08.5956336Z ok=49
2026-02-21T12:42:08.5956517Z min=0.0513
2026-02-21T12:42:08.5956697Z mid=0.0531
2026-02-21T12:42:08.5956866Z max=0.4963
2026-02-21T12:42:08.5957078Z best={'block_sizes': [1, 16384],
2026-02-21T12:42:08.5957404Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:42:08.5957762Z  'load_eviction_policies': ['', ''],
2026-02-21T12:42:08.5958019Z  'num_stages': 8,
2026-02-21T12:42:08.5958223Z  'num_warps': 4,
2026-02-21T12:42:08.5958423Z  'pid_type': 'flat',
2026-02-21T12:42:08.5958648Z  'range_flattens': [None, None],
2026-02-21T12:42:08.5958910Z  'range_multi_buffers': [None, False],
2026-02-21T12:42:08.5959180Z  'range_num_stages': [0, 4],
2026-02-21T12:42:08.5959432Z  'range_unroll_factors': [0, 2],
2026-02-21T12:42:08.5959679Z  'range_warp_specializes': []}
2026-02-21T12:42:08.5995645Z [769s] Fitting surrogate: 1002 points, 1002 targets
2026-02-21T12:42:09.3443052Z [769s] Generation 13 starting: 39 neighbors, 4 active search path(s)
2026-02-21T12:42:32.0155209Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39/39 2.3 configs/s
2026-02-21T12:42:34.3961624Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 39/39 16.7 configs/s
2026-02-21T12:42:40.2841626Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 171.3         
2026-02-21T12:42:40.2842778Z                                                                   configs/s     
2026-02-21T12:42:40.7066566Z [801s] Generation 13 complete: 
2026-02-21T12:42:40.7066874Z ok=43
2026-02-21T12:42:40.7067055Z min=0.0516
2026-02-21T12:42:40.7067222Z mid=0.0528
2026-02-21T12:42:40.7067389Z max=0.7284
2026-02-21T12:42:40.7067565Z best={'block_sizes': [1, 16384],
2026-02-21T12:42:40.7067885Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:42:40.7068189Z  'load_eviction_policies': ['', ''],
2026-02-21T12:42:40.7068422Z  'num_stages': 8,
2026-02-21T12:42:40.7068589Z  'num_warps': 4,
2026-02-21T12:42:40.7068765Z  'pid_type': 'flat',
2026-02-21T12:42:40.7068985Z  'range_flattens': [None, None],
2026-02-21T12:42:40.7069209Z  'range_multi_buffers': [None, False],
2026-02-21T12:42:40.7069442Z  'range_num_stages': [0, 3],
2026-02-21T12:42:40.7070305Z  'range_unroll_factors': [0, 2],
2026-02-21T12:42:40.7070528Z  'range_warp_specializes': []}
2026-02-21T12:42:40.7117491Z [801s] Fitting surrogate: 1045 points, 1045 targets
2026-02-21T12:42:41.0025070Z [801s] Generation 14 starting: 11 neighbors, 1 active search path(s)
2026-02-21T12:42:50.9705643Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.0 configs/s
2026-02-21T12:42:52.2049652Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 11/11 8.8 configs/s
2026-02-21T12:42:53.9158451Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 580.9         
2026-02-21T12:42:53.9158979Z                                                                   configs/s     
2026-02-21T12:42:54.0598985Z [814s] Generation 14 complete: 
2026-02-21T12:42:54.0599261Z ok=12
2026-02-21T12:42:54.0599977Z min=0.0554
2026-02-21T12:42:54.0600155Z mid=0.0557
2026-02-21T12:42:54.0600307Z max=0.0734
2026-02-21T12:42:54.0600489Z best={'block_sizes': [1, 16384],
2026-02-21T12:42:54.0600802Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:42:54.0601212Z  'load_eviction_policies': ['', ''],
2026-02-21T12:42:54.0601589Z  'num_stages': 8,
2026-02-21T12:42:54.0601771Z  'num_warps': 8,
2026-02-21T12:42:54.0601959Z  'pid_type': 'flat',
2026-02-21T12:42:54.0602158Z  'range_flattens': [None, None],
2026-02-21T12:42:54.0602397Z  'range_multi_buffers': [None, False],
2026-02-21T12:42:54.0602640Z  'range_num_stages': [0, 3],
2026-02-21T12:42:54.0602858Z  'range_unroll_factors': [0, 2],
2026-02-21T12:42:54.0603116Z  'range_warp_specializes': []}
2026-02-21T12:42:54.0641888Z [814s] Fitting surrogate: 1057 points, 1057 targets
2026-02-21T12:42:54.3334336Z [814s] Generation 15 starting: 7 neighbors, 1 active search path(s)
2026-02-21T12:43:02.6359513Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 1.5 configs/s
2026-02-21T12:43:03.1236529Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 18.2 configs/s
2026-02-21T12:43:04.2646520Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 863.7         
2026-02-21T12:43:04.2647069Z                                                                   configs/s     
2026-02-21T12:43:04.3733601Z [824s] Generation 15 complete: 
2026-02-21T12:43:04.3733875Z ok=9
2026-02-21T12:43:04.3734179Z min=0.0517
2026-02-21T12:43:04.3734337Z mid=0.0565
2026-02-21T12:43:04.3734494Z max=0.2650
2026-02-21T12:43:04.3734671Z best={'block_sizes': [1, 16384],
2026-02-21T12:43:04.3734958Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:43:04.3735271Z  'load_eviction_policies': ['', ''],
2026-02-21T12:43:04.3735501Z  'num_stages': 8,
2026-02-21T12:43:04.3735678Z  'num_warps': 8,
2026-02-21T12:43:04.3735854Z  'pid_type': 'flat',
2026-02-21T12:43:04.3736056Z  'range_flattens': [None, None],
2026-02-21T12:43:04.3736328Z  'range_multi_buffers': [None, False],
2026-02-21T12:43:04.3736576Z  'range_num_stages': [0, 3],
2026-02-21T12:43:04.3736795Z  'range_unroll_factors': [0, 2],
2026-02-21T12:43:04.3737033Z  'range_warp_specializes': []}
2026-02-21T12:43:04.3779306Z [824s] Fitting surrogate: 1066 points, 1066 targets
2026-02-21T12:43:04.6841076Z [825s] Generation 16 starting: 12 neighbors, 1 active search path(s)
2026-02-21T12:43:13.7867842Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.0 configs/s
2026-02-21T12:43:14.4975060Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 18.1 configs/s
2026-02-21T12:43:16.3713581Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 531.3         
2026-02-21T12:43:16.3714516Z                                                                   configs/s     
2026-02-21T12:43:16.5315281Z [836s] Generation 16 complete: 
2026-02-21T12:43:16.5315590Z ok=14
2026-02-21T12:43:16.5315815Z min=0.0552
2026-02-21T12:43:16.5316003Z mid=0.0558
2026-02-21T12:43:16.5316840Z max=0.0905
2026-02-21T12:43:16.5317072Z best={'block_sizes': [1, 16384],
2026-02-21T12:43:16.5317443Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:43:16.5318137Z  'load_eviction_policies': ['', ''],
2026-02-21T12:43:16.5318396Z  'num_stages': 8,
2026-02-21T12:43:16.5318603Z  'num_warps': 8,
2026-02-21T12:43:16.5318805Z  'pid_type': 'flat',
2026-02-21T12:43:16.5319036Z  'range_flattens': [None, None],
2026-02-21T12:43:16.5319302Z  'range_multi_buffers': [None, False],
2026-02-21T12:43:16.5319566Z  'range_num_stages': [0, 3],
2026-02-21T12:43:16.5319806Z  'range_unroll_factors': [0, 2],
2026-02-21T12:43:16.5320049Z  'range_warp_specializes': []}
2026-02-21T12:43:16.5362251Z [836s] Fitting surrogate: 1080 points, 1080 targets
2026-02-21T12:43:16.8047536Z [837s] Generation 17 starting: 7 neighbors, 1 active search path(s)
2026-02-21T12:43:24.9748360Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7/7 1.8 configs/s
2026-02-21T12:43:25.3945180Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 7/7 18.9 configs/s
2026-02-21T12:43:26.5369104Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 861.9         
2026-02-21T12:43:26.5369674Z                                                                   configs/s     
2026-02-21T12:43:26.6460846Z [847s] Generation 17 complete: 
2026-02-21T12:43:26.6461141Z ok=8
2026-02-21T12:43:26.6461307Z min=0.0553
2026-02-21T12:43:26.6461480Z mid=0.0557
2026-02-21T12:43:26.6461643Z max=0.0714
2026-02-21T12:43:26.6461852Z best={'block_sizes': [1, 16384],
2026-02-21T12:43:26.6462204Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:43:26.6462583Z  'load_eviction_policies': ['', ''],
2026-02-21T12:43:26.6462838Z  'num_stages': 8,
2026-02-21T12:43:26.6463031Z  'num_warps': 8,
2026-02-21T12:43:26.6463229Z  'pid_type': 'flat',
2026-02-21T12:43:26.6463452Z  'range_flattens': [None, None],
2026-02-21T12:43:26.6463705Z  'range_multi_buffers': [None, False],
2026-02-21T12:43:26.6464387Z  'range_num_stages': [0, 4],
2026-02-21T12:43:26.6464635Z  'range_unroll_factors': [0, 2],
2026-02-21T12:43:26.6464888Z  'range_warp_specializes': []}
2026-02-21T12:43:26.6506311Z [847s] Fitting surrogate: 1088 points, 1088 targets
2026-02-21T12:43:26.9403269Z [847s] Generation 18 starting: 10 neighbors, 1 active search path(s)
2026-02-21T12:43:36.7991233Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 1.6 configs/s
2026-02-21T12:43:37.4722000Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.5 configs/s
2026-02-21T12:43:38.6295408Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 850.7         
2026-02-21T12:43:38.6295941Z                                                                   configs/s     
2026-02-21T12:43:38.7394696Z [859s] Generation 18 complete: 
2026-02-21T12:43:38.7395016Z ok=12
2026-02-21T12:43:38.7395203Z min=0.0558
2026-02-21T12:43:38.7395378Z mid=0.0667
2026-02-21T12:43:38.7395549Z max=0.0974
2026-02-21T12:43:38.7395765Z best={'block_sizes': [1, 16384],
2026-02-21T12:43:38.7396133Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:43:38.7396543Z  'load_eviction_policies': ['', ''],
2026-02-21T12:43:38.7397383Z  'num_stages': 8,
2026-02-21T12:43:38.7397594Z  'num_warps': 8,
2026-02-21T12:43:38.7397790Z  'pid_type': 'flat',
2026-02-21T12:43:38.7398016Z  'range_flattens': [None, None],
2026-02-21T12:43:38.7398271Z  'range_multi_buffers': [None, False],
2026-02-21T12:43:38.7398551Z  'range_num_stages': [0, 4],
2026-02-21T12:43:38.7398784Z  'range_unroll_factors': [0, 2],
2026-02-21T12:43:38.7399036Z  'range_warp_specializes': []}
2026-02-21T12:43:38.7440370Z [859s] Fitting surrogate: 1100 points, 1100 targets
2026-02-21T12:43:38.9200223Z [859s] Autotuning complete in 859.4s after searching 1043 configs.
2026-02-21T12:43:38.9200748Z One can hardcode the best config and skip autotuning with:
2026-02-21T12:43:38.9202804Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=8, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 4], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T12:43:38.9204672Z 
2026-02-21T12:43:38.9205092Z [859s] Code of selected kernel: /tmp/torchinductor_root/xm/cxmmgyvyikbimxd6kl3wbm2qktyb5z6qb6y4uej3wwxh5kpewpuw.py
2026-02-21T12:43:38.9521593Z from __future__ import annotations
2026-02-21T12:43:38.9521876Z 
2026-02-21T12:43:38.9521955Z import torch
2026-02-21T12:43:38.9522131Z import triton
2026-02-21T12:43:38.9522327Z import triton.language as tl
2026-02-21T12:43:38.9522603Z from torch._inductor.runtime import triton_helpers
2026-02-21T12:43:38.9522975Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T12:43:38.9523376Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T12:43:38.9523651Z 
2026-02-21T12:43:38.9523752Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T12:43:38.9524155Z _BLOCK_SIZE_1 = tl.constexpr(16384)
2026-02-21T12:43:38.9524333Z 
2026-02-21T12:43:38.9524405Z @triton.jit
2026-02-21T12:43:38.9524615Z def _helion_softmax_two_pass(x, out):
2026-02-21T12:43:38.9524963Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:43:38.9525321Z     pid_0 = tl.program_id(0)
2026-02-21T12:43:38.9525531Z     offset_0 = pid_0
2026-02-21T12:43:38.9525754Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T12:43:38.9526147Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:43:38.9526566Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T12:43:38.9526935Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:43:38.9527275Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T12:43:38.9527640Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:43:38.9528013Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T12:43:38.9528358Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T12:43:38.9528674Z     # src[softmax.py:82-89]: ...
2026-02-21T12:43:38.9529141Z     for offset_2 in tl.range(0, 8704, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T12:43:38.9529847Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:43:38.9530179Z         mask_1 = indices_2 < 8704
2026-02-21T12:43:38.9530407Z         mi_copy = mi
2026-02-21T12:43:38.9530587Z         di_copy = di
2026-02-21T12:43:38.9530769Z         mi_copy_0 = mi_copy
2026-02-21T12:43:38.9530965Z         di_copy_0 = di_copy
2026-02-21T12:43:38.9531212Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T12:43:38.9531663Z         values = tl.load(x + (indices_0[:, None] * 8704 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T12:43:38.9532159Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T12:43:38.9532757Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T12:43:38.9533777Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T12:43:38.9534348Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T12:43:38.9534679Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T12:43:38.9534967Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T12:43:38.9535333Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:43:38.9535701Z         v_2 = mi_copy_0 - v_1
2026-02-21T12:43:38.9535936Z         v_3 = libdevice.exp(v_2)
2026-02-21T12:43:38.9536180Z         v_4 = di_copy_0 * v_3
2026-02-21T12:43:38.9536437Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T12:43:38.9536972Z         subscript = v_1[:, None]
2026-02-21T12:43:38.9537206Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T12:43:38.9537469Z         v_6 = v_5 - subscript
2026-02-21T12:43:38.9537776Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:43:38.9538167Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T12:43:38.9538459Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T12:43:38.9538699Z         v_7 = libdevice.exp(v_6)
2026-02-21T12:43:38.9539110Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T12:43:38.9539592Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T12:43:38.9539843Z         di = v_4 + sum_1
2026-02-21T12:43:38.9540031Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T12:43:38.9540247Z         mi = v_1
2026-02-21T12:43:38.9540500Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:43:38.9540859Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T12:43:38.9541236Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:43:38.9541805Z     for offset_2 in tl.range(0, 8704, _BLOCK_SIZE_1, loop_unroll_factor=2, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T12:43:38.9542314Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:43:38.9542603Z         mask_2 = indices_2 < 8704
2026-02-21T12:43:38.9542814Z         mi_copy_1 = mi
2026-02-21T12:43:38.9542984Z         di_copy_1 = di
2026-02-21T12:43:38.9543157Z         mi_copy_1_0 = mi_copy_1
2026-02-21T12:43:38.9543343Z         di_copy_1_0 = di_copy_1
2026-02-21T12:43:38.9543561Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T12:43:38.9543957Z         values_1 = tl.load(x + (indices_0[:, None] * 8704 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T12:43:38.9544589Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:43:38.9544946Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T12:43:38.9545182Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T12:43:38.9545438Z         v_10 = v_9 - subscript_1
2026-02-21T12:43:38.9545645Z         v_11 = libdevice.exp(v_10)
2026-02-21T12:43:38.9545861Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T12:43:38.9546068Z         v_12 = v_11 / subscript_2
2026-02-21T12:43:38.9546272Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T12:43:38.9546609Z         tl.store(out + (indices_0[:, None] * 8704 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T12:43:38.9546888Z 
2026-02-21T12:43:38.9547045Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T12:43:38.9547335Z     """
2026-02-21T12:43:38.9547585Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T12:43:38.9547991Z     This version uses fewer passes but is less numerically stable.
2026-02-21T12:43:38.9548262Z     Args:
2026-02-21T12:43:38.9548446Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T12:43:38.9548683Z     Returns:
2026-02-21T12:43:38.9549084Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T12:43:38.9549347Z     """
2026-02-21T12:43:38.9549499Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T12:43:38.9549712Z     m, n = x.size()
2026-02-21T12:43:38.9549901Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T12:43:38.9550149Z     out = torch.empty_like(x)
2026-02-21T12:43:38.9550419Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:43:38.9550826Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:43:38.9551220Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:43:38.9551509Z     # src[softmax.py:79-92]: ...
2026-02-21T12:43:38.9551966Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=8, num_stages=8)
2026-02-21T12:43:38.9552304Z     # src[softmax.py:93]: return out
2026-02-21T12:43:38.9552509Z     return out
2026-02-21T12:43:40.1871184Z WARNING:tritonbench.utils.triton_op:Completed input ID 66:
2026-02-21T12:43:40.1871633Z (M, N)
2026-02-21T12:43:40.1871809Z ------------
2026-02-21T12:43:40.1871997Z (4096, 8704)
2026-02-21T12:43:40.1872113Z 
2026-02-21T12:43:40.1896926Z  70%|███████   | 14/20 [1:40:35<57:11, 571.87s/it]WARNING:tritonbench.utils.triton_op:Running input ID 71:
2026-02-21T12:43:40.1897409Z (M, N)
2026-02-21T12:43:40.1897578Z ------------
2026-02-21T12:43:40.1897762Z (4096, 9344)
2026-02-21T12:43:40.1899700Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T12:43:41.6507050Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T12:43:43.2275358Z INFO:tritonbench.utils.triton_op:Took 3.37ms to get benchmark function for torch_compile_softmax
2026-02-21T12:43:44.9048231Z WARNING:__main__:Input tensor metadata:
2026-02-21T12:43:44.9048612Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T12:43:44.9048887Z               'dtype': 'torch.float16',
2026-02-21T12:43:44.9049202Z               'shape': (4096, 9344),
2026-02-21T12:43:44.9049456Z               'stride': (9344, 1)},),
2026-02-21T12:43:44.9049803Z   'kwargs': {}}
2026-02-21T12:43:44.9104240Z INFO:tritonbench.utils.triton_op:Took 5.98ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T12:43:45.2067866Z [0s] Autotune random seed: 2145258556
2026-02-21T12:43:45.2428205Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T12:44:22.0598627Z [36s] Timeout after 30s compiling Config(block_sizes=[256, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[False, True], range_num_stages=[4, 2], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T12:44:28.3634519Z [43s] Timeout after 30s compiling Config(block_sizes=[128, 32], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'last'], maxnreg=32, num_sm_multiplier=32, num_stages=5, num_warps=2, pid_type='persistent_blocked', range_flattens=[None, None], range_multi_buffers=[None, True], range_num_stages=[4, 3], range_unroll_factors=[4, 3], range_warp_specializes=[])
2026-02-21T12:44:28.9943739Z [43s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T12:44:32.4131781Z [47s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T12:44:33.9182866Z [48s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:44:34.2736003Z [49s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T12:44:47.3226847Z [62s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T12:44:47.3247649Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.7 configs/s
2026-02-21T12:44:56.9383284Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 10.4 configs/s
2026-02-21T12:44:56.9397479Z [71s] Adaptive compile timeout: 30s (90% percentile=30.4s, bounds=[30.0s, 30s])
2026-02-21T12:44:58.8336422Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 521.1 configs/s
2026-02-21T12:44:58.9747034Z [73s] Initial random population of 100, 5 starting points: 
2026-02-21T12:44:58.9747427Z error=7
2026-02-21T12:44:58.9747615Z timeout=7
2026-02-21T12:44:58.9747816Z ok=86
2026-02-21T12:44:58.9747992Z min=0.0851
2026-02-21T12:44:58.9748163Z mid=0.6257
2026-02-21T12:44:58.9748335Z max=127.6701
2026-02-21T12:44:58.9748532Z best={'block_sizes': [1, 4096],
2026-02-21T12:44:58.9748873Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:44:58.9749220Z  'load_eviction_policies': ['', ''],
2026-02-21T12:44:58.9749473Z  'maxnreg': 256,
2026-02-21T12:44:58.9749681Z  'num_sm_multiplier': 64,
2026-02-21T12:44:58.9749905Z  'num_stages': 7,
2026-02-21T12:44:58.9750105Z  'num_warps': 4,
2026-02-21T12:44:58.9750317Z  'pid_type': 'persistent_blocked',
2026-02-21T12:44:58.9750593Z  'range_flattens': [False, None],
2026-02-21T12:44:58.9750850Z  'range_multi_buffers': [True, None],
2026-02-21T12:44:58.9751122Z  'range_num_stages': [3, 3],
2026-02-21T12:44:58.9751384Z  'range_unroll_factors': [3, 4],
2026-02-21T12:44:58.9751636Z  'range_warp_specializes': []}
2026-02-21T12:44:58.9768074Z [73s] Fitting surrogate: 100 points, 100 targets
2026-02-21T12:45:00.4256001Z [75s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T12:45:50.2405022Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 1.1 configs/s
2026-02-21T12:45:56.9736704Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 14.0 configs/s
2026-02-21T12:46:02.9155742Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 169.1         
2026-02-21T12:46:02.9158164Z                                                                   configs/s     
2026-02-21T12:46:03.2781849Z [138s] Generation 1 complete: 
2026-02-21T12:46:03.2782131Z error=2
2026-02-21T12:46:03.2782298Z ok=93
2026-02-21T12:46:03.2782467Z min=0.0658
2026-02-21T12:46:03.2782633Z mid=0.1051
2026-02-21T12:46:03.2782810Z max=1.2131
2026-02-21T12:46:03.2783017Z best={'block_sizes': [1, 16384],
2026-02-21T12:46:03.2783361Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:46:03.2783745Z  'load_eviction_policies': ['', ''],
2026-02-21T12:46:03.2784970Z  'maxnreg': 256,
2026-02-21T12:46:03.2785167Z  'num_sm_multiplier': 32,
2026-02-21T12:46:03.2785389Z  'num_stages': 7,
2026-02-21T12:46:03.2785571Z  'num_warps': 8,
2026-02-21T12:46:03.2785779Z  'pid_type': 'persistent_blocked',
2026-02-21T12:46:03.2786040Z  'range_flattens': [False, None],
2026-02-21T12:46:03.2786297Z  'range_multi_buffers': [True, None],
2026-02-21T12:46:03.2786559Z  'range_num_stages': [3, 3],
2026-02-21T12:46:03.2786789Z  'range_unroll_factors': [3, 4],
2026-02-21T12:46:03.2787034Z  'range_warp_specializes': []}
2026-02-21T12:46:03.2803899Z [138s] Fitting surrogate: 195 points, 195 targets
2026-02-21T12:46:04.5701933Z [139s] Generation 2 starting: 80 neighbors, 5 active search path(s)
2026-02-21T12:46:39.8015608Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82/82 3.7 configs/s
2026-02-21T12:46:45.8653353Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 82/82 13.6 configs/s
2026-02-21T12:46:55.3929120Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 105.8         
2026-02-21T12:46:55.3930261Z                                                                   configs/s     
2026-02-21T12:46:55.9750890Z [190s] Generation 2 complete: 
2026-02-21T12:46:55.9751234Z error=2
2026-02-21T12:46:55.9751429Z ok=84
2026-02-21T12:46:55.9751619Z min=0.0555
2026-02-21T12:46:55.9751796Z mid=0.0839
2026-02-21T12:46:55.9751975Z max=1.1376
2026-02-21T12:46:55.9752175Z best={'block_sizes': [1, 16384],
2026-02-21T12:46:55.9752532Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:46:55.9752923Z  'load_eviction_policies': ['', ''],
2026-02-21T12:46:55.9753186Z  'num_stages': 7,
2026-02-21T12:46:55.9753409Z  'num_warps': 8,
2026-02-21T12:46:55.9753609Z  'pid_type': 'flat',
2026-02-21T12:46:55.9753830Z  'range_flattens': [None, None],
2026-02-21T12:46:55.9754376Z  'range_multi_buffers': [None, None],
2026-02-21T12:46:55.9754659Z  'range_num_stages': [0, 3],
2026-02-21T12:46:55.9754904Z  'range_unroll_factors': [0, 4],
2026-02-21T12:46:55.9755211Z  'range_warp_specializes': []}
2026-02-21T12:46:55.9773565Z [190s] Fitting surrogate: 281 points, 281 targets
2026-02-21T12:46:57.2399714Z [191s] Generation 3 starting: 78 neighbors, 5 active search path(s)
2026-02-21T12:47:29.8781014Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79/79 5.4 configs/s
2026-02-21T12:47:36.6079939Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 79/79 11.8 configs/s
2026-02-21T12:47:43.6066937Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 144.0         
2026-02-21T12:47:43.6067443Z                                                                   configs/s     
2026-02-21T12:47:44.0645801Z [238s] Generation 3 complete: 
2026-02-21T12:47:44.0646083Z ok=83
2026-02-21T12:47:44.0646245Z min=0.0555
2026-02-21T12:47:44.0646690Z mid=0.0827
2026-02-21T12:47:44.0646901Z max=0.1983
2026-02-21T12:47:44.0647077Z best={'block_sizes': [1, 16384],
2026-02-21T12:47:44.0647396Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:47:44.0647850Z  'load_eviction_policies': ['', ''],
2026-02-21T12:47:44.0648085Z  'num_stages': 7,
2026-02-21T12:47:44.0648271Z  'num_warps': 8,
2026-02-21T12:47:44.0648448Z  'pid_type': 'flat',
2026-02-21T12:47:44.0648653Z  'range_flattens': [None, None],
2026-02-21T12:47:44.0648898Z  'range_multi_buffers': [None, None],
2026-02-21T12:47:44.0649184Z  'range_num_stages': [0, 3],
2026-02-21T12:47:44.0649405Z  'range_unroll_factors': [0, 3],
2026-02-21T12:47:44.0649629Z  'range_warp_specializes': []}
2026-02-21T12:47:44.0674369Z [238s] Fitting surrogate: 364 points, 364 targets
2026-02-21T12:47:45.2051355Z [239s] Generation 4 starting: 69 neighbors, 5 active search path(s)
2026-02-21T12:48:16.6547069Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70/70 3.8 configs/s
2026-02-21T12:48:22.6546714Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 70/70 11.7 configs/s
2026-02-21T12:48:30.6267215Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 126.5         
2026-02-21T12:48:30.9513866Z                                                                   configs/s     
2026-02-21T12:48:31.1456240Z [285s] Generation 4 complete: 
2026-02-21T12:48:31.1456540Z ok=74
2026-02-21T12:48:31.1456724Z min=0.0551
2026-02-21T12:48:31.1456909Z mid=0.0740
2026-02-21T12:48:31.1457076Z max=0.3046
2026-02-21T12:48:31.1457270Z best={'block_sizes': [1, 16384],
2026-02-21T12:48:31.1457609Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:48:31.1457952Z  'load_eviction_policies': ['', ''],
2026-02-21T12:48:31.1458220Z  'num_stages': 7,
2026-02-21T12:48:31.1458413Z  'num_warps': 8,
2026-02-21T12:48:31.1458616Z  'pid_type': 'flat',
2026-02-21T12:48:31.1458833Z  'range_flattens': [None, None],
2026-02-21T12:48:31.1459095Z  'range_multi_buffers': [None, None],
2026-02-21T12:48:31.1459938Z  'range_num_stages': [0, 3],
2026-02-21T12:48:31.1460216Z  'range_unroll_factors': [0, 3],
2026-02-21T12:48:31.1460470Z  'range_warp_specializes': []}
2026-02-21T12:48:31.1487084Z [285s] Fitting surrogate: 438 points, 438 targets
2026-02-21T12:48:32.1915930Z [286s] Generation 5 starting: 65 neighbors, 5 active search path(s)
2026-02-21T12:49:04.3849294Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66/66 1.6 configs/s
2026-02-21T12:49:08.4160899Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 66/66 16.5 configs/s
2026-02-21T12:49:17.7034894Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 125.1         
2026-02-21T12:49:17.7035432Z                                                                   configs/s     
2026-02-21T12:49:18.2373570Z [332s] Generation 5 complete: 
2026-02-21T12:49:18.2374374Z ok=70
2026-02-21T12:49:18.2374734Z min=0.0553
2026-02-21T12:49:18.2374974Z mid=0.0730
2026-02-21T12:49:18.2375157Z max=1.5332
2026-02-21T12:49:18.2375380Z best={'block_sizes': [1, 16384],
2026-02-21T12:49:18.2375705Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:49:18.2376055Z  'load_eviction_policies': ['', ''],
2026-02-21T12:49:18.2376343Z  'num_stages': 7,
2026-02-21T12:49:18.2376542Z  'num_warps': 8,
2026-02-21T12:49:18.2376736Z  'pid_type': 'flat',
2026-02-21T12:49:18.2376965Z  'range_flattens': [None, None],
2026-02-21T12:49:18.2377219Z  'range_multi_buffers': [None, None],
2026-02-21T12:49:18.2377489Z  'range_num_stages': [0, 2],
2026-02-21T12:49:18.2377724Z  'range_unroll_factors': [0, 3],
2026-02-21T12:49:18.2377982Z  'range_warp_specializes': []}
2026-02-21T12:49:18.2399619Z [332s] Fitting surrogate: 508 points, 508 targets
2026-02-21T12:49:19.3679964Z [334s] Generation 6 starting: 68 neighbors, 5 active search path(s)
2026-02-21T12:49:49.0319568Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70/70 2.5 configs/s
2026-02-21T12:49:53.3435823Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 70/70 16.4 configs/s
2026-02-21T12:50:01.4227586Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 124.9         
2026-02-21T12:50:01.4228119Z                                                                   configs/s     
2026-02-21T12:50:01.9697416Z [376s] Generation 6 complete: 
2026-02-21T12:50:01.9697720Z ok=73
2026-02-21T12:50:01.9697910Z min=0.0550
2026-02-21T12:50:01.9698082Z mid=0.0668
2026-02-21T12:50:01.9698300Z max=2.4529
2026-02-21T12:50:01.9698492Z best={'block_sizes': [1, 16384],
2026-02-21T12:50:01.9698784Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:50:01.9699092Z  'load_eviction_policies': ['', ''],
2026-02-21T12:50:01.9699352Z  'num_stages': 4,
2026-02-21T12:50:01.9699569Z  'num_warps': 8,
2026-02-21T12:50:01.9699793Z  'pid_type': 'flat',
2026-02-21T12:50:01.9700031Z  'range_flattens': [None, True],
2026-02-21T12:50:01.9700285Z  'range_multi_buffers': [None, None],
2026-02-21T12:50:01.9700554Z  'range_num_stages': [0, 0],
2026-02-21T12:50:01.9701475Z  'range_unroll_factors': [0, 2],
2026-02-21T12:50:01.9701772Z  'range_warp_specializes': []}
2026-02-21T12:50:01.9733055Z [376s] Fitting surrogate: 581 points, 581 targets
2026-02-21T12:50:03.0204302Z [377s] Generation 7 starting: 59 neighbors, 5 active search path(s)
2026-02-21T12:50:32.2706868Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 2.5 configs/s
2026-02-21T12:50:35.9614867Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.7 configs/s
2026-02-21T12:50:42.9153172Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 144.9         
2026-02-21T12:50:42.9153755Z                                                                   configs/s     
2026-02-21T12:50:43.3912946Z [418s] Generation 7 complete: 
2026-02-21T12:50:43.3913430Z error=1
2026-02-21T12:50:43.3913708Z ok=63
2026-02-21T12:50:43.3914432Z min=0.0553
2026-02-21T12:50:43.3914620Z mid=0.0665
2026-02-21T12:50:43.3914801Z max=1.3796
2026-02-21T12:50:43.3915019Z best={'block_sizes': [1, 16384],
2026-02-21T12:50:43.3915419Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T12:50:43.3915834Z  'load_eviction_policies': ['', ''],
2026-02-21T12:50:43.3916119Z  'num_stages': 1,
2026-02-21T12:50:43.3916326Z  'num_warps': 8,
2026-02-21T12:50:43.3916532Z  'pid_type': 'flat',
2026-02-21T12:50:43.3916796Z  'range_flattens': [None, True],
2026-02-21T12:50:43.3917066Z  'range_multi_buffers': [None, False],
2026-02-21T12:50:43.3917346Z  'range_num_stages': [0, 4],
2026-02-21T12:50:43.3917593Z  'range_unroll_factors': [0, 2],
2026-02-21T12:50:43.3917844Z  'range_warp_specializes': []}
2026-02-21T12:50:43.3949622Z [418s] Fitting surrogate: 645 points, 645 targets
2026-02-21T12:50:44.3832557Z [419s] Generation 8 starting: 60 neighbors, 5 active search path(s)
2026-02-21T12:51:19.8634885Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 0.6 configs/s
2026-02-21T12:51:23.6048905Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 16.5 configs/s
2026-02-21T12:51:32.0517964Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 119.5         
2026-02-21T12:51:32.0518429Z                                                                   configs/s     
2026-02-21T12:51:32.6278222Z [467s] Generation 8 complete: 
2026-02-21T12:51:32.6278576Z ok=65
2026-02-21T12:51:32.6278775Z min=0.0552
2026-02-21T12:51:32.6278969Z mid=0.0566
2026-02-21T12:51:32.6279141Z max=1.3933
2026-02-21T12:51:32.6279361Z best={'block_sizes': [1, 16384],
2026-02-21T12:51:32.6279738Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:51:32.6280124Z  'load_eviction_policies': ['', ''],
2026-02-21T12:51:32.6280392Z  'num_stages': 1,
2026-02-21T12:51:32.6280588Z  'num_warps': 8,
2026-02-21T12:51:32.6280793Z  'pid_type': 'flat',
2026-02-21T12:51:32.6281024Z  'range_flattens': [None, True],
2026-02-21T12:51:32.6281290Z  'range_multi_buffers': [None, False],
2026-02-21T12:51:32.6281557Z  'range_num_stages': [0, 3],
2026-02-21T12:51:32.6281840Z  'range_unroll_factors': [0, 0],
2026-02-21T12:51:32.6282097Z  'range_warp_specializes': []}
2026-02-21T12:51:32.6316719Z [467s] Fitting surrogate: 710 points, 710 targets
2026-02-21T12:51:34.5759154Z [469s] Generation 9 starting: 36 neighbors, 3 active search path(s)
2026-02-21T12:51:51.5770225Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 3.1 configs/s
2026-02-21T12:51:53.8386809Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 37/37 16.7 configs/s
2026-02-21T12:51:58.7385252Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 205.4         
2026-02-21T12:51:58.7385779Z                                                                   configs/s     
2026-02-21T12:51:59.0918219Z [493s] Generation 9 complete: 
2026-02-21T12:51:59.0918536Z ok=39
2026-02-21T12:51:59.0918734Z min=0.0553
2026-02-21T12:51:59.0918934Z mid=0.0570
2026-02-21T12:51:59.0919116Z max=0.1566
2026-02-21T12:51:59.0919310Z best={'block_sizes': [1, 16384],
2026-02-21T12:51:59.0920420Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:51:59.0920822Z  'load_eviction_policies': ['', ''],
2026-02-21T12:51:59.0921087Z  'num_stages': 1,
2026-02-21T12:51:59.0921290Z  'num_warps': 8,
2026-02-21T12:51:59.0921508Z  'pid_type': 'flat',
2026-02-21T12:51:59.0921735Z  'range_flattens': [None, True],
2026-02-21T12:51:59.0921995Z  'range_multi_buffers': [None, False],
2026-02-21T12:51:59.0922285Z  'range_num_stages': [0, 3],
2026-02-21T12:51:59.0922534Z  'range_unroll_factors': [0, 0],
2026-02-21T12:51:59.0922793Z  'range_warp_specializes': []}
2026-02-21T12:51:59.0960947Z [493s] Fitting surrogate: 749 points, 749 targets
2026-02-21T12:51:59.4277926Z [494s] Generation 10 starting: 13 neighbors, 1 active search path(s)
2026-02-21T12:52:09.5964373Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14/14 1.5 configs/s
2026-02-21T12:52:10.4619355Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 14/14 17.1 configs/s
2026-02-21T12:52:11.7830146Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 747.5         
2026-02-21T12:52:11.7830688Z                                                                   configs/s     
2026-02-21T12:52:11.9030651Z [506s] Generation 10 complete: 
2026-02-21T12:52:11.9030955Z ok=15
2026-02-21T12:52:11.9031157Z min=0.0556
2026-02-21T12:52:11.9031339Z mid=0.0668
2026-02-21T12:52:11.9031514Z max=0.1843
2026-02-21T12:52:11.9031701Z best={'block_sizes': [1, 16384],
2026-02-21T12:52:11.9032068Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T12:52:11.9032449Z  'load_eviction_policies': ['', ''],
2026-02-21T12:52:11.9032715Z  'num_stages': 1,
2026-02-21T12:52:11.9032915Z  'num_warps': 8,
2026-02-21T12:52:11.9033134Z  'pid_type': 'flat',
2026-02-21T12:52:11.9033370Z  'range_flattens': [None, True],
2026-02-21T12:52:11.9033646Z  'range_multi_buffers': [None, False],
2026-02-21T12:52:11.9033936Z  'range_num_stages': [0, 3],
2026-02-21T12:52:11.9034362Z  'range_unroll_factors': [0, 0],
2026-02-21T12:52:11.9034641Z  'range_warp_specializes': []}
2026-02-21T12:52:11.9069037Z [506s] Fitting surrogate: 764 points, 764 targets
2026-02-21T12:52:12.2263756Z [506s] Generation 11 starting: 12 neighbors, 1 active search path(s)
2026-02-21T12:52:20.4396823Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 3.1 configs/s
2026-02-21T12:52:21.2216320Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.7 configs/s
2026-02-21T12:52:23.1557594Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 514.7         
2026-02-21T12:52:23.1558218Z                                                                   configs/s     
2026-02-21T12:52:23.3133288Z [518s] Generation 11 complete: 
2026-02-21T12:52:23.3133639Z ok=14
2026-02-21T12:52:23.3133807Z min=0.0591
2026-02-21T12:52:23.3133965Z mid=0.0615
2026-02-21T12:52:23.3134470Z max=0.1491
2026-02-21T12:52:23.3134649Z best={'block_sizes': [1, 16384],
2026-02-21T12:52:23.3134918Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:52:23.3135241Z  'load_eviction_policies': ['', ''],
2026-02-21T12:52:23.3135471Z  'num_stages': 1,
2026-02-21T12:52:23.3135650Z  'num_warps': 8,
2026-02-21T12:52:23.3135839Z  'pid_type': 'flat',
2026-02-21T12:52:23.3136747Z  'range_flattens': [None, True],
2026-02-21T12:52:23.3136982Z  'range_multi_buffers': [None, False],
2026-02-21T12:52:23.3137234Z  'range_num_stages': [0, 3],
2026-02-21T12:52:23.3137450Z  'range_unroll_factors': [0, 2],
2026-02-21T12:52:23.3137681Z  'range_warp_specializes': []}
2026-02-21T12:52:23.3168940Z [518s] Fitting surrogate: 778 points, 778 targets
2026-02-21T12:52:23.6320347Z [518s] Generation 12 starting: 11 neighbors, 1 active search path(s)
2026-02-21T12:52:30.2659489Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 3.4 configs/s
2026-02-21T12:52:30.9844728Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.9 configs/s
2026-02-21T12:52:32.4678355Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 666.9         
2026-02-21T12:52:32.4679503Z                                                                   configs/s     
2026-02-21T12:52:32.5976515Z [527s] Generation 12 complete: 
2026-02-21T12:52:32.5976836Z ok=13
2026-02-21T12:52:32.5977055Z min=0.0588
2026-02-21T12:52:32.5977239Z mid=0.0667
2026-02-21T12:52:32.5977407Z max=0.1219
2026-02-21T12:52:32.5977601Z best={'block_sizes': [1, 16384],
2026-02-21T12:52:32.5977922Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T12:52:32.5978275Z  'load_eviction_policies': ['', ''],
2026-02-21T12:52:32.5978534Z  'num_stages': 1,
2026-02-21T12:52:32.5978728Z  'num_warps': 8,
2026-02-21T12:52:32.5978928Z  'pid_type': 'flat',
2026-02-21T12:52:32.5979145Z  'range_flattens': [None, True],
2026-02-21T12:52:32.5979411Z  'range_multi_buffers': [None, False],
2026-02-21T12:52:32.5979690Z  'range_num_stages': [0, 3],
2026-02-21T12:52:32.5979980Z  'range_unroll_factors': [0, 2],
2026-02-21T12:52:32.5980277Z  'range_warp_specializes': []}
2026-02-21T12:52:32.6012601Z [527s] Fitting surrogate: 791 points, 791 targets
2026-02-21T12:52:32.9402816Z [527s] Generation 13 starting: 12 neighbors, 1 active search path(s)
2026-02-21T12:52:40.0598579Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 2.3 configs/s
2026-02-21T12:52:40.9463003Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 15.3 configs/s
2026-02-21T12:52:42.5935416Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 601.9         
2026-02-21T12:52:42.5935937Z                                                                   configs/s     
2026-02-21T12:52:42.7326572Z [537s] Generation 13 complete: 
2026-02-21T12:52:42.7326886Z ok=14
2026-02-21T12:52:42.7327066Z min=0.0588
2026-02-21T12:52:42.7327250Z mid=0.0669
2026-02-21T12:52:42.7327417Z max=0.1305
2026-02-21T12:52:42.7327616Z best={'block_sizes': [1, 16384],
2026-02-21T12:52:42.7327951Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T12:52:42.7328310Z  'load_eviction_policies': ['', ''],
2026-02-21T12:52:42.7328600Z  'num_stages': 1,
2026-02-21T12:52:42.7328798Z  'num_warps': 8,
2026-02-21T12:52:42.7328990Z  'pid_type': 'flat',
2026-02-21T12:52:42.7329212Z  'range_flattens': [None, True],
2026-02-21T12:52:42.7329492Z  'range_multi_buffers': [None, False],
2026-02-21T12:52:42.7329766Z  'range_num_stages': [0, 4],
2026-02-21T12:52:42.7330007Z  'range_unroll_factors': [0, 2],
2026-02-21T12:52:42.7330397Z  'range_warp_specializes': []}
2026-02-21T12:52:42.7362580Z [537s] Fitting surrogate: 805 points, 805 targets
2026-02-21T12:52:43.0350412Z [537s] Generation 14 starting: 11 neighbors, 1 active search path(s)
2026-02-21T12:52:50.0792455Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 2.6 configs/s
2026-02-21T12:52:50.7975961Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.9 configs/s
2026-02-21T12:52:52.6114297Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 548.1         
2026-02-21T12:52:52.6115421Z                                                                   configs/s     
2026-02-21T12:52:52.7616672Z [547s] Generation 14 complete: 
2026-02-21T12:52:52.7616969Z ok=13
2026-02-21T12:52:52.7617152Z min=0.0591
2026-02-21T12:52:52.7617332Z mid=0.0668
2026-02-21T12:52:52.7618084Z max=0.0925
2026-02-21T12:52:52.7618274Z best={'block_sizes': [1, 16384],
2026-02-21T12:52:52.7618630Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:52:52.7619008Z  'load_eviction_policies': ['', ''],
2026-02-21T12:52:52.7619255Z  'num_stages': 1,
2026-02-21T12:52:52.7619447Z  'num_warps': 8,
2026-02-21T12:52:52.7619634Z  'pid_type': 'flat',
2026-02-21T12:52:52.7619846Z  'range_flattens': [None, True],
2026-02-21T12:52:52.7620092Z  'range_multi_buffers': [None, False],
2026-02-21T12:52:52.7620356Z  'range_num_stages': [0, 4],
2026-02-21T12:52:52.7620586Z  'range_unroll_factors': [0, 2],
2026-02-21T12:52:52.7620823Z  'range_warp_specializes': []}
2026-02-21T12:52:52.7656334Z [547s] Fitting surrogate: 818 points, 818 targets
2026-02-21T12:52:53.0670683Z [547s] Generation 15 starting: 11 neighbors, 1 active search path(s)
2026-02-21T12:53:11.9342703Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 0.5 configs/s
2026-02-21T12:53:12.6698856Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.4 configs/s
2026-02-21T12:53:14.1355293Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 674.9         
2026-02-21T12:53:14.1355770Z                                                                   configs/s     
2026-02-21T12:53:14.2655087Z [569s] Generation 15 complete: 
2026-02-21T12:53:14.2655358Z ok=13
2026-02-21T12:53:14.2655534Z min=0.0556
2026-02-21T12:53:14.2655698Z mid=0.0657
2026-02-21T12:53:14.2655858Z max=1.3936
2026-02-21T12:53:14.2656024Z best={'block_sizes': [1, 16384],
2026-02-21T12:53:14.2656345Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T12:53:14.2656693Z  'load_eviction_policies': ['', ''],
2026-02-21T12:53:14.2656930Z  'num_stages': 1,
2026-02-21T12:53:14.2657143Z  'num_warps': 8,
2026-02-21T12:53:14.2657330Z  'pid_type': 'flat',
2026-02-21T12:53:14.2657528Z  'range_flattens': [None, True],
2026-02-21T12:53:14.2657760Z  'range_multi_buffers': [None, False],
2026-02-21T12:53:14.2658026Z  'range_num_stages': [0, 4],
2026-02-21T12:53:14.2658241Z  'range_unroll_factors': [0, 1],
2026-02-21T12:53:14.2658479Z  'range_warp_specializes': []}
2026-02-21T12:53:14.2692198Z [569s] Fitting surrogate: 831 points, 831 targets
2026-02-21T12:53:14.4292845Z [569s] Autotuning complete in 569.2s after searching 789 configs.
2026-02-21T12:53:14.4293287Z One can hardcode the best config and skip autotuning with:
2026-02-21T12:53:14.4295050Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=1, num_warps=8, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 4], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T12:53:14.4296344Z 
2026-02-21T12:53:14.4296721Z [569s] Code of selected kernel: /tmp/torchinductor_root/e2/ce2kb5lzg3fzmnoesvtv72jwre5vrlyj4utq24squeq7kc25752s.py
2026-02-21T12:53:14.4620024Z from __future__ import annotations
2026-02-21T12:53:14.4620236Z 
2026-02-21T12:53:14.4620316Z import torch
2026-02-21T12:53:14.4620513Z import triton
2026-02-21T12:53:14.4620748Z import triton.language as tl
2026-02-21T12:53:14.4621143Z from torch._inductor.runtime import triton_helpers
2026-02-21T12:53:14.4621536Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T12:53:14.4622048Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T12:53:14.4622329Z 
2026-02-21T12:53:14.4622419Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T12:53:14.4622725Z _BLOCK_SIZE_1 = tl.constexpr(16384)
2026-02-21T12:53:14.4622899Z 
2026-02-21T12:53:14.4622976Z @triton.jit
2026-02-21T12:53:14.4623179Z def _helion_softmax_two_pass(x, out):
2026-02-21T12:53:14.4624182Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:53:14.4624609Z     pid_0 = tl.program_id(0)
2026-02-21T12:53:14.4624839Z     offset_0 = pid_0
2026-02-21T12:53:14.4625085Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T12:53:14.4625556Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:53:14.4626027Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T12:53:14.4626528Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:53:14.4626909Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T12:53:14.4627351Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:53:14.4627812Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T12:53:14.4628181Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T12:53:14.4628559Z     # src[softmax.py:82-89]: ...
2026-02-21T12:53:14.4629149Z     for offset_2 in tl.range(0, 9344, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=4, disallow_acc_multi_buffer=True, flatten=True):
2026-02-21T12:53:14.4629890Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:53:14.4630280Z         mask_1 = indices_2 < 9344
2026-02-21T12:53:14.4630497Z         mi_copy = mi
2026-02-21T12:53:14.4630674Z         di_copy = di
2026-02-21T12:53:14.4630909Z         mi_copy_0 = mi_copy
2026-02-21T12:53:14.4631100Z         di_copy_0 = di_copy
2026-02-21T12:53:14.4631353Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T12:53:14.4631830Z         values = tl.load(x + (indices_0[:, None] * 9344 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T12:53:14.4632330Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T12:53:14.4632930Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T12:53:14.4633541Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T12:53:14.4633947Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T12:53:14.4634477Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T12:53:14.4634736Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T12:53:14.4635058Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:53:14.4635463Z         v_2 = mi_copy_0 - v_1
2026-02-21T12:53:14.4635678Z         v_3 = libdevice.exp(v_2)
2026-02-21T12:53:14.4635878Z         v_4 = di_copy_0 * v_3
2026-02-21T12:53:14.4636193Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T12:53:14.4636459Z         subscript = v_1[:, None]
2026-02-21T12:53:14.4636723Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T12:53:14.4636939Z         v_6 = v_5 - subscript
2026-02-21T12:53:14.4637205Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T12:53:14.4637716Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T12:53:14.4637975Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T12:53:14.4638281Z         v_7 = libdevice.exp(v_6)
2026-02-21T12:53:14.4638939Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T12:53:14.4639479Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T12:53:14.4639734Z         di = v_4 + sum_1
2026-02-21T12:53:14.4640053Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T12:53:14.4640280Z         mi = v_1
2026-02-21T12:53:14.4640521Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T12:53:14.4640941Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T12:53:14.4641316Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:53:14.4642127Z     for offset_2 in tl.range(0, 9344, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=4, disallow_acc_multi_buffer=True, flatten=True):
2026-02-21T12:53:14.4642771Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T12:53:14.4643073Z         mask_2 = indices_2 < 9344
2026-02-21T12:53:14.4643275Z         mi_copy_1 = mi
2026-02-21T12:53:14.4643527Z         di_copy_1 = di
2026-02-21T12:53:14.4643705Z         mi_copy_1_0 = mi_copy_1
2026-02-21T12:53:14.4643895Z         di_copy_1_0 = di_copy_1
2026-02-21T12:53:14.4644272Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T12:53:14.4644803Z         values_1 = tl.load(x + (indices_0[:, None] * 9344 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T12:53:14.4645397Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T12:53:14.4645768Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T12:53:14.4646028Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T12:53:14.4646323Z         v_10 = v_9 - subscript_1
2026-02-21T12:53:14.4646530Z         v_11 = libdevice.exp(v_10)
2026-02-21T12:53:14.4646814Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T12:53:14.4647029Z         v_12 = v_11 / subscript_2
2026-02-21T12:53:14.4647236Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T12:53:14.4647654Z         tl.store(out + (indices_0[:, None] * 9344 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T12:53:14.4647945Z 
2026-02-21T12:53:14.4648105Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T12:53:14.4648401Z     """
2026-02-21T12:53:14.4648655Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T12:53:14.4649113Z     This version uses fewer passes but is less numerically stable.
2026-02-21T12:53:14.4649394Z     Args:
2026-02-21T12:53:14.4649643Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T12:53:14.4649902Z     Returns:
2026-02-21T12:53:14.4650212Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T12:53:14.4650483Z     """
2026-02-21T12:53:14.4650637Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T12:53:14.4650856Z     m, n = x.size()
2026-02-21T12:53:14.4651076Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T12:53:14.4651365Z     out = torch.empty_like(x)
2026-02-21T12:53:14.4651638Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T12:53:14.4652136Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T12:53:14.4652541Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T12:53:14.4652833Z     # src[softmax.py:79-92]: ...
2026-02-21T12:53:14.4653148Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=8, num_stages=1)
2026-02-21T12:53:14.4653544Z     # src[softmax.py:93]: return out
2026-02-21T12:53:14.4653748Z     return out
2026-02-21T12:53:15.6470631Z WARNING:tritonbench.utils.triton_op:Completed input ID 71:
2026-02-21T12:53:15.6471116Z (M, N)
2026-02-21T12:53:15.6471329Z ------------
2026-02-21T12:53:15.6471528Z (4096, 9344)
2026-02-21T12:53:15.6471652Z 
2026-02-21T12:53:15.6495069Z  75%|███████▌  | 15/20 [1:50:10<47:44, 572.95s/it]WARNING:tritonbench.utils.triton_op:Running input ID 77:
2026-02-21T12:53:15.6496097Z (M, N)
2026-02-21T12:53:15.6496277Z -------------
2026-02-21T12:53:15.6496463Z (4096, 10112)
2026-02-21T12:53:15.6497885Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T12:53:17.1046444Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T12:53:18.6747632Z INFO:tritonbench.utils.triton_op:Took 3.30ms to get benchmark function for torch_compile_softmax
2026-02-21T12:53:20.2665296Z WARNING:__main__:Input tensor metadata:
2026-02-21T12:53:20.2665625Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T12:53:20.2665891Z               'dtype': 'torch.float16',
2026-02-21T12:53:20.2666160Z               'shape': (4096, 10112),
2026-02-21T12:53:20.2666841Z               'stride': (10112, 1)},),
2026-02-21T12:53:20.2667100Z   'kwargs': {}}
2026-02-21T12:53:20.2707641Z INFO:tritonbench.utils.triton_op:Took 4.56ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T12:53:20.5601856Z [0s] Autotune random seed: 2145258556
2026-02-21T12:53:20.5960145Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T12:53:57.8588634Z [37s] Timeout after 31s compiling Config(block_sizes=[256, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[False, True], range_num_stages=[4, 2], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T12:54:04.5817480Z [43s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T12:54:08.1696339Z [47s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T12:54:09.7681841Z [49s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T12:54:10.1449260Z [49s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T12:54:18.5471105Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.8 configs/s
2026-02-21T12:54:28.3216468Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 10.2 configs/s
2026-02-21T12:54:28.3230136Z [67s] Adaptive compile timeout: 30s (90% percentile=30.8s, bounds=[30.0s, 30s])
2026-02-21T12:54:30.2575922Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 509.9 configs/s
2026-02-21T12:54:30.4010508Z [69s] Initial random population of 100, 5 starting points: 
2026-02-21T12:54:30.4010891Z error=7
2026-02-21T12:54:30.4011071Z timeout=5
2026-02-21T12:54:30.4011242Z ok=88
2026-02-21T12:54:30.4011408Z min=0.0868
2026-02-21T12:54:30.4012245Z mid=0.7012
2026-02-21T12:54:30.4012426Z max=137.9716
2026-02-21T12:54:30.4012653Z best={'block_sizes': [1, 4096],
2026-02-21T12:54:30.4012978Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:54:30.4013315Z  'load_eviction_policies': ['', ''],
2026-02-21T12:54:30.4013576Z  'maxnreg': 256,
2026-02-21T12:54:30.4013785Z  'num_sm_multiplier': 64,
2026-02-21T12:54:30.4014410Z  'num_stages': 7,
2026-02-21T12:54:30.4014617Z  'num_warps': 4,
2026-02-21T12:54:30.4014837Z  'pid_type': 'persistent_blocked',
2026-02-21T12:54:30.4015105Z  'range_flattens': [False, None],
2026-02-21T12:54:30.4015372Z  'range_multi_buffers': [True, None],
2026-02-21T12:54:30.4015646Z  'range_num_stages': [3, 3],
2026-02-21T12:54:30.4015909Z  'range_unroll_factors': [3, 4],
2026-02-21T12:54:30.4016479Z  'range_warp_specializes': []}
2026-02-21T12:54:30.4028153Z [69s] Fitting surrogate: 100 points, 100 targets
2026-02-21T12:54:31.8303527Z [71s] Generation 1 starting: 89 neighbors, 5 active search path(s)
2026-02-21T12:55:32.0353550Z [131s] Timeout after 30s compiling Config(block_sizes=[8, 8192], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['last', 'last'], num_stages=1, num_warps=2, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 3], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T12:55:32.0376992Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94/94 0.5 configs/s
2026-02-21T12:55:37.8352633Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 94/94 16.3 configs/s
2026-02-21T12:55:48.0261724Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.8 configs/s
2026-02-21T12:55:48.6032123Z [148s] Generation 1 complete: 
2026-02-21T12:55:48.6034716Z error=2
2026-02-21T12:55:48.6035008Z timeout=1
2026-02-21T12:55:48.6035208Z ok=92
2026-02-21T12:55:48.6035403Z min=0.0755
2026-02-21T12:55:48.6035596Z mid=0.1070
2026-02-21T12:55:48.6035794Z max=0.3875
2026-02-21T12:55:48.6036050Z best={'block_sizes': [1, 2048],
2026-02-21T12:55:48.6036441Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:55:48.6036864Z  'load_eviction_policies': ['', ''],
2026-02-21T12:55:48.6037115Z  'num_stages': 7,
2026-02-21T12:55:48.6037308Z  'num_warps': 4,
2026-02-21T12:55:48.6037499Z  'pid_type': 'flat',
2026-02-21T12:55:48.6037715Z  'range_flattens': [None, None],
2026-02-21T12:55:48.6037966Z  'range_multi_buffers': [None, None],
2026-02-21T12:55:48.6038231Z  'range_num_stages': [0, 3],
2026-02-21T12:55:48.6038465Z  'range_unroll_factors': [0, 3],
2026-02-21T12:55:48.6038710Z  'range_warp_specializes': []}
2026-02-21T12:55:48.6052238Z [148s] Fitting surrogate: 195 points, 195 targets
2026-02-21T12:55:50.1438162Z [149s] Generation 2 starting: 83 neighbors, 5 active search path(s)
2026-02-21T12:56:25.8390543Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84/84 3.6 configs/s
2026-02-21T12:56:31.1495337Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 84/84 15.9 configs/s
2026-02-21T12:56:43.6730774Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 80.5 configs/s
2026-02-21T12:56:44.3952034Z [203s] Generation 2 complete: 
2026-02-21T12:56:44.3952508Z ok=89
2026-02-21T12:56:44.3952789Z min=0.0713
2026-02-21T12:56:44.3953085Z mid=0.0866
2026-02-21T12:56:44.3953356Z max=0.2255
2026-02-21T12:56:44.3953658Z best={'block_sizes': [1, 4096],
2026-02-21T12:56:44.3954414Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:56:44.3954982Z  'load_eviction_policies': ['', ''],
2026-02-21T12:56:44.3955432Z  'num_stages': 7,
2026-02-21T12:56:44.3955792Z  'num_warps': 4,
2026-02-21T12:56:44.3956023Z  'pid_type': 'flat',
2026-02-21T12:56:44.3956215Z  'range_flattens': [None, None],
2026-02-21T12:56:44.3956454Z  'range_multi_buffers': [None, None],
2026-02-21T12:56:44.3956739Z  'range_num_stages': [0, 3],
2026-02-21T12:56:44.3956967Z  'range_unroll_factors': [0, 3],
2026-02-21T12:56:44.3957200Z  'range_warp_specializes': []}
2026-02-21T12:56:44.3975818Z [203s] Fitting surrogate: 284 points, 284 targets
2026-02-21T12:56:45.7042225Z [205s] Generation 3 starting: 80 neighbors, 5 active search path(s)
2026-02-21T12:57:19.5564508Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81/81 2.1 configs/s
2026-02-21T12:57:24.5670390Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 81/81 16.3 configs/s
2026-02-21T12:57:33.3443827Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 114.8         
2026-02-21T12:57:33.3444777Z                                                                   configs/s     
2026-02-21T12:57:33.8811642Z [253s] Generation 3 complete: 
2026-02-21T12:57:33.8814768Z error=1
2026-02-21T12:57:33.8815037Z ok=84
2026-02-21T12:57:33.8815273Z min=0.0594
2026-02-21T12:57:33.8815503Z mid=0.0882
2026-02-21T12:57:33.8816356Z max=0.4171
2026-02-21T12:57:33.8816624Z best={'block_sizes': [1, 16384],
2026-02-21T12:57:33.8817041Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T12:57:33.8817496Z  'load_eviction_policies': ['', ''],
2026-02-21T12:57:33.8817820Z  'num_stages': 8,
2026-02-21T12:57:33.8818059Z  'num_warps': 8,
2026-02-21T12:57:33.8818305Z  'pid_type': 'flat',
2026-02-21T12:57:33.8818587Z  'range_flattens': [None, None],
2026-02-21T12:57:33.8818905Z  'range_multi_buffers': [None, None],
2026-02-21T12:57:33.8819226Z  'range_num_stages': [0, 3],
2026-02-21T12:57:33.8819549Z  'range_unroll_factors': [0, 3],
2026-02-21T12:57:33.8819931Z  'range_warp_specializes': []}
2026-02-21T12:57:33.8840468Z [253s] Fitting surrogate: 369 points, 369 targets
2026-02-21T12:57:35.1354786Z [254s] Generation 4 starting: 68 neighbors, 5 active search path(s)
2026-02-21T12:58:13.5609608Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70/70 0.7 configs/s
2026-02-21T12:58:17.8883718Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 70/70 16.3 configs/s
2026-02-21T12:58:27.1783429Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.6         
2026-02-21T12:58:27.1783960Z                                                                   configs/s     
2026-02-21T12:58:27.7697315Z [307s] Generation 4 complete: 
2026-02-21T12:58:27.7697658Z ok=74
2026-02-21T12:58:27.7697833Z min=0.0596
2026-02-21T12:58:27.7698014Z mid=0.0762
2026-02-21T12:58:27.7698183Z max=1.4674
2026-02-21T12:58:27.7698371Z best={'block_sizes': [1, 16384],
2026-02-21T12:58:27.7698658Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:58:27.7698966Z  'load_eviction_policies': ['', ''],
2026-02-21T12:58:27.7699218Z  'num_stages': 8,
2026-02-21T12:58:27.7699402Z  'num_warps': 8,
2026-02-21T12:58:27.7699592Z  'pid_type': 'flat',
2026-02-21T12:58:27.7699800Z  'range_flattens': [None, None],
2026-02-21T12:58:27.7700051Z  'range_multi_buffers': [None, None],
2026-02-21T12:58:27.7700308Z  'range_num_stages': [0, 3],
2026-02-21T12:58:27.7700571Z  'range_unroll_factors': [0, 3],
2026-02-21T12:58:27.7700816Z  'range_warp_specializes': []}
2026-02-21T12:58:27.7721252Z [307s] Fitting surrogate: 443 points, 443 targets
2026-02-21T12:58:28.8494922Z [308s] Generation 5 starting: 60 neighbors, 5 active search path(s)
2026-02-21T12:58:53.9572118Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 3.5 configs/s
2026-02-21T12:58:57.6296641Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.5 configs/s
2026-02-21T12:59:06.4035280Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 114.9         
2026-02-21T12:59:06.4035751Z                                                                   configs/s     
2026-02-21T12:59:06.9743558Z [346s] Generation 5 complete: 
2026-02-21T12:59:06.9743847Z ok=65
2026-02-21T12:59:06.9744277Z min=0.0594
2026-02-21T12:59:06.9744459Z mid=0.0670
2026-02-21T12:59:06.9744668Z max=0.1220
2026-02-21T12:59:06.9744906Z best={'block_sizes': [1, 16384],
2026-02-21T12:59:06.9745291Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T12:59:06.9745698Z  'load_eviction_policies': ['', ''],
2026-02-21T12:59:06.9745994Z  'num_stages': 8,
2026-02-21T12:59:06.9746736Z  'num_warps': 8,
2026-02-21T12:59:06.9746941Z  'pid_type': 'flat',
2026-02-21T12:59:06.9747165Z  'range_flattens': [None, False],
2026-02-21T12:59:06.9747439Z  'range_multi_buffers': [None, None],
2026-02-21T12:59:06.9747706Z  'range_num_stages': [0, 3],
2026-02-21T12:59:06.9747956Z  'range_unroll_factors': [0, 3],
2026-02-21T12:59:06.9748223Z  'range_warp_specializes': []}
2026-02-21T12:59:06.9771120Z [346s] Fitting surrogate: 508 points, 508 targets
2026-02-21T12:59:08.0234280Z [347s] Generation 6 starting: 66 neighbors, 5 active search path(s)
2026-02-21T12:59:35.9786157Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 3.3 configs/s
2026-02-21T12:59:46.4787907Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 67/67 6.3 configs/s
2026-02-21T12:59:55.8198490Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.0         
2026-02-21T12:59:55.8199136Z                                                                   configs/s     
2026-02-21T12:59:56.4463916Z [395s] Generation 6 complete: 
2026-02-21T12:59:56.4464399Z ok=71
2026-02-21T12:59:56.4464595Z min=0.0596
2026-02-21T12:59:56.4464784Z mid=0.0645
2026-02-21T12:59:56.4464961Z max=0.1102
2026-02-21T12:59:56.4465161Z best={'block_sizes': [1, 16384],
2026-02-21T12:59:56.4465494Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T12:59:56.4465865Z  'load_eviction_policies': ['', ''],
2026-02-21T12:59:56.4466140Z  'num_stages': 1,
2026-02-21T12:59:56.4466362Z  'num_warps': 8,
2026-02-21T12:59:56.4466580Z  'pid_type': 'flat',
2026-02-21T12:59:56.4466810Z  'range_flattens': [None, True],
2026-02-21T12:59:56.4467098Z  'range_multi_buffers': [None, None],
2026-02-21T12:59:56.4467396Z  'range_num_stages': [0, 3],
2026-02-21T12:59:56.4473429Z  'range_unroll_factors': [0, 2],
2026-02-21T12:59:56.4473761Z  'range_warp_specializes': []}
2026-02-21T12:59:56.4499971Z [395s] Fitting surrogate: 579 points, 579 targets
2026-02-21T12:59:57.4686690Z [396s] Generation 7 starting: 59 neighbors, 5 active search path(s)
2026-02-21T13:00:40.3556505Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60/60 1.0 configs/s
2026-02-21T13:00:44.1496763Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 60/60 16.0 configs/s
2026-02-21T13:00:51.2456577Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 142.1         
2026-02-21T13:00:51.2457140Z                                                                   configs/s     
2026-02-21T13:00:51.7215010Z [451s] Generation 7 complete: 
2026-02-21T13:00:51.7216711Z error=1
2026-02-21T13:00:51.7216944Z ok=63
2026-02-21T13:00:51.7217128Z min=0.0594
2026-02-21T13:00:51.7217328Z mid=0.0683
2026-02-21T13:00:51.7217530Z max=1.4678
2026-02-21T13:00:51.7217766Z best={'block_sizes': [1, 16384],
2026-02-21T13:00:51.7218134Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:00:51.7218477Z  'load_eviction_policies': ['', ''],
2026-02-21T13:00:51.7218725Z  'num_stages': 1,
2026-02-21T13:00:51.7218922Z  'num_warps': 8,
2026-02-21T13:00:51.7219511Z  'pid_type': 'flat',
2026-02-21T13:00:51.7219726Z  'range_flattens': [None, True],
2026-02-21T13:00:51.7219991Z  'range_multi_buffers': [None, None],
2026-02-21T13:00:51.7220249Z  'range_num_stages': [0, 4],
2026-02-21T13:00:51.7220484Z  'range_unroll_factors': [0, 2],
2026-02-21T13:00:51.7220728Z  'range_warp_specializes': []}
2026-02-21T13:00:51.7250186Z [451s] Fitting surrogate: 643 points, 643 targets
2026-02-21T13:00:52.6320771Z [452s] Generation 8 starting: 54 neighbors, 4 active search path(s)
2026-02-21T13:01:19.0563063Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55/55 1.3 configs/s
2026-02-21T13:01:22.3917605Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 55/55 16.7 configs/s
2026-02-21T13:01:31.1988057Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 135.7         
2026-02-21T13:01:31.1989855Z                                                                   configs/s     
2026-02-21T13:01:31.6939447Z [491s] Generation 8 complete: 
2026-02-21T13:01:31.6939781Z error=1
2026-02-21T13:01:31.6939948Z ok=57
2026-02-21T13:01:31.6940122Z min=0.0595
2026-02-21T13:01:31.6940293Z mid=0.0647
2026-02-21T13:01:31.6940473Z max=0.3143
2026-02-21T13:01:31.6940656Z best={'block_sizes': [1, 16384],
2026-02-21T13:01:31.6940949Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:01:31.6941263Z  'load_eviction_policies': ['', ''],
2026-02-21T13:01:31.6941523Z  'num_stages': 7,
2026-02-21T13:01:31.6941716Z  'num_warps': 8,
2026-02-21T13:01:31.6941919Z  'pid_type': 'flat',
2026-02-21T13:01:31.6942130Z  'range_flattens': [None, True],
2026-02-21T13:01:31.6942402Z  'range_multi_buffers': [None, None],
2026-02-21T13:01:31.6942669Z  'range_num_stages': [0, 2],
2026-02-21T13:01:31.6942914Z  'range_unroll_factors': [0, 2],
2026-02-21T13:01:31.6943181Z  'range_warp_specializes': []}
2026-02-21T13:01:31.6970384Z [491s] Fitting surrogate: 701 points, 701 targets
2026-02-21T13:01:32.4958036Z [491s] Generation 9 starting: 48 neighbors, 4 active search path(s)
2026-02-21T13:01:52.0368290Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 3.6 configs/s
2026-02-21T13:01:55.0441133Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.5 configs/s
2026-02-21T13:02:01.8288424Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 148.5         
2026-02-21T13:02:01.8288886Z                                                                   configs/s     
2026-02-21T13:02:02.2865874Z [521s] Generation 9 complete: 
2026-02-21T13:02:02.2866151Z ok=52
2026-02-21T13:02:02.2866333Z min=0.0594
2026-02-21T13:02:02.2866510Z mid=0.0635
2026-02-21T13:02:02.2866698Z max=1.3836
2026-02-21T13:02:02.2866931Z best={'block_sizes': [1, 16384],
2026-02-21T13:02:02.2867280Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:02:02.2867714Z  'load_eviction_policies': ['', ''],
2026-02-21T13:02:02.2868017Z  'num_stages': 7,
2026-02-21T13:02:02.2868220Z  'num_warps': 8,
2026-02-21T13:02:02.2868416Z  'pid_type': 'flat',
2026-02-21T13:02:02.2868667Z  'range_flattens': [None, None],
2026-02-21T13:02:02.2868929Z  'range_multi_buffers': [None, None],
2026-02-21T13:02:02.2869202Z  'range_num_stages': [0, 2],
2026-02-21T13:02:02.2869450Z  'range_unroll_factors': [0, 2],
2026-02-21T13:02:02.2869700Z  'range_warp_specializes': []}
2026-02-21T13:02:02.2902863Z [521s] Fitting surrogate: 753 points, 753 targets
2026-02-21T13:02:03.1493900Z [522s] Generation 10 starting: 51 neighbors, 4 active search path(s)
2026-02-21T13:02:24.5960697Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52/52 2.8 configs/s
2026-02-21T13:02:27.7743582Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 52/52 16.6 configs/s
2026-02-21T13:02:34.5007803Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 149.9         
2026-02-21T13:02:34.5008349Z                                                                   configs/s     
2026-02-21T13:02:34.9605548Z [554s] Generation 10 complete: 
2026-02-21T13:02:34.9605840Z ok=55
2026-02-21T13:02:34.9606740Z min=0.0590
2026-02-21T13:02:34.9606899Z mid=0.0616
2026-02-21T13:02:34.9607063Z max=0.5830
2026-02-21T13:02:34.9607232Z best={'block_sizes': [1, 16384],
2026-02-21T13:02:34.9607540Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:02:34.9607853Z  'load_eviction_policies': ['', ''],
2026-02-21T13:02:34.9608098Z  'num_stages': 7,
2026-02-21T13:02:34.9608280Z  'num_warps': 8,
2026-02-21T13:02:34.9608462Z  'pid_type': 'flat',
2026-02-21T13:02:34.9608674Z  'range_flattens': [None, None],
2026-02-21T13:02:34.9608919Z  'range_multi_buffers': [None, None],
2026-02-21T13:02:34.9609169Z  'range_num_stages': [0, 1],
2026-02-21T13:02:34.9609383Z  'range_unroll_factors': [0, 2],
2026-02-21T13:02:34.9609619Z  'range_warp_specializes': []}
2026-02-21T13:02:34.9647031Z [554s] Fitting surrogate: 808 points, 808 targets
2026-02-21T13:02:35.8736700Z [555s] Generation 11 starting: 55 neighbors, 4 active search path(s)
2026-02-21T13:03:00.0037765Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 2.4 configs/s
2026-02-21T13:03:03.4103149Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 57/57 17.0 configs/s
2026-02-21T13:03:11.0767140Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 131.5         
2026-02-21T13:03:11.0769307Z                                                                   configs/s     
2026-02-21T13:03:11.5871746Z [590s] Generation 11 complete: 
2026-02-21T13:03:11.5872092Z error=1
2026-02-21T13:03:11.5872280Z ok=59
2026-02-21T13:03:11.5872466Z min=0.0595
2026-02-21T13:03:11.5872650Z mid=0.0613
2026-02-21T13:03:11.5872840Z max=1.1348
2026-02-21T13:03:11.5873045Z best={'block_sizes': [1, 16384],
2026-02-21T13:03:11.5873394Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T13:03:11.5873823Z  'load_eviction_policies': ['', ''],
2026-02-21T13:03:11.5874545Z  'num_stages': 1,
2026-02-21T13:03:11.5874764Z  'num_warps': 8,
2026-02-21T13:03:11.5874990Z  'pid_type': 'flat',
2026-02-21T13:03:11.5875223Z  'range_flattens': [None, True],
2026-02-21T13:03:11.5875492Z  'range_multi_buffers': [None, True],
2026-02-21T13:03:11.5875741Z  'range_num_stages': [0, 2],
2026-02-21T13:03:11.5875955Z  'range_unroll_factors': [0, 2],
2026-02-21T13:03:11.5876190Z  'range_warp_specializes': []}
2026-02-21T13:03:11.5914208Z [590s] Fitting surrogate: 868 points, 868 targets
2026-02-21T13:03:12.6098749Z [592s] Generation 12 starting: 56 neighbors, 4 active search path(s)
2026-02-21T13:03:37.9959426Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58/58 2.1 configs/s
2026-02-21T13:03:41.8772566Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 58/58 15.1 configs/s
2026-02-21T13:03:49.1745651Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 138.1         
2026-02-21T13:03:49.1746167Z                                                                   configs/s     
2026-02-21T13:03:49.6591436Z [629s] Generation 12 complete: 
2026-02-21T13:03:49.6591886Z ok=60
2026-02-21T13:03:49.6592149Z min=0.0593
2026-02-21T13:03:49.6592458Z mid=0.0709
2026-02-21T13:03:49.6592715Z max=0.4652
2026-02-21T13:03:49.6592987Z best={'block_sizes': [1, 16384],
2026-02-21T13:03:49.6593425Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:03:49.6593893Z  'load_eviction_policies': ['', ''],
2026-02-21T13:03:49.6594909Z  'num_stages': 7,
2026-02-21T13:03:49.6595208Z  'num_warps': 8,
2026-02-21T13:03:49.6595495Z  'pid_type': 'flat',
2026-02-21T13:03:49.6595814Z  'range_flattens': [None, None],
2026-02-21T13:03:49.6596197Z  'range_multi_buffers': [None, None],
2026-02-21T13:03:49.6596580Z  'range_num_stages': [0, 1],
2026-02-21T13:03:49.6596912Z  'range_unroll_factors': [0, 1],
2026-02-21T13:03:49.6597267Z  'range_warp_specializes': []}
2026-02-21T13:03:49.6634997Z [629s] Fitting surrogate: 928 points, 928 targets
2026-02-21T13:03:50.6705512Z [630s] Generation 13 starting: 60 neighbors, 4 active search path(s)
2026-02-21T13:04:21.1026812Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62/62 1.6 configs/s
2026-02-21T13:04:24.7328032Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 62/62 17.3 configs/s
2026-02-21T13:04:30.2589259Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 182.2         
2026-02-21T13:04:30.2589722Z                                                                   configs/s     
2026-02-21T13:04:30.6296075Z [670s] Generation 13 complete: 
2026-02-21T13:04:30.6296604Z error=3
2026-02-21T13:04:30.6296878Z ok=61
2026-02-21T13:04:30.6297159Z min=0.0596
2026-02-21T13:04:30.6297440Z mid=0.0758
2026-02-21T13:04:30.6297715Z max=0.5988
2026-02-21T13:04:30.6298012Z best={'block_sizes': [1, 16384],
2026-02-21T13:04:30.6298503Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:04:30.6299031Z  'load_eviction_policies': ['', ''],
2026-02-21T13:04:30.6299444Z  'num_stages': 7,
2026-02-21T13:04:30.6300805Z  'num_warps': 8,
2026-02-21T13:04:30.6301061Z  'pid_type': 'flat',
2026-02-21T13:04:30.6301291Z  'range_flattens': [None, None],
2026-02-21T13:04:30.6301545Z  'range_multi_buffers': [None, None],
2026-02-21T13:04:30.6301831Z  'range_num_stages': [0, 2],
2026-02-21T13:04:30.6302066Z  'range_unroll_factors': [0, 1],
2026-02-21T13:04:30.6302313Z  'range_warp_specializes': []}
2026-02-21T13:04:30.6339532Z [670s] Fitting surrogate: 992 points, 992 targets
2026-02-21T13:04:31.5002149Z [670s] Generation 14 starting: 51 neighbors, 4 active search path(s)
2026-02-21T13:04:57.7509088Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53/53 1.6 configs/s
2026-02-21T13:05:00.9108026Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 53/53 17.0 configs/s
2026-02-21T13:05:06.3203122Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 186.1         
2026-02-21T13:05:06.3206633Z                                                                   configs/s     
2026-02-21T13:05:06.6911039Z [706s] Generation 14 complete: 
2026-02-21T13:05:06.6911375Z error=2
2026-02-21T13:05:06.6911559Z ok=53
2026-02-21T13:05:06.6911740Z min=0.0595
2026-02-21T13:05:06.6911965Z mid=0.0713
2026-02-21T13:05:06.6912148Z max=1.7191
2026-02-21T13:05:06.6912388Z best={'block_sizes': [1, 16384],
2026-02-21T13:05:06.6912817Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:05:06.6913194Z  'load_eviction_policies': ['', ''],
2026-02-21T13:05:06.6913468Z  'num_stages': 1,
2026-02-21T13:05:06.6913672Z  'num_warps': 8,
2026-02-21T13:05:06.6913883Z  'pid_type': 'flat',
2026-02-21T13:05:06.6914606Z  'range_flattens': [None, True],
2026-02-21T13:05:06.6914892Z  'range_multi_buffers': [None, True],
2026-02-21T13:05:06.6915214Z  'range_num_stages': [0, 2],
2026-02-21T13:05:06.6915487Z  'range_unroll_factors': [0, 2],
2026-02-21T13:05:06.6915738Z  'range_warp_specializes': []}
2026-02-21T13:05:06.6958072Z [706s] Fitting surrogate: 1047 points, 1047 targets
2026-02-21T13:05:07.5020898Z [706s] Generation 15 starting: 47 neighbors, 4 active search path(s)
2026-02-21T13:05:33.3844595Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 1.1 configs/s
2026-02-21T13:05:36.4204686Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 49/49 16.4 configs/s
2026-02-21T13:05:42.7429489Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 159.3         
2026-02-21T13:05:42.7432406Z                                                                   configs/s     
2026-02-21T13:05:43.1655399Z [742s] Generation 15 complete: 
2026-02-21T13:05:43.1655801Z ok=51
2026-02-21T13:05:43.1656064Z min=0.0593
2026-02-21T13:05:43.1656328Z mid=0.0675
2026-02-21T13:05:43.1656592Z max=1.4068
2026-02-21T13:05:43.1656871Z best={'block_sizes': [1, 16384],
2026-02-21T13:05:43.1657349Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:05:43.1657863Z  'load_eviction_policies': ['', ''],
2026-02-21T13:05:43.1658253Z  'num_stages': 1,
2026-02-21T13:05:43.1659259Z  'num_warps': 8,
2026-02-21T13:05:43.1659519Z  'pid_type': 'flat',
2026-02-21T13:05:43.1659838Z  'range_flattens': [None, True],
2026-02-21T13:05:43.1660225Z  'range_multi_buffers': [None, True],
2026-02-21T13:05:43.1660664Z  'range_num_stages': [0, 3],
2026-02-21T13:05:43.1661035Z  'range_unroll_factors': [0, 2],
2026-02-21T13:05:43.1661412Z  'range_warp_specializes': []}
2026-02-21T13:05:43.1703764Z [742s] Fitting surrogate: 1098 points, 1098 targets
2026-02-21T13:05:43.9882551Z [743s] Generation 16 starting: 47 neighbors, 4 active search path(s)
2026-02-21T13:06:04.8520164Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 2.1 configs/s
2026-02-21T13:06:07.7652007Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 48/48 16.7 configs/s
2026-02-21T13:06:14.9792421Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 139.8         
2026-02-21T13:06:14.9792959Z                                                                   configs/s     
2026-02-21T13:06:15.4632653Z [774s] Generation 16 complete: 
2026-02-21T13:06:15.4632941Z ok=51
2026-02-21T13:06:15.4633105Z min=0.0595
2026-02-21T13:06:15.4633356Z mid=0.0651
2026-02-21T13:06:15.4633611Z max=1.5217
2026-02-21T13:06:15.4633927Z best={'block_sizes': [1, 16384],
2026-02-21T13:06:15.4634607Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:06:15.4634936Z  'load_eviction_policies': ['', ''],
2026-02-21T13:06:15.4635176Z  'num_stages': 1,
2026-02-21T13:06:15.4635362Z  'num_warps': 8,
2026-02-21T13:06:15.4635544Z  'pid_type': 'flat',
2026-02-21T13:06:15.4635736Z  'range_flattens': [None, True],
2026-02-21T13:06:15.4635990Z  'range_multi_buffers': [None, True],
2026-02-21T13:06:15.4636230Z  'range_num_stages': [0, 3],
2026-02-21T13:06:15.4636452Z  'range_unroll_factors': [0, 1],
2026-02-21T13:06:15.4636679Z  'range_warp_specializes': []}
2026-02-21T13:06:15.4681327Z [774s] Fitting surrogate: 1149 points, 1149 targets
2026-02-21T13:06:16.2912651Z [775s] Generation 17 starting: 48 neighbors, 4 active search path(s)
2026-02-21T13:06:36.3940631Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 3.8 configs/s
2026-02-21T13:06:39.3767994Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 49/49 16.7 configs/s
2026-02-21T13:06:46.4981752Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 141.6         
2026-02-21T13:06:46.4982264Z                                                                   configs/s     
2026-02-21T13:06:46.9830227Z [806s] Generation 17 complete: 
2026-02-21T13:06:46.9830537Z ok=52
2026-02-21T13:06:46.9830724Z min=0.0593
2026-02-21T13:06:46.9830934Z mid=0.0622
2026-02-21T13:06:46.9831131Z max=0.2422
2026-02-21T13:06:46.9831331Z best={'block_sizes': [1, 16384],
2026-02-21T13:06:46.9831722Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T13:06:46.9832134Z  'load_eviction_policies': ['', ''],
2026-02-21T13:06:46.9832412Z  'num_stages': 7,
2026-02-21T13:06:46.9832609Z  'num_warps': 8,
2026-02-21T13:06:46.9832834Z  'pid_type': 'flat',
2026-02-21T13:06:46.9833105Z  'range_flattens': [None, None],
2026-02-21T13:06:46.9833388Z  'range_multi_buffers': [None, None],
2026-02-21T13:06:46.9833675Z  'range_num_stages': [0, 3],
2026-02-21T13:06:46.9835020Z  'range_unroll_factors': [0, 2],
2026-02-21T13:06:46.9835314Z  'range_warp_specializes': []}
2026-02-21T13:06:46.9882045Z [806s] Fitting surrogate: 1201 points, 1201 targets
2026-02-21T13:06:47.6371841Z [807s] Generation 18 starting: 35 neighbors, 3 active search path(s)
2026-02-21T13:07:04.8374888Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 1.8 configs/s
2026-02-21T13:07:06.9507309Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.9 configs/s
2026-02-21T13:07:12.7919651Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 172.5         
2026-02-21T13:07:12.7920194Z                                                                   configs/s     
2026-02-21T13:07:13.1922089Z [832s] Generation 18 complete: 
2026-02-21T13:07:13.1922422Z ok=38
2026-02-21T13:07:13.1923403Z min=0.0630
2026-02-21T13:07:13.1923605Z mid=0.0634
2026-02-21T13:07:13.1923798Z max=0.0766
2026-02-21T13:07:13.1924217Z best={'block_sizes': [1, 16384],
2026-02-21T13:07:13.1924634Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T13:07:13.1925030Z  'load_eviction_policies': ['', ''],
2026-02-21T13:07:13.1925289Z  'num_stages': 4,
2026-02-21T13:07:13.1925482Z  'num_warps': 8,
2026-02-21T13:07:13.1925701Z  'pid_type': 'flat',
2026-02-21T13:07:13.1925933Z  'range_flattens': [None, True],
2026-02-21T13:07:13.1926196Z  'range_multi_buffers': [None, None],
2026-02-21T13:07:13.1926468Z  'range_num_stages': [0, 1],
2026-02-21T13:07:13.1926703Z  'range_unroll_factors': [0, 2],
2026-02-21T13:07:13.1926953Z  'range_warp_specializes': []}
2026-02-21T13:07:13.1975146Z [832s] Fitting surrogate: 1239 points, 1239 targets
2026-02-21T13:07:13.6885270Z [833s] Generation 19 starting: 24 neighbors, 2 active search path(s)
2026-02-21T13:07:24.6461195Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 4.4 configs/s
2026-02-21T13:07:26.1602532Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 17.0 configs/s
2026-02-21T13:07:29.7257563Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 281.2         
2026-02-21T13:07:29.7258075Z                                                                   configs/s     
2026-02-21T13:07:29.9817791Z [849s] Generation 19 complete: 
2026-02-21T13:07:29.9818067Z ok=27
2026-02-21T13:07:29.9818242Z min=0.0596
2026-02-21T13:07:29.9818414Z mid=0.0683
2026-02-21T13:07:29.9818580Z max=0.1588
2026-02-21T13:07:29.9818758Z best={'block_sizes': [1, 16384],
2026-02-21T13:07:29.9819075Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:07:29.9819423Z  'load_eviction_policies': ['', ''],
2026-02-21T13:07:29.9819672Z  'num_stages': 2,
2026-02-21T13:07:29.9819865Z  'num_warps': 8,
2026-02-21T13:07:29.9820051Z  'pid_type': 'flat',
2026-02-21T13:07:29.9820293Z  'range_flattens': [None, False],
2026-02-21T13:07:29.9820549Z  'range_multi_buffers': [None, True],
2026-02-21T13:07:29.9820810Z  'range_num_stages': [0, 0],
2026-02-21T13:07:29.9821038Z  'range_unroll_factors': [0, 2],
2026-02-21T13:07:29.9821300Z  'range_warp_specializes': []}
2026-02-21T13:07:29.9869108Z [849s] Fitting surrogate: 1266 points, 1266 targets
2026-02-21T13:07:30.2985806Z [849s] Generation 20 starting: 12 neighbors, 1 active search path(s)
2026-02-21T13:07:37.3001830Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 1.9 configs/s
2026-02-21T13:07:38.0211080Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.8 configs/s
2026-02-21T13:07:39.8603376Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 539.8         
2026-02-21T13:07:39.8603884Z                                                                   configs/s     
2026-02-21T13:07:40.0097077Z [859s] Generation 20 complete: 
2026-02-21T13:07:40.0097556Z ok=13
2026-02-21T13:07:40.0097836Z min=0.0629
2026-02-21T13:07:40.0098183Z mid=0.0646
2026-02-21T13:07:40.0098453Z max=0.2545
2026-02-21T13:07:40.0098785Z best={'block_sizes': [1, 16384],
2026-02-21T13:07:40.0099315Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:07:40.0100832Z  'load_eviction_policies': ['', ''],
2026-02-21T13:07:40.0101252Z  'num_stages': 2,
2026-02-21T13:07:40.0101566Z  'num_warps': 8,
2026-02-21T13:07:40.0101874Z  'pid_type': 'flat',
2026-02-21T13:07:40.0102294Z  'range_flattens': [None, False],
2026-02-21T13:07:40.0102821Z  'range_multi_buffers': [None, True],
2026-02-21T13:07:40.0103119Z  'range_num_stages': [0, 0],
2026-02-21T13:07:40.0103363Z  'range_unroll_factors': [0, 2],
2026-02-21T13:07:40.0103608Z  'range_warp_specializes': []}
2026-02-21T13:07:40.0148260Z [859s] Fitting surrogate: 1279 points, 1279 targets
2026-02-21T13:07:40.1881825Z [859s] Autotuning complete in 859.6s after searching 1214 configs.
2026-02-21T13:07:40.1882396Z One can hardcode the best config and skip autotuning with:
2026-02-21T13:07:40.1884925Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T13:07:40.1886328Z 
2026-02-21T13:07:40.1886751Z [859s] Code of selected kernel: /tmp/torchinductor_root/dp/cdpzipkfw4fusijflqrlgmpnuowceonvmkdsuq6crzpq4fb6osnf.py
2026-02-21T13:07:40.2212403Z from __future__ import annotations
2026-02-21T13:07:40.2212710Z 
2026-02-21T13:07:40.2212796Z import torch
2026-02-21T13:07:40.2212998Z import triton
2026-02-21T13:07:40.2213219Z import triton.language as tl
2026-02-21T13:07:40.2213528Z from torch._inductor.runtime import triton_helpers
2026-02-21T13:07:40.2214195Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T13:07:40.2214755Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T13:07:40.2215036Z 
2026-02-21T13:07:40.2215137Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T13:07:40.2215421Z _BLOCK_SIZE_1 = tl.constexpr(16384)
2026-02-21T13:07:40.2215619Z 
2026-02-21T13:07:40.2215710Z @triton.jit
2026-02-21T13:07:40.2215920Z def _helion_softmax_two_pass(x, out):
2026-02-21T13:07:40.2216307Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:07:40.2216695Z     pid_0 = tl.program_id(0)
2026-02-21T13:07:40.2216938Z     offset_0 = pid_0
2026-02-21T13:07:40.2217183Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T13:07:40.2217606Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:07:40.2218060Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T13:07:40.2218472Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:07:40.2218852Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T13:07:40.2219252Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:07:40.2219682Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T13:07:40.2220076Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T13:07:40.2220435Z     # src[softmax.py:82-89]: ...
2026-02-21T13:07:40.2220969Z     for offset_2 in tl.range(0, 10112, _BLOCK_SIZE_1, loop_unroll_factor=2, disallow_acc_multi_buffer=False, flatten=False):
2026-02-21T13:07:40.2221624Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:07:40.2221988Z         mask_1 = indices_2 < 10112
2026-02-21T13:07:40.2222277Z         mi_copy = mi
2026-02-21T13:07:40.2222521Z         di_copy = di
2026-02-21T13:07:40.2222748Z         mi_copy_0 = mi_copy
2026-02-21T13:07:40.2222971Z         di_copy_0 = di_copy
2026-02-21T13:07:40.2223229Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T13:07:40.2223736Z         values = tl.load(x + (indices_0[:, None] * 10112 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T13:07:40.2224400Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T13:07:40.2225075Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T13:07:40.2226216Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T13:07:40.2226609Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T13:07:40.2226972Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T13:07:40.2227273Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T13:07:40.2227659Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:07:40.2228020Z         v_2 = mi_copy_0 - v_1
2026-02-21T13:07:40.2228261Z         v_3 = libdevice.exp(v_2)
2026-02-21T13:07:40.2228502Z         v_4 = di_copy_0 * v_3
2026-02-21T13:07:40.2229008Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T13:07:40.2229326Z         subscript = v_1[:, None]
2026-02-21T13:07:40.2229570Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T13:07:40.2229834Z         v_6 = v_5 - subscript
2026-02-21T13:07:40.2230160Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:07:40.2230564Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T13:07:40.2230888Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T13:07:40.2231166Z         v_7 = libdevice.exp(v_6)
2026-02-21T13:07:40.2231676Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T13:07:40.2232243Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T13:07:40.2232550Z         di = v_4 + sum_1
2026-02-21T13:07:40.2232765Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T13:07:40.2233017Z         mi = v_1
2026-02-21T13:07:40.2233311Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:07:40.2233715Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T13:07:40.2234260Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:07:40.2234830Z     for offset_2 in tl.range(0, 10112, _BLOCK_SIZE_1, loop_unroll_factor=2, disallow_acc_multi_buffer=False, flatten=False):
2026-02-21T13:07:40.2235360Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:07:40.2235665Z         mask_2 = indices_2 < 10112
2026-02-21T13:07:40.2235860Z         mi_copy_1 = mi
2026-02-21T13:07:40.2236026Z         di_copy_1 = di
2026-02-21T13:07:40.2236190Z         mi_copy_1_0 = mi_copy_1
2026-02-21T13:07:40.2236379Z         di_copy_1_0 = di_copy_1
2026-02-21T13:07:40.2236595Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T13:07:40.2236994Z         values_1 = tl.load(x + (indices_0[:, None] * 10112 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T13:07:40.2237494Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:07:40.2237855Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T13:07:40.2238088Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T13:07:40.2238302Z         v_10 = v_9 - subscript_1
2026-02-21T13:07:40.2238503Z         v_11 = libdevice.exp(v_10)
2026-02-21T13:07:40.2238708Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T13:07:40.2238922Z         v_12 = v_11 / subscript_2
2026-02-21T13:07:40.2239129Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T13:07:40.2239475Z         tl.store(out + (indices_0[:, None] * 10112 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T13:07:40.2239754Z 
2026-02-21T13:07:40.2239916Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T13:07:40.2240199Z     """
2026-02-21T13:07:40.2240448Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T13:07:40.2240831Z     This version uses fewer passes but is less numerically stable.
2026-02-21T13:07:40.2241104Z     Args:
2026-02-21T13:07:40.2241286Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T13:07:40.2241724Z     Returns:
2026-02-21T13:07:40.2241934Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T13:07:40.2242193Z     """
2026-02-21T13:07:40.2242348Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T13:07:40.2242564Z     m, n = x.size()
2026-02-21T13:07:40.2242757Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T13:07:40.2243002Z     out = torch.empty_like(x)
2026-02-21T13:07:40.2243300Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:07:40.2243694Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:07:40.2244232Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:07:40.2244531Z     # src[softmax.py:79-92]: ...
2026-02-21T13:07:40.2244997Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=8, num_stages=2)
2026-02-21T13:07:40.2245348Z     # src[softmax.py:93]: return out
2026-02-21T13:07:40.2245551Z     return out
2026-02-21T13:07:41.4390241Z WARNING:tritonbench.utils.triton_op:Completed input ID 77:
2026-02-21T13:07:41.4390653Z (M, N)
2026-02-21T13:07:41.4390832Z -------------
2026-02-21T13:07:41.4391037Z (4096, 10112)
2026-02-21T13:07:41.4391158Z 
2026-02-21T13:07:41.4413214Z  80%|████████  | 16/20 [2:04:36<44:04, 661.10s/it]WARNING:tritonbench.utils.triton_op:Running input ID 82:
2026-02-21T13:07:41.4413660Z (M, N)
2026-02-21T13:07:41.4413823Z -------------
2026-02-21T13:07:41.4414385Z (4096, 10752)
2026-02-21T13:07:41.4416455Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T13:07:42.8875328Z INFO:tritonbench.utils.triton_op:Took 0.02ms to get benchmark function for triton_softmax
2026-02-21T13:07:44.4493467Z INFO:tritonbench.utils.triton_op:Took 3.93ms to get benchmark function for torch_compile_softmax
2026-02-21T13:07:45.9724215Z WARNING:__main__:Input tensor metadata:
2026-02-21T13:07:45.9724592Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T13:07:45.9724879Z               'dtype': 'torch.float16',
2026-02-21T13:07:45.9725126Z               'shape': (4096, 10752),
2026-02-21T13:07:45.9725368Z               'stride': (10752, 1)},),
2026-02-21T13:07:45.9725591Z   'kwargs': {}}
2026-02-21T13:07:45.9785354Z INFO:tritonbench.utils.triton_op:Took 6.53ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T13:07:46.2741175Z [0s] Autotune random seed: 2145258556
2026-02-21T13:07:46.3144968Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T13:08:27.7350025Z [41s] Timeout after 35s compiling Config(block_sizes=[256, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[False, True], range_num_stages=[4, 2], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T13:08:31.2025832Z [44s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T13:08:35.3686984Z [49s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T13:08:37.1825591Z [50s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:08:37.6064659Z [51s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:08:53.4875812Z [67s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T13:08:53.4897876Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T13:09:03.4820786Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 10.0 configs/s
2026-02-21T13:09:03.4835856Z [77s] Adaptive compile timeout: 30s (90% percentile=35.0s, bounds=[30.0s, 30s])
2026-02-21T13:09:05.0417184Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 629.4 configs/s
2026-02-21T13:09:05.1658908Z [78s] Initial random population of 100, 5 starting points: 
2026-02-21T13:09:05.1659310Z error=7
2026-02-21T13:09:05.1659495Z timeout=6
2026-02-21T13:09:05.1659774Z ok=87
2026-02-21T13:09:05.1659946Z min=0.0870
2026-02-21T13:09:05.1660122Z mid=0.7415
2026-02-21T13:09:05.1660288Z max=147.2454
2026-02-21T13:09:05.1660612Z best={'block_sizes': [1, 4096],
2026-02-21T13:09:05.1660938Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:09:05.1661345Z  'load_eviction_policies': ['', ''],
2026-02-21T13:09:05.1661744Z  'maxnreg': 256,
2026-02-21T13:09:05.1661959Z  'num_sm_multiplier': 64,
2026-02-21T13:09:05.1662191Z  'num_stages': 7,
2026-02-21T13:09:05.1662430Z  'num_warps': 4,
2026-02-21T13:09:05.1662638Z  'pid_type': 'persistent_blocked',
2026-02-21T13:09:05.1662904Z  'range_flattens': [False, None],
2026-02-21T13:09:05.1663230Z  'range_multi_buffers': [True, None],
2026-02-21T13:09:05.1663495Z  'range_num_stages': [3, 3],
2026-02-21T13:09:05.1663745Z  'range_unroll_factors': [3, 4],
2026-02-21T13:09:05.1664387Z  'range_warp_specializes': []}
2026-02-21T13:09:05.1677804Z [78s] Fitting surrogate: 100 points, 100 targets
2026-02-21T13:09:06.8564291Z [80s] Generation 1 starting: 92 neighbors, 5 active search path(s)
2026-02-21T13:09:50.4651395Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97/97 1.6 configs/s
2026-02-21T13:09:56.8287613Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 97/97 15.3 configs/s
2026-02-21T13:10:01.7099674Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 205.5         
2026-02-21T13:10:01.7100220Z                                                                   configs/s     
2026-02-21T13:10:02.0063556Z [135s] Generation 1 complete: 
2026-02-21T13:10:02.0063875Z error=1
2026-02-21T13:10:02.0064180Z ok=97
2026-02-21T13:10:02.0064352Z min=0.0686
2026-02-21T13:10:02.0064526Z mid=0.1148
2026-02-21T13:10:02.0064710Z max=0.4772
2026-02-21T13:10:02.0064894Z best={'block_sizes': [1, 16384],
2026-02-21T13:10:02.0065240Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:10:02.0065623Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:10:02.0065891Z  'num_stages': 1,
2026-02-21T13:10:02.0066082Z  'num_warps': 16,
2026-02-21T13:10:02.0066278Z  'pid_type': 'flat',
2026-02-21T13:10:02.0066519Z  'range_flattens': [None, None],
2026-02-21T13:10:02.0066779Z  'range_multi_buffers': [None, None],
2026-02-21T13:10:02.0067041Z  'range_num_stages': [0, 1],
2026-02-21T13:10:02.0067269Z  'range_unroll_factors': [0, 3],
2026-02-21T13:10:02.0068087Z  'range_warp_specializes': []}
2026-02-21T13:10:02.0086159Z [135s] Fitting surrogate: 198 points, 198 targets
2026-02-21T13:10:03.5305471Z [137s] Generation 2 starting: 84 neighbors, 5 active search path(s)
2026-02-21T13:10:41.2160520Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/87 2.8 configs/s
2026-02-21T13:10:46.5702164Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 87/87 16.4 configs/s
2026-02-21T13:10:58.4417588Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 97.2 configs/s
2026-02-21T13:10:59.0526576Z [192s] Generation 2 complete: 
2026-02-21T13:10:59.0526923Z error=1
2026-02-21T13:10:59.0527104Z ok=88
2026-02-21T13:10:59.0527283Z min=0.0679
2026-02-21T13:10:59.0527462Z mid=0.0940
2026-02-21T13:10:59.0528355Z max=0.3767
2026-02-21T13:10:59.0528561Z best={'block_sizes': [1, 16384],
2026-02-21T13:10:59.0528918Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:10:59.0529362Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:10:59.0529637Z  'num_stages': 1,
2026-02-21T13:10:59.0529842Z  'num_warps': 4,
2026-02-21T13:10:59.0530152Z  'pid_type': 'flat',
2026-02-21T13:10:59.0530382Z  'range_flattens': [None, None],
2026-02-21T13:10:59.0530642Z  'range_multi_buffers': [None, None],
2026-02-21T13:10:59.0530949Z  'range_num_stages': [0, 0],
2026-02-21T13:10:59.0531227Z  'range_unroll_factors': [0, 3],
2026-02-21T13:10:59.0531460Z  'range_warp_specializes': []}
2026-02-21T13:10:59.0547583Z [192s] Fitting surrogate: 287 points, 287 targets
2026-02-21T13:11:00.3392958Z [194s] Generation 3 starting: 70 neighbors, 5 active search path(s)
2026-02-21T13:11:35.2963949Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72/72 1.2 configs/s
2026-02-21T13:11:40.1890908Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 72/72 14.8 configs/s
2026-02-21T13:11:48.4416919Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 122.0         
2026-02-21T13:11:48.4417466Z                                                                   configs/s     
2026-02-21T13:11:48.9483163Z [242s] Generation 3 complete: 
2026-02-21T13:11:48.9483691Z ok=75
2026-02-21T13:11:48.9484485Z min=0.0646
2026-02-21T13:11:48.9484820Z mid=0.0907
2026-02-21T13:11:48.9485095Z max=0.6457
2026-02-21T13:11:48.9485407Z best={'block_sizes': [1, 16384],
2026-02-21T13:11:48.9486068Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:11:48.9486614Z  'load_eviction_policies': ['', ''],
2026-02-21T13:11:48.9486846Z  'num_stages': 2,
2026-02-21T13:11:48.9487028Z  'num_warps': 4,
2026-02-21T13:11:48.9487212Z  'pid_type': 'flat',
2026-02-21T13:11:48.9487414Z  'range_flattens': [None, None],
2026-02-21T13:11:48.9487657Z  'range_multi_buffers': [None, None],
2026-02-21T13:11:48.9487929Z  'range_num_stages': [0, 0],
2026-02-21T13:11:48.9488151Z  'range_unroll_factors': [0, 3],
2026-02-21T13:11:48.9488379Z  'range_warp_specializes': []}
2026-02-21T13:11:48.9512980Z [242s] Fitting surrogate: 362 points, 362 targets
2026-02-21T13:11:50.0223141Z [243s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T13:12:18.8832518Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 2.9 configs/s
2026-02-21T13:12:22.9905747Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.5 configs/s
2026-02-21T13:12:32.3060397Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 108.2         
2026-02-21T13:12:32.3061507Z                                                                   configs/s     
2026-02-21T13:12:32.8939983Z [286s] Generation 4 complete: 
2026-02-21T13:12:32.8940269Z ok=71
2026-02-21T13:12:32.8940439Z min=0.0639
2026-02-21T13:12:32.8940618Z mid=0.0744
2026-02-21T13:12:32.8940783Z max=0.6163
2026-02-21T13:12:32.8941525Z best={'block_sizes': [1, 16384],
2026-02-21T13:12:32.8941892Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:12:32.8942269Z  'load_eviction_policies': ['', ''],
2026-02-21T13:12:32.8942535Z  'num_stages': 2,
2026-02-21T13:12:32.8942732Z  'num_warps': 8,
2026-02-21T13:12:32.8942920Z  'pid_type': 'flat',
2026-02-21T13:12:32.8943136Z  'range_flattens': [None, None],
2026-02-21T13:12:32.8943389Z  'range_multi_buffers': [None, False],
2026-02-21T13:12:32.8943648Z  'range_num_stages': [0, 0],
2026-02-21T13:12:32.8943883Z  'range_unroll_factors': [0, 3],
2026-02-21T13:12:32.8946214Z  'range_warp_specializes': []}
2026-02-21T13:12:32.8969887Z [286s] Fitting surrogate: 433 points, 433 targets
2026-02-21T13:12:34.0071300Z [287s] Generation 5 starting: 67 neighbors, 5 active search path(s)
2026-02-21T13:13:02.7664991Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 3.4 configs/s
2026-02-21T13:13:06.9477969Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 16.4 configs/s
2026-02-21T13:13:16.5360478Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 105.3         
2026-02-21T13:13:16.5361000Z                                                                   configs/s     
2026-02-21T13:13:17.1514227Z [330s] Generation 5 complete: 
2026-02-21T13:13:17.1514528Z ok=72
2026-02-21T13:13:17.1514714Z min=0.0637
2026-02-21T13:13:17.1514922Z mid=0.0686
2026-02-21T13:13:17.1515099Z max=0.6228
2026-02-21T13:13:17.1515302Z best={'block_sizes': [1, 16384],
2026-02-21T13:13:17.1515676Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:13:17.1516099Z  'load_eviction_policies': ['', ''],
2026-02-21T13:13:17.1516372Z  'num_stages': 1,
2026-02-21T13:13:17.1516586Z  'num_warps': 8,
2026-02-21T13:13:17.1516803Z  'pid_type': 'flat',
2026-02-21T13:13:17.1517043Z  'range_flattens': [None, None],
2026-02-21T13:13:17.1517319Z  'range_multi_buffers': [None, False],
2026-02-21T13:13:17.1517558Z  'range_num_stages': [0, 0],
2026-02-21T13:13:17.1517800Z  'range_unroll_factors': [0, 3],
2026-02-21T13:13:17.1518025Z  'range_warp_specializes': []}
2026-02-21T13:13:17.1548027Z [330s] Fitting surrogate: 505 points, 505 targets
2026-02-21T13:13:18.3391440Z [332s] Generation 6 starting: 65 neighbors, 5 active search path(s)
2026-02-21T13:14:07.2319579Z [380s] Timeout after 30s compiling Config(block_sizes=[4, 16384], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], num_stages=5, num_warps=1, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T13:14:07.2340764Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 0.4 configs/s
2026-02-21T13:14:11.4057032Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.2 configs/s
2026-02-21T13:14:22.1935772Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 107.9         
2026-02-21T13:14:22.1936330Z                                                                   configs/s     
2026-02-21T13:14:22.7898859Z [396s] Generation 6 complete: 
2026-02-21T13:14:22.7899191Z timeout=1
2026-02-21T13:14:22.7900091Z ok=69
2026-02-21T13:14:22.7900265Z min=0.0637
2026-02-21T13:14:22.7900447Z mid=0.0712
2026-02-21T13:14:22.7900621Z max=0.8292
2026-02-21T13:14:22.7900843Z best={'block_sizes': [1, 16384],
2026-02-21T13:14:22.7901183Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:14:22.7901536Z  'load_eviction_policies': ['', ''],
2026-02-21T13:14:22.7901799Z  'num_stages': 2,
2026-02-21T13:14:22.7901996Z  'num_warps': 8,
2026-02-21T13:14:22.7902201Z  'pid_type': 'flat',
2026-02-21T13:14:22.7902421Z  'range_flattens': [None, True],
2026-02-21T13:14:22.7902729Z  'range_multi_buffers': [None, False],
2026-02-21T13:14:22.7903057Z  'range_num_stages': [0, 3],
2026-02-21T13:14:22.7903319Z  'range_unroll_factors': [0, 3],
2026-02-21T13:14:22.7903569Z  'range_warp_specializes': []}
2026-02-21T13:14:22.7928755Z [396s] Fitting surrogate: 575 points, 575 targets
2026-02-21T13:14:23.7225700Z [397s] Generation 7 starting: 56 neighbors, 5 active search path(s)
2026-02-21T13:14:48.7462016Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 2.8 configs/s
2026-02-21T13:14:52.2270010Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 16.6 configs/s
2026-02-21T13:15:00.7738821Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 118.0         
2026-02-21T13:15:00.7739425Z                                                                   configs/s     
2026-02-21T13:15:01.3280532Z [435s] Generation 7 complete: 
2026-02-21T13:15:01.3281030Z ok=61
2026-02-21T13:15:01.3281312Z min=0.0635
2026-02-21T13:15:01.3281599Z mid=0.0647
2026-02-21T13:15:01.3281866Z max=1.6270
2026-02-21T13:15:01.3282178Z best={'block_sizes': [1, 16384],
2026-02-21T13:15:01.3282696Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:15:01.3283266Z  'load_eviction_policies': ['', ''],
2026-02-21T13:15:01.3283732Z  'num_stages': 5,
2026-02-21T13:15:01.3284623Z  'num_warps': 8,
2026-02-21T13:15:01.3284964Z  'pid_type': 'flat',
2026-02-21T13:15:01.3285341Z  'range_flattens': [None, None],
2026-02-21T13:15:01.3285804Z  'range_multi_buffers': [None, None],
2026-02-21T13:15:01.3286260Z  'range_num_stages': [0, 0],
2026-02-21T13:15:01.3286653Z  'range_unroll_factors': [0, 2],
2026-02-21T13:15:01.3287051Z  'range_warp_specializes': []}
2026-02-21T13:15:01.3322695Z [435s] Fitting surrogate: 636 points, 636 targets
2026-02-21T13:15:02.1020360Z [435s] Generation 8 starting: 47 neighbors, 4 active search path(s)
2026-02-21T13:15:39.1741830Z [472s] Timeout after 30s compiling Config(block_sizes=[4, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'first'], num_stages=1, num_warps=1, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:15:39.1765287Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 0.4 configs/s
2026-02-21T13:15:42.0637556Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 17.2 configs/s
2026-02-21T13:15:47.8839749Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 172.9         
2026-02-21T13:15:47.8840361Z                                                                   configs/s     
2026-02-21T13:15:48.2817638Z [481s] Generation 8 complete: 
2026-02-21T13:15:48.2817931Z error=1
2026-02-21T13:15:48.2818103Z timeout=1
2026-02-21T13:15:48.2818270Z ok=49
2026-02-21T13:15:48.2818429Z min=0.0638
2026-02-21T13:15:48.2818584Z mid=0.0699
2026-02-21T13:15:48.2818743Z max=0.6148
2026-02-21T13:15:48.2818914Z best={'block_sizes': [1, 16384],
2026-02-21T13:15:48.2819213Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:15:48.2819526Z  'load_eviction_policies': ['', ''],
2026-02-21T13:15:48.2819764Z  'num_stages': 3,
2026-02-21T13:15:48.2819948Z  'num_warps': 8,
2026-02-21T13:15:48.2820166Z  'pid_type': 'flat',
2026-02-21T13:15:48.2820360Z  'range_flattens': [None, None],
2026-02-21T13:15:48.2820594Z  'range_multi_buffers': [None, True],
2026-02-21T13:15:48.2821474Z  'range_num_stages': [0, 3],
2026-02-21T13:15:48.2821688Z  'range_unroll_factors': [0, 3],
2026-02-21T13:15:48.2821916Z  'range_warp_specializes': []}
2026-02-21T13:15:48.2855966Z [481s] Fitting surrogate: 687 points, 687 targets
2026-02-21T13:15:49.0986250Z [482s] Generation 9 starting: 48 neighbors, 4 active search path(s)
2026-02-21T13:16:11.2979247Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 3.5 configs/s
2026-02-21T13:16:14.5692444Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 15.5 configs/s
2026-02-21T13:16:21.5361263Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 144.5         
2026-02-21T13:16:21.5361778Z                                                                   configs/s     
2026-02-21T13:16:21.9878637Z [515s] Generation 9 complete: 
2026-02-21T13:16:21.9879676Z ok=52
2026-02-21T13:16:21.9879897Z min=0.0632
2026-02-21T13:16:21.9880073Z mid=0.0724
2026-02-21T13:16:21.9880263Z max=1.8072
2026-02-21T13:16:21.9880459Z best={'block_sizes': [1, 16384],
2026-02-21T13:16:21.9880798Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:16:21.9881121Z  'load_eviction_policies': ['', ''],
2026-02-21T13:16:21.9881389Z  'num_stages': 3,
2026-02-21T13:16:21.9881594Z  'num_warps': 8,
2026-02-21T13:16:21.9881786Z  'pid_type': 'flat',
2026-02-21T13:16:21.9882011Z  'range_flattens': [None, None],
2026-02-21T13:16:21.9882272Z  'range_multi_buffers': [None, True],
2026-02-21T13:16:21.9882550Z  'range_num_stages': [0, 3],
2026-02-21T13:16:21.9882785Z  'range_unroll_factors': [0, 3],
2026-02-21T13:16:21.9883039Z  'range_warp_specializes': []}
2026-02-21T13:16:21.9918473Z [515s] Fitting surrogate: 739 points, 739 targets
2026-02-21T13:16:22.8503219Z [516s] Generation 10 starting: 46 neighbors, 4 active search path(s)
2026-02-21T13:16:51.7654348Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 0.4 configs/s
2026-02-21T13:16:55.7000042Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 48/48 12.6 configs/s
2026-02-21T13:17:02.0778143Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 157.8         
2026-02-21T13:17:02.0778660Z                                                                   configs/s     
2026-02-21T13:17:02.4969005Z [556s] Generation 10 complete: 
2026-02-21T13:17:02.4969322Z ok=50
2026-02-21T13:17:02.4969505Z min=0.0635
2026-02-21T13:17:02.4969721Z mid=0.0692
2026-02-21T13:17:02.4970026Z max=1.8068
2026-02-21T13:17:02.4970225Z best={'block_sizes': [1, 16384],
2026-02-21T13:17:02.4970602Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:17:02.4970988Z  'load_eviction_policies': ['', ''],
2026-02-21T13:17:02.4971242Z  'num_stages': 4,
2026-02-21T13:17:02.4971444Z  'num_warps': 8,
2026-02-21T13:17:02.4971641Z  'pid_type': 'flat',
2026-02-21T13:17:02.4971906Z  'range_flattens': [None, False],
2026-02-21T13:17:02.4972173Z  'range_multi_buffers': [None, None],
2026-02-21T13:17:02.4972450Z  'range_num_stages': [0, 1],
2026-02-21T13:17:02.4972693Z  'range_unroll_factors': [0, 2],
2026-02-21T13:17:02.4973744Z  'range_warp_specializes': []}
2026-02-21T13:17:02.5008925Z [556s] Fitting surrogate: 789 points, 789 targets
2026-02-21T13:17:03.3342531Z [557s] Generation 11 starting: 46 neighbors, 4 active search path(s)
2026-02-21T13:17:44.2248365Z [597s] Timeout after 30s compiling Config(block_sizes=[4, 16384], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', ''], num_stages=1, num_warps=1, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:17:44.2267024Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 0.2 configs/s
2026-02-21T13:17:47.8271435Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 47/47 14.5 configs/s
2026-02-21T13:17:56.1466241Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 140.0         
2026-02-21T13:17:56.1466780Z                                                                   configs/s     
2026-02-21T13:17:56.6238816Z [610s] Generation 11 complete: 
2026-02-21T13:17:56.6239337Z timeout=1
2026-02-21T13:17:56.6239646Z ok=49
2026-02-21T13:17:56.6239919Z min=0.0638
2026-02-21T13:17:56.6240194Z mid=0.0643
2026-02-21T13:17:56.6240455Z max=0.6814
2026-02-21T13:17:56.6240756Z best={'block_sizes': [1, 16384],
2026-02-21T13:17:56.6241228Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:17:56.6241777Z  'load_eviction_policies': ['', ''],
2026-02-21T13:17:56.6242246Z  'num_stages': 7,
2026-02-21T13:17:56.6242594Z  'num_warps': 8,
2026-02-21T13:17:56.6242933Z  'pid_type': 'flat',
2026-02-21T13:17:56.6243151Z  'range_flattens': [None, False],
2026-02-21T13:17:56.6243396Z  'range_multi_buffers': [None, False],
2026-02-21T13:17:56.6243660Z  'range_num_stages': [0, 1],
2026-02-21T13:17:56.6243880Z  'range_unroll_factors': [0, 3],
2026-02-21T13:17:56.6244440Z  'range_warp_specializes': []}
2026-02-21T13:17:56.6274467Z [610s] Fitting surrogate: 839 points, 839 targets
2026-02-21T13:17:57.4616474Z [611s] Generation 12 starting: 50 neighbors, 4 active search path(s)
2026-02-21T13:18:28.1539981Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50/50 1.6 configs/s
2026-02-21T13:18:37.0395303Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 50/50 5.6 configs/s
2026-02-21T13:18:45.3678181Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 121.1         
2026-02-21T13:18:45.3678656Z                                                                   configs/s     
2026-02-21T13:18:45.9130959Z [659s] Generation 12 complete: 
2026-02-21T13:18:45.9133602Z ok=54
2026-02-21T13:18:45.9133957Z min=0.0636
2026-02-21T13:18:45.9134494Z mid=0.0642
2026-02-21T13:18:45.9134769Z max=0.1105
2026-02-21T13:18:45.9135058Z best={'block_sizes': [1, 16384],
2026-02-21T13:18:45.9135606Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:18:45.9136146Z  'load_eviction_policies': ['', ''],
2026-02-21T13:18:45.9136628Z  'num_stages': 3,
2026-02-21T13:18:45.9137005Z  'num_warps': 8,
2026-02-21T13:18:45.9137341Z  'pid_type': 'flat',
2026-02-21T13:18:45.9137567Z  'range_flattens': [None, None],
2026-02-21T13:18:45.9137819Z  'range_multi_buffers': [None, True],
2026-02-21T13:18:45.9138087Z  'range_num_stages': [0, 4],
2026-02-21T13:18:45.9138317Z  'range_unroll_factors': [0, 2],
2026-02-21T13:18:45.9138568Z  'range_warp_specializes': []}
2026-02-21T13:18:45.9174927Z [659s] Fitting surrogate: 893 points, 893 targets
2026-02-21T13:18:46.4006852Z [660s] Generation 13 starting: 24 neighbors, 2 active search path(s)
2026-02-21T13:19:06.9222422Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 1.2 configs/s
2026-02-21T13:19:09.5859668Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 24/24 9.0 configs/s
2026-02-21T13:19:13.4336905Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 260.8         
2026-02-21T13:19:13.4337409Z                                                                   configs/s     
2026-02-21T13:19:13.7077554Z [687s] Generation 13 complete: 
2026-02-21T13:19:13.7077885Z ok=27
2026-02-21T13:19:13.7078066Z min=0.0634
2026-02-21T13:19:13.7078255Z mid=0.0639
2026-02-21T13:19:13.7078427Z max=0.1240
2026-02-21T13:19:13.7078627Z best={'block_sizes': [1, 16384],
2026-02-21T13:19:13.7078944Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:19:13.7079267Z  'load_eviction_policies': ['', ''],
2026-02-21T13:19:13.7079525Z  'num_stages': 4,
2026-02-21T13:19:13.7079732Z  'num_warps': 8,
2026-02-21T13:19:13.7079926Z  'pid_type': 'flat',
2026-02-21T13:19:13.7080154Z  'range_flattens': [None, False],
2026-02-21T13:19:13.7080424Z  'range_multi_buffers': [None, None],
2026-02-21T13:19:13.7080694Z  'range_num_stages': [0, 0],
2026-02-21T13:19:13.7080943Z  'range_unroll_factors': [0, 2],
2026-02-21T13:19:13.7081881Z  'range_warp_specializes': []}
2026-02-21T13:19:13.7121293Z [687s] Fitting surrogate: 920 points, 920 targets
2026-02-21T13:19:14.1939926Z [687s] Generation 14 starting: 23 neighbors, 2 active search path(s)
2026-02-21T13:19:33.8741173Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23/23 1.9 configs/s
2026-02-21T13:19:36.5879426Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 23/23 8.4 configs/s
2026-02-21T13:19:40.5456080Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 253.5         
2026-02-21T13:19:40.5456590Z                                                                   configs/s     
2026-02-21T13:19:40.8202602Z [714s] Generation 14 complete: 
2026-02-21T13:19:40.8202861Z ok=25
2026-02-21T13:19:40.8203024Z min=0.0669
2026-02-21T13:19:40.8203173Z mid=0.0674
2026-02-21T13:19:40.8203324Z max=0.0880
2026-02-21T13:19:40.8203493Z best={'block_sizes': [1, 16384],
2026-02-21T13:19:40.8203781Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:19:40.8204480Z  'load_eviction_policies': ['', ''],
2026-02-21T13:19:40.8204730Z  'num_stages': 7,
2026-02-21T13:19:40.8204912Z  'num_warps': 8,
2026-02-21T13:19:40.8205105Z  'pid_type': 'flat',
2026-02-21T13:19:40.8205324Z  'range_flattens': [None, False],
2026-02-21T13:19:40.8205570Z  'range_multi_buffers': [None, False],
2026-02-21T13:19:40.8205817Z  'range_num_stages': [0, 3],
2026-02-21T13:19:40.8206037Z  'range_unroll_factors': [0, 3],
2026-02-21T13:19:40.8206280Z  'range_warp_specializes': []}
2026-02-21T13:19:40.8244691Z [714s] Fitting surrogate: 945 points, 945 targets
2026-02-21T13:19:41.3028388Z [714s] Generation 15 starting: 24 neighbors, 2 active search path(s)
2026-02-21T13:20:07.2197891Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 1.2 configs/s
2026-02-21T13:20:12.5214991Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 26/26 4.8 configs/s
2026-02-21T13:20:16.4580324Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 255.0         
2026-02-21T13:20:16.4580868Z                                                                   configs/s     
2026-02-21T13:20:16.7305610Z [750s] Generation 15 complete: 
2026-02-21T13:20:16.7305946Z ok=27
2026-02-21T13:20:16.7306119Z min=0.0669
2026-02-21T13:20:16.7306290Z mid=0.0683
2026-02-21T13:20:16.7306454Z max=0.1162
2026-02-21T13:20:16.7306639Z best={'block_sizes': [1, 16384],
2026-02-21T13:20:16.7306981Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T13:20:16.7307355Z  'load_eviction_policies': ['', ''],
2026-02-21T13:20:16.7307603Z  'num_stages': 7,
2026-02-21T13:20:16.7307794Z  'num_warps': 8,
2026-02-21T13:20:16.7307983Z  'pid_type': 'flat',
2026-02-21T13:20:16.7308199Z  'range_flattens': [None, False],
2026-02-21T13:20:16.7308461Z  'range_multi_buffers': [None, False],
2026-02-21T13:20:16.7308717Z  'range_num_stages': [0, 3],
2026-02-21T13:20:16.7308951Z  'range_unroll_factors': [0, 3],
2026-02-21T13:20:16.7309195Z  'range_warp_specializes': []}
2026-02-21T13:20:16.7349619Z [750s] Fitting surrogate: 972 points, 972 targets
2026-02-21T13:20:17.1989581Z [750s] Generation 16 starting: 23 neighbors, 2 active search path(s)
2026-02-21T13:20:48.5458544Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25/25 0.8 configs/s
2026-02-21T13:20:50.0447778Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 25/25 17.2 configs/s
2026-02-21T13:20:54.0320923Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 251.7         
2026-02-21T13:20:54.0321441Z                                                                   configs/s     
2026-02-21T13:20:54.3068225Z [787s] Generation 16 complete: 
2026-02-21T13:20:54.3068478Z ok=26
2026-02-21T13:20:54.3068654Z min=0.0672
2026-02-21T13:20:54.3068830Z mid=0.0713
2026-02-21T13:20:54.3068985Z max=0.7143
2026-02-21T13:20:54.3069171Z best={'block_sizes': [1, 16384],
2026-02-21T13:20:54.3069504Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T13:20:54.3070260Z  'load_eviction_policies': ['', ''],
2026-02-21T13:20:54.3070514Z  'num_stages': 7,
2026-02-21T13:20:54.3070695Z  'num_warps': 8,
2026-02-21T13:20:54.3070880Z  'pid_type': 'flat',
2026-02-21T13:20:54.3071074Z  'range_flattens': [None, True],
2026-02-21T13:20:54.3071328Z  'range_multi_buffers': [None, False],
2026-02-21T13:20:54.3071576Z  'range_num_stages': [0, 2],
2026-02-21T13:20:54.3071798Z  'range_unroll_factors': [0, 3],
2026-02-21T13:20:54.3072022Z  'range_warp_specializes': []}
2026-02-21T13:20:54.3115441Z [787s] Fitting surrogate: 998 points, 998 targets
2026-02-21T13:20:54.7923270Z [788s] Generation 17 starting: 24 neighbors, 2 active search path(s)
2026-02-21T13:21:06.8340358Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26/26 3.5 configs/s
2026-02-21T13:21:08.4178580Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 26/26 16.9 configs/s
2026-02-21T13:21:12.3054864Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 258.0         
2026-02-21T13:21:12.3055378Z                                                                   configs/s     
2026-02-21T13:21:12.5749529Z [806s] Generation 17 complete: 
2026-02-21T13:21:12.5749894Z ok=27
2026-02-21T13:21:12.5750094Z min=0.0671
2026-02-21T13:21:12.5750332Z mid=0.0714
2026-02-21T13:21:12.5750521Z max=0.1491
2026-02-21T13:21:12.5750740Z best={'block_sizes': [1, 16384],
2026-02-21T13:21:12.5751139Z  'indexing': ['tensor_descriptor', 'pointer', 'tensor_descriptor'],
2026-02-21T13:21:12.5751582Z  'load_eviction_policies': ['', ''],
2026-02-21T13:21:12.5751876Z  'num_stages': 7,
2026-02-21T13:21:12.5752097Z  'num_warps': 8,
2026-02-21T13:21:12.5752323Z  'pid_type': 'flat',
2026-02-21T13:21:12.5752569Z  'range_flattens': [None, True],
2026-02-21T13:21:12.5752864Z  'range_multi_buffers': [None, False],
2026-02-21T13:21:12.5753174Z  'range_num_stages': [0, 1],
2026-02-21T13:21:12.5753458Z  'range_unroll_factors': [0, 3],
2026-02-21T13:21:12.5753742Z  'range_warp_specializes': []}
2026-02-21T13:21:12.5796566Z [806s] Fitting surrogate: 1025 points, 1025 targets
2026-02-21T13:21:13.0603251Z [806s] Generation 18 starting: 22 neighbors, 2 active search path(s)
2026-02-21T13:21:24.2872489Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24/24 1.5 configs/s
2026-02-21T13:21:25.7951695Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 24/24 16.4 configs/s
2026-02-21T13:21:29.6621197Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 259.3         
2026-02-21T13:21:29.6621699Z                                                                   configs/s     
2026-02-21T13:21:29.9273219Z [823s] Generation 18 complete: 
2026-02-21T13:21:29.9273515Z ok=25
2026-02-21T13:21:29.9273705Z min=0.0673
2026-02-21T13:21:29.9273886Z mid=0.0702
2026-02-21T13:21:29.9274230Z max=0.1117
2026-02-21T13:21:29.9274427Z best={'block_sizes': [1, 16384],
2026-02-21T13:21:29.9274730Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:21:29.9275053Z  'load_eviction_policies': ['', ''],
2026-02-21T13:21:29.9275316Z  'num_stages': 5,
2026-02-21T13:21:29.9275570Z  'num_warps': 8,
2026-02-21T13:21:29.9275771Z  'pid_type': 'flat',
2026-02-21T13:21:29.9276003Z  'range_flattens': [None, None],
2026-02-21T13:21:29.9276264Z  'range_multi_buffers': [None, False],
2026-02-21T13:21:29.9746571Z  'range_num_stages': [0, 0],
2026-02-21T13:21:29.9746819Z  'range_unroll_factors': [0, 2],
2026-02-21T13:21:29.9747077Z  'range_warp_specializes': []}
2026-02-21T13:21:29.9747385Z [823s] Fitting surrogate: 1050 points, 1050 targets
2026-02-21T13:21:30.2451345Z [823s] Generation 19 starting: 12 neighbors, 1 active search path(s)
2026-02-21T13:21:38.8816304Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 1.5 configs/s
2026-02-21T13:21:40.0826233Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 10.9 configs/s
2026-02-21T13:21:43.8398295Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 447.5         
2026-02-21T13:21:43.8398829Z                                                                   configs/s     
2026-02-21T13:21:44.1085775Z [837s] Generation 19 complete: 
2026-02-21T13:21:44.1086455Z ok=14
2026-02-21T13:21:44.1086607Z min=0.0673
2026-02-21T13:21:44.1086776Z mid=0.0714
2026-02-21T13:21:44.1086935Z max=0.0995
2026-02-21T13:21:44.1087106Z best={'block_sizes': [1, 16384],
2026-02-21T13:21:44.1087352Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:21:44.1087628Z  'load_eviction_policies': ['', ''],
2026-02-21T13:21:44.1087845Z  'num_stages': 5,
2026-02-21T13:21:44.1088012Z  'num_warps': 8,
2026-02-21T13:21:44.1088178Z  'pid_type': 'flat',
2026-02-21T13:21:44.1088367Z  'range_flattens': [None, None],
2026-02-21T13:21:44.1088587Z  'range_multi_buffers': [None, None],
2026-02-21T13:21:44.1088805Z  'range_num_stages': [0, 0],
2026-02-21T13:21:44.1089009Z  'range_unroll_factors': [0, 2],
2026-02-21T13:21:44.1089209Z  'range_warp_specializes': []}
2026-02-21T13:21:44.1089450Z [837s] Fitting surrogate: 1064 points, 1064 targets
2026-02-21T13:21:44.3536670Z [838s] Autotuning complete in 838.0s after searching 1011 configs.
2026-02-21T13:21:44.3537166Z One can hardcode the best config and skip autotuning with:
2026-02-21T13:21:44.3538601Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', ''], num_stages=5, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 2], range_warp_specializes=[]), static_shapes=True)
2026-02-21T13:21:44.3539819Z 
2026-02-21T13:21:44.3540196Z [838s] Code of selected kernel: /tmp/torchinductor_root/3w/c3w2abpilscggzg6wuqzkitubnxiuk374j7x3rv4bid2t4s7umpw.py
2026-02-21T13:21:44.3879018Z from __future__ import annotations
2026-02-21T13:21:44.3879263Z 
2026-02-21T13:21:44.3879345Z import torch
2026-02-21T13:21:44.3879537Z import triton
2026-02-21T13:21:44.3879756Z import triton.language as tl
2026-02-21T13:21:44.3880058Z from torch._inductor.runtime import triton_helpers
2026-02-21T13:21:44.3880492Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T13:21:44.3880970Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T13:21:44.3881260Z 
2026-02-21T13:21:44.5450535Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T13:21:44.5450802Z _BLOCK_SIZE_1 = tl.constexpr(16384)
2026-02-21T13:21:44.5450974Z 
2026-02-21T13:21:44.5451044Z @triton.jit
2026-02-21T13:21:44.5451361Z def _helion_softmax_two_pass(x, out):
2026-02-21T13:21:44.5451997Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:21:44.5452634Z     pid_0 = tl.program_id(0)
2026-02-21T13:21:44.5452999Z     offset_0 = pid_0
2026-02-21T13:21:44.5453366Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T13:21:44.5454583Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:21:44.5455312Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T13:21:44.5456301Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:21:44.5456899Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T13:21:44.5457494Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:21:44.5458176Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T13:21:44.5458789Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T13:21:44.5459343Z     # src[softmax.py:82-89]: ...
2026-02-21T13:21:44.5459900Z     for offset_2 in tl.range(0, 10752, _BLOCK_SIZE_1, loop_unroll_factor=2):
2026-02-21T13:21:44.5460619Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:21:44.5461302Z         mask_1 = indices_2 < 10752
2026-02-21T13:21:44.5461583Z         mi_copy = mi
2026-02-21T13:21:44.5461779Z         di_copy = di
2026-02-21T13:21:44.5461972Z         mi_copy_0 = mi_copy
2026-02-21T13:21:44.5462192Z         di_copy_0 = di_copy
2026-02-21T13:21:44.5462447Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T13:21:44.5462948Z         values = tl.load(x + (indices_0[:, None] * 10752 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T13:21:44.5463488Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T13:21:44.5464355Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T13:21:44.5465003Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T13:21:44.5465394Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T13:21:44.5465754Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T13:21:44.5466075Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T13:21:44.5466457Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:21:44.5466828Z         v_2 = mi_copy_0 - v_1
2026-02-21T13:21:44.5467058Z         v_3 = libdevice.exp(v_2)
2026-02-21T13:21:44.5467299Z         v_4 = di_copy_0 * v_3
2026-02-21T13:21:44.5467563Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T13:21:44.5467861Z         subscript = v_1[:, None]
2026-02-21T13:21:44.5468100Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T13:21:44.5468366Z         v_6 = v_5 - subscript
2026-02-21T13:21:44.5468676Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:21:44.5469073Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T13:21:44.5469394Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T13:21:44.5469657Z         v_7 = libdevice.exp(v_6)
2026-02-21T13:21:44.5470154Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T13:21:44.5470719Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T13:21:44.5471036Z         di = v_4 + sum_1
2026-02-21T13:21:44.5471258Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T13:21:44.5471505Z         mi = v_1
2026-02-21T13:21:44.5471801Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:21:44.5472151Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T13:21:44.5472710Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:21:44.5473135Z     for offset_2 in tl.range(0, 10752, _BLOCK_SIZE_1, loop_unroll_factor=2):
2026-02-21T13:21:44.5473516Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:21:44.5473807Z         mask_2 = indices_2 < 10752
2026-02-21T13:21:44.5474164Z         mi_copy_1 = mi
2026-02-21T13:21:44.5474344Z         di_copy_1 = di
2026-02-21T13:21:44.5474510Z         mi_copy_1_0 = mi_copy_1
2026-02-21T13:21:44.5474708Z         di_copy_1_0 = di_copy_1
2026-02-21T13:21:44.5474926Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T13:21:44.5955090Z         values_1 = tl.load(x + (indices_0[:, None] * 10752 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T13:21:44.5956368Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:21:44.5957083Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T13:21:44.5957533Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T13:21:44.5957945Z         v_10 = v_9 - subscript_1
2026-02-21T13:21:44.5958331Z         v_11 = libdevice.exp(v_10)
2026-02-21T13:21:44.5958718Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T13:21:44.5959123Z         v_12 = v_11 / subscript_2
2026-02-21T13:21:44.5959498Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T13:21:44.5960142Z         tl.store(out + (indices_0[:, None] * 10752 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T13:21:44.5960669Z 
2026-02-21T13:21:44.5961006Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T13:21:44.5961558Z     """
2026-02-21T13:21:44.5961846Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T13:21:44.5962308Z     This version uses fewer passes but is less numerically stable.
2026-02-21T13:21:44.5962627Z     Args:
2026-02-21T13:21:44.5962834Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T13:21:44.5963114Z     Returns:
2026-02-21T13:21:44.5963344Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T13:21:44.5963638Z     """
2026-02-21T13:21:44.5963813Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T13:21:44.5964254Z     m, n = x.size()
2026-02-21T13:21:44.5964480Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T13:21:44.5964757Z     out = torch.empty_like(x)
2026-02-21T13:21:44.5965077Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:21:44.5965541Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:21:44.5965998Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:21:44.5966351Z     # src[softmax.py:79-92]: ...
2026-02-21T13:21:44.5966699Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=8, num_stages=5)
2026-02-21T13:21:44.5967087Z     # src[softmax.py:93]: return out
2026-02-21T13:21:44.5967310Z     return out
2026-02-21T13:21:45.6677911Z WARNING:tritonbench.utils.triton_op:Completed input ID 82:
2026-02-21T13:21:45.6678275Z (M, N)
2026-02-21T13:21:45.6678451Z -------------
2026-02-21T13:21:45.6678622Z (4096, 10752)
2026-02-21T13:21:45.6678720Z 
2026-02-21T13:21:45.6698371Z  85%|████████▌ | 17/20 [2:18:40<35:48, 716.17s/it]WARNING:tritonbench.utils.triton_op:Running input ID 87:
2026-02-21T13:21:45.6698864Z (M, N)
2026-02-21T13:21:45.6699038Z -------------
2026-02-21T13:21:45.6699256Z (4096, 11392)
2026-02-21T13:21:45.6700759Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for naive_softmax
2026-02-21T13:21:47.1088311Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T13:21:48.6527163Z INFO:tritonbench.utils.triton_op:Took 3.36ms to get benchmark function for torch_compile_softmax
2026-02-21T13:21:51.0837706Z WARNING:__main__:Input tensor metadata:
2026-02-21T13:21:51.0838105Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T13:21:51.1110730Z               'dtype': 'torch.float16',
2026-02-21T13:21:51.1111023Z               'shape': (4096, 11392),
2026-02-21T13:21:51.1111300Z               'stride': (11392, 1)},),
2026-02-21T13:21:51.1111561Z   'kwargs': {}}
2026-02-21T13:21:51.1112022Z INFO:tritonbench.utils.triton_op:Took 3.49ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T13:21:51.3801176Z [0s] Autotune random seed: 2145258556
2026-02-21T13:21:51.4538189Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T13:22:34.4926219Z [42s] Timeout after 36s compiling Config(block_sizes=[256, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[False, True], range_num_stages=[4, 2], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T13:22:37.4301428Z [45s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T13:22:41.6028128Z [50s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T13:22:43.4522816Z [52s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:22:43.8879821Z [52s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:22:54.1697793Z [62s] Timeout after 30s compiling Config(block_sizes=[256, 512], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', ''], maxnreg=256, num_sm_multiplier=64, num_stages=6, num_warps=32, pid_type='persistent_blocked', range_flattens=[True, False], range_multi_buffers=[None, False], range_num_stages=[2, 1], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:22:59.9000791Z [68s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T13:22:59.9020811Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.4 configs/s
2026-02-21T13:23:13.6737280Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━━ 100/100 7.2 configs/s
2026-02-21T13:23:13.6751826Z [82s] Adaptive compile timeout: 30s (90% percentile=35.8s, bounds=[30.0s, 30s])
2026-02-21T13:23:14.8298703Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 840.5 configs/s
2026-02-21T13:23:14.9339176Z [83s] Initial random population of 100, 5 starting points: 
2026-02-21T13:23:14.9339891Z error=6
2026-02-21T13:23:14.9340069Z timeout=7
2026-02-21T13:23:14.9340237Z ok=87
2026-02-21T13:23:14.9340405Z min=0.0848
2026-02-21T13:23:14.9340572Z mid=0.7873
2026-02-21T13:23:14.9340747Z max=158.4153
2026-02-21T13:23:14.9340936Z best={'block_sizes': [1, 4096],
2026-02-21T13:23:14.9341243Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:23:14.9341570Z  'load_eviction_policies': ['', ''],
2026-02-21T13:23:14.9341823Z  'maxnreg': 256,
2026-02-21T13:23:14.9347756Z  'num_sm_multiplier': 64,
2026-02-21T13:23:14.9348052Z  'num_stages': 7,
2026-02-21T13:23:14.9348245Z  'num_warps': 4,
2026-02-21T13:23:14.9348448Z  'pid_type': 'persistent_blocked',
2026-02-21T13:23:14.9348708Z  'range_flattens': [False, None],
2026-02-21T13:23:14.9349282Z  'range_multi_buffers': [True, None],
2026-02-21T13:23:14.9349559Z  'range_num_stages': [3, 3],
2026-02-21T13:23:14.9349779Z  'range_unroll_factors': [3, 4],
2026-02-21T13:23:14.9350014Z  'range_warp_specializes': []}
2026-02-21T13:23:14.9360196Z [83s] Fitting surrogate: 100 points, 100 targets
2026-02-21T13:23:16.4289653Z [84s] Generation 1 starting: 92 neighbors, 5 active search path(s)
2026-02-21T13:24:08.8294308Z [137s] Timeout after 34s compiling Config(block_sizes=[1, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=64, num_sm_multiplier=64, num_stages=7, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[None, None], range_num_stages=[3, 3], range_unroll_factors=[3, 4], range_warp_specializes=[]) (SIGKILL required)
2026-02-21T13:24:27.1835826Z [155s] Timeout after 52s compiling Config(block_sizes=[1, 8192], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=4, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[3, 4], range_warp_specializes=[]) (SIGKILL required)
2026-02-21T13:24:40.1622956Z [168s] Timeout after 67s compiling Config(block_sizes=[2, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[4, 3], range_unroll_factors=[3, 4], range_warp_specializes=[])
2026-02-21T13:24:46.0451225Z [174s] Timeout after 74s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[2, 4], range_warp_specializes=[])
2026-02-21T13:24:46.7637650Z [175s] Timeout after 79s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:24:51.8691670Z [180s] Timeout after 79s compiling Config(block_sizes=[1, 8192], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=256, num_sm_multiplier=64, num_stages=6, num_warps=1, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[3, 4], range_warp_specializes=[])
2026-02-21T13:24:52.4910693Z [181s] Timeout after 83s compiling Config(block_sizes=[1, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=256, num_sm_multiplier=64, num_stages=7, num_warps=4, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:24:54.9136532Z [183s] Timeout after 82s compiling Config(block_sizes=[4, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=256, num_sm_multiplier=32, num_stages=1, num_warps=8, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T13:25:04.9230222Z [193s] Timeout after 84s compiling Config(block_sizes=[2, 2048], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=32, num_stages=1, num_warps=1, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[]) (SIGKILL required)
2026-02-21T13:25:08.3538413Z [196s] Timeout after 96s compiling Config(block_sizes=[1, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=64, num_sm_multiplier=32, num_stages=1, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, False], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T13:25:08.5485757Z [197s] Timeout after 95s compiling Config(block_sizes=[2, 2048], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=32, num_stages=1, num_warps=4, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, False], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T13:25:08.5556717Z [197s] Timeout after 95s compiling Config(block_sizes=[1, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=256, num_sm_multiplier=32, num_stages=1, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, False], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T13:25:08.6521242Z [197s] Timeout after 94s compiling Config(block_sizes=[2, 1024], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', ''], maxnreg=256, num_sm_multiplier=32, num_stages=1, num_warps=2, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T13:25:08.9407901Z [197s] Timeout after 94s compiling Config(block_sizes=[2, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['first', 'first'], num_sm_multiplier=32, num_stages=1, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, True], range_multi_buffers=[True, False], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T13:25:09.1281588Z [197s] Timeout after 84s compiling Config(block_sizes=[1, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=64, num_sm_multiplier=8, num_stages=1, num_warps=2, pid_type='persistent_blocked', range_flattens=[False, True], range_multi_buffers=[False, False], range_num_stages=[4, 3], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T13:25:09.5667974Z [198s] Timeout after 81s compiling Config(block_sizes=[4, 8192], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=1, num_warps=4, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[3, 1], range_unroll_factors=[1, 3], range_warp_specializes=[])
2026-02-21T13:25:10.0014947Z [198s] Timeout after 74s compiling Config(block_sizes=[16, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first'], num_stages=5, num_warps=16, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T13:25:10.0092873Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97/97 - configs/s
2026-02-21T13:25:14.9558094Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 97/97 19.8 configs/s
2026-02-21T13:25:23.0299995Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 124.5         
2026-02-21T13:25:23.0301943Z                                                                   configs/s     
2026-02-21T13:25:23.4722992Z [212s] Generation 1 complete: 
2026-02-21T13:25:23.4741185Z error=1
2026-02-21T13:25:23.4741393Z timeout=17
2026-02-21T13:25:23.4741564Z ok=80
2026-02-21T13:25:23.4741735Z min=0.0807
2026-02-21T13:25:23.4741908Z mid=0.1189
2026-02-21T13:25:23.4742099Z max=0.9068
2026-02-21T13:25:23.4742287Z best={'block_sizes': [1, 4096],
2026-02-21T13:25:23.4742602Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:25:23.4742949Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:25:23.4743209Z  'maxnreg': 256,
2026-02-21T13:25:23.4743415Z  'num_sm_multiplier': 64,
2026-02-21T13:25:23.4743644Z  'num_stages': 7,
2026-02-21T13:25:23.4743843Z  'num_warps': 4,
2026-02-21T13:25:23.4744390Z  'pid_type': 'persistent_blocked',
2026-02-21T13:25:23.4744641Z  'range_flattens': [False, None],
2026-02-21T13:25:23.4744884Z  'range_multi_buffers': [None, None],
2026-02-21T13:25:23.4745125Z  'range_num_stages': [3, 3],
2026-02-21T13:25:23.4745367Z  'range_unroll_factors': [3, 4],
2026-02-21T13:25:23.4745594Z  'range_warp_specializes': []}
2026-02-21T13:25:23.4746104Z [212s] Fitting surrogate: 198 points, 198 targets
2026-02-21T13:25:25.1126696Z [213s] Generation 2 starting: 89 neighbors, 5 active search path(s)
2026-02-21T13:26:12.0764548Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89/89 0.6 configs/s
2026-02-21T13:26:17.6362716Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 89/89 16.1 configs/s
2026-02-21T13:26:32.1123225Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 69.6 configs/s
2026-02-21T13:26:32.9150433Z [281s] Generation 2 complete: 
2026-02-21T13:26:32.9150730Z ok=94
2026-02-21T13:26:32.9150906Z min=0.0788
2026-02-21T13:26:32.9151091Z mid=0.0990
2026-02-21T13:26:32.9151260Z max=0.8250
2026-02-21T13:26:32.9151448Z best={'block_sizes': [1, 4096],
2026-02-21T13:26:32.9151773Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:26:32.9152117Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:26:32.9152392Z  'num_stages': 1,
2026-02-21T13:26:32.9152582Z  'num_warps': 8,
2026-02-21T13:26:32.9152810Z  'pid_type': 'flat',
2026-02-21T13:26:32.9153026Z  'range_flattens': [None, True],
2026-02-21T13:26:32.9153284Z  'range_multi_buffers': [None, False],
2026-02-21T13:26:32.9153547Z  'range_num_stages': [0, 3],
2026-02-21T13:26:32.9153771Z  'range_unroll_factors': [0, 2],
2026-02-21T13:26:32.9154331Z  'range_warp_specializes': []}
2026-02-21T13:26:32.9178154Z [281s] Fitting surrogate: 292 points, 292 targets
2026-02-21T13:26:34.2417941Z [282s] Generation 3 starting: 82 neighbors, 5 active search path(s)
2026-02-21T13:27:35.6832437Z [344s] Timeout after 30s compiling Config(block_sizes=[4, 4096], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first'], num_stages=5, num_warps=1, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T13:27:35.6852398Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84/84 0.2 configs/s
2026-02-21T13:27:41.8871925Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 84/84 13.6 configs/s
2026-02-21T13:27:52.8447048Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 106.5         
2026-02-21T13:27:52.8448695Z                                                                   configs/s     
2026-02-21T13:27:53.3969688Z [361s] Generation 3 complete: 
2026-02-21T13:27:53.3970117Z timeout=1
2026-02-21T13:27:53.3970295Z ok=86
2026-02-21T13:27:53.3970473Z min=0.0762
2026-02-21T13:27:53.3970646Z mid=0.1046
2026-02-21T13:27:53.3970826Z max=0.5601
2026-02-21T13:27:53.3971016Z best={'block_sizes': [1, 8192],
2026-02-21T13:27:53.3971348Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:27:53.3971711Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:27:53.3971997Z  'num_stages': 5,
2026-02-21T13:27:53.3972211Z  'num_warps': 8,
2026-02-21T13:27:53.3972422Z  'pid_type': 'flat',
2026-02-21T13:27:53.3972648Z  'range_flattens': [None, False],
2026-02-21T13:27:53.4771061Z  'range_multi_buffers': [None, False],
2026-02-21T13:27:53.4771750Z  'range_num_stages': [0, 1],
2026-02-21T13:27:53.4772024Z  'range_unroll_factors': [0, 2],
2026-02-21T13:27:53.4772293Z  'range_warp_specializes': []}
2026-02-21T13:27:53.4772649Z [361s] Fitting surrogate: 379 points, 379 targets
2026-02-21T13:27:54.7003352Z [363s] Generation 4 starting: 77 neighbors, 5 active search path(s)
2026-02-21T13:28:27.7426180Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77/77 2.8 configs/s
2026-02-21T13:28:32.5062130Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 77/77 16.3 configs/s
2026-02-21T13:28:45.4135673Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 78.1 configs/s
2026-02-21T13:28:46.1721759Z [414s] Generation 4 complete: 
2026-02-21T13:28:46.1722042Z ok=82
2026-02-21T13:28:46.1722206Z min=0.0708
2026-02-21T13:28:46.1722362Z mid=0.0819
2026-02-21T13:28:46.1722517Z max=0.2708
2026-02-21T13:28:46.1722684Z best={'block_sizes': [1, 16384],
2026-02-21T13:28:46.1723043Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T13:28:46.1723398Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:28:46.1723636Z  'num_stages': 2,
2026-02-21T13:28:46.1723834Z  'num_warps': 16,
2026-02-21T13:28:46.1724389Z  'pid_type': 'flat',
2026-02-21T13:28:46.1724613Z  'range_flattens': [None, None],
2026-02-21T13:28:46.1724849Z  'range_multi_buffers': [None, False],
2026-02-21T13:28:46.1725095Z  'range_num_stages': [0, 0],
2026-02-21T13:28:46.1725306Z  'range_unroll_factors': [0, 0],
2026-02-21T13:28:46.1725532Z  'range_warp_specializes': []}
2026-02-21T13:28:46.1755055Z [414s] Fitting surrogate: 461 points, 461 targets
2026-02-21T13:28:47.2396466Z [415s] Generation 5 starting: 60 neighbors, 5 active search path(s)
2026-02-21T13:29:18.4570965Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64/64 4.5 configs/s
2026-02-21T13:29:22.8651640Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 64/64 14.6 configs/s
2026-02-21T13:29:33.0070745Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 99.4 configs/s
2026-02-21T13:29:33.6298463Z [462s] Generation 5 complete: 
2026-02-21T13:29:33.6298759Z ok=66
2026-02-21T13:29:33.6298975Z min=0.0710
2026-02-21T13:29:33.6299157Z mid=0.0742
2026-02-21T13:29:33.6299319Z max=0.2380
2026-02-21T13:29:33.6299507Z best={'block_sizes': [1, 16384],
2026-02-21T13:29:33.6299834Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T13:29:33.6300192Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:29:33.6300460Z  'num_stages': 2,
2026-02-21T13:29:33.6300652Z  'num_warps': 16,
2026-02-21T13:29:33.6300845Z  'pid_type': 'flat',
2026-02-21T13:29:33.6301053Z  'range_flattens': [None, None],
2026-02-21T13:29:33.6301305Z  'range_multi_buffers': [None, False],
2026-02-21T13:29:33.6301561Z  'range_num_stages': [0, 0],
2026-02-21T13:29:33.6301800Z  'range_unroll_factors': [0, 0],
2026-02-21T13:29:33.6302042Z  'range_warp_specializes': []}
2026-02-21T13:29:33.6330359Z [462s] Fitting surrogate: 527 points, 527 targets
2026-02-21T13:29:34.5388785Z [463s] Generation 6 starting: 57 neighbors, 5 active search path(s)
2026-02-21T13:30:13.1773268Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61/61 1.8 configs/s
2026-02-21T13:30:18.2160882Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 61/61 12.2 configs/s
2026-02-21T13:30:28.3109042Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 99.9 configs/s
2026-02-21T13:30:28.9382669Z [517s] Generation 6 complete: 
2026-02-21T13:30:28.9382942Z ok=63
2026-02-21T13:30:28.9383108Z min=0.0708
2026-02-21T13:30:28.9383294Z mid=0.0718
2026-02-21T13:30:28.9383455Z max=0.1291
2026-02-21T13:30:28.9383649Z best={'block_sizes': [1, 16384],
2026-02-21T13:30:28.9384311Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T13:30:28.9384709Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:30:28.9384988Z  'num_stages': 1,
2026-02-21T13:30:28.9385179Z  'num_warps': 16,
2026-02-21T13:30:28.9385912Z  'pid_type': 'flat',
2026-02-21T13:30:28.9386136Z  'range_flattens': [None, None],
2026-02-21T13:30:28.9386391Z  'range_multi_buffers': [None, None],
2026-02-21T13:30:28.9386648Z  'range_num_stages': [0, 4],
2026-02-21T13:30:28.9386907Z  'range_unroll_factors': [0, 1],
2026-02-21T13:30:28.9387157Z  'range_warp_specializes': []}
2026-02-21T13:30:28.9418720Z [517s] Fitting surrogate: 590 points, 590 targets
2026-02-21T13:30:29.7647798Z [518s] Generation 7 starting: 47 neighbors, 4 active search path(s)
2026-02-21T13:30:53.5632037Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47/47 1.1 configs/s
2026-02-21T13:30:59.8155051Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 47/47 7.5 configs/s
2026-02-21T13:31:09.7657392Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 119.3         
2026-02-21T13:31:09.7657907Z                                                                   configs/s     
2026-02-21T13:31:10.2938458Z [558s] Generation 7 complete: 
2026-02-21T13:31:10.2938765Z ok=51
2026-02-21T13:31:10.2938934Z min=0.0708
2026-02-21T13:31:10.2939110Z mid=0.0713
2026-02-21T13:31:10.2939270Z max=0.1049
2026-02-21T13:31:10.2939455Z best={'block_sizes': [1, 16384],
2026-02-21T13:31:10.2939799Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:31:10.2940149Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:31:10.2940426Z  'num_stages': 5,
2026-02-21T13:31:10.2940613Z  'num_warps': 16,
2026-02-21T13:31:10.2940803Z  'pid_type': 'flat',
2026-02-21T13:31:10.2941017Z  'range_flattens': [None, None],
2026-02-21T13:31:10.2941272Z  'range_multi_buffers': [None, False],
2026-02-21T13:31:10.2941527Z  'range_num_stages': [0, 2],
2026-02-21T13:31:10.2941763Z  'range_unroll_factors': [0, 3],
2026-02-21T13:31:10.2942005Z  'range_warp_specializes': []}
2026-02-21T13:31:10.2970153Z [558s] Fitting surrogate: 641 points, 641 targets
2026-02-21T13:31:11.0662491Z [559s] Generation 8 starting: 44 neighbors, 4 active search path(s)
2026-02-21T13:31:37.8582465Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44/44 3.0 configs/s
2026-02-21T13:31:40.5342620Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 44/44 16.7 configs/s
2026-02-21T13:31:48.3080036Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 129.6         
2026-02-21T13:31:48.3080564Z                                                                   configs/s     
2026-02-21T13:31:48.7946179Z [597s] Generation 8 complete: 
2026-02-21T13:31:48.7946479Z ok=48
2026-02-21T13:31:48.7946649Z min=0.0708
2026-02-21T13:31:48.7946821Z mid=0.0714
2026-02-21T13:31:48.7946982Z max=0.0960
2026-02-21T13:31:48.7947170Z best={'block_sizes': [1, 16384],
2026-02-21T13:31:48.7947479Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:31:48.7947836Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:31:48.7948119Z  'num_stages': 2,
2026-02-21T13:31:48.7948311Z  'num_warps': 16,
2026-02-21T13:31:48.7948496Z  'pid_type': 'flat',
2026-02-21T13:31:48.8296554Z  'range_flattens': [None, None],
2026-02-21T13:31:48.8296971Z  'range_multi_buffers': [None, None],
2026-02-21T13:31:48.8297243Z  'range_num_stages': [0, 4],
2026-02-21T13:31:48.8297491Z  'range_unroll_factors': [0, 1],
2026-02-21T13:31:48.8297765Z  'range_warp_specializes': []}
2026-02-21T13:31:48.8298074Z [597s] Fitting surrogate: 689 points, 689 targets
2026-02-21T13:31:49.3959295Z [597s] Generation 9 starting: 31 neighbors, 3 active search path(s)
2026-02-21T13:32:06.3207054Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 1.0 configs/s
2026-02-21T13:32:08.2133757Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 31/31 16.8 configs/s
2026-02-21T13:32:13.8331418Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 178.8         
2026-02-21T13:32:13.8333826Z                                                                   configs/s     
2026-02-21T13:32:14.1995698Z [622s] Generation 9 complete: 
2026-02-21T13:32:14.1996026Z ok=34
2026-02-21T13:32:14.1996211Z min=0.0706
2026-02-21T13:32:14.1996437Z mid=0.0712
2026-02-21T13:32:14.1996615Z max=0.1123
2026-02-21T13:32:14.1996817Z best={'block_sizes': [1, 16384],
2026-02-21T13:32:14.1997167Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:32:14.1997580Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:32:14.1997871Z  'num_stages': 5,
2026-02-21T13:32:14.1998079Z  'num_warps': 16,
2026-02-21T13:32:14.1998291Z  'pid_type': 'flat',
2026-02-21T13:32:14.1998533Z  'range_flattens': [None, None],
2026-02-21T13:32:14.1998814Z  'range_multi_buffers': [None, True],
2026-02-21T13:32:14.1999091Z  'range_num_stages': [0, 1],
2026-02-21T13:32:14.1999347Z  'range_unroll_factors': [0, 4],
2026-02-21T13:32:14.1999608Z  'range_warp_specializes': []}
2026-02-21T13:32:14.2041342Z [622s] Fitting surrogate: 723 points, 723 targets
2026-02-21T13:32:14.7972694Z [623s] Generation 10 starting: 31 neighbors, 3 active search path(s)
2026-02-21T13:32:28.5974685Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31/31 6.2 configs/s
2026-02-21T13:32:30.7764572Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 31/31 14.5 configs/s
2026-02-21T13:32:36.1959556Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 185.4         
2026-02-21T13:32:36.1960069Z                                                                   configs/s     
2026-02-21T13:32:36.5478729Z [645s] Generation 10 complete: 
2026-02-21T13:32:36.5479241Z ok=34
2026-02-21T13:32:36.5479527Z min=0.0708
2026-02-21T13:32:36.5479808Z mid=0.0709
2026-02-21T13:32:36.5480067Z max=0.1176
2026-02-21T13:32:36.5480380Z best={'block_sizes': [1, 16384],
2026-02-21T13:32:36.5480893Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:32:36.5481477Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:32:36.5481914Z  'num_stages': 2,
2026-02-21T13:32:36.5482253Z  'num_warps': 16,
2026-02-21T13:32:36.5482578Z  'pid_type': 'flat',
2026-02-21T13:32:36.5482955Z  'range_flattens': [None, None],
2026-02-21T13:32:36.5483421Z  'range_multi_buffers': [None, True],
2026-02-21T13:32:36.5483847Z  'range_num_stages': [0, 0],
2026-02-21T13:32:36.5484817Z  'range_unroll_factors': [0, 0],
2026-02-21T13:32:36.5485218Z  'range_warp_specializes': []}
2026-02-21T13:32:36.5517723Z [645s] Fitting surrogate: 757 points, 757 targets
2026-02-21T13:32:36.9659557Z [645s] Generation 11 starting: 15 neighbors, 2 active search path(s)
2026-02-21T13:32:44.8802307Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15/15 2.6 configs/s
2026-02-21T13:32:45.7961391Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 15/15 17.2 configs/s
2026-02-21T13:32:48.6328754Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 351.6         
2026-02-21T13:32:48.6329292Z                                                                   configs/s     
2026-02-21T13:32:48.8308740Z [657s] Generation 11 complete: 
2026-02-21T13:32:48.8309112Z ok=17
2026-02-21T13:32:48.8309312Z min=0.0707
2026-02-21T13:32:48.8309508Z mid=0.0708
2026-02-21T13:32:48.8310377Z max=0.1054
2026-02-21T13:32:48.8310603Z best={'block_sizes': [1, 16384],
2026-02-21T13:32:48.8310935Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:32:48.8311332Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:32:48.8311657Z  'num_stages': 2,
2026-02-21T13:32:48.8311873Z  'num_warps': 16,
2026-02-21T13:32:48.8312112Z  'pid_type': 'flat',
2026-02-21T13:32:48.8312355Z  'range_flattens': [None, None],
2026-02-21T13:32:48.8312649Z  'range_multi_buffers': [None, True],
2026-02-21T13:32:48.8312955Z  'range_num_stages': [0, 1],
2026-02-21T13:32:48.8313220Z  'range_unroll_factors': [0, 0],
2026-02-21T13:32:48.8313532Z  'range_warp_specializes': []}
2026-02-21T13:32:48.8349742Z [657s] Fitting surrogate: 774 points, 774 targets
2026-02-21T13:32:49.1125702Z [657s] Generation 12 starting: 11 neighbors, 1 active search path(s)
2026-02-21T13:32:55.3976228Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.1 configs/s
2026-02-21T13:32:56.0757881Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.4 configs/s
2026-02-21T13:32:57.8426088Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 560.3         
2026-02-21T13:32:57.8426635Z                                                                   configs/s     
2026-02-21T13:32:57.9877173Z [666s] Generation 12 complete: 
2026-02-21T13:32:57.9877552Z ok=12
2026-02-21T13:32:57.9877788Z min=0.0705
2026-02-21T13:32:57.9878020Z mid=0.0706
2026-02-21T13:32:57.9878235Z max=0.1259
2026-02-21T13:32:57.9878483Z best={'block_sizes': [1, 16384],
2026-02-21T13:32:57.9878855Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:32:57.9879282Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:32:57.9879646Z  'num_stages': 2,
2026-02-21T13:32:57.9879923Z  'num_warps': 16,
2026-02-21T13:32:57.9880173Z  'pid_type': 'flat',
2026-02-21T13:32:57.9880454Z  'range_flattens': [None, None],
2026-02-21T13:32:57.9880779Z  'range_multi_buffers': [None, False],
2026-02-21T13:32:57.9881200Z  'range_num_stages': [0, 1],
2026-02-21T13:32:57.9881558Z  'range_unroll_factors': [0, 0],
2026-02-21T13:32:57.9881819Z  'range_warp_specializes': []}
2026-02-21T13:32:57.9913674Z [666s] Fitting surrogate: 786 points, 786 targets
2026-02-21T13:32:58.3088430Z [666s] Generation 13 starting: 11 neighbors, 1 active search path(s)
2026-02-21T13:33:04.5348782Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 2.4 configs/s
2026-02-21T13:33:05.2124460Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.4 configs/s
2026-02-21T13:33:07.1454245Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 513.3         
2026-02-21T13:33:07.1454786Z                                                                   configs/s     
2026-02-21T13:33:07.3037724Z [675s] Generation 13 complete: 
2026-02-21T13:33:07.3038126Z ok=12
2026-02-21T13:33:07.3038373Z min=0.0706
2026-02-21T13:33:07.3038607Z mid=0.0707
2026-02-21T13:33:07.3038863Z max=0.1041
2026-02-21T13:33:07.3039189Z best={'block_sizes': [1, 16384],
2026-02-21T13:33:07.3039536Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:33:07.3040009Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:33:07.3040785Z  'num_stages': 2,
2026-02-21T13:33:07.3040985Z  'num_warps': 16,
2026-02-21T13:33:07.3041172Z  'pid_type': 'flat',
2026-02-21T13:33:07.3041390Z  'range_flattens': [None, None],
2026-02-21T13:33:07.3041646Z  'range_multi_buffers': [None, False],
2026-02-21T13:33:07.3041906Z  'range_num_stages': [0, 0],
2026-02-21T13:33:07.3042146Z  'range_unroll_factors': [0, 0],
2026-02-21T13:33:07.3042402Z  'range_warp_specializes': []}
2026-02-21T13:33:07.3081098Z [675s] Fitting surrogate: 798 points, 798 targets
2026-02-21T13:33:07.5832001Z [676s] Generation 14 starting: 8 neighbors, 1 active search path(s)
2026-02-21T13:33:12.2996288Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8/8 3.1 configs/s
2026-02-21T13:33:12.7989159Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 8/8 17.6 configs/s
2026-02-21T13:33:14.2785108Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 665.7         
2026-02-21T13:33:14.2785614Z                                                                   configs/s     
2026-02-21T13:33:14.4036113Z [682s] Generation 14 complete: 
2026-02-21T13:33:14.4036448Z ok=9
2026-02-21T13:33:14.4036640Z min=0.0704
2026-02-21T13:33:14.4036842Z mid=0.0708
2026-02-21T13:33:14.4037029Z max=0.1051
2026-02-21T13:33:14.4037246Z best={'block_sizes': [1, 16384],
2026-02-21T13:33:14.4037571Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:33:14.4037940Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:33:14.4038258Z  'num_stages': 3,
2026-02-21T13:33:14.4038478Z  'num_warps': 16,
2026-02-21T13:33:14.4038699Z  'pid_type': 'flat',
2026-02-21T13:33:14.4038940Z  'range_flattens': [None, None],
2026-02-21T13:33:14.4039228Z  'range_multi_buffers': [None, False],
2026-02-21T13:33:14.4039526Z  'range_num_stages': [0, 0],
2026-02-21T13:33:14.4039828Z  'range_unroll_factors': [0, 0],
2026-02-21T13:33:14.4040111Z  'range_warp_specializes': []}
2026-02-21T13:33:14.4073861Z [682s] Fitting surrogate: 807 points, 807 targets
2026-02-21T13:33:14.7198331Z [683s] Generation 15 starting: 11 neighbors, 1 active search path(s)
2026-02-21T13:33:50.7659295Z [719s] Timeout after 30s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:33:54.7151766Z [723s] Timeout after 34s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:33:57.0775146Z [725s] Timeout after 38s compiling Config(block_sizes=[1, 16384], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:34:07.0666770Z [735s] Timeout after 40s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', ''], num_stages=3, num_warps=32, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:08.8110354Z [737s] Timeout after 49s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 0], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:10.4727605Z [739s] Timeout after 51s compiling Config(block_sizes=[1, 8192], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:13.3399391Z [741s] Timeout after 52s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=256, num_sm_multiplier=32, num_stages=2, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, False], range_num_stages=[3, 0], range_unroll_factors=[1, 0], range_warp_specializes=[])
2026-02-21T13:34:14.7573208Z [743s] Timeout after 54s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=3, num_warps=32, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, True], range_num_stages=[0, 0], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:14.7575832Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 - configs/s
2026-02-21T13:34:14.9422230Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━ 11/11 102.7 configs/s
2026-02-21T13:34:15.5409635Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 1593.3        
2026-02-21T13:34:15.5410241Z                                                                   configs/s     
2026-02-21T13:34:15.6161197Z [744s] Generation 15 complete: 
2026-02-21T13:34:15.6165212Z timeout=8
2026-02-21T13:34:15.6165604Z ok=4
2026-02-21T13:34:15.6165930Z min=0.0701
2026-02-21T13:34:15.6166187Z mid=0.0702
2026-02-21T13:34:15.6166342Z max=0.0704
2026-02-21T13:34:15.6166505Z best={'block_sizes': [1, 16384],
2026-02-21T13:34:15.6166803Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:34:15.6167087Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:34:15.6167338Z  'num_stages': 4,
2026-02-21T13:34:15.6167502Z  'num_warps': 16,
2026-02-21T13:34:15.6167693Z  'pid_type': 'flat',
2026-02-21T13:34:15.6167875Z  'range_flattens': [None, None],
2026-02-21T13:34:15.6168100Z  'range_multi_buffers': [None, False],
2026-02-21T13:34:15.6168329Z  'range_num_stages': [0, 1],
2026-02-21T13:34:15.6168538Z  'range_unroll_factors': [0, 0],
2026-02-21T13:34:15.6168768Z  'range_warp_specializes': []}
2026-02-21T13:34:15.6200427Z [744s] Fitting surrogate: 819 points, 819 targets
2026-02-21T13:34:15.9293009Z [744s] Generation 16 starting: 12 neighbors, 1 active search path(s)
2026-02-21T13:34:47.2971478Z [775s] Timeout after 30s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:48.6390364Z [777s] Timeout after 30s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, None], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:49.0770405Z [777s] Timeout after 31s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:49.7747370Z [778s] Timeout after 31s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:50.6811303Z [779s] Timeout after 31s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:53.5980943Z [782s] Timeout after 32s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:34:54.2258489Z [782s] Timeout after 34s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, True], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:54.4855215Z [783s] Timeout after 34s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', ''], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:54.9333640Z [783s] Timeout after 34s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=32, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:55.5958164Z [784s] Timeout after 34s compiling Config(block_sizes=[1, 8192], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, False], range_num_stages=[0, 2], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:56.1878137Z [784s] Timeout after 35s compiling Config(block_sizes=[2, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=3, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[])
2026-02-21T13:34:56.1900443Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 - configs/s
2026-02-21T13:34:56.2500511Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━━ 12/12 - configs/s
2026-02-21T13:34:56.5310615Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 3192.6        
2026-02-21T13:34:56.5311124Z                                                                   configs/s     
2026-02-21T13:34:56.5882908Z [785s] Generation 16 complete: 
2026-02-21T13:34:56.7328089Z timeout=11
2026-02-21T13:34:56.7328333Z ok=2
2026-02-21T13:34:56.7328509Z min=0.0700
2026-02-21T13:34:56.7328657Z mid=0.0703
2026-02-21T13:34:56.7328806Z max=0.0703
2026-02-21T13:34:56.7328980Z best={'block_sizes': [1, 16384],
2026-02-21T13:34:56.7329331Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:34:56.7329620Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:34:56.7329867Z  'num_stages': 4,
2026-02-21T13:34:56.7330229Z  'num_warps': 16,
2026-02-21T13:34:56.7330473Z  'pid_type': 'flat',
2026-02-21T13:34:56.7330661Z  'range_flattens': [None, None],
2026-02-21T13:34:56.7330953Z  'range_multi_buffers': [None, False],
2026-02-21T13:34:56.7331261Z  'range_num_stages': [0, 1],
2026-02-21T13:34:56.7331468Z  'range_unroll_factors': [0, 0],
2026-02-21T13:34:56.7332075Z  'range_warp_specializes': []}
2026-02-21T13:34:56.7332386Z [785s] Fitting surrogate: 832 points, 832 targets
2026-02-21T13:34:56.8783709Z [785s] Autotuning complete in 785.4s after searching 749 configs.
2026-02-21T13:34:56.8784674Z One can hardcode the best config and skip autotuning with:
2026-02-21T13:34:56.8786205Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['last', 'first'], num_stages=4, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 0], range_warp_specializes=[]), static_shapes=True)
2026-02-21T13:34:56.8787548Z 
2026-02-21T13:34:56.8787956Z [785s] Code of selected kernel: /tmp/torchinductor_root/os/cosdbwunjog6q4ytf4r6biuxuonlrd3hxq42etxx25z3paezmjnh.py
2026-02-21T13:34:56.9110429Z from __future__ import annotations
2026-02-21T13:34:56.9110668Z 
2026-02-21T13:34:56.9110744Z import torch
2026-02-21T13:34:56.9110919Z import triton
2026-02-21T13:34:56.9111159Z import triton.language as tl
2026-02-21T13:34:56.9111429Z from torch._inductor.runtime import triton_helpers
2026-02-21T13:34:56.9111803Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T13:34:56.9112232Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T13:34:56.9112502Z 
2026-02-21T13:34:56.9112590Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T13:34:56.9112824Z _BLOCK_SIZE_1 = tl.constexpr(16384)
2026-02-21T13:34:56.9112985Z 
2026-02-21T13:34:56.9113052Z @triton.jit
2026-02-21T13:34:56.9113238Z def _helion_softmax_two_pass(x, out):
2026-02-21T13:34:56.9113575Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:34:56.9113939Z     pid_0 = tl.program_id(0)
2026-02-21T13:34:56.9114317Z     offset_0 = pid_0
2026-02-21T13:34:56.9114540Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T13:34:56.9114942Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:34:56.9115372Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T13:34:56.9115758Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:34:56.9116128Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T13:34:56.9116489Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:34:56.9116875Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T13:34:56.9117216Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T13:34:56.9117533Z     # src[softmax.py:82-89]: ...
2026-02-21T13:34:56.9117922Z     for offset_2 in tl.range(0, 11392, _BLOCK_SIZE_1, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T13:34:56.9118421Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:34:56.9118751Z         mask_1 = indices_2 < 11392
2026-02-21T13:34:56.9118971Z         mi_copy = mi
2026-02-21T13:34:56.9119149Z         di_copy = di
2026-02-21T13:34:56.9119341Z         mi_copy_0 = mi_copy
2026-02-21T13:34:56.9119545Z         di_copy_0 = di_copy
2026-02-21T13:34:56.9119778Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T13:34:57.0512503Z         values = tl.load(x + (indices_0[:, None] * 11392 + indices_2[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_last')
2026-02-21T13:34:57.0513209Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T13:34:57.0513922Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T13:34:57.0515090Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T13:34:57.0515455Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T13:34:57.0515788Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T13:34:57.0516066Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T13:34:57.0516706Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:34:57.0517070Z         v_2 = mi_copy_0 - v_1
2026-02-21T13:34:57.0517300Z         v_3 = libdevice.exp(v_2)
2026-02-21T13:34:57.0517527Z         v_4 = di_copy_0 * v_3
2026-02-21T13:34:57.0517780Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T13:34:57.0518061Z         subscript = v_1[:, None]
2026-02-21T13:34:57.0518287Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T13:34:57.0518535Z         v_6 = v_5 - subscript
2026-02-21T13:34:57.0518836Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:34:57.0519225Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T13:34:57.0519520Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T13:34:57.0519774Z         v_7 = libdevice.exp(v_6)
2026-02-21T13:34:57.0520247Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T13:34:57.0520776Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T13:34:57.0521069Z         di = v_4 + sum_1
2026-02-21T13:34:57.0521274Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T13:34:57.0521512Z         mi = v_1
2026-02-21T13:34:57.0521778Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:34:57.0522168Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T13:34:57.0522590Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:34:57.0523156Z     for offset_2 in tl.range(0, 11392, _BLOCK_SIZE_1, num_stages=1, disallow_acc_multi_buffer=True):
2026-02-21T13:34:57.0523658Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:34:57.0524131Z         mask_2 = indices_2 < 11392
2026-02-21T13:34:57.0524368Z         mi_copy_1 = mi
2026-02-21T13:34:57.0524569Z         di_copy_1 = di
2026-02-21T13:34:57.0524760Z         mi_copy_1_0 = mi_copy_1
2026-02-21T13:34:57.0525025Z         di_copy_1_0 = di_copy_1
2026-02-21T13:34:57.0525277Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T13:34:57.0525775Z         values_1 = tl.load(x + (indices_0[:, None] * 11392 + indices_2[None, :] * 1), mask_2[None, :], other=0, eviction_policy='evict_first')
2026-02-21T13:34:57.0526371Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:34:57.0526735Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T13:34:57.0526962Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T13:34:57.0527175Z         v_10 = v_9 - subscript_1
2026-02-21T13:34:57.0527375Z         v_11 = libdevice.exp(v_10)
2026-02-21T13:34:57.0527580Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T13:34:57.0527796Z         v_12 = v_11 / subscript_2
2026-02-21T13:34:57.0527994Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T13:34:57.0528344Z         tl.store(out + (indices_0[:, None] * 11392 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T13:34:57.0528635Z 
2026-02-21T13:34:57.0528795Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T13:34:57.0529083Z     """
2026-02-21T13:34:57.3994772Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T13:34:57.3995286Z     This version uses fewer passes but is less numerically stable.
2026-02-21T13:34:57.3995653Z     Args:
2026-02-21T13:34:57.3995898Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T13:34:57.3996201Z     Returns:
2026-02-21T13:34:57.3996461Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T13:34:57.3996810Z     """
2026-02-21T13:34:57.3997006Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T13:34:57.3997279Z     m, n = x.size()
2026-02-21T13:34:57.3997517Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T13:34:57.3997836Z     out = torch.empty_like(x)
2026-02-21T13:34:57.7323104Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:34:57.7323777Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:34:57.7324920Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:34:57.7325312Z     # src[softmax.py:79-92]: ...
2026-02-21T13:34:57.7325707Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=16, num_stages=4)
2026-02-21T13:34:57.7326133Z     # src[softmax.py:93]: return out
2026-02-21T13:34:57.7326382Z     return out
2026-02-21T13:34:58.1433919Z WARNING:tritonbench.utils.triton_op:Completed input ID 87:
2026-02-21T13:34:58.1434720Z (M, N)
2026-02-21T13:34:58.1434912Z -------------
2026-02-21T13:34:58.1435129Z (4096, 11392)
2026-02-21T13:34:58.1435254Z 
2026-02-21T13:34:58.1456863Z  90%|█████████ | 18/20 [2:31:53<24:38, 739.10s/it]WARNING:tritonbench.utils.triton_op:Running input ID 92:
2026-02-21T13:34:58.1463188Z (M, N)
2026-02-21T13:34:58.1463379Z -------------
2026-02-21T13:34:58.1463573Z (4096, 12032)
2026-02-21T13:34:58.1464183Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T13:34:59.5960499Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T13:35:01.1113117Z INFO:tritonbench.utils.triton_op:Took 3.44ms to get benchmark function for torch_compile_softmax
2026-02-21T13:35:04.2140944Z WARNING:__main__:Input tensor metadata:
2026-02-21T13:35:04.2141296Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T13:35:04.2141572Z               'dtype': 'torch.float16',
2026-02-21T13:35:04.2141849Z               'shape': (4096, 12032),
2026-02-21T13:35:04.2142106Z               'stride': (12032, 1)},),
2026-02-21T13:35:04.2142346Z   'kwargs': {}}
2026-02-21T13:35:04.2188897Z INFO:tritonbench.utils.triton_op:Took 5.22ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T13:35:04.5207753Z [0s] Autotune random seed: 2145258556
2026-02-21T13:35:05.8490503Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T13:36:11.8085734Z [66s] Timeout after 37s compiling Config(block_sizes=[256, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[False, True], range_num_stages=[4, 2], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T13:36:13.5217679Z [67s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T13:36:17.8317087Z [72s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T13:36:19.8019934Z [74s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:36:20.2739515Z [74s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:36:37.0296054Z [91s] Timeout after 30s compiling Config(block_sizes=[128, 256], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', ''], maxnreg=32, num_sm_multiplier=8, num_stages=3, num_warps=2, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[True, False], range_num_stages=[4, 2], range_unroll_factors=[1, 2], range_warp_specializes=[])
2026-02-21T13:36:37.0315383Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T13:36:47.0604817Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━ 100/100 10.0 configs/s
2026-02-21T13:36:47.0618658Z [101s] Adaptive compile timeout: 30s (90% percentile=37.3s, bounds=[30.0s, 30s])
2026-02-21T13:36:48.2298612Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 831.2 configs/s
2026-02-21T13:36:48.3348377Z [102s] Initial random population of 100, 5 starting points: 
2026-02-21T13:36:48.3348735Z error=7
2026-02-21T13:36:48.3348905Z timeout=6
2026-02-21T13:36:48.3349078Z ok=87
2026-02-21T13:36:48.3349262Z min=0.0870
2026-02-21T13:36:48.3349438Z mid=0.8374
2026-02-21T13:36:48.3349611Z max=167.3683
2026-02-21T13:36:48.3349799Z best={'block_sizes': [1, 4096],
2026-02-21T13:36:48.3350105Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:36:48.3350436Z  'load_eviction_policies': ['', ''],
2026-02-21T13:36:48.3350694Z  'maxnreg': 256,
2026-02-21T13:36:48.3350902Z  'num_sm_multiplier': 64,
2026-02-21T13:36:48.3351221Z  'num_stages': 7,
2026-02-21T13:36:48.3351431Z  'num_warps': 4,
2026-02-21T13:36:48.3351708Z  'pid_type': 'persistent_blocked',
2026-02-21T13:36:48.3352023Z  'range_flattens': [False, None],
2026-02-21T13:36:48.3352326Z  'range_multi_buffers': [True, None],
2026-02-21T13:36:48.3352639Z  'range_num_stages': [3, 3],
2026-02-21T13:36:48.3352926Z  'range_unroll_factors': [3, 4],
2026-02-21T13:36:48.3353210Z  'range_warp_specializes': []}
2026-02-21T13:36:48.3369339Z [102s] Fitting surrogate: 100 points, 100 targets
2026-02-21T13:36:49.8487968Z [104s] Generation 1 starting: 92 neighbors, 5 active search path(s)
2026-02-21T13:37:34.0105426Z [148s] Timeout after 38s compiling Config(block_sizes=[2, 4096], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=256, num_sm_multiplier=32, num_stages=7, num_warps=1, pid_type='persistent_blocked', range_flattens=[False, None], range_multi_buffers=[True, None], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:37:36.3759982Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97/97 2.7 configs/s
2026-02-21T13:37:42.4574804Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 97/97 16.1 configs/s
2026-02-21T13:37:52.2906501Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.3         
2026-02-21T13:37:52.2907147Z                                                                   configs/s     
2026-02-21T13:37:52.8134634Z [167s] Generation 1 complete: 
2026-02-21T13:37:52.8134966Z error=3
2026-02-21T13:37:52.8138123Z timeout=1
2026-02-21T13:37:52.8138354Z ok=94
2026-02-21T13:37:52.8138517Z min=0.0825
2026-02-21T13:37:52.8138700Z mid=0.1204
2026-02-21T13:37:52.8138869Z max=0.6908
2026-02-21T13:37:52.8139050Z best={'block_sizes': [1, 4096],
2026-02-21T13:37:52.8139365Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:37:52.8139710Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:37:52.8139981Z  'maxnreg': 256,
2026-02-21T13:37:52.8140177Z  'num_sm_multiplier': 64,
2026-02-21T13:37:52.8140404Z  'num_stages': 7,
2026-02-21T13:37:52.8140592Z  'num_warps': 4,
2026-02-21T13:37:52.8140804Z  'pid_type': 'persistent_blocked',
2026-02-21T13:37:52.8141067Z  'range_flattens': [False, None],
2026-02-21T13:37:52.8141331Z  'range_multi_buffers': [None, None],
2026-02-21T13:37:52.8141889Z  'range_num_stages': [3, 3],
2026-02-21T13:37:52.8142132Z  'range_unroll_factors': [3, 4],
2026-02-21T13:37:52.8142386Z  'range_warp_specializes': []}
2026-02-21T13:37:52.8156256Z [167s] Fitting surrogate: 198 points, 198 targets
2026-02-21T13:37:54.3487147Z [168s] Generation 2 starting: 93 neighbors, 5 active search path(s)
2026-02-21T13:38:38.3109481Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 1.6 configs/s
2026-02-21T13:38:44.0630511Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 16.3 configs/s
2026-02-21T13:38:56.3096916Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 82.2 configs/s
2026-02-21T13:38:56.9985366Z [231s] Generation 2 complete: 
2026-02-21T13:38:56.9985676Z error=3
2026-02-21T13:38:56.9985854Z ok=95
2026-02-21T13:38:56.9986017Z min=0.0728
2026-02-21T13:38:56.9986190Z mid=0.1026
2026-02-21T13:38:56.9986353Z max=0.4472
2026-02-21T13:38:56.9986539Z best={'block_sizes': [1, 16384],
2026-02-21T13:38:56.9986912Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:38:56.9987304Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:38:56.9987568Z  'num_stages': 2,
2026-02-21T13:38:56.9987764Z  'num_warps': 16,
2026-02-21T13:38:56.9987987Z  'pid_type': 'flat',
2026-02-21T13:38:56.9988203Z  'range_flattens': [None, None],
2026-02-21T13:38:56.9988459Z  'range_multi_buffers': [None, None],
2026-02-21T13:38:56.9988713Z  'range_num_stages': [0, 1],
2026-02-21T13:38:56.9988953Z  'range_unroll_factors': [0, 3],
2026-02-21T13:38:56.9989193Z  'range_warp_specializes': []}
2026-02-21T13:38:57.0012493Z [231s] Fitting surrogate: 296 points, 296 targets
2026-02-21T13:38:58.3048823Z [232s] Generation 3 starting: 71 neighbors, 5 active search path(s)
2026-02-21T13:39:33.4141130Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75/75 3.8 configs/s
2026-02-21T13:39:38.3307454Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 75/75 15.2 configs/s
2026-02-21T13:39:47.0955681Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 114.9         
2026-02-21T13:39:47.0956168Z                                                                   configs/s     
2026-02-21T13:39:47.6179305Z [281s] Generation 3 complete: 
2026-02-21T13:39:47.6179593Z error=1
2026-02-21T13:39:47.6179759Z ok=76
2026-02-21T13:39:47.6179927Z min=0.0725
2026-02-21T13:39:47.6180092Z mid=0.0976
2026-02-21T13:39:47.6180261Z max=1.1815
2026-02-21T13:39:47.6180440Z best={'block_sizes': [1, 16384],
2026-02-21T13:39:47.6180782Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:39:47.6181158Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:39:47.6181429Z  'num_stages': 2,
2026-02-21T13:39:47.6181615Z  'num_warps': 16,
2026-02-21T13:39:47.6181813Z  'pid_type': 'flat',
2026-02-21T13:39:47.6182028Z  'range_flattens': [None, None],
2026-02-21T13:39:47.6182276Z  'range_multi_buffers': [None, True],
2026-02-21T13:39:47.6182535Z  'range_num_stages': [0, 0],
2026-02-21T13:39:47.6182763Z  'range_unroll_factors': [0, 3],
2026-02-21T13:39:47.6183026Z  'range_warp_specializes': []}
2026-02-21T13:39:47.6212251Z [281s] Fitting surrogate: 373 points, 373 targets
2026-02-21T13:39:48.6855953Z [283s] Generation 4 starting: 65 neighbors, 5 active search path(s)
2026-02-21T13:40:24.4931221Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 0.8 configs/s
2026-02-21T13:40:28.6751381Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 16.4 configs/s
2026-02-21T13:40:40.7911121Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 95.3 configs/s
2026-02-21T13:40:41.4577412Z [335s] Generation 4 complete: 
2026-02-21T13:40:41.4577693Z ok=71
2026-02-21T13:40:41.4577920Z min=0.0724
2026-02-21T13:40:41.4578193Z mid=0.0800
2026-02-21T13:40:41.4578613Z max=1.0001
2026-02-21T13:40:41.4578821Z best={'block_sizes': [1, 16384],
2026-02-21T13:40:41.4579139Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:40:41.4579501Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:40:41.4580342Z  'num_stages': 2,
2026-02-21T13:40:41.4580542Z  'num_warps': 16,
2026-02-21T13:40:41.4580744Z  'pid_type': 'flat',
2026-02-21T13:40:41.4580954Z  'range_flattens': [None, None],
2026-02-21T13:40:41.4581240Z  'range_multi_buffers': [None, None],
2026-02-21T13:40:41.4581500Z  'range_num_stages': [0, 3],
2026-02-21T13:40:41.4581742Z  'range_unroll_factors': [0, 2],
2026-02-21T13:40:41.4581987Z  'range_warp_specializes': []}
2026-02-21T13:40:41.4609203Z [335s] Fitting surrogate: 444 points, 444 targets
2026-02-21T13:40:42.3489587Z [336s] Generation 5 starting: 55 neighbors, 5 active search path(s)
2026-02-21T13:41:08.5250738Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56/56 2.9 configs/s
2026-02-21T13:41:11.9317831Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 56/56 16.6 configs/s
2026-02-21T13:41:21.9896726Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 100.2         
2026-02-21T13:41:21.9897293Z                                                                   configs/s     
2026-02-21T13:41:22.6172487Z [376s] Generation 5 complete: 
2026-02-21T13:41:22.6172767Z ok=61
2026-02-21T13:41:22.6172931Z min=0.0730
2026-02-21T13:41:22.6173108Z mid=0.0742
2026-02-21T13:41:22.6173299Z max=0.1053
2026-02-21T13:41:22.6173489Z best={'block_sizes': [1, 16384],
2026-02-21T13:41:22.6173801Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:41:22.6174538Z  'load_eviction_policies': ['last', 'first'],
2026-02-21T13:41:22.6174822Z  'num_stages': 2,
2026-02-21T13:41:22.6175015Z  'num_warps': 16,
2026-02-21T13:41:22.6175213Z  'pid_type': 'flat',
2026-02-21T13:41:22.6175420Z  'range_flattens': [None, None],
2026-02-21T13:41:22.6175676Z  'range_multi_buffers': [None, None],
2026-02-21T13:41:22.6175942Z  'range_num_stages': [0, 3],
2026-02-21T13:41:22.6176186Z  'range_unroll_factors': [0, 2],
2026-02-21T13:41:22.6176437Z  'range_warp_specializes': []}
2026-02-21T13:41:22.6210326Z [376s] Fitting surrogate: 505 points, 505 targets
2026-02-21T13:41:23.4916154Z [377s] Generation 6 starting: 49 neighbors, 5 active search path(s)
2026-02-21T13:41:47.0284361Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49/49 3.6 configs/s
2026-02-21T13:41:49.9977575Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 49/49 16.7 configs/s
2026-02-21T13:41:58.9153059Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 112.9         
2026-02-21T13:41:58.9153618Z                                                                   configs/s     
2026-02-21T13:41:59.4691276Z [413s] Generation 6 complete: 
2026-02-21T13:41:59.4691568Z ok=54
2026-02-21T13:41:59.4691725Z min=0.0729
2026-02-21T13:41:59.4691889Z mid=0.0735
2026-02-21T13:41:59.4692041Z max=0.1061
2026-02-21T13:41:59.4692212Z best={'block_sizes': [1, 16384],
2026-02-21T13:41:59.4692500Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:41:59.4692832Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:41:59.4693086Z  'num_stages': 2,
2026-02-21T13:41:59.4693301Z  'num_warps': 8,
2026-02-21T13:41:59.4693498Z  'pid_type': 'flat',
2026-02-21T13:41:59.4693692Z  'range_flattens': [None, None],
2026-02-21T13:41:59.4693933Z  'range_multi_buffers': [None, None],
2026-02-21T13:41:59.4695149Z  'range_num_stages': [0, 3],
2026-02-21T13:41:59.4695379Z  'range_unroll_factors': [0, 3],
2026-02-21T13:41:59.4695609Z  'range_warp_specializes': []}
2026-02-21T13:41:59.4725077Z [413s] Fitting surrogate: 559 points, 559 targets
2026-02-21T13:42:00.4131648Z [414s] Generation 7 starting: 57 neighbors, 5 active search path(s)
2026-02-21T13:42:27.3721179Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57/57 3.0 configs/s
2026-02-21T13:42:30.8039776Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 57/57 16.8 configs/s
2026-02-21T13:42:41.0653647Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 98.2 configs/s
2026-02-21T13:42:41.6938352Z [456s] Generation 7 complete: 
2026-02-21T13:42:41.6938663Z ok=62
2026-02-21T13:42:41.6938846Z min=0.0725
2026-02-21T13:42:41.6939498Z mid=0.0730
2026-02-21T13:42:41.6939692Z max=0.1287
2026-02-21T13:42:41.6939874Z best={'block_sizes': [1, 16384],
2026-02-21T13:42:41.6940240Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T13:42:41.6940664Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:42:41.6940945Z  'num_stages': 2,
2026-02-21T13:42:41.6941131Z  'num_warps': 8,
2026-02-21T13:42:41.6941333Z  'pid_type': 'flat',
2026-02-21T13:42:41.6941548Z  'range_flattens': [None, None],
2026-02-21T13:42:41.6941805Z  'range_multi_buffers': [None, None],
2026-02-21T13:42:41.6942071Z  'range_num_stages': [0, 3],
2026-02-21T13:42:41.6942302Z  'range_unroll_factors': [0, 3],
2026-02-21T13:42:41.6942548Z  'range_warp_specializes': []}
2026-02-21T13:42:41.6973865Z [456s] Fitting surrogate: 621 points, 621 targets
2026-02-21T13:42:42.4367663Z [456s] Generation 8 starting: 40 neighbors, 4 active search path(s)
2026-02-21T13:43:09.1034943Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41/41 1.6 configs/s
2026-02-21T13:43:11.9698172Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 41/41 14.5 configs/s
2026-02-21T13:43:19.2887256Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 137.6         
2026-02-21T13:43:19.2887801Z                                                                   configs/s     
2026-02-21T13:43:19.7467837Z [494s] Generation 8 complete: 
2026-02-21T13:43:19.7468364Z ok=44
2026-02-21T13:43:19.7468659Z min=0.0726
2026-02-21T13:43:19.7468943Z mid=0.0731
2026-02-21T13:43:19.7469207Z max=0.1051
2026-02-21T13:43:19.7469515Z best={'block_sizes': [1, 16384],
2026-02-21T13:43:19.7470093Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T13:43:19.7470773Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:43:19.7471225Z  'num_stages': 2,
2026-02-21T13:43:19.7471544Z  'num_warps': 8,
2026-02-21T13:43:19.7471861Z  'pid_type': 'flat',
2026-02-21T13:43:19.7472235Z  'range_flattens': [None, True],
2026-02-21T13:43:19.7472696Z  'range_multi_buffers': [None, None],
2026-02-21T13:43:19.7473133Z  'range_num_stages': [0, 3],
2026-02-21T13:43:19.7473522Z  'range_unroll_factors': [0, 2],
2026-02-21T13:43:19.9915170Z  'range_warp_specializes': []}
2026-02-21T13:43:19.9915721Z [494s] Fitting surrogate: 665 points, 665 targets
2026-02-21T13:43:20.4897003Z [494s] Generation 9 starting: 43 neighbors, 4 active search path(s)
2026-02-21T13:44:00.3904594Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43/43 2.4 configs/s
2026-02-21T13:44:07.7603044Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 43/43 5.8 configs/s
2026-02-21T13:44:15.4233650Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 131.4         
2026-02-21T13:44:15.4234567Z                                                                   configs/s     
2026-02-21T13:44:15.9007589Z [550s] Generation 9 complete: 
2026-02-21T13:44:15.9007900Z ok=47
2026-02-21T13:44:15.9008088Z min=0.0724
2026-02-21T13:44:15.9008270Z mid=0.0731
2026-02-21T13:44:15.9009103Z max=0.1244
2026-02-21T13:44:15.9009346Z best={'block_sizes': [1, 16384],
2026-02-21T13:44:15.9009655Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:44:15.9010115Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:44:15.9010384Z  'num_stages': 3,
2026-02-21T13:44:15.9010594Z  'num_warps': 16,
2026-02-21T13:44:15.9010784Z  'pid_type': 'flat',
2026-02-21T13:44:15.9011006Z  'range_flattens': [None, None],
2026-02-21T13:44:15.9011259Z  'range_multi_buffers': [None, False],
2026-02-21T13:44:15.9011543Z  'range_num_stages': [0, 0],
2026-02-21T13:44:15.9011797Z  'range_unroll_factors': [0, 1],
2026-02-21T13:44:15.9012062Z  'range_warp_specializes': []}
2026-02-21T13:44:15.9043094Z [550s] Fitting surrogate: 712 points, 712 targets
2026-02-21T13:44:16.5106654Z [550s] Generation 10 starting: 32 neighbors, 3 active search path(s)
2026-02-21T13:44:39.1631506Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 33/33 2.6 configs/s
2026-02-21T13:44:45.8411168Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 33/33 5.1 configs/s
2026-02-21T13:44:51.4347546Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 179.7         
2026-02-21T13:44:51.4348088Z                                                                   configs/s     
2026-02-21T13:44:51.7985052Z [586s] Generation 10 complete: 
2026-02-21T13:44:51.7985337Z ok=35
2026-02-21T13:44:51.7985522Z min=0.0724
2026-02-21T13:44:51.7985705Z mid=0.0729
2026-02-21T13:44:51.7985869Z max=1.5036
2026-02-21T13:44:51.7986052Z best={'block_sizes': [1, 16384],
2026-02-21T13:44:51.7986358Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:44:51.7986712Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:44:51.7986991Z  'num_stages': 7,
2026-02-21T13:44:51.7987183Z  'num_warps': 8,
2026-02-21T13:44:51.7987383Z  'pid_type': 'flat',
2026-02-21T13:44:51.7987604Z  'range_flattens': [None, False],
2026-02-21T13:44:51.7987858Z  'range_multi_buffers': [None, True],
2026-02-21T13:44:51.7988164Z  'range_num_stages': [0, 3],
2026-02-21T13:44:51.7988402Z  'range_unroll_factors': [0, 4],
2026-02-21T13:44:51.7988647Z  'range_warp_specializes': []}
2026-02-21T13:44:51.8022806Z [586s] Fitting surrogate: 747 points, 747 targets
2026-02-21T13:44:52.4244664Z [586s] Generation 11 starting: 34 neighbors, 3 active search path(s)
2026-02-21T13:45:30.3132889Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 1.4 configs/s
2026-02-21T13:45:34.6982676Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 35/35 7.9 configs/s
2026-02-21T13:45:40.7249309Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 166.9         
2026-02-21T13:45:40.7249864Z                                                                   configs/s     
2026-02-21T13:45:41.1016593Z [635s] Generation 11 complete: 
2026-02-21T13:45:41.1016889Z ok=38
2026-02-21T13:45:41.1017071Z min=0.0742
2026-02-21T13:45:41.1017237Z mid=0.0767
2026-02-21T13:45:41.1017417Z max=1.5035
2026-02-21T13:45:41.1017635Z best={'block_sizes': [1, 16384],
2026-02-21T13:45:41.1017928Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:45:41.1018247Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:45:41.1019061Z  'num_stages': 3,
2026-02-21T13:45:41.1019256Z  'num_warps': 16,
2026-02-21T13:45:41.1019441Z  'pid_type': 'flat',
2026-02-21T13:45:41.1019656Z  'range_flattens': [None, False],
2026-02-21T13:45:41.1019907Z  'range_multi_buffers': [None, False],
2026-02-21T13:45:41.1020167Z  'range_num_stages': [0, 1],
2026-02-21T13:45:41.1020396Z  'range_unroll_factors': [0, 1],
2026-02-21T13:45:41.1020645Z  'range_warp_specializes': []}
2026-02-21T13:45:41.1056176Z [635s] Fitting surrogate: 785 points, 785 targets
2026-02-21T13:45:41.7076935Z [636s] Generation 12 starting: 34 neighbors, 3 active search path(s)
2026-02-21T13:46:29.2626176Z [683s] Timeout after 30s compiling Config(block_sizes=[2, 16384], indexing=['tensor_descriptor', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=64, num_sm_multiplier=32, num_stages=5, num_warps=1, pid_type='persistent_blocked', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[4, 0], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T13:46:29.2648893Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37/37 0.2 configs/s
2026-02-21T13:46:31.5161897Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 37/37 16.8 configs/s
2026-02-21T13:46:36.5303159Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 200.3         
2026-02-21T13:46:36.5303654Z                                                                   configs/s     
2026-02-21T13:46:36.8529653Z [691s] Generation 12 complete: 
2026-02-21T13:46:36.8530021Z timeout=1
2026-02-21T13:46:36.8530219Z ok=37
2026-02-21T13:46:36.8530391Z min=0.0742
2026-02-21T13:46:36.8530569Z mid=0.0767
2026-02-21T13:46:36.8530746Z max=1.6655
2026-02-21T13:46:36.8530957Z best={'block_sizes': [1, 16384],
2026-02-21T13:46:36.8531296Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T13:46:36.8531621Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:46:36.8531898Z  'num_stages': 3,
2026-02-21T13:46:36.8532091Z  'num_warps': 16,
2026-02-21T13:46:36.8532331Z  'pid_type': 'flat',
2026-02-21T13:46:36.8532575Z  'range_flattens': [None, False],
2026-02-21T13:46:36.8532861Z  'range_multi_buffers': [None, False],
2026-02-21T13:46:36.8533105Z  'range_num_stages': [0, 1],
2026-02-21T13:46:36.8533319Z  'range_unroll_factors': [0, 1],
2026-02-21T13:46:36.8533546Z  'range_warp_specializes': []}
2026-02-21T13:46:36.8571736Z [691s] Fitting surrogate: 823 points, 823 targets
2026-02-21T13:46:37.5021781Z [691s] Generation 13 starting: 37 neighbors, 3 active search path(s)
2026-02-21T13:46:56.4783606Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40/40 5.2 configs/s
2026-02-21T13:46:58.9206415Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 40/40 16.7 configs/s
2026-02-21T13:47:04.6288691Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 176.0         
2026-02-21T13:47:04.6289202Z                                                                   configs/s     
2026-02-21T13:47:04.9960841Z [719s] Generation 13 complete: 
2026-02-21T13:47:04.9961164Z ok=41
2026-02-21T13:47:04.9961351Z min=0.0724
2026-02-21T13:47:04.9961539Z mid=0.0766
2026-02-21T13:47:04.9961711Z max=0.5433
2026-02-21T13:47:04.9961912Z best={'block_sizes': [1, 16384],
2026-02-21T13:47:04.9962271Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:47:04.9962688Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:47:04.9962968Z  'num_stages': 5,
2026-02-21T13:47:04.9963185Z  'num_warps': 16,
2026-02-21T13:47:04.9963392Z  'pid_type': 'flat',
2026-02-21T13:47:04.9963613Z  'range_flattens': [None, True],
2026-02-21T13:47:04.9963880Z  'range_multi_buffers': [None, True],
2026-02-21T13:47:04.9964578Z  'range_num_stages': [0, 0],
2026-02-21T13:47:04.9964828Z  'range_unroll_factors': [0, 2],
2026-02-21T13:47:04.9965107Z  'range_warp_specializes': []}
2026-02-21T13:47:05.0005483Z [719s] Fitting surrogate: 864 points, 864 targets
2026-02-21T13:47:05.6026875Z [719s] Generation 14 starting: 33 neighbors, 3 active search path(s)
2026-02-21T13:47:21.3984709Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34/34 4.4 configs/s
2026-02-21T13:47:23.4795786Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 34/34 16.7 configs/s
2026-02-21T13:47:29.1638402Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 176.7         
2026-02-21T13:47:29.1638884Z                                                                   configs/s     
2026-02-21T13:47:29.5231627Z [743s] Generation 14 complete: 
2026-02-21T13:47:29.5231978Z ok=36
2026-02-21T13:47:29.5232162Z min=0.0722
2026-02-21T13:47:29.5232347Z mid=0.0732
2026-02-21T13:47:29.5232518Z max=0.1537
2026-02-21T13:47:29.5232724Z best={'block_sizes': [1, 16384],
2026-02-21T13:47:29.5233096Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:47:29.5262545Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:47:29.5262857Z  'num_stages': 3,
2026-02-21T13:47:29.5263051Z  'num_warps': 16,
2026-02-21T13:47:29.5263246Z  'pid_type': 'flat',
2026-02-21T13:47:29.5263471Z  'range_flattens': [None, None],
2026-02-21T13:47:29.5263727Z  'range_multi_buffers': [None, False],
2026-02-21T13:47:29.5264322Z  'range_num_stages': [0, 1],
2026-02-21T13:47:29.5264568Z  'range_unroll_factors': [0, 1],
2026-02-21T13:47:29.5264807Z  'range_warp_specializes': []}
2026-02-21T13:47:29.5276507Z [743s] Fitting surrogate: 900 points, 900 targets
2026-02-21T13:47:30.1136796Z [744s] Generation 15 starting: 32 neighbors, 3 active search path(s)
2026-02-21T13:47:46.2846513Z Generation 15: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 3.6 configs/s
2026-02-21T13:47:48.2783901Z Generation 15: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 16.4 configs/s
2026-02-21T13:47:53.9217786Z Generation 15: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 178.1         
2026-02-21T13:47:53.9218329Z                                                                   configs/s     
2026-02-21T13:47:54.2884771Z [768s] Generation 15 complete: 
2026-02-21T13:47:54.2885143Z ok=35
2026-02-21T13:47:54.2885330Z min=0.0740
2026-02-21T13:47:54.2885511Z mid=0.0744
2026-02-21T13:47:54.2885702Z max=0.1350
2026-02-21T13:47:54.2885889Z best={'block_sizes': [1, 16384],
2026-02-21T13:47:54.2886257Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T13:47:54.2886650Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:47:54.2886925Z  'num_stages': 8,
2026-02-21T13:47:54.2887122Z  'num_warps': 16,
2026-02-21T13:47:54.2887325Z  'pid_type': 'flat',
2026-02-21T13:47:54.2887556Z  'range_flattens': [None, False],
2026-02-21T13:47:54.2887830Z  'range_multi_buffers': [None, True],
2026-02-21T13:47:54.2888104Z  'range_num_stages': [0, 1],
2026-02-21T13:47:54.2888341Z  'range_unroll_factors': [0, 4],
2026-02-21T13:47:54.2888597Z  'range_warp_specializes': []}
2026-02-21T13:47:54.2931788Z [768s] Fitting surrogate: 935 points, 935 targets
2026-02-21T13:47:56.5588201Z [770s] Generation 16 starting: 33 neighbors, 3 active search path(s)
2026-02-21T13:48:28.1098940Z Generation 16: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 1.7 configs/s
2026-02-21T13:48:32.0571346Z Generation 16: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 36/36 9.1 configs/s
2026-02-21T13:48:37.4587401Z Generation 16: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 186.0         
2026-02-21T13:48:37.4588162Z                                                                   configs/s     
2026-02-21T13:48:37.7999129Z [812s] Generation 16 complete: 
2026-02-21T13:48:37.7999416Z ok=37
2026-02-21T13:48:37.7999598Z min=0.0724
2026-02-21T13:48:37.7999784Z mid=0.0765
2026-02-21T13:48:37.7999953Z max=0.2199
2026-02-21T13:48:37.8000153Z best={'block_sizes': [1, 16384],
2026-02-21T13:48:37.8000523Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:48:37.8001455Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:48:37.8001765Z  'num_stages': 2,
2026-02-21T13:48:37.8001964Z  'num_warps': 8,
2026-02-21T13:48:37.8002170Z  'pid_type': 'flat',
2026-02-21T13:48:37.8002429Z  'range_flattens': [None, None],
2026-02-21T13:48:37.8002698Z  'range_multi_buffers': [None, False],
2026-02-21T13:48:37.8002971Z  'range_num_stages': [0, 1],
2026-02-21T13:48:37.8003213Z  'range_unroll_factors': [0, 1],
2026-02-21T13:48:37.8003471Z  'range_warp_specializes': []}
2026-02-21T13:48:37.8046109Z [812s] Fitting surrogate: 972 points, 972 targets
2026-02-21T13:48:38.4119822Z [812s] Generation 17 starting: 32 neighbors, 3 active search path(s)
2026-02-21T13:49:16.1575289Z [850s] Timeout after 30s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=1, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:49:17.4636538Z [851s] Timeout after 32s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=2, num_warps=4, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:49:18.4908904Z [852s] Timeout after 32s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:49:22.9860380Z [857s] Timeout after 33s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=1, num_warps=16, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:49:24.3836848Z [858s] Timeout after 37s compiling Config(block_sizes=[2, 16384], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:49:25.4868491Z [859s] Timeout after 38s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, True], range_num_stages=[0, 1], range_unroll_factors=[0, 2], range_warp_specializes=[])
2026-02-21T13:49:26.8731469Z [861s] Timeout after 39s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], maxnreg=256, num_sm_multiplier=64, num_stages=2, num_warps=4, pid_type='persistent_interleaved', range_flattens=[None, None], range_multi_buffers=[False, False], range_num_stages=[3, 1], range_unroll_factors=[1, 1], range_warp_specializes=[])
2026-02-21T13:49:29.4077145Z [863s] Timeout after 40s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'tensor_descriptor', 'tensor_descriptor'], load_eviction_policies=['first', 'first'], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, None], range_multi_buffers=[None, False], range_num_stages=[0, 0], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:49:30.7750402Z [864s] Timeout after 40s compiling Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'tensor_descriptor'], load_eviction_policies=['', 'first'], num_stages=5, num_warps=16, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, False], range_num_stages=[0, 1], range_unroll_factors=[0, 3], range_warp_specializes=[])
2026-02-21T13:49:30.9577795Z Generation 17: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 1.0 configs/s
2026-02-21T13:49:33.5734519Z Generation 17: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 32/32 12.3 configs/s
2026-02-21T13:49:37.6288181Z Generation 17: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 247.4         
2026-02-21T13:49:37.6288727Z                                                                   configs/s     
2026-02-21T13:49:37.9018195Z [872s] Generation 17 complete: 
2026-02-21T13:49:37.9018511Z timeout=9
2026-02-21T13:49:37.9018693Z ok=26
2026-02-21T13:49:37.9018900Z min=0.0723
2026-02-21T13:49:37.9019109Z mid=0.0727
2026-02-21T13:49:37.9019321Z max=0.1332
2026-02-21T13:49:37.9019498Z best={'block_sizes': [1, 16384],
2026-02-21T13:49:37.9019846Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T13:49:37.9020218Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:49:37.9020514Z  'num_stages': 8,
2026-02-21T13:49:37.9020702Z  'num_warps': 16,
2026-02-21T13:49:37.9020894Z  'pid_type': 'flat',
2026-02-21T13:49:37.9021121Z  'range_flattens': [None, False],
2026-02-21T13:49:37.9021402Z  'range_multi_buffers': [None, True],
2026-02-21T13:49:37.9021660Z  'range_num_stages': [0, 3],
2026-02-21T13:49:37.9021887Z  'range_unroll_factors': [0, 4],
2026-02-21T13:49:37.9022131Z  'range_warp_specializes': []}
2026-02-21T13:49:37.9066741Z [872s] Fitting surrogate: 1007 points, 1007 targets
2026-02-21T13:49:38.4941937Z [872s] Generation 18 starting: 32 neighbors, 3 active search path(s)
2026-02-21T13:50:13.3522824Z Generation 18: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32/32 0.9 configs/s
2026-02-21T13:50:16.9517683Z Generation 18: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 32/32 8.9 configs/s
2026-02-21T13:50:22.2796150Z Generation 18: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 188.7         
2026-02-21T13:50:22.2796663Z                                                                   configs/s     
2026-02-21T13:50:22.6233730Z [917s] Generation 18 complete: 
2026-02-21T13:50:22.6234398Z ok=35
2026-02-21T13:50:22.6242672Z min=0.0740
2026-02-21T13:50:22.6242954Z mid=0.0765
2026-02-21T13:50:22.6243132Z max=1.5039
2026-02-21T13:50:22.6243318Z best={'block_sizes': [1, 16384],
2026-02-21T13:50:22.6243645Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T13:50:22.6244181Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:50:22.6244471Z  'num_stages': 8,
2026-02-21T13:50:22.6244663Z  'num_warps': 16,
2026-02-21T13:50:22.6244861Z  'pid_type': 'flat',
2026-02-21T13:50:22.6245079Z  'range_flattens': [None, False],
2026-02-21T13:50:22.6245346Z  'range_multi_buffers': [None, True],
2026-02-21T13:50:22.6245612Z  'range_num_stages': [0, 3],
2026-02-21T13:50:22.6245843Z  'range_unroll_factors': [0, 3],
2026-02-21T13:50:22.6246092Z  'range_warp_specializes': []}
2026-02-21T13:50:22.6290601Z [917s] Fitting surrogate: 1042 points, 1042 targets
2026-02-21T13:50:23.2733941Z [917s] Generation 19 starting: 33 neighbors, 3 active search path(s)
2026-02-21T13:50:47.2933402Z Generation 19: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36/36 3.6 configs/s
2026-02-21T13:50:49.4937229Z Generation 19: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 36/36 16.7 configs/s
2026-02-21T13:50:55.1940950Z Generation 19: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 176.2         
2026-02-21T13:50:55.1941464Z                                                                   configs/s     
2026-02-21T13:50:55.5521265Z [949s] Generation 19 complete: 
2026-02-21T13:50:55.5521579Z ok=37
2026-02-21T13:50:55.5521768Z min=0.0724
2026-02-21T13:50:55.5521952Z mid=0.0764
2026-02-21T13:50:55.5522131Z max=0.1727
2026-02-21T13:50:55.5522322Z best={'block_sizes': [1, 16384],
2026-02-21T13:50:55.5522657Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:50:55.5523050Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:50:55.5523392Z  'num_stages': 2,
2026-02-21T13:50:55.5524614Z  'num_warps': 4,
2026-02-21T13:50:55.5524849Z  'pid_type': 'flat',
2026-02-21T13:50:55.5525060Z  'range_flattens': [None, None],
2026-02-21T13:50:55.5525300Z  'range_multi_buffers': [None, False],
2026-02-21T13:50:55.5525588Z  'range_num_stages': [0, 2],
2026-02-21T13:50:55.5525812Z  'range_unroll_factors': [0, 1],
2026-02-21T13:50:55.5526054Z  'range_warp_specializes': []}
2026-02-21T13:50:55.5571139Z [949s] Fitting surrogate: 1079 points, 1079 targets
2026-02-21T13:50:56.2485491Z [950s] Generation 20 starting: 35 neighbors, 3 active search path(s)
2026-02-21T13:51:12.5039650Z Generation 20: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 3.6 configs/s
2026-02-21T13:51:14.6744130Z Generation 20: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 35/35 16.5 configs/s
2026-02-21T13:51:20.3062142Z Generation 20: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 178.5         
2026-02-21T13:51:20.3062690Z                                                                   configs/s     
2026-02-21T13:51:20.6647410Z [975s] Generation 20 complete: 
2026-02-21T13:51:20.6647742Z ok=38
2026-02-21T13:51:20.6647932Z min=0.0763
2026-02-21T13:51:20.6648115Z mid=0.0767
2026-02-21T13:51:20.6648318Z max=1.5047
2026-02-21T13:51:20.6648504Z best={'block_sizes': [1, 16384],
2026-02-21T13:51:20.6648844Z  'indexing': ['tensor_descriptor', 'pointer', 'pointer'],
2026-02-21T13:51:20.6649226Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:51:20.6649519Z  'num_stages': 8,
2026-02-21T13:51:20.6649717Z  'num_warps': 4,
2026-02-21T13:51:20.6649923Z  'pid_type': 'flat',
2026-02-21T13:51:20.6650238Z  'range_flattens': [None, False],
2026-02-21T13:51:20.6650526Z  'range_multi_buffers': [None, True],
2026-02-21T13:51:20.6650830Z  'range_num_stages': [0, 3],
2026-02-21T13:51:20.6651062Z  'range_unroll_factors': [0, 1],
2026-02-21T13:51:20.6651302Z  'range_warp_specializes': []}
2026-02-21T13:51:20.6698349Z [975s] Fitting surrogate: 1117 points, 1117 targets
2026-02-21T13:51:20.8442502Z [975s] Autotuning complete in 975.2s after searching 1044 configs.
2026-02-21T13:51:20.8442991Z One can hardcode the best config and skip autotuning with:
2026-02-21T13:51:20.8444872Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['tensor_descriptor', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], num_stages=8, num_warps=4, pid_type='flat', range_flattens=[None, False], range_multi_buffers=[None, True], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T13:51:20.8446362Z 
2026-02-21T13:51:20.8446765Z [975s] Code of selected kernel: /tmp/torchinductor_root/mq/cmqlxotpz7vmpgtm2zryyycpvxxsvcyiwu32w43d3pe4eq4j7w6l.py
2026-02-21T13:51:20.8786472Z from __future__ import annotations
2026-02-21T13:51:20.8786755Z 
2026-02-21T13:51:20.8786834Z import torch
2026-02-21T13:51:20.8787030Z import triton
2026-02-21T13:51:20.8787232Z import triton.language as tl
2026-02-21T13:51:20.8787560Z from torch._inductor.runtime import triton_helpers
2026-02-21T13:51:20.8788014Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T13:51:20.8788522Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T13:51:20.8789322Z 
2026-02-21T13:51:20.8789444Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T13:51:20.8789695Z _BLOCK_SIZE_1 = tl.constexpr(16384)
2026-02-21T13:51:20.8789869Z 
2026-02-21T13:51:20.8789947Z @triton.jit
2026-02-21T13:51:20.8790201Z def _helion_softmax_two_pass(x, out):
2026-02-21T13:51:20.8790585Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:51:20.8791011Z     pid_0 = tl.program_id(0)
2026-02-21T13:51:20.8791265Z     offset_0 = pid_0
2026-02-21T13:51:20.8791504Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T13:51:20.8791905Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:51:20.8792332Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T13:51:20.8792979Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:51:20.8793348Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T13:51:20.8793707Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:51:20.8794287Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T13:51:20.8794643Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T13:51:20.8794958Z     # src[softmax.py:82-89]: ...
2026-02-21T13:51:20.8795506Z     for offset_2 in tl.range(0, 12032, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=3, disallow_acc_multi_buffer=False, flatten=False):
2026-02-21T13:51:20.8796132Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:51:20.8796460Z         mask_1 = indices_2 < 12032
2026-02-21T13:51:20.8796680Z         mi_copy = mi
2026-02-21T13:51:20.8796867Z         di_copy = di
2026-02-21T13:51:20.8797045Z         mi_copy_0 = mi_copy
2026-02-21T13:51:20.8797256Z         di_copy_0 = di_copy
2026-02-21T13:51:20.8797505Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T13:51:20.8798042Z         values = tl.load(x + (indices_0[:, None] * 12032 + indices_2[None, :] * 1), mask_1[None, :], other=0, eviction_policy='evict_first')
2026-02-21T13:51:20.8798631Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T13:51:20.8799228Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T13:51:20.8799821Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T13:51:20.8800191Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T13:51:20.8800521Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T13:51:20.8800813Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T13:51:20.8801177Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:51:20.8801522Z         v_2 = mi_copy_0 - v_1
2026-02-21T13:51:20.8801720Z         v_3 = libdevice.exp(v_2)
2026-02-21T13:51:20.8801922Z         v_4 = di_copy_0 * v_3
2026-02-21T13:51:20.8802140Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T13:51:20.8802398Z         subscript = v_1[:, None]
2026-02-21T13:51:20.8802603Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T13:51:20.8802815Z         v_6 = v_5 - subscript
2026-02-21T13:51:20.8803079Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T13:51:20.8803409Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T13:51:20.8803674Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T13:51:20.8803891Z         v_7 = libdevice.exp(v_6)
2026-02-21T13:51:20.8804443Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T13:51:20.8804912Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T13:51:20.8805161Z         di = v_4 + sum_1
2026-02-21T13:51:20.8805362Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T13:51:20.8805578Z         mi = v_1
2026-02-21T13:51:20.8805828Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T13:51:20.8817642Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T13:51:20.8818025Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:51:20.8818628Z     for offset_2 in tl.range(0, 12032, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=3, disallow_acc_multi_buffer=False, flatten=False):
2026-02-21T13:51:20.8819175Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T13:51:20.8819473Z         mask_2 = indices_2 < 12032
2026-02-21T13:51:20.8819684Z         mi_copy_1 = mi
2026-02-21T13:51:20.8819864Z         di_copy_1 = di
2026-02-21T13:51:20.8820030Z         mi_copy_1_0 = mi_copy_1
2026-02-21T13:51:20.8820223Z         di_copy_1_0 = di_copy_1
2026-02-21T13:51:20.8820601Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T13:51:20.8821093Z         values_1 = tl.load(x + (indices_0[:, None] * 12032 + indices_2[None, :] * 1), mask_2[None, :], other=0, eviction_policy='evict_first')
2026-02-21T13:51:20.8821677Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T13:51:20.8822029Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T13:51:20.8822268Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T13:51:20.8822499Z         v_10 = v_9 - subscript_1
2026-02-21T13:51:20.8822721Z         v_11 = libdevice.exp(v_10)
2026-02-21T13:51:20.8822930Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T13:51:20.8823173Z         v_12 = v_11 / subscript_2
2026-02-21T13:51:20.8823453Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T13:51:20.8823798Z         tl.store(out + (indices_0[:, None] * 12032 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T13:51:20.8824318Z 
2026-02-21T13:51:20.8824496Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T13:51:20.8824798Z     """
2026-02-21T13:51:20.8825163Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T13:51:20.8825570Z     This version uses fewer passes but is less numerically stable.
2026-02-21T13:51:20.8825893Z     Args:
2026-02-21T13:51:20.8826131Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T13:51:20.8826372Z     Returns:
2026-02-21T13:51:20.8826590Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T13:51:20.8826988Z     """
2026-02-21T13:51:20.8827242Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T13:51:20.8827454Z     m, n = x.size()
2026-02-21T13:51:20.8827735Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T13:51:20.8827985Z     out = torch.empty_like(x)
2026-02-21T13:51:20.8828263Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T13:51:20.8828762Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T13:51:20.8829157Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T13:51:20.8829551Z     # src[softmax.py:79-92]: ...
2026-02-21T13:51:20.8829854Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=4, num_stages=8)
2026-02-21T13:51:20.8830281Z     # src[softmax.py:93]: return out
2026-02-21T13:51:20.8830485Z     return out
2026-02-21T13:51:22.1161780Z WARNING:tritonbench.utils.triton_op:Completed input ID 92:
2026-02-21T13:51:22.1162146Z (M, N)
2026-02-21T13:51:22.1162310Z -------------
2026-02-21T13:51:22.1162487Z (4096, 12032)
2026-02-21T13:51:22.1162585Z 
2026-02-21T13:51:22.1187560Z  95%|█████████▌| 19/20 [2:48:17<13:32, 812.64s/it]WARNING:tritonbench.utils.triton_op:Running input ID 97:
2026-02-21T13:51:22.1188024Z (M, N)
2026-02-21T13:51:22.1188187Z -------------
2026-02-21T13:51:22.1188380Z (4096, 12672)
2026-02-21T13:51:22.1190563Z INFO:tritonbench.utils.triton_op:Took 0.00ms to get benchmark function for naive_softmax
2026-02-21T13:51:23.5493449Z INFO:tritonbench.utils.triton_op:Took 0.01ms to get benchmark function for triton_softmax
2026-02-21T13:51:25.0497064Z INFO:tritonbench.utils.triton_op:Took 3.56ms to get benchmark function for torch_compile_softmax
2026-02-21T13:51:26.7198550Z WARNING:__main__:Input tensor metadata:
2026-02-21T13:51:26.7198926Z { 'args': ( { 'device': 'cuda:0',
2026-02-21T13:51:26.7199200Z               'dtype': 'torch.float16',
2026-02-21T13:51:26.7199480Z               'shape': (4096, 12672),
2026-02-21T13:51:26.7199750Z               'stride': (12672, 1)},),
2026-02-21T13:51:26.7200001Z   'kwargs': {}}
2026-02-21T13:51:26.7252680Z INFO:tritonbench.utils.triton_op:Took 5.81ms to get benchmark function for helion_softmax_tritonbench
2026-02-21T13:51:27.0225917Z [0s] Autotune random seed: 2145258556
2026-02-21T13:51:27.0623453Z [0s] Starting LFBOPatternSearch with initial_population=FROM_RANDOM, copies=5, max_generations=20, similarity_penalty=1.0
2026-02-21T13:52:12.9195008Z [45s] Timeout after 39s compiling Config(block_sizes=[256, 512], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', 'last'], maxnreg=32, num_sm_multiplier=2, num_stages=7, num_warps=16, pid_type='persistent_blocked', range_flattens=[True, True], range_multi_buffers=[False, True], range_num_stages=[4, 2], range_unroll_factors=[4, 2], range_warp_specializes=[])
2026-02-21T13:52:13.4787574Z [46s] Timeout after 30s compiling Config(block_sizes=[256, 2048], indexing=['tensor_descriptor', 'tensor_descriptor', 'pointer'], load_eviction_policies=['', ''], maxnreg=128, num_sm_multiplier=32, num_stages=6, num_warps=8, pid_type='persistent_blocked', range_flattens=[True, None], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 1], range_warp_specializes=[])
2026-02-21T13:52:18.0259125Z [50s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'tensor_descriptor', 'pointer'], load_eviction_policies=['last', 'first'], maxnreg=64, num_sm_multiplier=4, num_stages=5, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[True, None], range_num_stages=[2, 0], range_unroll_factors=[4, 4], range_warp_specializes=[])
2026-02-21T13:52:20.0330762Z [52s] Timeout after 30s compiling Config(block_sizes=[512, 128], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', 'first'], maxnreg=128, num_sm_multiplier=16, num_stages=1, num_warps=8, pid_type='persistent_blocked', range_flattens=[False, False], range_multi_buffers=[False, True], range_num_stages=[3, 3], range_unroll_factors=[3, 3], range_warp_specializes=[])
2026-02-21T13:52:20.5224657Z [53s] Timeout after 30s compiling Config(block_sizes=[256, 64], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['first', 'first'], maxnreg=128, num_sm_multiplier=8, num_stages=2, num_warps=1, pid_type='persistent_interleaved', range_flattens=[True, None], range_multi_buffers=[None, False], range_num_stages=[0, 3], range_unroll_factors=[0, 1], range_warp_specializes=[])
2026-02-21T13:52:30.4737245Z Initial population precompiling 100% ━━━━━━━━━━━━━━━━━━━━━ 100/100 0.5 configs/s
2026-02-21T13:52:40.8466633Z Initial population exploring neighbors 100% ━━━━━━━━━━━━━━ 100/100 9.6 configs/s
2026-02-21T13:52:40.8481412Z [73s] Adaptive compile timeout: 30s (90% percentile=38.9s, bounds=[30.0s, 30s])
2026-02-21T13:52:43.3458166Z Verifying initial results 100% ━━━━━━━━━━━━━━━━━━━━━━━ 1000/1000 395.4 configs/s
2026-02-21T13:52:43.5066755Z [76s] Initial random population of 100, 5 starting points: 
2026-02-21T13:52:43.5067126Z error=7
2026-02-21T13:52:43.5067304Z timeout=5
2026-02-21T13:52:43.5067466Z ok=88
2026-02-21T13:52:43.5067635Z min=0.1159
2026-02-21T13:52:43.5067800Z mid=0.9355
2026-02-21T13:52:43.5067973Z max=173.0049
2026-02-21T13:52:43.5068164Z best={'block_sizes': [1, 8192],
2026-02-21T13:52:43.5068511Z  'indexing': ['pointer', 'tensor_descriptor', 'tensor_descriptor'],
2026-02-21T13:52:43.5068930Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:52:43.5069194Z  'maxnreg': 64,
2026-02-21T13:52:43.5069393Z  'num_sm_multiplier': 4,
2026-02-21T13:52:43.5070214Z  'num_stages': 1,
2026-02-21T13:52:43.5070398Z  'num_warps': 16,
2026-02-21T13:52:43.5070597Z  'pid_type': 'persistent_interleaved',
2026-02-21T13:52:43.5070858Z  'range_flattens': [False, None],
2026-02-21T13:52:43.5071094Z  'range_multi_buffers': [True, None],
2026-02-21T13:52:43.5071335Z  'range_num_stages': [3, 1],
2026-02-21T13:52:43.5071552Z  'range_unroll_factors': [1, 3],
2026-02-21T13:52:43.5071797Z  'range_warp_specializes': []}
2026-02-21T13:52:43.5084773Z [76s] Fitting surrogate: 100 points, 100 targets
2026-02-21T13:52:44.9237574Z [77s] Generation 1 starting: 88 neighbors, 5 active search path(s)
2026-02-21T13:53:39.9618837Z Generation 1: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93/93 0.4 configs/s
2026-02-21T13:53:45.4566546Z Generation 1: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 93/93 17.1 configs/s
2026-02-21T13:53:58.1990245Z Generation 1: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 90.6 configs/s
2026-02-21T13:53:58.7582416Z [151s] Generation 1 complete: 
2026-02-21T13:53:58.7582755Z error=5
2026-02-21T13:53:58.7582943Z ok=89
2026-02-21T13:53:58.7583114Z min=0.0957
2026-02-21T13:53:58.7583281Z mid=0.1350
2026-02-21T13:53:58.7583451Z max=0.7062
2026-02-21T13:53:58.7583634Z best={'block_sizes': [1, 16384],
2026-02-21T13:53:58.7583951Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:53:58.7584497Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:53:58.7584769Z  'maxnreg': 64,
2026-02-21T13:53:58.7584966Z  'num_sm_multiplier': 4,
2026-02-21T13:53:58.7585190Z  'num_stages': 1,
2026-02-21T13:53:58.7585393Z  'num_warps': 8,
2026-02-21T13:53:58.7585613Z  'pid_type': 'persistent_interleaved',
2026-02-21T13:53:58.7585893Z  'range_flattens': [False, None],
2026-02-21T13:53:58.7586148Z  'range_multi_buffers': [True, None],
2026-02-21T13:53:58.7586427Z  'range_num_stages': [3, 1],
2026-02-21T13:53:58.7586659Z  'range_unroll_factors': [1, 3],
2026-02-21T13:53:58.7586907Z  'range_warp_specializes': []}
2026-02-21T13:53:58.7603650Z [151s] Fitting surrogate: 194 points, 194 targets
2026-02-21T13:54:00.1411544Z [153s] Generation 2 starting: 85 neighbors, 5 active search path(s)
2026-02-21T13:54:50.4351569Z Generation 2: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88/88 2.1 configs/s
2026-02-21T13:54:59.2500697Z Generation 2: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 88/88 10.0 configs/s
2026-02-21T13:55:10.7287180Z Generation 2: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 87.6 configs/s
2026-02-21T13:55:11.3365026Z [224s] Generation 2 complete: 
2026-02-21T13:55:11.3365351Z ok=91
2026-02-21T13:55:11.3365532Z min=0.0803
2026-02-21T13:55:11.3365714Z mid=0.1158
2026-02-21T13:55:11.3365899Z max=0.9217
2026-02-21T13:55:11.3366100Z best={'block_sizes': [1, 16384],
2026-02-21T13:55:11.3366427Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:55:11.3366824Z  'load_eviction_policies': ['', 'first'],
2026-02-21T13:55:11.3367102Z  'num_stages': 1,
2026-02-21T13:55:11.3367300Z  'num_warps': 8,
2026-02-21T13:55:11.3367510Z  'pid_type': 'flat',
2026-02-21T13:55:11.3368302Z  'range_flattens': [None, None],
2026-02-21T13:55:11.3368574Z  'range_multi_buffers': [None, None],
2026-02-21T13:55:11.3368844Z  'range_num_stages': [0, 1],
2026-02-21T13:55:11.3369105Z  'range_unroll_factors': [0, 3],
2026-02-21T13:55:11.3369359Z  'range_warp_specializes': []}
2026-02-21T13:55:11.3390242Z [224s] Fitting surrogate: 285 points, 285 targets
2026-02-21T13:55:12.6260249Z [225s] Generation 3 starting: 79 neighbors, 5 active search path(s)
2026-02-21T13:55:52.4251482Z Generation 3: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80/80 4.4 configs/s
2026-02-21T13:55:57.3846330Z Generation 3: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 80/80 16.3 configs/s
2026-02-21T13:56:08.3750306Z Generation 3: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 91.6 configs/s
2026-02-21T13:56:08.9927787Z [281s] Generation 3 complete: 
2026-02-21T13:56:08.9928230Z ok=84
2026-02-21T13:56:08.9928466Z min=0.0805
2026-02-21T13:56:08.9928739Z mid=0.1118
2026-02-21T13:56:08.9929015Z max=0.6536
2026-02-21T13:56:08.9929285Z best={'block_sizes': [1, 16384],
2026-02-21T13:56:08.9929739Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:56:08.9930291Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:56:08.9930667Z  'num_stages': 1,
2026-02-21T13:56:08.9930922Z  'num_warps': 8,
2026-02-21T13:56:08.9931204Z  'pid_type': 'flat',
2026-02-21T13:56:08.9931503Z  'range_flattens': [None, None],
2026-02-21T13:56:08.9931873Z  'range_multi_buffers': [None, None],
2026-02-21T13:56:08.9932248Z  'range_num_stages': [0, 1],
2026-02-21T13:56:08.9932523Z  'range_unroll_factors': [0, 3],
2026-02-21T13:56:08.9932828Z  'range_warp_specializes': []}
2026-02-21T13:56:08.9961841Z [281s] Fitting surrogate: 369 points, 369 targets
2026-02-21T13:56:10.2265802Z [283s] Generation 4 starting: 77 neighbors, 5 active search path(s)
2026-02-21T13:57:11.4991921Z Generation 4: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78/78 0.4 configs/s
2026-02-21T13:57:18.4004678Z Generation 4: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 78/78 11.3 configs/s
2026-02-21T13:57:29.4490211Z Generation 4: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 91.1 configs/s
2026-02-21T13:57:30.0540413Z [362s] Generation 4 complete: 
2026-02-21T13:57:30.0540783Z error=1
2026-02-21T13:57:30.0541000Z ok=81
2026-02-21T13:57:30.0541245Z min=0.0766
2026-02-21T13:57:30.0541460Z mid=0.1055
2026-02-21T13:57:30.0541700Z max=1.2114
2026-02-21T13:57:30.0541970Z best={'block_sizes': [1, 16384],
2026-02-21T13:57:30.0542329Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:57:30.0542767Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:57:30.0543091Z  'num_stages': 1,
2026-02-21T13:57:30.0543353Z  'num_warps': 8,
2026-02-21T13:57:30.0543587Z  'pid_type': 'flat',
2026-02-21T13:57:30.0543896Z  'range_flattens': [None, None],
2026-02-21T13:57:30.0544358Z  'range_multi_buffers': [None, None],
2026-02-21T13:57:30.0544697Z  'range_num_stages': [0, 1],
2026-02-21T13:57:30.0544972Z  'range_unroll_factors': [0, 3],
2026-02-21T13:57:30.0545326Z  'range_warp_specializes': []}
2026-02-21T13:57:30.0572617Z [362s] Fitting surrogate: 451 points, 451 targets
2026-02-21T13:57:31.1399757Z [364s] Generation 5 starting: 67 neighbors, 5 active search path(s)
2026-02-21T13:58:03.1383159Z Generation 5: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 68/68 8.9 configs/s
2026-02-21T13:58:07.3430572Z Generation 5: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 68/68 16.3 configs/s
2026-02-21T13:58:19.1650090Z Generation 5: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 99.5 configs/s
2026-02-21T13:58:19.7532419Z [412s] Generation 5 complete: 
2026-02-21T13:58:19.7532713Z ok=72
2026-02-21T13:58:19.7532982Z min=0.0765
2026-02-21T13:58:19.7533235Z mid=0.0922
2026-02-21T13:58:19.7533469Z max=0.3861
2026-02-21T13:58:19.7533708Z best={'block_sizes': [1, 16384],
2026-02-21T13:58:19.7534416Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T13:58:19.7534799Z  'load_eviction_policies': ['first', 'first'],
2026-02-21T13:58:19.7535600Z  'num_stages': 1,
2026-02-21T13:58:19.7535824Z  'num_warps': 8,
2026-02-21T13:58:19.7536077Z  'pid_type': 'flat',
2026-02-21T13:58:19.7536360Z  'range_flattens': [None, False],
2026-02-21T13:58:19.7536642Z  'range_multi_buffers': [None, None],
2026-02-21T13:58:19.7536957Z  'range_num_stages': [0, 1],
2026-02-21T13:58:19.7537219Z  'range_unroll_factors': [0, 3],
2026-02-21T13:58:19.7537523Z  'range_warp_specializes': []}
2026-02-21T13:58:19.7563750Z [412s] Fitting surrogate: 523 points, 523 targets
2026-02-21T13:58:20.8141099Z [413s] Generation 6 starting: 65 neighbors, 5 active search path(s)
2026-02-21T13:59:20.5709953Z Generation 6: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67/67 5.4 configs/s
2026-02-21T13:59:24.7721665Z Generation 6: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 67/67 16.1 configs/s
2026-02-21T13:59:34.6039434Z Generation 6: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 102.5         
2026-02-21T13:59:34.6040044Z                                                                   configs/s     
2026-02-21T13:59:35.1865711Z [488s] Generation 6 complete: 
2026-02-21T13:59:35.1866151Z ok=70
2026-02-21T13:59:35.1866416Z min=0.0764
2026-02-21T13:59:35.1866721Z mid=0.0827
2026-02-21T13:59:35.1866984Z max=1.3835
2026-02-21T13:59:35.1867243Z best={'block_sizes': [1, 16384],
2026-02-21T13:59:35.1867674Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T13:59:35.1868079Z  'load_eviction_policies': ['', ''],
2026-02-21T13:59:35.1868438Z  'num_stages': 5,
2026-02-21T13:59:35.1868721Z  'num_warps': 4,
2026-02-21T13:59:35.1869013Z  'pid_type': 'flat',
2026-02-21T13:59:35.1869307Z  'range_flattens': [None, True],
2026-02-21T13:59:35.1869661Z  'range_multi_buffers': [None, None],
2026-02-21T13:59:35.1870021Z  'range_num_stages': [0, 2],
2026-02-21T13:59:35.1870349Z  'range_unroll_factors': [0, 2],
2026-02-21T13:59:35.1870689Z  'range_warp_specializes': []}
2026-02-21T13:59:35.1905679Z [488s] Fitting surrogate: 593 points, 593 targets
2026-02-21T13:59:36.0006794Z [488s] Generation 7 starting: 46 neighbors, 3 active search path(s)
2026-02-21T14:00:01.3428832Z Generation 7: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48/48 1.5 configs/s
2026-02-21T14:00:04.3316920Z Generation 7: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 48/48 16.3 configs/s
2026-02-21T14:00:09.7398988Z Generation 7: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 185.8         
2026-02-21T14:00:09.7399576Z                                                                   configs/s     
2026-02-21T14:00:10.0765912Z [523s] Generation 7 complete: 
2026-02-21T14:00:10.0766553Z ok=49
2026-02-21T14:00:10.0766902Z min=0.0748
2026-02-21T14:00:10.0767295Z mid=0.1028
2026-02-21T14:00:10.0767633Z max=0.6243
2026-02-21T14:00:10.0768053Z best={'block_sizes': [1, 16384],
2026-02-21T14:00:10.0768715Z  'indexing': ['tensor_descriptor', 'tensor_descriptor', 'pointer'],
2026-02-21T14:00:10.0769409Z  'load_eviction_policies': ['', ''],
2026-02-21T14:00:10.0769984Z  'num_stages': 1,
2026-02-21T14:00:10.0770465Z  'num_warps': 8,
2026-02-21T14:00:10.0770820Z  'pid_type': 'flat',
2026-02-21T14:00:10.0771100Z  'range_flattens': [None, None],
2026-02-21T14:00:10.0771417Z  'range_multi_buffers': [None, True],
2026-02-21T14:00:10.0771705Z  'range_num_stages': [0, 1],
2026-02-21T14:00:10.0771991Z  'range_unroll_factors': [0, 0],
2026-02-21T14:00:10.0772266Z  'range_warp_specializes': []}
2026-02-21T14:00:10.0800731Z [523s] Fitting surrogate: 642 points, 642 targets
2026-02-21T14:00:10.7896353Z [523s] Generation 8 starting: 37 neighbors, 3 active search path(s)
2026-02-21T14:00:30.8650150Z Generation 8: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38/38 1.1 configs/s
2026-02-21T14:00:33.1911701Z Generation 8: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 38/38 16.6 configs/s
2026-02-21T14:00:37.9028449Z Generation 8: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 212.9         
2026-02-21T14:00:37.9030506Z                                                                   configs/s     
2026-02-21T14:00:38.2057864Z [551s] Generation 8 complete: 
2026-02-21T14:00:38.2058351Z ok=40
2026-02-21T14:00:38.2058596Z min=0.0743
2026-02-21T14:00:38.2058875Z mid=0.0862
2026-02-21T14:00:38.2059099Z max=0.5324
2026-02-21T14:00:38.2059382Z best={'block_sizes': [1, 16384],
2026-02-21T14:00:38.2059835Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T14:00:38.2060256Z  'load_eviction_policies': ['', ''],
2026-02-21T14:00:38.2060549Z  'num_stages': 1,
2026-02-21T14:00:38.2060847Z  'num_warps': 8,
2026-02-21T14:00:38.2061078Z  'pid_type': 'flat',
2026-02-21T14:00:38.2061358Z  'range_flattens': [None, None],
2026-02-21T14:00:38.2061691Z  'range_multi_buffers': [None, True],
2026-02-21T14:00:38.2061996Z  'range_num_stages': [0, 1],
2026-02-21T14:00:38.2062315Z  'range_unroll_factors': [0, 0],
2026-02-21T14:00:38.2063100Z  'range_warp_specializes': []}
2026-02-21T14:00:38.2092782Z [551s] Fitting surrogate: 682 points, 682 targets
2026-02-21T14:00:38.8652593Z [551s] Generation 9 starting: 34 neighbors, 3 active search path(s)
2026-02-21T14:00:56.8646386Z Generation 9: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35/35 3.8 configs/s
2026-02-21T14:00:59.0356020Z Generation 9: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━ 35/35 16.4 configs/s
2026-02-21T14:01:04.2502684Z Generation 9: verifying top configs 100% ━━━━━━━━━━━━━━ 1000/1000 192.6         
2026-02-21T14:01:04.2503258Z                                                                   configs/s     
2026-02-21T14:01:04.5853840Z [577s] Generation 9 complete: 
2026-02-21T14:01:04.5854884Z ok=37
2026-02-21T14:01:04.5855274Z min=0.0747
2026-02-21T14:01:04.5855620Z mid=0.0789
2026-02-21T14:01:04.5856005Z max=0.6716
2026-02-21T14:01:04.5856388Z best={'block_sizes': [1, 16384],
2026-02-21T14:01:04.5857023Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T14:01:04.5857733Z  'load_eviction_policies': ['', ''],
2026-02-21T14:01:04.5858268Z  'num_stages': 5,
2026-02-21T14:01:04.5858735Z  'num_warps': 8,
2026-02-21T14:01:04.5858988Z  'pid_type': 'flat',
2026-02-21T14:01:04.5859288Z  'range_flattens': [None, None],
2026-02-21T14:01:04.5859580Z  'range_multi_buffers': [None, None],
2026-02-21T14:01:04.5859908Z  'range_num_stages': [0, 2],
2026-02-21T14:01:04.5860181Z  'range_unroll_factors': [0, 2],
2026-02-21T14:01:04.5860500Z  'range_warp_specializes': []}
2026-02-21T14:01:04.5891077Z [577s] Fitting surrogate: 719 points, 719 targets
2026-02-21T14:01:05.0213853Z [577s] Generation 10 starting: 21 neighbors, 2 active search path(s)
2026-02-21T14:01:16.3087863Z Generation 10: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 22/22 8.2 configs/s
2026-02-21T14:01:17.6760378Z Generation 10: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 22/22 16.6 configs/s
2026-02-21T14:01:20.8573538Z Generation 10: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 314.3         
2026-02-21T14:01:20.8574338Z                                                                   configs/s     
2026-02-21T14:01:21.0797201Z [594s] Generation 10 complete: 
2026-02-21T14:01:21.0797801Z ok=24
2026-02-21T14:01:21.0798194Z min=0.0747
2026-02-21T14:01:21.0798585Z mid=0.0786
2026-02-21T14:01:21.0798938Z max=1.7712
2026-02-21T14:01:21.0799334Z best={'block_sizes': [1, 16384],
2026-02-21T14:01:21.0799946Z  'indexing': ['pointer', 'pointer', 'tensor_descriptor'],
2026-02-21T14:01:21.0800417Z  'load_eviction_policies': ['', ''],
2026-02-21T14:01:21.0800706Z  'num_stages': 5,
2026-02-21T14:01:21.0800956Z  'num_warps': 8,
2026-02-21T14:01:21.0801202Z  'pid_type': 'flat',
2026-02-21T14:01:21.0801443Z  'range_flattens': [None, None],
2026-02-21T14:01:21.0801752Z  'range_multi_buffers': [None, None],
2026-02-21T14:01:21.0802038Z  'range_num_stages': [0, 2],
2026-02-21T14:01:21.0802324Z  'range_unroll_factors': [0, 2],
2026-02-21T14:01:21.0802594Z  'range_warp_specializes': []}
2026-02-21T14:01:21.0835041Z [594s] Fitting surrogate: 743 points, 743 targets
2026-02-21T14:01:21.3326543Z [594s] Generation 11 starting: 6 neighbors, 1 active search path(s)
2026-02-21T14:01:25.6923704Z Generation 11: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6/6 2.6 configs/s
2026-02-21T14:01:26.0646603Z Generation 11: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━━━ 6/6 18.5 configs/s
2026-02-21T14:01:27.3658496Z Generation 11: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 754.7         
2026-02-21T14:01:27.3659155Z                                                                   configs/s     
2026-02-21T14:01:27.4819928Z [600s] Generation 11 complete: 
2026-02-21T14:01:27.4820283Z ok=8
2026-02-21T14:01:27.4820523Z min=0.0783
2026-02-21T14:01:27.4820749Z mid=0.0787
2026-02-21T14:01:27.4820988Z max=0.0804
2026-02-21T14:01:27.4821217Z best={'block_sizes': [1, 16384],
2026-02-21T14:01:27.4821608Z  'indexing': ['pointer', 'tensor_descriptor', 'pointer'],
2026-02-21T14:01:27.4821996Z  'load_eviction_policies': ['', ''],
2026-02-21T14:01:27.4822975Z  'num_stages': 2,
2026-02-21T14:01:27.4823243Z  'num_warps': 8,
2026-02-21T14:01:27.4823542Z  'pid_type': 'flat',
2026-02-21T14:01:27.4823803Z  'range_flattens': [None, None],
2026-02-21T14:01:27.4824629Z  'range_multi_buffers': [None, True],
2026-02-21T14:01:27.4824968Z  'range_num_stages': [0, 2],
2026-02-21T14:01:27.4825231Z  'range_unroll_factors': [0, 0],
2026-02-21T14:01:27.4825526Z  'range_warp_specializes': []}
2026-02-21T14:01:27.4858171Z [600s] Fitting surrogate: 751 points, 751 targets
2026-02-21T14:01:27.7713511Z [600s] Generation 12 starting: 10 neighbors, 1 active search path(s)
2026-02-21T14:01:34.4036627Z Generation 12: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11/11 3.2 configs/s
2026-02-21T14:01:35.0739967Z Generation 12: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 11/11 17.6 configs/s
2026-02-21T14:01:37.0923795Z Generation 12: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 491.2         
2026-02-21T14:01:37.0926157Z                                                                   configs/s     
2026-02-21T14:01:37.2451692Z [610s] Generation 12 complete: 
2026-02-21T14:01:37.2452102Z ok=12
2026-02-21T14:01:37.2452335Z min=0.0781
2026-02-21T14:01:37.2452606Z mid=0.0802
2026-02-21T14:01:37.2452898Z max=0.1001
2026-02-21T14:01:37.2453137Z best={'block_sizes': [1, 16384],
2026-02-21T14:01:37.2453536Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T14:01:37.2453908Z  'load_eviction_policies': ['', ''],
2026-02-21T14:01:37.2454670Z  'num_stages': 2,
2026-02-21T14:01:37.2454931Z  'num_warps': 8,
2026-02-21T14:01:37.2455215Z  'pid_type': 'flat',
2026-02-21T14:01:37.2455490Z  'range_flattens': [None, None],
2026-02-21T14:01:37.2455864Z  'range_multi_buffers': [None, True],
2026-02-21T14:01:37.2456189Z  'range_num_stages': [0, 2],
2026-02-21T14:01:37.2456514Z  'range_unroll_factors': [0, 0],
2026-02-21T14:01:37.2456854Z  'range_warp_specializes': []}
2026-02-21T14:01:37.2487765Z [610s] Fitting surrogate: 763 points, 763 targets
2026-02-21T14:01:37.5579680Z [610s] Generation 13 starting: 11 neighbors, 1 active search path(s)
2026-02-21T14:01:44.9531738Z Generation 13: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12/12 1.1 configs/s
2026-02-21T14:01:45.6907052Z Generation 13: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 12/12 17.3 configs/s
2026-02-21T14:01:47.7888396Z Generation 13: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 472.4         
2026-02-21T14:01:47.7888963Z                                                                   configs/s     
2026-02-21T14:01:47.9418003Z [620s] Generation 13 complete: 
2026-02-21T14:01:47.9418627Z ok=13
2026-02-21T14:01:47.9419043Z min=0.0783
2026-02-21T14:01:47.9419350Z mid=0.0910
2026-02-21T14:01:47.9419565Z max=0.4500
2026-02-21T14:01:47.9419816Z best={'block_sizes': [1, 16384],
2026-02-21T14:01:47.9420144Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T14:01:47.9420525Z  'load_eviction_policies': ['', ''],
2026-02-21T14:01:47.9420819Z  'num_stages': 2,
2026-02-21T14:01:47.9421074Z  'num_warps': 8,
2026-02-21T14:01:47.9421852Z  'pid_type': 'flat',
2026-02-21T14:01:47.9422164Z  'range_flattens': [None, True],
2026-02-21T14:01:47.9422472Z  'range_multi_buffers': [None, True],
2026-02-21T14:01:47.9422811Z  'range_num_stages': [0, 2],
2026-02-21T14:01:47.9423136Z  'range_unroll_factors': [0, 1],
2026-02-21T14:01:47.9423422Z  'range_warp_specializes': []}
2026-02-21T14:01:47.9456237Z [620s] Fitting surrogate: 776 points, 776 targets
2026-02-21T14:01:48.2777300Z [621s] Generation 14 starting: 12 neighbors, 1 active search path(s)
2026-02-21T14:01:58.7377479Z Generation 14: precompiling 100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13/13 0.7 configs/s
2026-02-21T14:01:59.5438983Z Generation 14: exploring neighbors 100% ━━━━━━━━━━━━━━━━━━━ 13/13 17.0 configs/s
2026-02-21T14:02:01.5513415Z Generation 14: verifying top configs 100% ━━━━━━━━━━━━━ 1000/1000 494.1         
2026-02-21T14:02:01.5513963Z                                                                   configs/s     
2026-02-21T14:02:01.7043789Z [634s] Generation 14 complete: 
2026-02-21T14:02:01.7044741Z ok=14
2026-02-21T14:02:01.7045118Z min=0.0781
2026-02-21T14:02:01.7045533Z mid=0.0801
2026-02-21T14:02:01.7045909Z max=1.7699
2026-02-21T14:02:01.7046350Z best={'block_sizes': [1, 16384],
2026-02-21T14:02:01.7046966Z  'indexing': ['pointer', 'pointer', 'pointer'],
2026-02-21T14:02:01.7047611Z  'load_eviction_policies': ['', ''],
2026-02-21T14:02:01.7048162Z  'num_stages': 2,
2026-02-21T14:02:01.7048576Z  'num_warps': 8,
2026-02-21T14:02:01.7049045Z  'pid_type': 'flat',
2026-02-21T14:02:01.7049366Z  'range_flattens': [None, True],
2026-02-21T14:02:01.7049662Z  'range_multi_buffers': [None, True],
2026-02-21T14:02:01.7049945Z  'range_num_stages': [0, 2],
2026-02-21T14:02:01.7050291Z  'range_unroll_factors': [0, 1],
2026-02-21T14:02:01.7050557Z  'range_warp_specializes': []}
2026-02-21T14:02:01.7081422Z [634s] Fitting surrogate: 790 points, 790 targets
2026-02-21T14:02:01.8681320Z [634s] Autotuning complete in 634.8s after searching 754 configs.
2026-02-21T14:02:01.8681850Z One can hardcode the best config and skip autotuning with:
2026-02-21T14:02:01.8683329Z     @helion.kernel(config=helion.Config(block_sizes=[1, 16384], indexing=['pointer', 'pointer', 'pointer'], load_eviction_policies=['', ''], num_stages=2, num_warps=8, pid_type='flat', range_flattens=[None, True], range_multi_buffers=[None, True], range_num_stages=[0, 2], range_unroll_factors=[0, 1], range_warp_specializes=[]), static_shapes=True)
2026-02-21T14:02:01.8684937Z 
2026-02-21T14:02:01.8685395Z [634s] Code of selected kernel: /tmp/torchinductor_root/ie/cieqgazblo257p5hpqjad3agxbr3mjr5e244b2ejzplutv3bp476.py
2026-02-21T14:02:01.9013065Z from __future__ import annotations
2026-02-21T14:02:01.9013575Z 
2026-02-21T14:02:01.9013716Z import torch
2026-02-21T14:02:01.9021677Z import triton
2026-02-21T14:02:01.9021963Z import triton.language as tl
2026-02-21T14:02:01.9022301Z from torch._inductor.runtime import triton_helpers
2026-02-21T14:02:01.9022750Z from torch._inductor.runtime.triton_compat import libdevice
2026-02-21T14:02:01.9023248Z from helion.runtime import default_launcher as _default_launcher
2026-02-21T14:02:01.9023557Z 
2026-02-21T14:02:01.9023663Z _BLOCK_SIZE_0 = tl.constexpr(1)
2026-02-21T14:02:01.9023933Z _BLOCK_SIZE_1 = tl.constexpr(16384)
2026-02-21T14:02:01.9024756Z 
2026-02-21T14:02:01.9024844Z @triton.jit
2026-02-21T14:02:01.9025062Z def _helion_softmax_two_pass(x, out):
2026-02-21T14:02:01.9025465Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T14:02:01.9025878Z     pid_0 = tl.program_id(0)
2026-02-21T14:02:01.9026137Z     offset_0 = pid_0
2026-02-21T14:02:01.9026396Z     indices_0 = offset_0 + tl.zeros([1], tl.int32)
2026-02-21T14:02:01.9026853Z     # src[softmax.py:80]: mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T14:02:01.9027347Z     mi = tl.full([_BLOCK_SIZE_0], float('-inf'), tl.float32)
2026-02-21T14:02:01.9027795Z     # src[softmax.py:81]: di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T14:02:01.9028471Z     di = tl.full([_BLOCK_SIZE_0], 0.0, tl.float32)
2026-02-21T14:02:01.9028910Z     # src[softmax.py:82]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T14:02:01.9029368Z     # src[softmax.py:83]:     values = x[tile_m, tile_n]
2026-02-21T14:02:01.9029711Z     # src[softmax.py:84]:     local_amax = torch.amax(values, dim=1)
2026-02-21T14:02:01.9030010Z     # src[softmax.py:82-89]: ...
2026-02-21T14:02:01.9030510Z     for offset_2 in tl.range(0, 12672, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=2, disallow_acc_multi_buffer=False, flatten=True):
2026-02-21T14:02:01.9031085Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T14:02:01.9031447Z         mask_1 = indices_2 < 12672
2026-02-21T14:02:01.9031698Z         mi_copy = mi
2026-02-21T14:02:01.9031910Z         di_copy = di
2026-02-21T14:02:01.9032121Z         mi_copy_0 = mi_copy
2026-02-21T14:02:01.9032382Z         di_copy_0 = di_copy
2026-02-21T14:02:01.9032646Z         # src[softmax.py:83]: values = x[tile_m, tile_n]
2026-02-21T14:02:01.9033133Z         values = tl.load(x + (indices_0[:, None] * 12672 + indices_2[None, :] * 1), mask_1[None, :], other=0)
2026-02-21T14:02:01.9033621Z         # src[softmax.py:84]: local_amax = torch.amax(values, dim=1)
2026-02-21T14:02:01.9034367Z         _mask_to = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), values, tl.full([], float('-inf'), tl.float16))
2026-02-21T14:02:01.9034997Z         local_amax = tl.cast(tl.max(_mask_to, 1), tl.float16)
2026-02-21T14:02:01.9035399Z         # src[softmax.py:85]: mi_next = torch.maximum(mi, local_amax)
2026-02-21T14:02:01.9035775Z         v_0 = tl.cast(local_amax, tl.float32)
2026-02-21T14:02:01.9036079Z         v_1 = triton_helpers.maximum(mi_copy_0, v_0)
2026-02-21T14:02:01.9036480Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T14:02:01.9036874Z         v_2 = mi_copy_0 - v_1
2026-02-21T14:02:01.9037126Z         v_3 = libdevice.exp(v_2)
2026-02-21T14:02:01.9037397Z         v_4 = di_copy_0 * v_3
2026-02-21T14:02:01.9037675Z         # src[softmax.py:87]: values - mi_next[:, None]
2026-02-21T14:02:01.9038019Z         subscript = v_1[:, None]
2026-02-21T14:02:01.9038272Z         v_5 = tl.cast(values, tl.float32)
2026-02-21T14:02:01.9038575Z         v_6 = v_5 - subscript
2026-02-21T14:02:01.9038883Z         # src[softmax.py:86]: di = di * torch.exp(mi - mi_next) + torch.exp(
2026-02-21T14:02:01.9039296Z         # src[softmax.py:87]:     values - mi_next[:, None]
2026-02-21T14:02:01.9039624Z         # src[softmax.py:88]: ).sum(dim=1)
2026-02-21T14:02:01.9039892Z         v_7 = libdevice.exp(v_6)
2026-02-21T14:02:01.9040383Z         _mask_to_1 = tl.where(tl.broadcast_to(mask_1[None, :], [_BLOCK_SIZE_0, _BLOCK_SIZE_1]), v_7, tl.full([], 0, tl.float32))
2026-02-21T14:02:01.9040895Z         sum_1 = tl.cast(tl.sum(_mask_to_1, 1), tl.float32)
2026-02-21T14:02:01.9041207Z         di = v_4 + sum_1
2026-02-21T14:02:01.9041435Z         # src[softmax.py:89]: mi = mi_next
2026-02-21T14:02:01.9041713Z         mi = v_1
2026-02-21T14:02:01.9042004Z     # src[softmax.py:90]: for tile_n in hl.tile(n, block_size=block_size_n):
2026-02-21T14:02:01.9042412Z     # src[softmax.py:91]:     values = x[tile_m, tile_n]
2026-02-21T14:02:01.9043078Z     # src[softmax.py:92]:     out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T14:02:01.9043729Z     for offset_2 in tl.range(0, 12672, _BLOCK_SIZE_1, loop_unroll_factor=1, num_stages=2, disallow_acc_multi_buffer=False, flatten=True):
2026-02-21T14:02:01.9044483Z         indices_2 = offset_2 + tl.arange(0, _BLOCK_SIZE_1).to(tl.int32)
2026-02-21T14:02:01.9044819Z         mask_2 = indices_2 < 12672
2026-02-21T14:02:01.9045096Z         mi_copy_1 = mi
2026-02-21T14:02:01.9045339Z         di_copy_1 = di
2026-02-21T14:02:01.9045549Z         mi_copy_1_0 = mi_copy_1
2026-02-21T14:02:01.9045818Z         di_copy_1_0 = di_copy_1
2026-02-21T14:02:01.9046080Z         # src[softmax.py:91]: values = x[tile_m, tile_n]
2026-02-21T14:02:01.9046716Z         values_1 = tl.load(x + (indices_0[:, None] * 12672 + indices_2[None, :] * 1), mask_2[None, :], other=0)
2026-02-21T14:02:01.9047275Z         # src[softmax.py:92]: out[tile_m, tile_n] = torch.exp(values - mi[:, None]) / di[:, None]
2026-02-21T14:02:01.9047711Z         subscript_1 = mi_copy_1_0[:, None]
2026-02-21T14:02:01.9047987Z         v_9 = tl.cast(values_1, tl.float32)
2026-02-21T14:02:01.9048277Z         v_10 = v_9 - subscript_1
2026-02-21T14:02:01.9048558Z         v_11 = libdevice.exp(v_10)
2026-02-21T14:02:01.9048808Z         subscript_2 = di_copy_1_0[:, None]
2026-02-21T14:02:01.9049093Z         v_12 = v_11 / subscript_2
2026-02-21T14:02:01.9049345Z         v_13 = tl.cast(v_12, tl.float16)
2026-02-21T14:02:01.9049755Z         tl.store(out + (indices_0[:, None] * 12672 + indices_2[None, :] * 1), v_13, mask_2[None, :])
2026-02-21T14:02:01.9050057Z 
2026-02-21T14:02:01.9050331Z def softmax_two_pass(x: torch.Tensor, *, _launcher=_default_launcher):
2026-02-21T14:02:01.9050695Z     """
2026-02-21T14:02:01.9051020Z     Numerically optimized Helion kernel performing softmax in two passes.
2026-02-21T14:02:01.9051465Z     This version uses fewer passes but is less numerically stable.
2026-02-21T14:02:01.9051822Z     Args:
2026-02-21T14:02:01.9052064Z         x (torch.Tensor): Input tensor of shape [m, n].
2026-02-21T14:02:01.9052376Z     Returns:
2026-02-21T14:02:01.9052622Z         torch.Tensor: Softmax output tensor of the same shape.
2026-02-21T14:02:01.9052950Z     """
2026-02-21T14:02:01.9053149Z     # src[softmax.py:75]: m, n = x.size()
2026-02-21T14:02:01.9053432Z     m, n = x.size()
2026-02-21T14:02:01.9053689Z     # src[softmax.py:76]: out = torch.empty_like(x)
2026-02-21T14:02:01.9054128Z     out = torch.empty_like(x)
2026-02-21T14:02:01.9054480Z     # src[softmax.py:79]: for tile_m in hl.tile(m, block_size=block_size_m):
2026-02-21T14:02:01.9054914Z     # src[softmax.py:80]:     mi = hl.full([tile_m], float("-inf"), dtype=torch.float32)
2026-02-21T14:02:01.9055397Z     # src[softmax.py:81]:     di = hl.zeros([tile_m], dtype=torch.float32)
2026-02-21T14:02:01.9055741Z     # src[softmax.py:79-92]: ...
2026-02-21T14:02:01.9056110Z     _launcher(_helion_softmax_two_pass, (4096,), x, out, num_warps=8, num_stages=2)
2026-02-21T14:02:01.9056528Z     # src[softmax.py:93]: return out
2026-02-21T14:02:01.9056770Z     return out
2026-02-21T14:02:03.1722162Z WARNING:tritonbench.utils.triton_op:Completed input ID 97:
2026-02-21T14:02:03.1722574Z (M, N)
2026-02-21T14:02:03.1722776Z -------------
2026-02-21T14:02:03.1723010Z (4096, 12672)
2026-02-21T14:02:03.1723137Z 
2026-02-21T14:02:03.1723647Z 100%|██████████| 20/20 [2:58:58<00:00, 761.13s/it]
2026-02-21T14:02:03.1724227Z 100%|██████████| 20/20 [2:58:58<00:00, 536.92s/it]
2026-02-21T14:02:03.3645137Z INFO:tritonbench.utils.run_utils:[tritonbench] Output result csv to /tmp/tmp1cgxs7jo.csv
2026-02-21T14:02:07.8350035Z        (M, N)    triton_softmax-speedup    triton_softmax-accuracy    torch_compile_softmax-speedup    torch_compile_softmax-accuracy    helion_softmax_tritonbench-speedup    helion_softmax_tritonbench-accuracy
2026-02-21T14:02:07.8351521Z -------------  ------------------------  -------------------------  -------------------------------  --------------------------------  ------------------------------------  -------------------------------------
2026-02-21T14:02:07.8353106Z   (4096, 256)                   0.98726                          1                         1.26119                                  1                               1.34626                                      1
2026-02-21T14:02:07.8355229Z   (4096, 896)                   1.54354                          1                         1.42071                                  1                               2.09756                                      1
2026-02-21T14:02:07.8356133Z  (4096, 1536)                   1.94381                          1                         1.36959                                  1                               2.48058                                      1
2026-02-21T14:02:07.8357336Z  (4096, 2176)                   2.02119                          1                         1.82393                                  1                               2.8982                                       1
2026-02-21T14:02:07.8358229Z  (4096, 2816)                   2.04651                          1                         1.63043                                  1                               2.46461                                      1
2026-02-21T14:02:07.8359100Z  (4096, 3584)                   2.14281                          1                         1.56285                                  1                               2.35064                                      1
2026-02-21T14:02:07.8359961Z  (4096, 4224)                   2.12915                          1                         1.45754                                  1                               2.34756                                      1
2026-02-21T14:02:07.8360803Z  (4096, 4864)                   2.1246                           1                         1.42807                                  1                               2.23245                                      1
2026-02-21T14:02:07.8361672Z  (4096, 5504)                   2.22549                          1                         1.47075                                  1                               2.24021                                      1
2026-02-21T14:02:07.8362543Z  (4096, 6144)                   2.1921                           1                         1.49688                                  1                               2.22512                                      1
2026-02-21T14:02:07.8363297Z  (4096, 6784)                   2.97183                          1                         1.89961                                  1                               2.93715                                      1
2026-02-21T14:02:07.8364192Z  (4096, 7424)                   2.97586                          1                         1.93633                                  1                               2.9494                                       1
2026-02-21T14:02:07.8364930Z  (4096, 8064)                   2.9038                           1                         1.87168                                  1                               2.88155                                      1
2026-02-21T14:02:07.8365609Z  (4096, 8704)                   2.36702                          1                         1.88417                                  1                               2.80549                                      1
2026-02-21T14:02:07.8366309Z  (4096, 9344)                   1.49681                          1                         1.08082                                  1                               1.71787                                      1
2026-02-21T14:02:07.8367007Z (4096, 10112)                   1.48623                          1                         1.07689                                  1                               1.64316                                      1
2026-02-21T14:02:07.8367685Z (4096, 10752)                   1.49458                          1                         1.05569                                  1                               1.58459                                      1
2026-02-21T14:02:07.8368633Z (4096, 11392)                   1.492                            1                         0.952812                                 1                               1.54915                                      1
2026-02-21T14:02:07.8369339Z (4096, 12032)                   1.46812                          1                         0.981995                                 1                               1.4422                                       1
2026-02-21T14:02:07.8370037Z (4096, 12672)                   1.47323                          1                         0.909295                                 1                               1.47551                                      1
2026-02-21T14:02:07.8371010Z       average                   1.9743                           1                         1.42856                                  1                               2.18346                                      1
2026-02-21T14:02:19.3587997Z ✅ Completed benchmark for kernel: softmax
2026-02-21T14:02:19.3602193Z [
2026-02-21T14:02:19.3602486Z   {
2026-02-21T14:02:19.3602695Z     "benchmark": {
2026-02-21T14:02:19.3603208Z       "name": "Helion Benchmark",
2026-02-21T14:02:19.3603516Z       "extra_info": {
2026-02-21T14:02:19.3603753Z         "device": "NVIDIA H100"
2026-02-21T14:02:19.3604376Z       }
2026-02-21T14:02:19.3604595Z     },
2026-02-21T14:02:19.3604828Z     "model": {
2026-02-21T14:02:19.3605044Z       "name": "softmax"
2026-02-21T14:02:19.3605309Z     },
2026-02-21T14:02:19.3605522Z     "metric": {
2026-02-21T14:02:19.3605778Z       "name": "triton_speedup",
2026-02-21T14:02:19.3606052Z       "benchmark_values": [
2026-02-21T14:02:19.3606328Z         0.9872599977881941,
2026-02-21T14:02:19.3606564Z         1.5435437917869932,
2026-02-21T14:02:19.3606859Z         1.943808262700695,
2026-02-21T14:02:19.3607127Z         2.0211893847596913,
2026-02-21T14:02:19.3607364Z         2.0465062963172977,
2026-02-21T14:02:19.3607650Z         2.1428102698776077,
2026-02-21T14:02:19.3607879Z         2.1291465643120646,
2026-02-21T14:02:19.3608133Z         2.1246015149245627,
2026-02-21T14:02:19.3608364Z         2.225489024912755,
2026-02-21T14:02:19.3608621Z         2.1921018530779057,
2026-02-21T14:02:19.3608950Z         2.971829688904039,
2026-02-21T14:02:19.3609211Z         2.9758572410194413,
2026-02-21T14:02:19.3609469Z         2.903804571589343,
2026-02-21T14:02:19.3609694Z         2.3670169540554094,
2026-02-21T14:02:19.3609945Z         1.4968094895002806,
2026-02-21T14:02:19.3610328Z         1.4862273399657744,
2026-02-21T14:02:19.3610607Z         1.4945803156521074,
2026-02-21T14:02:19.3610845Z         1.4919992036471124,
2026-02-21T14:02:19.3611102Z         1.4681151585866963,
2026-02-21T14:02:19.3611329Z         1.4732304569552896
2026-02-21T14:02:19.3611587Z       ]
2026-02-21T14:02:19.3611777Z     },
2026-02-21T14:02:19.3612003Z     "shape": [
2026-02-21T14:02:19.3612244Z       "(4096, 256)",
2026-02-21T14:02:19.3612461Z       "(4096, 896)",
2026-02-21T14:02:19.3612714Z       "(4096, 1536)",
2026-02-21T14:02:19.3612930Z       "(4096, 2176)",
2026-02-21T14:02:19.3613169Z       "(4096, 2816)",
2026-02-21T14:02:19.3613382Z       "(4096, 3584)",
2026-02-21T14:02:19.3613618Z       "(4096, 4224)",
2026-02-21T14:02:19.3613833Z       "(4096, 4864)",
2026-02-21T14:02:19.3614314Z       "(4096, 5504)",
2026-02-21T14:02:19.3614531Z       "(4096, 6144)",
2026-02-21T14:02:19.3614749Z       "(4096, 6784)",
2026-02-21T14:02:19.3614961Z       "(4096, 7424)",
2026-02-21T14:02:19.3615193Z       "(4096, 8064)",
2026-02-21T14:02:19.3615375Z       "(4096, 8704)",
2026-02-21T14:02:19.3615541Z       "(4096, 9344)",
2026-02-21T14:02:19.3615714Z       "(4096, 10112)",
2026-02-21T14:02:19.3615885Z       "(4096, 10752)",
2026-02-21T14:02:19.3616059Z       "(4096, 11392)",
2026-02-21T14:02:19.3616235Z       "(4096, 12032)",
2026-02-21T14:02:19.3616406Z       "(4096, 12672)"
2026-02-21T14:02:19.3616570Z     ]
2026-02-21T14:02:19.3616728Z   },
2026-02-21T14:02:19.3617358Z   {
2026-02-21T14:02:19.3617512Z     "benchmark": {
2026-02-21T14:02:19.3617709Z       "name": "Helion Benchmark",
2026-02-21T14:02:19.3617935Z       "extra_info": {
2026-02-21T14:02:19.3618129Z         "device": "NVIDIA H100"
2026-02-21T14:02:19.3618329Z       }
2026-02-21T14:02:19.3618477Z     },
2026-02-21T14:02:19.3618627Z     "model": {
2026-02-21T14:02:19.3618801Z       "name": "softmax"
2026-02-21T14:02:19.3618979Z     },
2026-02-21T14:02:19.3619133Z     "metric": {
2026-02-21T14:02:19.3619306Z       "name": "triton_accuracy",
2026-02-21T14:02:19.3619535Z       "benchmark_values": [
2026-02-21T14:02:19.3619730Z         1.0,
2026-02-21T14:02:19.3619888Z         1.0,
2026-02-21T14:02:19.3620045Z         1.0,
2026-02-21T14:02:19.3620199Z         1.0,
2026-02-21T14:02:19.3620350Z         1.0,
2026-02-21T14:02:19.3620761Z         1.0,
2026-02-21T14:02:19.3620923Z         1.0,
2026-02-21T14:02:19.3621071Z         1.0,
2026-02-21T14:02:19.3621223Z         1.0,
2026-02-21T14:02:19.3621367Z         1.0,
2026-02-21T14:02:19.3621528Z         1.0,
2026-02-21T14:02:19.3621660Z         1.0,
2026-02-21T14:02:19.3621798Z         1.0,
2026-02-21T14:02:19.3621932Z         1.0,
2026-02-21T14:02:19.3622064Z         1.0,
2026-02-21T14:02:19.3622193Z         1.0,
2026-02-21T14:02:19.3622326Z         1.0,
2026-02-21T14:02:19.3622453Z         1.0,
2026-02-21T14:02:19.3622588Z         1.0,
2026-02-21T14:02:19.3622721Z         1.0
2026-02-21T14:02:19.3622850Z       ]
2026-02-21T14:02:19.3622984Z     },
2026-02-21T14:02:19.3623115Z     "shape": [
2026-02-21T14:02:19.3623276Z       "(4096, 256)",
2026-02-21T14:02:19.3623431Z       "(4096, 896)",
2026-02-21T14:02:19.3623581Z       "(4096, 1536)",
2026-02-21T14:02:19.3623733Z       "(4096, 2176)",
2026-02-21T14:02:19.3623888Z       "(4096, 2816)",
2026-02-21T14:02:19.3624285Z       "(4096, 3584)",
2026-02-21T14:02:19.3624438Z       "(4096, 4224)",
2026-02-21T14:02:19.3624582Z       "(4096, 4864)",
2026-02-21T14:02:19.3624747Z       "(4096, 5504)",
2026-02-21T14:02:19.3624907Z       "(4096, 6144)",
2026-02-21T14:02:19.3625051Z       "(4096, 6784)",
2026-02-21T14:02:19.3625198Z       "(4096, 7424)",
2026-02-21T14:02:19.3625342Z       "(4096, 8064)",
2026-02-21T14:02:19.3625496Z       "(4096, 8704)",
2026-02-21T14:02:19.3625641Z       "(4096, 9344)",
2026-02-21T14:02:19.3625793Z       "(4096, 10112)",
2026-02-21T14:02:19.3625958Z       "(4096, 10752)",
2026-02-21T14:02:19.3626116Z       "(4096, 11392)",
2026-02-21T14:02:19.3626266Z       "(4096, 12032)",
2026-02-21T14:02:19.3626420Z       "(4096, 12672)"
2026-02-21T14:02:19.3626570Z     ]
2026-02-21T14:02:19.3626698Z   },
2026-02-21T14:02:19.3626828Z   {
2026-02-21T14:02:19.3626960Z     "benchmark": {
2026-02-21T14:02:19.3627132Z       "name": "Helion Benchmark",
2026-02-21T14:02:19.3627328Z       "extra_info": {
2026-02-21T14:02:19.3627508Z         "device": "NVIDIA H100"
2026-02-21T14:02:19.3627696Z       }
2026-02-21T14:02:19.3627833Z     },
2026-02-21T14:02:19.3627963Z     "model": {
2026-02-21T14:02:19.3628124Z       "name": "softmax"
2026-02-21T14:02:19.3628290Z     },
2026-02-21T14:02:19.3628428Z     "metric": {
2026-02-21T14:02:19.3628638Z       "name": "torch_compile_speedup",
2026-02-21T14:02:19.3628859Z       "benchmark_values": [
2026-02-21T14:02:19.3629037Z         1.261190736197844,
2026-02-21T14:02:19.3629208Z         1.4207098334850385,
2026-02-21T14:02:19.3629374Z         1.3695926682479103,
2026-02-21T14:02:19.3629546Z         1.823927310696639,
2026-02-21T14:02:19.3629713Z         1.6304286393604388,
2026-02-21T14:02:19.3629881Z         1.5628474439728035,
2026-02-21T14:02:19.3630041Z         1.4575380086583236,
2026-02-21T14:02:19.3630206Z         1.4280657357229043,
2026-02-21T14:02:19.3630368Z         1.4707532179907485,
2026-02-21T14:02:19.3630529Z         1.4968819929641628,
2026-02-21T14:02:19.3630701Z         1.899607902838452,
2026-02-21T14:02:19.3630879Z         1.9363321036237102,
2026-02-21T14:02:19.3631049Z         1.8716753463594777,
2026-02-21T14:02:19.3631208Z         1.884174182731496,
2026-02-21T14:02:19.3631571Z         1.0808152989918831,
2026-02-21T14:02:19.3631742Z         1.076887426866541,
2026-02-21T14:02:19.3631911Z         1.055686326064135,
2026-02-21T14:02:19.3632071Z         0.9528116405651135,
2026-02-21T14:02:19.3632235Z         0.981994881285258,
2026-02-21T14:02:19.3632400Z         0.909295222358827
2026-02-21T14:02:19.3632556Z       ]
2026-02-21T14:02:19.3632688Z     },
2026-02-21T14:02:19.3632821Z     "shape": [
2026-02-21T14:02:19.3632978Z       "(4096, 256)",
2026-02-21T14:02:19.3633131Z       "(4096, 896)",
2026-02-21T14:02:19.3633288Z       "(4096, 1536)",
2026-02-21T14:02:19.3633438Z       "(4096, 2176)",
2026-02-21T14:02:19.3633593Z       "(4096, 2816)",
2026-02-21T14:02:19.3633753Z       "(4096, 3584)",
2026-02-21T14:02:19.3633907Z       "(4096, 4224)",
2026-02-21T14:02:19.3634352Z       "(4096, 4864)",
2026-02-21T14:02:19.3634513Z       "(4096, 5504)",
2026-02-21T14:02:19.3634664Z       "(4096, 6144)",
2026-02-21T14:02:19.3634809Z       "(4096, 6784)",
2026-02-21T14:02:19.3634971Z       "(4096, 7424)",
2026-02-21T14:02:19.3635129Z       "(4096, 8064)",
2026-02-21T14:02:19.3635281Z       "(4096, 8704)",
2026-02-21T14:02:19.3635430Z       "(4096, 9344)",
2026-02-21T14:02:19.3635581Z       "(4096, 10112)",
2026-02-21T14:02:19.3635735Z       "(4096, 10752)",
2026-02-21T14:02:19.3635890Z       "(4096, 11392)",
2026-02-21T14:02:19.3636041Z       "(4096, 12032)",
2026-02-21T14:02:19.3636195Z       "(4096, 12672)"
2026-02-21T14:02:19.3636349Z     ]
2026-02-21T14:02:19.3636478Z   },
2026-02-21T14:02:19.3636614Z   {
2026-02-21T14:02:19.3636745Z     "benchmark": {
2026-02-21T14:02:19.3636915Z       "name": "Helion Benchmark",
2026-02-21T14:02:19.3637106Z       "extra_info": {
2026-02-21T14:02:19.3637275Z         "device": "NVIDIA H100"
2026-02-21T14:02:19.3637446Z       }
2026-02-21T14:02:19.3637584Z     },
2026-02-21T14:02:19.3637724Z     "model": {
2026-02-21T14:02:19.3637877Z       "name": "softmax"
2026-02-21T14:02:19.3638033Z     },
2026-02-21T14:02:19.3638165Z     "metric": {
2026-02-21T14:02:19.3638334Z       "name": "torch_compile_accuracy",
2026-02-21T14:02:19.3638552Z       "benchmark_values": [
2026-02-21T14:02:19.3638723Z         1.0,
2026-02-21T14:02:19.3638857Z         1.0,
2026-02-21T14:02:19.3638992Z         1.0,
2026-02-21T14:02:19.3639119Z         1.0,
2026-02-21T14:02:19.3639265Z         1.0,
2026-02-21T14:02:19.3639397Z         1.0,
2026-02-21T14:02:19.3639529Z         1.0,
2026-02-21T14:02:19.3639655Z         1.0,
2026-02-21T14:02:19.3639788Z         1.0,
2026-02-21T14:02:19.3639918Z         1.0,
2026-02-21T14:02:19.3640055Z         1.0,
2026-02-21T14:02:19.3640182Z         1.0,
2026-02-21T14:02:19.3640317Z         1.0,
2026-02-21T14:02:19.3640453Z         1.0,
2026-02-21T14:02:19.3640582Z         1.0,
2026-02-21T14:02:19.3640925Z         1.0,
2026-02-21T14:02:19.3641097Z         1.0,
2026-02-21T14:02:19.3641305Z         1.0,
2026-02-21T14:02:19.3641462Z         1.0,
2026-02-21T14:02:19.3641602Z         1.0
2026-02-21T14:02:19.3641736Z       ]
2026-02-21T14:02:19.3641867Z     },
2026-02-21T14:02:19.3642002Z     "shape": [
2026-02-21T14:02:19.3642146Z       "(4096, 256)",
2026-02-21T14:02:19.3642307Z       "(4096, 896)",
2026-02-21T14:02:19.3642455Z       "(4096, 1536)",
2026-02-21T14:02:19.3642614Z       "(4096, 2176)",
2026-02-21T14:02:19.3642766Z       "(4096, 2816)",
2026-02-21T14:02:19.3642922Z       "(4096, 3584)",
2026-02-21T14:02:19.3643082Z       "(4096, 4224)",
2026-02-21T14:02:19.3643241Z       "(4096, 4864)",
2026-02-21T14:02:19.3643399Z       "(4096, 5504)",
2026-02-21T14:02:19.3643550Z       "(4096, 6144)",
2026-02-21T14:02:19.3643706Z       "(4096, 6784)",
2026-02-21T14:02:19.3643851Z       "(4096, 7424)",
2026-02-21T14:02:19.3644128Z       "(4096, 8064)",
2026-02-21T14:02:19.3644280Z       "(4096, 8704)",
2026-02-21T14:02:19.3644432Z       "(4096, 9344)",
2026-02-21T14:02:19.3644587Z       "(4096, 10112)",
2026-02-21T14:02:19.3644761Z       "(4096, 10752)",
2026-02-21T14:02:19.3644921Z       "(4096, 11392)",
2026-02-21T14:02:19.3645085Z       "(4096, 12032)",
2026-02-21T14:02:19.3645425Z       "(4096, 12672)"
2026-02-21T14:02:19.3645578Z     ]
2026-02-21T14:02:19.3645728Z   },
2026-02-21T14:02:19.3645855Z   {
2026-02-21T14:02:19.3645992Z     "benchmark": {
2026-02-21T14:02:19.3646159Z       "name": "Helion Benchmark",
2026-02-21T14:02:19.3646363Z       "extra_info": {
2026-02-21T14:02:19.3646527Z         "device": "NVIDIA H100"
2026-02-21T14:02:19.3646709Z       }
2026-02-21T14:02:19.3646850Z     },
2026-02-21T14:02:19.3646990Z     "model": {
2026-02-21T14:02:19.3647143Z       "name": "softmax"
2026-02-21T14:02:19.3647299Z     },
2026-02-21T14:02:19.3647434Z     "metric": {
2026-02-21T14:02:19.3647591Z       "name": "helion_speedup",
2026-02-21T14:02:19.3647787Z       "benchmark_values": [
2026-02-21T14:02:19.3647963Z         1.3462594037103992,
2026-02-21T14:02:19.3648283Z         2.097557883887645,
2026-02-21T14:02:19.3648460Z         2.480580672232898,
2026-02-21T14:02:19.3648635Z         2.8982038044677085,
2026-02-21T14:02:19.3648800Z         2.464613991687056,
2026-02-21T14:02:19.3648982Z         2.350638106845555,
2026-02-21T14:02:19.3649150Z         2.347559517150898,
2026-02-21T14:02:19.3649325Z         2.2324537334549035,
2026-02-21T14:02:19.3649498Z         2.240211830962172,
2026-02-21T14:02:19.3649668Z         2.2251203096295487,
2026-02-21T14:02:19.3649831Z         2.9371540459512224,
2026-02-21T14:02:19.3650006Z         2.949396173896183,
2026-02-21T14:02:19.3650277Z         2.881546989334652,
2026-02-21T14:02:19.3650447Z         2.805492712389589,
2026-02-21T14:02:19.3650610Z         1.7178654383291732,
2026-02-21T14:02:19.3650777Z         1.6431601166436252,
2026-02-21T14:02:19.3650937Z         1.5845934986966042,
2026-02-21T14:02:19.3651108Z         1.549149159318882,
2026-02-21T14:02:19.3651272Z         1.4421982452041664,
2026-02-21T14:02:19.3651440Z         1.4755083724284501
2026-02-21T14:02:19.3651603Z       ]
2026-02-21T14:02:19.3651730Z     },
2026-02-21T14:02:19.3651867Z     "shape": [
2026-02-21T14:02:19.3652009Z       "(4096, 256)",
2026-02-21T14:02:19.3652170Z       "(4096, 896)",
2026-02-21T14:02:19.3652318Z       "(4096, 1536)",
2026-02-21T14:02:19.3652475Z       "(4096, 2176)",
2026-02-21T14:02:19.3652626Z       "(4096, 2816)",
2026-02-21T14:02:19.3652776Z       "(4096, 3584)",
2026-02-21T14:02:19.3652921Z       "(4096, 4224)",
2026-02-21T14:02:19.3653072Z       "(4096, 4864)",
2026-02-21T14:02:19.3653217Z       "(4096, 5504)",
2026-02-21T14:02:19.3653364Z       "(4096, 6144)",
2026-02-21T14:02:19.3653511Z       "(4096, 6784)",
2026-02-21T14:02:19.3653653Z       "(4096, 7424)",
2026-02-21T14:02:19.3653803Z       "(4096, 8064)",
2026-02-21T14:02:19.3653949Z       "(4096, 8704)",
2026-02-21T14:02:19.3654232Z       "(4096, 9344)",
2026-02-21T14:02:19.3654378Z       "(4096, 10112)",
2026-02-21T14:02:19.3654535Z       "(4096, 10752)",
2026-02-21T14:02:19.3654687Z       "(4096, 11392)",
2026-02-21T14:02:19.3654855Z       "(4096, 12032)",
2026-02-21T14:02:19.3655006Z       "(4096, 12672)"
2026-02-21T14:02:19.3655157Z     ]
2026-02-21T14:02:19.3655288Z   },
2026-02-21T14:02:19.3655418Z   {
2026-02-21T14:02:19.3655553Z     "benchmark": {
2026-02-21T14:02:19.3655719Z       "name": "Helion Benchmark",
2026-02-21T14:02:19.3655918Z       "extra_info": {
2026-02-21T14:02:19.3656081Z         "device": "NVIDIA H100"
2026-02-21T14:02:19.3656268Z       }
2026-02-21T14:02:19.3656393Z     },
2026-02-21T14:02:19.3656532Z     "model": {
2026-02-21T14:02:19.3656678Z       "name": "softmax"
2026-02-21T14:02:19.3656839Z     },
2026-02-21T14:02:19.3656968Z     "metric": {
2026-02-21T14:02:19.3657137Z       "name": "helion_accuracy",
2026-02-21T14:02:19.3657333Z       "benchmark_values": [
2026-02-21T14:02:19.3657511Z         1.0,
2026-02-21T14:02:19.3657656Z         1.0,
2026-02-21T14:02:19.3657804Z         1.0,
2026-02-21T14:02:19.3657945Z         1.0,
2026-02-21T14:02:19.3658081Z         1.0,
2026-02-21T14:02:19.3658223Z         1.0,
2026-02-21T14:02:19.3658355Z         1.0,
2026-02-21T14:02:19.3658494Z         1.0,
2026-02-21T14:02:19.3658624Z         1.0,
2026-02-21T14:02:19.3658941Z         1.0,
2026-02-21T14:02:19.3659074Z         1.0,
2026-02-21T14:02:19.3659217Z         1.0,
2026-02-21T14:02:19.3659347Z         1.0,
2026-02-21T14:02:19.3659491Z         1.0,
2026-02-21T14:02:19.3659633Z         1.0,
2026-02-21T14:02:19.3659763Z         1.0,
2026-02-21T14:02:19.3659895Z         1.0,
2026-02-21T14:02:19.3660026Z         1.0,
2026-02-21T14:02:19.3660158Z         1.0,
2026-02-21T14:02:19.3660285Z         1.0
2026-02-21T14:02:19.3660420Z       ]
2026-02-21T14:02:19.3660543Z     },
2026-02-21T14:02:19.3660678Z     "shape": [
2026-02-21T14:02:19.3660826Z       "(4096, 256)",
2026-02-21T14:02:19.3660993Z       "(4096, 896)",
2026-02-21T14:02:19.3661144Z       "(4096, 1536)",
2026-02-21T14:02:19.3661298Z       "(4096, 2176)",
2026-02-21T14:02:19.3661449Z       "(4096, 2816)",
2026-02-21T14:02:19.3661777Z       "(4096, 3584)",
2026-02-21T14:02:19.3661946Z       "(4096, 4224)",
2026-02-21T14:02:19.3662094Z       "(4096, 4864)",
2026-02-21T14:02:19.3662244Z       "(4096, 5504)",
2026-02-21T14:02:19.3662395Z       "(4096, 6144)",
2026-02-21T14:02:19.3662542Z       "(4096, 6784)",
2026-02-21T14:02:19.3662688Z       "(4096, 7424)",
2026-02-21T14:02:19.3662837Z       "(4096, 8064)",
2026-02-21T14:02:19.3662980Z       "(4096, 8704)",
2026-02-21T14:02:19.3663130Z       "(4096, 9344)",
2026-02-21T14:02:19.3663275Z       "(4096, 10112)",
2026-02-21T14:02:19.3663433Z       "(4096, 10752)",
2026-02-21T14:02:19.3663589Z       "(4096, 11392)",
2026-02-21T14:02:19.3663736Z       "(4096, 12032)",
2026-02-21T14:02:19.3663890Z       "(4096, 12672)"
2026-02-21T14:02:19.3664162Z     ]
2026-02-21T14:02:19.3664298Z   }
2026-02-21T14:02:19.3664434Z ]
2026-02-21T14:02:19.3982982Z ##[group]Run pytorch/test-infra/.github/actions/gather-benchmark-metadata@main
2026-02-21T14:02:19.3983374Z with:
2026-02-21T14:02:19.3983913Z   github-token: ***
2026-02-21T14:02:19.3984267Z   venv: .venv/bin/activate
2026-02-21T14:02:19.3984461Z   schema-version: v3
2026-02-21T14:02:19.3984623Z env:
2026-02-21T14:02:19.3984786Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:19.3985043Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.3985363Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:19.3985675Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.3985943Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.3986211Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.3986526Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:19.3986899Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:19.3987224Z ##[endgroup]
2026-02-21T14:02:19.4057278Z ##[group]Run set -eux
2026-02-21T14:02:19.4057484Z set -eux
2026-02-21T14:02:19.4057644Z 
2026-02-21T14:02:19.4057816Z if [[ -z "${GITHUB_TOKEN}" ]]; then
2026-02-21T14:02:19.4058077Z   echo "Missing github-token input"
2026-02-21T14:02:19.4058309Z   exit 1
2026-02-21T14:02:19.4058464Z fi
2026-02-21T14:02:19.4059392Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T14:02:19.4059656Z env:
2026-02-21T14:02:19.4059820Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:19.4060060Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.4060385Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:19.4060704Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.4060965Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.4061225Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:19.4061545Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:19.4061903Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:19.4062352Z   GITHUB_TOKEN: ***
2026-02-21T14:02:19.4062525Z ##[endgroup]
2026-02-21T14:02:19.8592487Z + [[ -z *** ]]
2026-02-21T14:02:20.0035759Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main
2026-02-21T14:02:20.0036417Z with:
2026-02-21T14:02:20.0036775Z   github-token: ***
2026-02-21T14:02:20.0036957Z env:
2026-02-21T14:02:20.0037117Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:20.0037350Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0037655Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:20.0037970Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0038247Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0038506Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0038827Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:20.0039190Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:20.0039461Z ##[endgroup]
2026-02-21T14:02:20.0052673Z ##[group]Run set -eux
2026-02-21T14:02:20.0052880Z set -eux
2026-02-21T14:02:20.0053042Z 
2026-02-21T14:02:20.0053411Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2026-02-21T14:02:20.0053965Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T14:02:20.0054388Z env:
2026-02-21T14:02:20.0054556Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:20.0054815Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0055124Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:20.0055428Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0055701Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0056278Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:20.0056646Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:20.0057014Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:20.0057422Z   GITHUB_TOKEN: ***
2026-02-21T14:02:20.0057593Z ##[endgroup]
2026-02-21T14:02:20.2637162Z + python3 /__w/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 22253280836 i-094f68f2a7449fe73-1004
2026-02-21T14:02:22.3665454Z setting job-id=64380330152
2026-02-21T14:02:22.3665928Z setting job-name=run-h100 (softmax) / benchmark-cu128-softmax-py3.12-h100
2026-02-21T14:02:22.3898634Z ##[group]Run set -eux
2026-02-21T14:02:22.3898860Z set -eux
2026-02-21T14:02:22.3899013Z 
2026-02-21T14:02:22.3899199Z if [[ -n ".venv/bin/activate" ]]; then
2026-02-21T14:02:22.3899459Z   source ".venv/bin/activate"
2026-02-21T14:02:22.3899685Z fi
2026-02-21T14:02:22.3899860Z 
2026-02-21T14:02:22.3900149Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \
2026-02-21T14:02:22.3900533Z   --schema-version "${SCHEMA_VERSION}" \
2026-02-21T14:02:22.3900794Z   --repo "${REPO}" \
2026-02-21T14:02:22.3901012Z   --head-branch "${HEAD_BRANCH}" \
2026-02-21T14:02:22.3901265Z   --head-sha "${HEAD_SHA}" \
2026-02-21T14:02:22.3901501Z   --workflow-id "${WORKFLOW_RUN_ID}" \
2026-02-21T14:02:22.3901763Z   --run-attempt "${RUN_ATTEMPT}" \
2026-02-21T14:02:22.3901999Z   --job-id "${JOB_ID}" \
2026-02-21T14:02:22.3902207Z   --job-name "${JOB_NAME}"
2026-02-21T14:02:22.3902533Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T14:02:22.3902774Z env:
2026-02-21T14:02:22.3902930Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:22.3903170Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.3903492Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:22.3903797Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.3904276Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.3904555Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.3904875Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:22.3905541Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:22.3905812Z   SCHEMA_VERSION: v3
2026-02-21T14:02:22.3905991Z   REPO: pytorch/helion
2026-02-21T14:02:22.3906173Z   HEAD_BRANCH: refs/heads/main
2026-02-21T14:02:22.3906397Z   HEAD_SHA: 874a7d0cadab18218a84ad3579d329dc95c51820
2026-02-21T14:02:22.3906670Z   WORKFLOW_RUN_ID: 22253280836
2026-02-21T14:02:22.3906857Z   RUN_ATTEMPT: 1
2026-02-21T14:02:22.3907015Z   JOB_ID: 64380330152
2026-02-21T14:02:22.3907268Z   JOB_NAME: run-h100 (softmax) / benchmark-cu128-softmax-py3.12-h100
2026-02-21T14:02:22.3907577Z ##[endgroup]
2026-02-21T14:02:22.6484653Z + [[ -n .venv/bin/activate ]]
2026-02-21T14:02:22.6485195Z + source .venv/bin/activate
2026-02-21T14:02:22.6485591Z ++ '[' -z '' ']'
2026-02-21T14:02:22.6485909Z ++ '[' -n x ']'
2026-02-21T14:02:22.6486264Z ++ SCRIPT_PATH=.venv/bin/activate
2026-02-21T14:02:22.6486895Z ++ '[' .venv/bin/activate = /__w/_temp/a16d72fd-07e4-414b-a8fa-de55e1aa7b70.sh ']'
2026-02-21T14:02:22.6487597Z ++ deactivate nondestructive
2026-02-21T14:02:22.6487985Z ++ unset -f pydoc
2026-02-21T14:02:22.6488293Z ++ '[' -z '' ']'
2026-02-21T14:02:22.6488583Z ++ '[' -z '' ']'
2026-02-21T14:02:22.6488857Z ++ hash -r
2026-02-21T14:02:22.6489132Z ++ '[' -z '' ']'
2026-02-21T14:02:22.6489421Z ++ unset VIRTUAL_ENV
2026-02-21T14:02:22.6489786Z ++ unset VIRTUAL_ENV_PROMPT
2026-02-21T14:02:22.6490423Z ++ '[' '!' nondestructive = nondestructive ']'
2026-02-21T14:02:22.6490905Z ++ VIRTUAL_ENV=/__w/helion/helion/.venv
2026-02-21T14:02:22.6493942Z ++ '[' linux-gnu = cygwin ']'
2026-02-21T14:02:22.6494296Z ++ '[' linux-gnu = msys ']'
2026-02-21T14:02:22.6496314Z ++ export VIRTUAL_ENV
2026-02-21T14:02:22.6496530Z ++ '[' -z '' ']'
2026-02-21T14:02:22.6496720Z ++ unset SCRIPT_PATH
2026-02-21T14:02:22.6497603Z ++ _OLD_VIRTUAL_PATH=/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T14:02:22.6499229Z ++ PATH=/__w/helion/helion/.venv/bin:/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T14:02:22.6500173Z ++ export PATH
2026-02-21T14:02:22.6500347Z ++ '[' xhelion '!=' x ']'
2026-02-21T14:02:22.6500561Z ++ VIRTUAL_ENV_PROMPT=helion
2026-02-21T14:02:22.6500779Z ++ export VIRTUAL_ENV_PROMPT
2026-02-21T14:02:22.6500984Z ++ '[' -z '' ']'
2026-02-21T14:02:22.6501153Z ++ '[' -z '' ']'
2026-02-21T14:02:22.6501324Z ++ _OLD_VIRTUAL_PS1=
2026-02-21T14:02:22.6501510Z ++ PS1='(helion) '
2026-02-21T14:02:22.6501679Z ++ export PS1
2026-02-21T14:02:22.6501845Z ++ alias pydoc
2026-02-21T14:02:22.6502007Z ++ true
2026-02-21T14:02:22.6502164Z ++ hash -r
2026-02-21T14:02:22.6503601Z + python3 /__w/_actions/pytorch/test-infra/main/.github/actions/gather-benchmark-metadata/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/helion --head-branch refs/heads/main --head-sha 874a7d0cadab18218a84ad3579d329dc95c51820 --workflow-id 22253280836 --run-attempt 1 --job-id 64380330152 --job-name 'run-h100 (softmax) / benchmark-cu128-softmax-py3.12-h100'
2026-02-21T14:02:22.6972357Z ##[group]Run pytorch/test-infra/.github/actions/gather-runners-info@main
2026-02-21T14:02:22.6972727Z with:
2026-02-21T14:02:22.6972896Z   venv: .venv/bin/activate
2026-02-21T14:02:22.6973073Z env:
2026-02-21T14:02:22.6973231Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:22.6973472Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6973778Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:22.6974268Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6974551Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6974805Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6975360Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:22.6975730Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:22.6975999Z ##[endgroup]
2026-02-21T14:02:22.6989006Z ##[group]Run set -eux
2026-02-21T14:02:22.6989278Z set -eux
2026-02-21T14:02:22.6989440Z 
2026-02-21T14:02:22.6989618Z if command -v nvidia-smi; then
2026-02-21T14:02:22.6989853Z   DEVICE_NAME=cuda
2026-02-21T14:02:22.6990052Z   nvidia-smi
2026-02-21T14:02:22.6990243Z elif command -v rocm-smi; then
2026-02-21T14:02:22.6990475Z   DEVICE_NAME=rocm
2026-02-21T14:02:22.6990660Z   rocm-smi
2026-02-21T14:02:22.6990839Z elif command -v hl-smi; then
2026-02-21T14:02:22.6991056Z   DEVICE_NAME=hpu
2026-02-21T14:02:22.6991237Z   hl-smi
2026-02-21T14:02:22.6991393Z else
2026-02-21T14:02:22.6991548Z   arch=$(uname -m)
2026-02-21T14:02:22.6991746Z 
2026-02-21T14:02:22.6991887Z   case "$arch" in
2026-02-21T14:02:22.6992071Z     aarch64|arm64)
2026-02-21T14:02:22.6992265Z       DEVICE_NAME=arm64-cpu
2026-02-21T14:02:22.6992469Z       ;;
2026-02-21T14:02:22.6992615Z     *)
2026-02-21T14:02:22.6992782Z       DEVICE_NAME=cpu
2026-02-21T14:02:22.6992991Z       ;;
2026-02-21T14:02:22.6993134Z   esac
2026-02-21T14:02:22.6993286Z   lscpu
2026-02-21T14:02:22.6993433Z fi
2026-02-21T14:02:22.6993630Z echo "DEVICE_NAME=$DEVICE_NAME" >> $GITHUB_ENV
2026-02-21T14:02:22.6994228Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T14:02:22.6994478Z env:
2026-02-21T14:02:22.6994640Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:22.6994882Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6995240Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:22.6995543Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6995810Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6996066Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:22.6996391Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:22.6996754Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:22.6997024Z ##[endgroup]
2026-02-21T14:02:22.9551045Z + command -v nvidia-smi
2026-02-21T14:02:22.9551277Z + DEVICE_NAME=cuda
2026-02-21T14:02:22.9551478Z + nvidia-smi
2026-02-21T14:02:22.9551675Z /usr/bin/nvidia-smi
2026-02-21T14:02:22.9742778Z Sat Feb 21 14:02:22 2026       
2026-02-21T14:02:22.9743150Z +-----------------------------------------------------------------------------------------+
2026-02-21T14:02:22.9743676Z | NVIDIA-SMI 580.95.05              Driver Version: 580.95.05      CUDA Version: 13.0     |
2026-02-21T14:02:22.9744470Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T14:02:22.9745008Z | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
2026-02-21T14:02:22.9745548Z | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
2026-02-21T14:02:22.9746383Z |                                         |                        |               MIG M. |
2026-02-21T14:02:22.9746771Z |=========================================+========================+======================|
2026-02-21T14:02:22.9961088Z |   0  NVIDIA H100 80GB HBM3          On  |   00000000:86:00.0 Off |                    0 |
2026-02-21T14:02:22.9961709Z | N/A   35C    P0             75W /  500W |       0MiB /  81559MiB |      0%      Default |
2026-02-21T14:02:22.9962202Z |                                         |                        |             Disabled |
2026-02-21T14:02:22.9962709Z +-----------------------------------------+------------------------+----------------------+
2026-02-21T14:02:22.9964973Z 
2026-02-21T14:02:22.9965748Z +-----------------------------------------------------------------------------------------+
2026-02-21T14:02:22.9966476Z | Processes:                                                                              |
2026-02-21T14:02:22.9967179Z |  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
2026-02-21T14:02:22.9967845Z |        ID   ID                                                               Usage      |
2026-02-21T14:02:22.9968399Z |=========================================================================================|
2026-02-21T14:02:22.9971758Z |  No running processes found                                                             |
2026-02-21T14:02:22.9972500Z +-----------------------------------------------------------------------------------------+
2026-02-21T14:02:23.0741590Z + echo DEVICE_NAME=cuda
2026-02-21T14:02:23.1825142Z ##[group]Run set -eux
2026-02-21T14:02:23.1825379Z set -eux
2026-02-21T14:02:23.1825532Z 
2026-02-21T14:02:23.1825728Z if [[ "${DEVICE_NAME}" == "cuda" ]]; then
2026-02-21T14:02:23.1826007Z   # Return the same device name as PyTorch
2026-02-21T14:02:23.1826362Z   DEVICE_TYPE=$(nvidia-smi -i 0 --query-gpu=name --format=csv,noheader)
2026-02-21T14:02:23.1826772Z elif [[ "${DEVICE_NAME}" == "rocm" ]]; then
2026-02-21T14:02:23.1827204Z   DEVICE_TYPE=$(rocminfo | grep "Marketing Name" | tail -n1 | awk -F':' '{print $2}' | xargs)
2026-02-21T14:02:23.1827635Z elif [[ "${DEVICE_NAME}" == "hpu" ]]; then
2026-02-21T14:02:23.1828119Z   DEVICE_TYPE="Intel Gaudi3 "$(hl-smi -q | grep "Product Name" | head -n 1 | awk -F ':' '{print $2}' | sed 's/^ *//')
2026-02-21T14:02:23.1828578Z elif [[ "${DEVICE_NAME}" == "cpu" ]]; then
2026-02-21T14:02:23.1829466Z   DEVICE_TYPE="$(lscpu | grep "Model name" | sed -E 's/.*Model name:[[:space:]]*//; s/Intel\(R\)//g; s/\(R\)//g; s/\(TM\)//g; s/CPU//g; s/Processor//g; s/[[:space:]]+/ /g; s/^ //; s/ $//; s/ /_/g')_$(awk -F: '/Core\(s\) per socket/ {c=$2} /Socket\(s\)/ {s=$2} END {gsub(/ /,"",c); gsub(/ /,"",s); printf "%sc", c*s}' < <(lscpu))"
2026-02-21T14:02:23.1830408Z elif [[ "${DEVICE_NAME}" == "arm64-cpu" ]]; then
2026-02-21T14:02:23.1830813Z   DEVICE_TYPE=$(lscpu | grep 'Vendor ID' | cut -f 2 -d ":" | awk '{$1=$1}1' | cut -f 2 -d " ")
2026-02-21T14:02:23.1831170Z fi
2026-02-21T14:02:23.1831364Z echo "DEVICE_TYPE=$DEVICE_TYPE" >> $GITHUB_ENV
2026-02-21T14:02:23.1831748Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T14:02:23.1832004Z env:
2026-02-21T14:02:23.1832156Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:23.1832398Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.1832698Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:23.1832999Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.1833260Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.1833522Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.1833839Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:23.1834332Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:23.1834888Z   DEVICE_NAME: cuda
2026-02-21T14:02:23.1835065Z ##[endgroup]
2026-02-21T14:02:23.3809407Z + [[ cuda == \c\u\d\a ]]
2026-02-21T14:02:23.3815611Z ++ nvidia-smi -i 0 --query-gpu=name --format=csv,noheader
2026-02-21T14:02:23.4042972Z + DEVICE_TYPE='NVIDIA H100 80GB HBM3'
2026-02-21T14:02:23.4043270Z + echo 'DEVICE_TYPE=NVIDIA H100 80GB HBM3'
2026-02-21T14:02:23.4353233Z ##[group]Run set -eux
2026-02-21T14:02:23.4353482Z set -eux
2026-02-21T14:02:23.4353663Z 
2026-02-21T14:02:23.4353879Z if [[ -n ".venv/bin/activate" ]]; then
2026-02-21T14:02:23.4354367Z   source ".venv/bin/activate"
2026-02-21T14:02:23.4354602Z fi
2026-02-21T14:02:23.4354755Z 
2026-02-21T14:02:23.4355346Z python3 -mpip install psutil==7.0.0 nvidia-ml-py==13.580.82
2026-02-21T14:02:23.4355803Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_runners_info.py"
2026-02-21T14:02:23.4356286Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T14:02:23.4356557Z env:
2026-02-21T14:02:23.4356716Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:23.4356971Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.4357278Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:23.4357581Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.4357845Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.4358100Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:23.4358416Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:23.4358770Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:23.4359041Z   DEVICE_NAME: cuda
2026-02-21T14:02:23.4359215Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T14:02:23.4359432Z ##[endgroup]
2026-02-21T14:02:23.5816490Z + [[ -n .venv/bin/activate ]]
2026-02-21T14:02:23.5816824Z + source .venv/bin/activate
2026-02-21T14:02:23.5817080Z ++ '[' -z '' ']'
2026-02-21T14:02:23.5817310Z ++ '[' -n x ']'
2026-02-21T14:02:23.5817537Z ++ SCRIPT_PATH=.venv/bin/activate
2026-02-21T14:02:23.5817935Z ++ '[' .venv/bin/activate = /__w/_temp/69425958-4bbb-4ba3-8857-b1fb153ba60d.sh ']'
2026-02-21T14:02:23.5818371Z ++ deactivate nondestructive
2026-02-21T14:02:23.5818623Z ++ unset -f pydoc
2026-02-21T14:02:23.5818838Z ++ '[' -z '' ']'
2026-02-21T14:02:23.5819033Z ++ '[' -z '' ']'
2026-02-21T14:02:23.5819222Z ++ hash -r
2026-02-21T14:02:23.5819398Z ++ '[' -z '' ']'
2026-02-21T14:02:23.5819589Z ++ unset VIRTUAL_ENV
2026-02-21T14:02:23.5819805Z ++ unset VIRTUAL_ENV_PROMPT
2026-02-21T14:02:23.5820083Z ++ '[' '!' nondestructive = nondestructive ']'
2026-02-21T14:02:23.5820386Z ++ VIRTUAL_ENV=/__w/helion/helion/.venv
2026-02-21T14:02:23.5823707Z ++ '[' linux-gnu = cygwin ']'
2026-02-21T14:02:23.5823929Z ++ '[' linux-gnu = msys ']'
2026-02-21T14:02:23.5825926Z ++ export VIRTUAL_ENV
2026-02-21T14:02:23.5826122Z ++ '[' -z '' ']'
2026-02-21T14:02:23.5826306Z ++ unset SCRIPT_PATH
2026-02-21T14:02:23.5827208Z ++ _OLD_VIRTUAL_PATH=/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T14:02:23.5828885Z ++ PATH=/__w/helion/helion/.venv/bin:/github/home/.local/share/uv/python:/__w/_tool/uv/0.10.4/x86_64:/github/home/.local/bin:/__w/_tool/Python/3.12.12/x64/bin:/__w/_tool/Python/3.12.12/x64:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2026-02-21T14:02:23.5829900Z ++ export PATH
2026-02-21T14:02:23.5830089Z ++ '[' xhelion '!=' x ']'
2026-02-21T14:02:23.5830295Z ++ VIRTUAL_ENV_PROMPT=helion
2026-02-21T14:02:23.5830524Z ++ export VIRTUAL_ENV_PROMPT
2026-02-21T14:02:23.5830726Z ++ '[' -z '' ']'
2026-02-21T14:02:23.5830900Z ++ '[' -z '' ']'
2026-02-21T14:02:23.5831065Z ++ _OLD_VIRTUAL_PS1=
2026-02-21T14:02:23.5831250Z ++ PS1='(helion) '
2026-02-21T14:02:23.5831427Z ++ export PS1
2026-02-21T14:02:23.5831945Z ++ alias pydoc
2026-02-21T14:02:23.5832125Z ++ true
2026-02-21T14:02:23.5832273Z ++ hash -r
2026-02-21T14:02:23.5832519Z + python3 -mpip install psutil==7.0.0 nvidia-ml-py==13.580.82
2026-02-21T14:02:27.3116525Z Collecting psutil==7.0.0
2026-02-21T14:02:27.4593416Z   Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (22 kB)
2026-02-21T14:02:29.9917927Z Collecting nvidia-ml-py==13.580.82
2026-02-21T14:02:30.1914851Z   Downloading nvidia_ml_py-13.580.82-py3-none-any.whl.metadata (9.6 kB)
2026-02-21T14:02:31.2950972Z Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB)
2026-02-21T14:02:32.3610941Z Downloading nvidia_ml_py-13.580.82-py3-none-any.whl (49 kB)
2026-02-21T14:02:33.8816202Z Installing collected packages: nvidia-ml-py, psutil
2026-02-21T14:02:33.8821399Z   Attempting uninstall: nvidia-ml-py
2026-02-21T14:02:33.8840326Z     Found existing installation: nvidia-ml-py 13.590.48
2026-02-21T14:02:33.8858527Z     Uninstalling nvidia-ml-py-13.590.48:
2026-02-21T14:02:34.4793476Z       Successfully uninstalled nvidia-ml-py-13.590.48
2026-02-21T14:02:35.6628994Z   Attempting uninstall: psutil
2026-02-21T14:02:35.8019932Z     Found existing installation: psutil 7.2.2
2026-02-21T14:02:35.8043881Z     Uninstalling psutil-7.2.2:
2026-02-21T14:02:35.9405015Z       Successfully uninstalled psutil-7.2.2
2026-02-21T14:02:38.0977542Z 
2026-02-21T14:02:38.1032535Z Successfully installed nvidia-ml-py-13.580.82 psutil-7.0.0
2026-02-21T14:02:40.1250666Z + python3 /__w/_actions/pytorch/test-infra/main/.github/actions/gather-runners-info/../../scripts/benchmarks/gather_runners_info.py
2026-02-21T14:02:42.1238624Z ##[group]Run pytorch/test-infra/.github/actions/gather-dependencies@main
2026-02-21T14:02:42.1238994Z with:
2026-02-21T14:02:42.1239171Z   venv: .venv/bin/activate
2026-02-21T14:02:42.1239360Z env:
2026-02-21T14:02:42.1239519Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:42.1239773Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1240083Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:42.1240389Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1240659Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1240928Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1241247Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:42.1241609Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:42.1241881Z   DEVICE_NAME: cuda
2026-02-21T14:02:42.1242051Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T14:02:42.1242302Z ##[endgroup]
2026-02-21T14:02:42.1892944Z ##[group]Run set -eux
2026-02-21T14:02:42.1893169Z set -eux
2026-02-21T14:02:42.1893333Z 
2026-02-21T14:02:42.1893526Z # TODO (huydhn): Implement this part
2026-02-21T14:02:42.1893852Z echo "dependencies={}" >> "${GITHUB_OUTPUT}"
2026-02-21T14:02:42.1894444Z shell: bash --noprofile --norc -e -o pipefail {0}
2026-02-21T14:02:42.1894715Z env:
2026-02-21T14:02:42.1894884Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:42.1895144Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1895506Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:42.1895847Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1896138Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1896433Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.1896791Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:42.1897215Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:42.1897514Z   DEVICE_NAME: cuda
2026-02-21T14:02:42.1897691Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T14:02:42.1897903Z ##[endgroup]
2026-02-21T14:02:42.3616709Z + echo 'dependencies={}'
2026-02-21T14:02:42.3686605Z ##[group]Run actions/upload-artifact@v6
2026-02-21T14:02:42.3686885Z with:
2026-02-21T14:02:42.3687061Z   name: benchmark-results-h100-softmax
2026-02-21T14:02:42.3687302Z   path: test/test-reports
2026-02-21T14:02:42.3687500Z   if-no-files-found: warn
2026-02-21T14:02:42.3687688Z   compression-level: 6
2026-02-21T14:02:42.3687860Z   overwrite: false
2026-02-21T14:02:42.3688039Z   include-hidden-files: false
2026-02-21T14:02:42.3688229Z env:
2026-02-21T14:02:42.3688376Z   HELION_AUTOTUNE_LOG_LEVEL: INFO
2026-02-21T14:02:42.3688617Z   pythonLocation: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.3688918Z   PKG_CONFIG_PATH: /__w/_tool/Python/3.12.12/x64/lib/pkgconfig
2026-02-21T14:02:42.3689507Z   Python_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.3689774Z   Python2_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.3690129Z   Python3_ROOT_DIR: /__w/_tool/Python/3.12.12/x64
2026-02-21T14:02:42.3690558Z   LD_LIBRARY_PATH: /__w/_tool/Python/3.12.12/x64/lib:/usr/local/cuda/lib64
2026-02-21T14:02:42.3690956Z   UV_PYTHON_INSTALL_DIR: /github/home/.local/share/uv/python
2026-02-21T14:02:42.3691232Z   DEVICE_NAME: cuda
2026-02-21T14:02:42.3691404Z   DEVICE_TYPE: NVIDIA H100 80GB HBM3
2026-02-21T14:02:42.3691622Z ##[endgroup]
2026-02-21T14:02:42.3694474Z ##[command]/usr/bin/docker exec  37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T14:02:42.7519529Z With the provided path, there will be 1 file uploaded
2026-02-21T14:02:42.7524265Z Artifact name is valid!
2026-02-21T14:02:42.7525091Z Root directory input is valid!
2026-02-21T14:02:43.0091707Z Beginning upload of artifact content to blob storage
2026-02-21T14:02:43.0092286Z Uploaded bytes 1071
2026-02-21T14:02:43.0283845Z Finished uploading artifact content to blob storage!
2026-02-21T14:02:43.0284995Z SHA256 digest of uploaded artifact zip is f46ba3542c7825547c900b2b39cc39d27a8dceb3462849c699193dd8cfa16d6f
2026-02-21T14:02:43.0286439Z Finalizing artifact upload
2026-02-21T14:02:43.1339965Z Artifact benchmark-results-h100-softmax.zip successfully finalized. Artifact ID 5601592574
2026-02-21T14:02:43.1340847Z Artifact benchmark-results-h100-softmax has been successfully uploaded! Final size is 1071 bytes. Artifact ID is 5601592574
2026-02-21T14:02:43.1343852Z Artifact download URL: https://github.com/pytorch/helion/actions/runs/22253280836/artifacts/5601592574
2026-02-21T14:02:43.2829657Z Post job cleanup.
2026-02-21T14:02:43.2834691Z ##[command]/usr/bin/docker exec  37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T14:02:43.6449810Z UV_PYTHON_INSTALL_DIR is already set to /github/home/.local/share/uv/python
2026-02-21T14:02:43.6453225Z (node:557160) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.
2026-02-21T14:02:43.6454155Z (Use `node --trace-deprecation ...` to show where the warning was created)
2026-02-21T14:02:43.7364745Z Post job cleanup.
2026-02-21T14:02:43.7368092Z ##[command]/usr/bin/docker exec  37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T14:02:44.3024589Z Post job cleanup.
2026-02-21T14:02:44.3028533Z ##[command]/usr/bin/docker exec  37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640 sh -c "cat /etc/*release | grep ^ID"
2026-02-21T14:02:44.6846077Z [command]/usr/bin/git version
2026-02-21T14:02:44.6887778Z git version 2.43.0
2026-02-21T14:02:44.7319209Z Temporarily overriding HOME='/__w/_temp/316c947b-2a13-4444-924b-c59c5686e099' before making global git config changes
2026-02-21T14:02:44.7320124Z Adding repository directory to the temporary git global config as a safe directory
2026-02-21T14:02:44.7330731Z [command]/usr/bin/git config --global --add safe.directory /__w/helion/helion
2026-02-21T14:02:44.8963756Z Removing SSH command configuration
2026-02-21T14:02:44.8969462Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2026-02-21T14:02:44.9005758Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2026-02-21T14:02:44.9313070Z Removing HTTP extra header
2026-02-21T14:02:44.9316472Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2026-02-21T14:02:44.9349264Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2026-02-21T14:02:44.9640192Z Removing includeIf entries pointing to credentials config files
2026-02-21T14:02:44.9643721Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir:
2026-02-21T14:02:44.9670740Z includeif.gitdir:/__w/helion/helion/.git.path
2026-02-21T14:02:44.9671134Z includeif.gitdir:/__w/helion/helion/.git/worktrees/*.path
2026-02-21T14:02:44.9671535Z includeif.gitdir:/github/workspace/.git.path
2026-02-21T14:02:44.9671906Z includeif.gitdir:/github/workspace/.git/worktrees/*.path
2026-02-21T14:02:44.9680454Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/__w/helion/helion/.git.path
2026-02-21T14:02:44.9705179Z /__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:44.9712868Z [command]/usr/bin/git config --local --unset includeif.gitdir:/__w/helion/helion/.git.path /__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:45.2654571Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/__w/helion/helion/.git/worktrees/*.path
2026-02-21T14:02:45.2681766Z /__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:45.2691526Z [command]/usr/bin/git config --local --unset includeif.gitdir:/__w/helion/helion/.git/worktrees/*.path /__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:45.5165064Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/github/workspace/.git.path
2026-02-21T14:02:45.5190036Z /github/runner_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:45.5198122Z [command]/usr/bin/git config --local --unset includeif.gitdir:/github/workspace/.git.path /github/runner_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:45.7523648Z [command]/usr/bin/git config --local --get-all includeif.gitdir:/github/workspace/.git/worktrees/*.path
2026-02-21T14:02:45.7552574Z /github/runner_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:45.7561970Z [command]/usr/bin/git config --local --unset includeif.gitdir:/github/workspace/.git/worktrees/*.path /github/runner_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config
2026-02-21T14:02:45.8029084Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url
2026-02-21T14:02:45.8327835Z Removing credentials config '/__w/_temp/git-credentials-e60a039a-939a-4086-a59c-13d3559e5baf.config'
2026-02-21T14:02:45.8477858Z Stop and remove container: 5f739eec64c34cfd821ea03384ecf4e3_nvidiacuda1281develubuntu2404_5b52ed
2026-02-21T14:02:45.8482218Z ##[command]/usr/bin/docker rm --force 37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640
2026-02-21T14:04:30.6974818Z 37a2f203a45b29ec331a476456c0ccabed98bf27c7d00ca920cab22950830640
2026-02-21T14:04:30.7038973Z Remove container network: github_network_9d5d9ac0f22e44959724a92a47e0c2ce
2026-02-21T14:04:30.7043121Z ##[command]/usr/bin/docker network rm github_network_9d5d9ac0f22e44959724a92a47e0c2ce
2026-02-21T14:04:31.7905604Z github_network_9d5d9ac0f22e44959724a92a47e0c2ce
2026-02-21T14:04:31.7978754Z Evaluate and set job outputs
2026-02-21T14:04:31.7984733Z Set output 'benchmark-metadata'
2026-02-21T14:04:31.7987189Z Set output 'runners-info'
2026-02-21T14:04:31.7987724Z Set output 'dependencies'
2026-02-21T14:04:31.7988404Z Cleaning up orphan processes