2026-09-07T10:26:21.976566Z  INFO retained operator-plan finalist finalist=0 values=11 operations=7 estimated_cycles=389364 estimated_exchange_cycles=167160 exchange_row_bytes=35908 peak_standard_bytes=343108 peak_interleaved_bytes=52480 peak_total_bytes=388164 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 460, 1472} padding_group_counts={} conversion_sources=[]
2026-09-07T10:26:21.996694Z  INFO retained operator-plan finalist finalist=1 values=13 operations=9 estimated_cycles=485787 estimated_exchange_cycles=152040 exchange_row_bytes=32768 peak_standard_bytes=278528 peak_interleaved_bytes=180224 peak_total_bytes=458752 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 460, 1380, 1472} padding_group_counts={} conversion_sources=[Some(OperationId(1)), Some(OperationId(2))]
2026-09-07T10:26:22.017135Z  INFO retained operator-plan finalist finalist=2 values=11 operations=7 estimated_cycles=510149 estimated_exchange_cycles=168440 exchange_row_bytes=36196 peak_standard_bytes=200036 peak_interleaved_bytes=52864 peak_total_bytes=211364 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 480, 1472} padding_group_counts={16} conversion_sources=[]
2026-09-07T10:26:22.020853Z  INFO retained operator-plan finalist finalist=3 values=13 operations=9 estimated_cycles=640077 estimated_exchange_cycles=279240 exchange_row_bytes=60864 peak_standard_bytes=275904 peak_interleaved_bytes=50560 peak_total_bytes=312576 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 360, 480, 1440, 1472} padding_group_counts={16} conversion_sources=[Some(OperationId(1)), Some(OperationId(2))]
2026-09-07T10:26:24.548612Z  INFO retained operator-plan finalist finalist=0 values=11 operations=7 estimated_cycles=389364 estimated_exchange_cycles=167160 exchange_row_bytes=35908 peak_standard_bytes=343108 peak_interleaved_bytes=52480 peak_total_bytes=388164 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 460, 1472} padding_group_counts={} conversion_sources=[]
2026-09-07T10:26:24.568697Z  INFO retained operator-plan finalist finalist=1 values=11 operations=7 estimated_cycles=389364 estimated_exchange_cycles=167160 exchange_row_bytes=35908 peak_standard_bytes=330820 peak_interleaved_bytes=61056 peak_total_bytes=388164 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 460, 1472} padding_group_counts={} conversion_sources=[]
2026-09-07T10:26:24.588680Z  INFO retained operator-plan finalist finalist=2 values=11 operations=7 estimated_cycles=394386 estimated_exchange_cycles=174360 exchange_row_bytes=37528 peak_standard_bytes=341656 peak_interleaved_bytes=51200 peak_total_bytes=383640 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 368, 1472} padding_group_counts={} conversion_sources=[]
2026-09-07T10:26:24.609989Z  INFO retained operator-plan finalist finalist=3 values=11 operations=7 estimated_cycles=495238 estimated_exchange_cycles=248920 exchange_row_bytes=54304 peak_standard_bytes=229408 peak_interleaved_bytes=60416 peak_total_bytes=270368 maximum_standard_allocation_bytes=122880 active_tile_counts={192, 207, 1472} padding_group_counts={} conversion_sources=[]
2026-09-07T10:26:24.716501Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_mid"}: package build phase finished phase="lower_mid" elapsed_ms=5978 success=true
2026-09-07T10:26:51.025483Z  INFO screened tile mappings by exchange resource load candidates=87 baseline_cycles=69128 candidate_cycles=65672 baseline_pressure=55302 candidate_pressure=51846
2026-09-07T10:26:51.111162Z  INFO screened tile mappings by exchange resource load candidates=87 baseline_cycles=69128 candidate_cycles=65672 baseline_pressure=55443 candidate_pressure=51987
2026-09-07T10:26:51.149139Z  INFO modelled expanded operator plan finalist=8 modelled_cycles=298155 estimated_cycles=396291 estimated_exchange_cycles=170408
2026-09-07T10:26:51.198451Z  INFO screened tile mappings by exchange resource load candidates=87 baseline_cycles=100744 candidate_cycles=99720 baseline_pressure=73195 candidate_pressure=72257
2026-09-07T10:26:51.227502Z  INFO modelled expanded operator plan finalist=9 modelled_cycles=305413 estimated_cycles=408029 estimated_exchange_cycles=174888
2026-09-07T10:26:51.285682Z  INFO screened tile mappings by exchange resource load candidates=87 baseline_cycles=100744 candidate_cycles=99720 baseline_pressure=73444 candidate_pressure=72506
2026-09-07T10:26:51.316583Z  INFO modelled expanded operator plan finalist=10 modelled_cycles=371193 estimated_cycles=537937 estimated_exchange_cycles=273064
2026-09-07T10:26:51.403372Z  INFO modelled expanded operator plan finalist=11 modelled_cycles=386671 estimated_cycles=561095 estimated_exchange_cycles=280744
2026-09-07T10:26:52.679816Z  INFO screened tile mappings by exchange resource load candidates=111 baseline_cycles=65736 candidate_cycles=64712 baseline_pressure=54385 candidate_pressure=53447
2026-09-07T10:26:52.789843Z  INFO modelled expanded operator plan finalist=0 modelled_cycles=296027 estimated_cycles=408019 estimated_exchange_cycles=183304
2026-09-07T10:26:52.813376Z  INFO screened tile mappings by exchange resource load candidates=111 baseline_cycles=65736 candidate_cycles=64712 baseline_pressure=54533 candidate_pressure=53595
2026-09-07T10:26:52.933438Z  INFO modelled expanded operator plan finalist=7 modelled_cycles=294043 estimated_cycles=406035 estimated_exchange_cycles=183304
2026-09-07T10:26:53.218722Z  INFO screened tile mappings by exchange resource load candidates=115 baseline_cycles=71304 candidate_cycles=70280 baseline_pressure=50410 candidate_pressure=49472
2026-09-07T10:26:53.318509Z  INFO modelled expanded operator plan finalist=3 modelled_cycles=416996 estimated_cycles=552204 estimated_exchange_cycles=210888
2026-09-07T10:26:53.478495Z  INFO screened tile mappings by exchange resource load candidates=111 baseline_cycles=65736 candidate_cycles=64712 baseline_pressure=54385 candidate_pressure=53447
2026-09-07T10:26:53.600804Z  INFO modelled expanded operator plan finalist=6 modelled_cycles=288395 estimated_cycles=400387 estimated_exchange_cycles=183304
2026-09-07T10:26:53.676753Z  INFO screened tile mappings by exchange resource load candidates=111 baseline_cycles=65736 candidate_cycles=64712 baseline_pressure=54533 candidate_pressure=53595
2026-09-07T10:26:53.796224Z  INFO modelled expanded operator plan finalist=1 modelled_cycles=301675 estimated_cycles=413667 estimated_exchange_cycles=183304
2026-09-07T10:26:55.525290Z  INFO screened tile mappings by exchange resource load candidates=115 baseline_cycles=71304 candidate_cycles=70280 baseline_pressure=50262 candidate_pressure=49324
2026-09-07T10:26:55.684184Z  INFO modelled expanded operator plan finalist=2 modelled_cycles=416644 estimated_cycles=551852 estimated_exchange_cycles=210888
2026-09-07T10:27:06.545964Z  INFO screened tile mappings by exchange resource load candidates=145 baseline_cycles=65872 candidate_cycles=64848 baseline_pressure=54598 candidate_pressure=53660
2026-09-07T10:27:06.831791Z  INFO modelled expanded operator plan finalist=4 modelled_cycles=749621 estimated_cycles=1320693 estimated_exchange_cycles=642520
2026-09-07T10:27:08.076511Z  INFO screened tile mappings by exchange resource load candidates=193 baseline_cycles=114096 candidate_cycles=113648 baseline_pressure=87082 candidate_pressure=89114
2026-09-07T10:27:08.211343Z  INFO modelled expanded operator plan finalist=5 modelled_cycles=615946 estimated_cycles=1067946 estimated_exchange_cycles=572248
2026-09-07T10:27:08.959214Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=1 transfers=1334 maximum_identical_destinations=1
2026-09-07T10:27:08.959270Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=1 initial_horizon=2913 selected_horizon=2913 endpoint_lower_bound=2784 lower_bound_gap=129 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:08.960326Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=1 tile=367 row_words=11 horizon=2913
2026-09-07T10:27:08.984992Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=3 transfers=1334 maximum_identical_destinations=1
2026-09-07T10:27:08.985013Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=3 initial_horizon=2913 selected_horizon=2913 endpoint_lower_bound=2784 lower_bound_gap=129 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:08.986029Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=3 tile=367 row_words=11 horizon=2913
2026-09-07T10:27:09.010298Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=5 transfers=1288 maximum_identical_destinations=1
2026-09-07T10:27:09.010324Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=5 initial_horizon=2887 selected_horizon=2887 endpoint_lower_bound=2784 lower_bound_gap=103 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:09.011263Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=5 tile=919 row_words=11 horizon=2887
2026-09-07T10:27:10.066814Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=6 transfers=18209 maximum_identical_destinations=1
2026-09-07T10:27:10.066851Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=6 initial_horizon=1702 selected_horizon=1702 endpoint_lower_bound=928 lower_bound_gap=774 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:10.082512Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=6 tile=380 row_words=125 horizon=1702
2026-09-07T10:27:40.945133Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=7 transfers=84522 maximum_identical_destinations=1
2026-09-07T10:27:40.945182Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=7 initial_horizon=13399 selected_horizon=13399 endpoint_lower_bound=9712 lower_bound_gap=3687 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:41.068959Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=7 tile=52 row_words=1111 horizon=13399
2026-09-07T10:27:46.058128Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=8 transfers=14720 maximum_identical_destinations=1
2026-09-07T10:27:46.058172Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=8 initial_horizon=3491 selected_horizon=3491 endpoint_lower_bound=2880 lower_bound_gap=611 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:46.120796Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=8 tile=551 row_words=354 horizon=3491
2026-09-07T10:27:52.899885Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=9 transfers=66880 maximum_identical_destinations=1
2026-09-07T10:27:52.899935Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=9 initial_horizon=5497 selected_horizon=5497 endpoint_lower_bound=3640 lower_bound_gap=1857 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:52.966769Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=9 tile=362 row_words=321 horizon=5497
2026-09-07T10:27:53.123237Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: scheduled operator-plan finalist finalist=6 mapped=false analytical_cycles=400387 analytical_exchange_cycles=183304 scheduled_exchange_cycles=79973 refined_cycles=297056
2026-09-07T10:27:53.171216Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=1 transfers=1334 maximum_identical_destinations=1
2026-09-07T10:27:53.171250Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=1 initial_horizon=2910 selected_horizon=2910 endpoint_lower_bound=2784 lower_bound_gap=126 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:53.172431Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=1 tile=486 row_words=12 horizon=2910
2026-09-07T10:27:53.200000Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=3 transfers=1334 maximum_identical_destinations=1
2026-09-07T10:27:53.200021Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=3 initial_horizon=2910 selected_horizon=2910 endpoint_lower_bound=2784 lower_bound_gap=126 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:53.201197Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=3 tile=486 row_words=12 horizon=2910
2026-09-07T10:27:53.227630Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=5 transfers=1288 maximum_identical_destinations=1
2026-09-07T10:27:53.227650Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=5 initial_horizon=2888 selected_horizon=2888 endpoint_lower_bound=2784 lower_bound_gap=104 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:53.228829Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=5 tile=1286 row_words=11 horizon=2888
2026-09-07T10:27:54.277488Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=6 transfers=18209 maximum_identical_destinations=1
2026-09-07T10:27:54.277525Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=6 initial_horizon=1720 selected_horizon=1720 endpoint_lower_bound=928 lower_bound_gap=792 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:27:54.295616Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=6 tile=278 row_words=123 horizon=1720
2026-09-07T10:28:22.214151Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=7 transfers=84522 maximum_identical_destinations=1
2026-09-07T10:28:22.214227Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=7 initial_horizon=14317 selected_horizon=14317 endpoint_lower_bound=9712 lower_bound_gap=4605 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:28:22.416703Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=7 tile=66 row_words=1130 horizon=14317
2026-09-07T10:28:31.780034Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: compared ordinary and paired exchange schedules phase=8 candidates=2656 ordinary_horizon=4031 paired_horizon=4048 use_paired=false
2026-09-07T10:28:31.844952Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=8 transfers=14720 maximum_identical_destinations=1
2026-09-07T10:28:31.844973Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=8 initial_horizon=4031 selected_horizon=4031 endpoint_lower_bound=2880 lower_bound_gap=1151 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:28:31.883264Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=8 tile=1096 row_words=380 horizon=4031
2026-09-07T10:28:36.425538Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: prepared large physical exchange phase phase=9 transfers=66880 maximum_identical_destinations=1
2026-09-07T10:28:36.425573Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: optimized physical exchange schedule phase=9 initial_horizon=5866 selected_horizon=5866 endpoint_lower_bound=3640 lower_bound_gap=2226 selected_kind="full-duplex" neighborhood_improvements=0
2026-09-07T10:28:36.465117Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: finished large physical exchange phase phase=9 tile=730 row_words=327 horizon=5866
2026-09-07T10:28:36.615403Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: scheduled operator-plan finalist finalist=6 mapped=true analytical_cycles=400387 analytical_exchange_cycles=183304 scheduled_exchange_cycles=81794 refined_cycles=298877
2026-09-07T10:28:37.020775Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: selected physically scheduled operator-plan finalist selected=6 mapped=false
2026-09-07T10:28:37.020806Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="select_finalist"}: package build phase finished phase="select_finalist" elapsed_ms=132304 success=true
2026-09-07T10:28:37.020821Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}: lowered graph for package construction logical_shards=40908 exchange_phases=11
2026-09-07T10:28:37.024016Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="compile_runtime"}: package build phase finished phase="compile_runtime" elapsed_ms=3 success=true
2026-09-07T10:28:37.030170Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="plan_kernels"}: package build phase finished phase="plan_kernels" elapsed_ms=6 success=true
2026-09-07T10:28:37.030471Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="compile_kernels"}: compiling kernel source=/srv/home/gc-sdk/ipu-stack/crates/ipu-tests/../../device/gemm_f16_amp.S name="gemm_f16_interleaved_k80_c64_r91_r92" target=ipu21
2026-09-07T10:28:37.084372Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="compile_kernels"}: kernel artifact created object=/srv/home/.cache/ipu-stack/kernels/de78d171fba3a88724d71e4f0b011fa102c50565600ab7b5817071e371ec2e62/kernel.o metadata=/srv/home/.cache/ipu-stack/kernels/de78d171fba3a88724d71e4f0b011fa102c50565600ab7b5817071e371ec2e62/kernel.json
2026-09-07T10:28:37.084723Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="compile_kernels"}: compiling kernel source=/srv/home/gc-sdk/ipu-stack/crates/ipu-tests/../../device/gemm_f16_amp.S name="gemm_f16_interleaved_k80_c80_r91_r92" target=ipu21
2026-09-07T10:28:37.132928Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="compile_kernels"}: kernel artifact created object=/srv/home/.cache/ipu-stack/kernels/ebdfff9b16c4dd79071e1bce6110d94afc687ceb598c87f2559327bbecdc8cb0/kernel.o metadata=/srv/home/.cache/ipu-stack/kernels/ebdfff9b16c4dd79071e1bce6110d94afc687ceb598c87f2559327bbecdc8cb0/kernel.json
2026-09-07T10:28:37.134794Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="compile_kernels"}: package build phase finished phase="compile_kernels" elapsed_ms=104 success=true
2026-09-07T10:28:37.136189Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="link_runtime"}: package build phase finished phase="link_runtime" elapsed_ms=0 success=true
2026-09-07T10:28:38.454838Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="size_tile_code"}: package build phase finished phase="size_tile_code" elapsed_ms=20 success=true
2026-09-07T10:28:38.454928Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}: allocated package support memory linked_end=324988 profile_bytes=160 exchange_table_bytes=6608 host_code_bytes=4736 generated_code_bytes=2764 code_address=414400 standard_ranges=[(425984, 524288)]
2026-09-07T10:28:39.190946Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="place_storage"}: package build phase finished phase="place_storage" elapsed_ms=735 success=true
2026-09-07T10:28:39.194269Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=0
2026-09-07T10:28:39.202834Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=1
2026-09-07T10:28:39.203380Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: prepared large physical exchange phase phase=1 transfers=1334 maximum_identical_destinations=1
2026-09-07T10:28:39.203392Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: optimized physical exchange schedule phase=1 initial_horizon=2913 selected_horizon=2913 endpoint_lower_bound=2784 lower_bound_gap=129 selected_kind="reused" neighborhood_improvements=0
2026-09-07T10:28:39.204423Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: finished large physical exchange phase phase=1 tile=367 row_words=11 horizon=2913
2026-09-07T10:28:39.207908Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=2
2026-09-07T10:28:39.216628Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=3
2026-09-07T10:28:39.217152Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: prepared large physical exchange phase phase=3 transfers=1334 maximum_identical_destinations=1
2026-09-07T10:28:39.217163Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: optimized physical exchange schedule phase=3 initial_horizon=2913 selected_horizon=2913 endpoint_lower_bound=2784 lower_bound_gap=129 selected_kind="reused" neighborhood_improvements=0
2026-09-07T10:28:39.218220Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: finished large physical exchange phase phase=3 tile=367 row_words=11 horizon=2913
2026-09-07T10:28:39.221792Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=4
2026-09-07T10:28:39.230411Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=5
2026-09-07T10:28:39.230901Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: prepared large physical exchange phase phase=5 transfers=1288 maximum_identical_destinations=1
2026-09-07T10:28:39.230910Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: optimized physical exchange schedule phase=5 initial_horizon=2887 selected_horizon=2887 endpoint_lower_bound=2784 lower_bound_gap=103 selected_kind="reused" neighborhood_improvements=0
2026-09-07T10:28:39.231871Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: finished large physical exchange phase phase=5 tile=919 row_words=11 horizon=2887
2026-09-07T10:28:39.710316Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=6
2026-09-07T10:28:39.718331Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: prepared large physical exchange phase phase=6 transfers=18209 maximum_identical_destinations=1
2026-09-07T10:28:39.718350Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: optimized physical exchange schedule phase=6 initial_horizon=1702 selected_horizon=1702 endpoint_lower_bound=928 lower_bound_gap=774 selected_kind="reused" neighborhood_improvements=0
2026-09-07T10:28:39.733533Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: finished large physical exchange phase phase=6 tile=380 row_words=125 horizon=1702
2026-09-07T10:29:03.152310Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=7
2026-09-07T10:29:03.200817Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: prepared large physical exchange phase phase=7 transfers=84522 maximum_identical_destinations=1
2026-09-07T10:29:03.200839Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: optimized physical exchange schedule phase=7 initial_horizon=13399 selected_horizon=13399 endpoint_lower_bound=9712 lower_bound_gap=3687 selected_kind="reused" neighborhood_improvements=0
2026-09-07T10:29:03.320363Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: finished large physical exchange phase phase=7 tile=52 row_words=1111 horizon=13399
2026-09-07T10:29:05.673851Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=8
2026-09-07T10:29:05.692328Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: prepared large physical exchange phase phase=8 transfers=14720 maximum_identical_destinations=1
2026-09-07T10:29:05.692348Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: optimized physical exchange schedule phase=8 initial_horizon=3491 selected_horizon=3491 endpoint_lower_bound=2880 lower_bound_gap=611 selected_kind="reused" neighborhood_improvements=0
2026-09-07T10:29:05.728979Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: finished large physical exchange phase phase=8 tile=551 row_words=354 horizon=3491
2026-09-07T10:29:07.626603Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=9
2026-09-07T10:29:07.648766Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: prepared large physical exchange phase phase=9 transfers=66880 maximum_identical_destinations=1
2026-09-07T10:29:07.648790Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: optimized physical exchange schedule phase=9 initial_horizon=5497 selected_horizon=5497 endpoint_lower_bound=3640 lower_bound_gap=1857 selected_kind="reused" neighborhood_improvements=0
2026-09-07T10:29:07.689632Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: finished large physical exchange phase phase=9 tile=362 row_words=321 horizon=5497
2026-09-07T10:29:07.766776Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: reused exchange optimization after validating relocated rows phase=10
2026-09-07T10:29:07.771822Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="lower_exchanges"}: package build phase finished phase="lower_exchanges" elapsed_ms=28580 success=true
2026-09-07T10:29:13.841959Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="optimize_exchange_placement"}: package build phase finished phase="optimize_exchange_placement" elapsed_ms=6070 success=true
2026-09-07T10:29:13.849449Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}: costed final placed program final_cycles=297056 final_exchange=79973
2026-09-07T10:29:14.569610Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="prepare_tile_code"}: package build phase finished phase="prepare_tile_code" elapsed_ms=26 success=true
2026-09-07T10:29:14.594307Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="emit_tile_code"}: package build phase finished phase="emit_tile_code" elapsed_ms=24 success=true
2026-09-07T10:29:14.784730Z  INFO ipu_codegen.package.build{tile_count=1472 operations=7}:ipu_codegen.package.phase{phase="build_tile_images"}: package build phase finished phase="build_tile_images" elapsed_ms=183 success=true
2026-09-07T10:29:14.892059Z  INFO writing application package tiles=1472
2026-09-07T10:29:14.953252Z  INFO application package written
2026-09-07T10:29:14.953778Z  INFO reading application package
2026-09-07T10:29:15.129865Z  INFO application package read tiles=1472 compiler=0.1.0
2026-09-07T10:29:15.130750Z  INFO waiting for hardware ownership path=artifacts/layout-sweep/device.lock
2026-09-07T10:29:15.130775Z  INFO acquired hardware ownership path=artifacts/layout-sweep/device.lock
2026-09-07T10:29:15.130780Z  INFO opening IPU device path="/dev/ipu0"
2026-09-07T10:29:15.130811Z  INFO IPU device attached path=/dev/ipu0
2026-09-07T10:29:15.130816Z  INFO initializing IPU device
2026-09-07T10:29:15.139191Z  INFO IPU device initialized
2026-09-07T10:29:15.139243Z  INFO replaying device configuration register_writes=2003
2026-09-07T10:29:15.154678Z  INFO loading application tile_count=1472 final_mark=23
2026-09-07T10:29:15.481919Z  INFO application loaded and initial synchronization completed tile_count=1472
2026-09-07T10:29:24.041091Z  INFO starting host exchange session startup_mark=23
2026-09-07T10:29:24.041135Z  INFO attaching host exchange pages pages=2
2026-09-07T10:29:24.041790Z  INFO host exchange session started
2026-09-07T10:29:24.043026Z  INFO invoking streaming host exchange call call="initialize" command=0 phases=132
2026-09-07T10:29:24.185791Z  INFO invoking streaming host exchange call call="run" command=0 phases=13
profile=artifacts/attention-product-grids/qk-only/execution.ipuprofile tiles=1472 samples=42778
attentionNumericalChecks=839808 blocks=1 expected=0.999756 maxError=0.000930 numericalTest=PASS
package=artifacts/attention-product-grids/qk-only/model.ipuexe tiles=1472 hardwareTest=PASS