2026-09-12T12:49:51.601254Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="compile_runtime"}: package build phase finished phase="compile_runtime" elapsed_ms=0 success=true
2026-09-12T12:50:29.181008Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: screened exchange table geometry expansion_ms=5832 expansion_and_footprint_ms=7443 estimated_row_bytes=106400 heuristic_row_bytes=176908 geometry_fragments_per_tile=11109 fragment_limit=16384
2026-09-12T12:50:29.349726Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: eliminated unread FP8 cast input padding clears removed=0
2026-09-12T12:50:29.932802Z ERROR ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: failed to prepare logical exchange transfer phase=152 transfer=0 provenance=WorkProvenance { operation: Some(OperationId(29)), value: None, reason: OperatorInputs } source=ShardView { shard: BlockValueId(248840), extents: [ShardExtent { axis: 0, start: 0, logical_end: 1, physical_end: 1 }, ShardExtent { axis: 1, start: 0, logical_end: 1, physical_end: 1 }, ShardExtent { axis: 2, start: 4, logical_end: 8, physical_end: 8 }] } destinations=[ShardView { shard: BlockValueId(372344), extents: [ShardExtent { axis: 0, start: 0, logical_end: 1, physical_end: 1 }, ShardExtent { axis: 1, start: 0, logical_end: 1, physical_end: 1 }, ShardExtent { axis: 2, start: 4, logical_end: 8, physical_end: 8 }] }] error=UnalignedPayload
2026-09-12T12:50:29.943196Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=205 transfers=2151 maximum_identical_destinations=1
2026-09-12T12:50:29.943263Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=205 initial_horizon=172 selected_horizon=172 endpoint_lower_bound=64 lower_bound_gap=108 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:29.944528Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=53 transfers=4032 maximum_identical_destinations=1
2026-09-12T12:50:29.944571Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=53 initial_horizon=4270 selected_horizon=4270 endpoint_lower_bound=4224 lower_bound_gap=46 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:29.946031Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=205 tile=1104 row_words=41 horizon=172
2026-09-12T12:50:29.948015Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=46 transfers=4032 maximum_identical_destinations=1
2026-09-12T12:50:29.948047Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=46 initial_horizon=4282 selected_horizon=4282 endpoint_lower_bound=4176 lower_bound_gap=106 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:29.948863Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=53 tile=1296 row_words=89 horizon=4270
2026-09-12T12:50:29.949565Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=106 transfers=2016 maximum_identical_destinations=1
2026-09-12T12:50:29.949608Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=106 initial_horizon=7217 selected_horizon=7217 endpoint_lower_bound=7008 lower_bound_gap=209 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:29.950157Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: compared ordinary and paired exchange schedules phase=160 candidates=17 ordinary_horizon=688 paired_horizon=1417 use_paired=false
2026-09-12T12:50:29.950333Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=19 transfers=4248 maximum_identical_destinations=1
2026-09-12T12:50:29.950365Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=19 initial_horizon=5917 selected_horizon=5917 endpoint_lower_bound=5856 lower_bound_gap=61 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:29.950988Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=46 tile=1080 row_words=84 horizon=4282
2026-09-12T12:50:29.952828Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=106 tile=1294 row_words=37 horizon=7217
2026-09-12T12:50:29.953823Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=19 tile=1400 row_words=125 horizon=5917
2026-09-12T12:50:29.961666Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=13 transfers=4248 maximum_identical_destinations=1
2026-09-12T12:50:29.961704Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=13 initial_horizon=4253 selected_horizon=4253 endpoint_lower_bound=4176 lower_bound_gap=77 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:29.966433Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=13 tile=783 row_words=88 horizon=4253
2026-09-12T12:50:30.020483Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=26 transfers=12528 maximum_identical_destinations=1
2026-09-12T12:50:30.020514Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=26 initial_horizon=6110 selected_horizon=6110 endpoint_lower_bound=6016 lower_bound_gap=94 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:30.027176Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=26 tile=53 row_words=124 horizon=6110
2026-09-12T12:50:30.078464Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=32 transfers=12528 maximum_identical_destinations=1
2026-09-12T12:50:30.078501Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=32 initial_horizon=7885 selected_horizon=7885 endpoint_lower_bound=7808 lower_bound_gap=77 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:30.086151Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=32 tile=1202 row_words=164 horizon=7885
2026-09-12T12:50:30.557005Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=39 transfers=43760 maximum_identical_destinations=1
2026-09-12T12:50:30.557050Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=39 initial_horizon=2347 selected_horizon=2347 endpoint_lower_bound=1960 lower_bound_gap=387 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:30.578072Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=39 tile=96 row_words=112 horizon=2347
2026-09-12T12:50:37.275349Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: compared ordinary and paired exchange schedules phase=0 candidates=11 ordinary_horizon=4358 paired_horizon=4934 use_paired=true
2026-09-12T12:50:37.426279Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: prepared large physical exchange phase phase=0 transfers=13851 maximum_identical_destinations=1
2026-09-12T12:50:37.426320Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: optimized physical exchange schedule phase=0 initial_horizon=4934 selected_horizon=4934 endpoint_lower_bound=3904 lower_bound_gap=1030 selected_kind="balanced-compact-streams" neighborhood_improvements=0
2026-09-12T12:50:37.499744Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: finished large physical exchange phase phase=0 tile=289 row_words=641 horizon=4934
2026-09-12T12:50:38.220131Z  INFO ipu_codegen.package.build{tile_count=1472 operations=25}:ipu_codegen.package.phase{phase="plan_package"}: package build phase finished phase="plan_package" elapsed_ms=46618 success=false
Error: exchange lowering failed: exchange payload is not a nonempty whole number of words

Caused by:
    exchange payload is not a nonempty whole number of words