2026-07-22T09:12:12.217078Z INFO loaded SigLIP vision weight index image_size=384 patch_size=14 sequence_length=729 hidden_size=1152 layers=27 heads=16 2026-07-22T09:12:12.656550Z INFO configured encoder tile-memory policy transient=[MemoryArena { base: 442368, limit: 524288 }, MemoryArena { base: 524288, limit: 557056 }, MemoryArena { base: 557056, limit: 950272 }] resident=[MemoryArena { base: 557056, limit: 950272 }, MemoryArena { base: 442368, limit: 524288 }, MemoryArena { base: 524288, limit: 557056 }] weight_storage=F16 precision=SiglipEncoderPrecision { qkv: F16, attention_output: F16, mlp_up: F16, mlp_down: F16 } resident_f16_layers=1 tuning=SiglipEncoderTuning { gemm_row_block_rows: 0, automatic_gemm_row_blocks: true, row_gemm_inner_block_columns: 0, qkv_inner_block_columns: 0, attention_output_inner_block_columns: 0, mlp_up_inner_block_columns: 0, gemm_output_block_columns: 0, qkv_output_block_columns: 0, attention_output_block_columns: 0, mlp_up_output_block_columns: 0, mlp_down_output_block_columns: 0, attention_query_block_rows: 0, attention_key_block_rows: 0 } 2026-07-22T09:12:12.656647Z INFO siglip_encoder_layer{layer=0}: planning SigLIP encoder stage stage="norm1_qkv" 2026-07-22T09:12:12.669607Z INFO siglip_encoder_layer{layer=0}: selected SigLIP GEMM blocking operation="qkv" row_block_rows=27 output_block_columns=128 2026-07-22T09:12:12.966255Z INFO siglip_encoder_layer{layer=0}: selected shared QKV row-shard placement source_row_block_rows=27 destination_row_block_rows=24 2026-07-22T09:12:12.989270Z INFO siglip_encoder_layer{layer=0}: planning SigLIP encoder stage stage="attention" 2026-07-22T09:12:13.115094Z INFO siglip_encoder_layer{layer=0}: planned SigLIP attention blocking stage="encoder" query_block_rows=67 key_block_rows=92 key_block_columns=96 tasks=1408 key_value_blocks=1024 2026-07-22T09:12:13.267093Z INFO siglip_encoder_layer{layer=0}: planning SigLIP encoder stage stage="attention_output" 2026-07-22T09:12:13.408846Z INFO siglip_encoder_layer{layer=0}: selected attention residual row-shard placement source_row_block_rows=72 destination_row_block_rows=36 2026-07-22T09:12:13.419622Z INFO siglip_encoder_layer{layer=0}: planning SigLIP encoder stage stage="norm2_mlp" 2026-07-22T09:12:13.463107Z INFO siglip_encoder_layer{layer=0}: selected SigLIP GEMM blocking operation="mlp_up" row_block_rows=46 output_block_columns=128 2026-07-22T09:12:13.735458Z INFO siglip_encoder_layer{layer=0}: selected SigLIP GEMM blocking operation="mlp_down" row_block_rows=46 inner_block_columns=128 2026-07-22T09:12:14.093067Z INFO siglip_encoder_layer{layer=0}: planned SigLIP encoder layer stage="complete" 2026-07-22T09:12:14.399121Z INFO accumulated SigLIP compiler state layer=0 phases=599 compute_commands=439493 transfers=708907 allocations=810455 host_bindings=1 host_bytes=7464960 2026-07-22T09:12:15.809256Z INFO lowered exchange schedule phases=298 launches=297 2026-07-22T09:12:16.193530Z INFO lowered per-tile programs tiles=1472 2026-07-22T09:12:16.346959Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.347299Z INFO tile image linked bytes=20104 symbols=60 entry=0x4c014 2026-07-22T09:12:16.347331Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.347561Z INFO tile image linked bytes=20104 symbols=60 entry=0x4c014 2026-07-22T09:12:16.347578Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.347784Z INFO tile image linked bytes=18752 symbols=58 entry=0x4c014 2026-07-22T09:12:16.347801Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.347996Z INFO tile image linked bytes=17448 symbols=54 entry=0x4c014 2026-07-22T09:12:16.348020Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.348241Z INFO tile image linked bytes=18752 symbols=58 entry=0x4c014 2026-07-22T09:12:16.348462Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.348661Z INFO tile image linked bytes=17952 symbols=55 entry=0x4c014 2026-07-22T09:12:16.348690Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.348873Z INFO tile image linked bytes=16656 symbols=51 entry=0x4c014 2026-07-22T09:12:16.348893Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.349080Z INFO tile image linked bytes=17776 symbols=53 entry=0x4c014 2026-07-22T09:12:16.349107Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.349319Z INFO tile image linked bytes=17776 symbols=53 entry=0x4c014 2026-07-22T09:12:16.349345Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.349531Z INFO tile image linked bytes=16480 symbols=49 entry=0x4c014 2026-07-22T09:12:16.349742Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.349914Z INFO tile image linked bytes=15792 symbols=47 entry=0x4c014 2026-07-22T09:12:16.349933Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.350114Z INFO tile image linked bytes=17088 symbols=51 entry=0x4c014 2026-07-22T09:12:16.350133Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.350335Z INFO tile image linked bytes=17088 symbols=51 entry=0x4c014 2026-07-22T09:12:16.350604Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.350787Z INFO tile image linked bytes=16864 symbols=50 entry=0x4c014 2026-07-22T09:12:16.350800Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.350972Z INFO tile image linked bytes=16864 symbols=50 entry=0x4c014 2026-07-22T09:12:16.351018Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.351184Z INFO tile image linked bytes=15568 symbols=46 entry=0x4c014 2026-07-22T09:12:16.352095Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.352343Z INFO tile image linked bytes=18216 symbols=52 entry=0x4c014 2026-07-22T09:12:16.352358Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.352540Z INFO tile image linked bytes=18216 symbols=52 entry=0x4c014 2026-07-22T09:12:16.352563Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.352736Z INFO tile image linked bytes=16920 symbols=48 entry=0x4c014 2026-07-22T09:12:16.354685Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.354885Z INFO tile image linked bytes=16920 symbols=48 entry=0x4c014 2026-07-22T09:12:16.354898Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.355087Z INFO tile image linked bytes=18216 symbols=52 entry=0x4c014 2026-07-22T09:12:16.355105Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.355303Z INFO tile image linked bytes=18216 symbols=52 entry=0x4c014 2026-07-22T09:12:16.355562Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.355700Z INFO tile image linked bytes=8816 symbols=30 entry=0x4c014 2026-07-22T09:12:16.355784Z INFO linking tile image objects=23 base=0x4c010 entry=ipu_stack_static_start 2026-07-22T09:12:16.355920Z INFO tile image linked bytes=8664 symbols=29 entry=0x4c014 2026-07-22T09:12:16.382453Z INFO packed segmented host runtime ranges=[(378504, 389844), (389848, 391468), (391472, 393216), (400144, 400324), (400328, 400508), (400512, 400692), (400696, 400876), (400880, 401060), (401064, 401244), (401248, 401428), (401432, 401612), (401616, 401796), (401800, 401980), (401984, 402164), (402168, 402348), (402352, 402532), (402536, 402716), (402720, 402900), (402904, 403084), (403088, 403268), (403272, 403452), (403456, 403636), (403640, 403820), (403824, 403908), (403912, 404012), (518912, 520672), (520672, 520708), (520712, 520724), (520728, 520740), (520744, 520756), (520760, 520772), (520776, 520788), (520792, 520804), (520808, 520820), (520824, 520836), (520840, 520852), (520856, 520868), (520872, 520884), (520888, 520900), (520904, 520916), (520920, 520932), (520936, 520948), (520952, 520964), (520968, 520980), (520984, 520996), (521000, 521012), (521016, 521028), (521032, 521384)] first_plan="0x62a20" worker_sync=0x7eb00 completion=0x7eb00 2026-07-22T09:12:16.646250Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.646562Z INFO tile image linked bytes=20104 symbols=60 entry=0x64004 2026-07-22T09:12:16.646588Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.646823Z INFO tile image linked bytes=20104 symbols=60 entry=0x64004 2026-07-22T09:12:16.646836Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.647061Z INFO tile image linked bytes=18752 symbols=58 entry=0x64004 2026-07-22T09:12:16.647076Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.647301Z INFO tile image linked bytes=17448 symbols=54 entry=0x64004 2026-07-22T09:12:16.647325Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.647526Z INFO tile image linked bytes=18752 symbols=58 entry=0x64004 2026-07-22T09:12:16.647700Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.647898Z INFO tile image linked bytes=17952 symbols=55 entry=0x64004 2026-07-22T09:12:16.647914Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.648097Z INFO tile image linked bytes=16656 symbols=51 entry=0x64004 2026-07-22T09:12:16.648110Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.648320Z INFO tile image linked bytes=17776 symbols=53 entry=0x60004 2026-07-22T09:12:16.648344Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.648542Z INFO tile image linked bytes=17776 symbols=53 entry=0x60004 2026-07-22T09:12:16.648553Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.648736Z INFO tile image linked bytes=17776 symbols=53 entry=0x64004 2026-07-22T09:12:16.648748Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.648920Z INFO tile image linked bytes=16480 symbols=49 entry=0x60004 2026-07-22T09:12:16.648928Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.649099Z INFO tile image linked bytes=16480 symbols=49 entry=0x64004 2026-07-22T09:12:16.649111Z INFO linking tile image objects=23 base=0x64000 entry=ipu_stack_static_start 2026-07-22T09:12:16.649306Z INFO tile image linked bytes=17776 symbols=53 entry=0x64004 2026-07-22T09:12:16.649501Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.649671Z INFO tile image linked bytes=15792 symbols=47 entry=0x60004 2026-07-22T09:12:16.649684Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.649866Z INFO tile image linked bytes=17088 symbols=51 entry=0x60004 2026-07-22T09:12:16.649898Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.650076Z INFO tile image linked bytes=17088 symbols=51 entry=0x60004 2026-07-22T09:12:16.650268Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.650449Z INFO tile image linked bytes=16864 symbols=50 entry=0x60004 2026-07-22T09:12:16.650460Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.650642Z INFO tile image linked bytes=16864 symbols=50 entry=0x60004 2026-07-22T09:12:16.650658Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.650838Z INFO tile image linked bytes=15568 symbols=46 entry=0x60004 2026-07-22T09:12:16.651552Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.651749Z INFO tile image linked bytes=18216 symbols=52 entry=0x60004 2026-07-22T09:12:16.651760Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.651939Z INFO tile image linked bytes=18216 symbols=52 entry=0x60004 2026-07-22T09:12:16.651957Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.652128Z INFO tile image linked bytes=16920 symbols=48 entry=0x60004 2026-07-22T09:12:16.653694Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.653895Z INFO tile image linked bytes=16920 symbols=48 entry=0x60004 2026-07-22T09:12:16.653904Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.654090Z INFO tile image linked bytes=18216 symbols=52 entry=0x60004 2026-07-22T09:12:16.654102Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.654298Z INFO tile image linked bytes=18216 symbols=52 entry=0x60004 2026-07-22T09:12:16.654530Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.654660Z INFO tile image linked bytes=8816 symbols=30 entry=0x60004 2026-07-22T09:12:16.654741Z INFO linking tile image objects=23 base=0x60000 entry=ipu_stack_static_start 2026-07-22T09:12:16.654871Z INFO tile image linked bytes=8664 symbols=29 entry=0x60004 2026-07-22T09:12:16.657337Z INFO largest generated tile program breakdown logical_tile=61 generated_bytes=8536 generated_exchange_bytes=1292 generated_compute_bytes=6468 generated_unrolled_compute_calls=250 generated_fused_compute_calls=178 generated_compute_argument_words=616 generated_fused_run_bytes=280 generated_fused_runs=10 generated_host_and_control_bytes=496 support_image_bytes=18752 exchange_plan_bytes=19244 host_plan_and_state_bytes=6012 2026-07-22T09:12:16.870604Z INFO packaged static executable graph tiles=1472 exchange_launches=297 host_inputs=1 host_outputs=1 max_program_bytes=8536 distinct_image_bases=27 minimum_image_base=0x60000 maximum_image_base=0x689c0 minimum_program_base=0x5c000 maximum_program_base=0x60000 2026-07-22T09:12:17.112853Z INFO opening IPU device path="/dev/ipu0" 2026-07-22T09:12:17.112901Z INFO IPU device attached path=/dev/ipu0 2026-07-22T09:12:17.112906Z INFO initializing IPU device 2026-07-22T09:12:17.121255Z INFO IPU device initialized 2026-07-22T09:12:17.121262Z INFO replaying device configuration register_writes=2003 2026-07-22T09:12:17.127343Z INFO loading application tile_count=1472 final_mark=23 2026-07-22T09:12:17.327061Z INFO application loaded and initial synchronization completed tile_count=1472 2026-07-22T09:12:17.330277Z INFO starting host exchange session startup_mark=23 2026-07-22T09:12:17.330289Z INFO attaching host exchange pages pages=2 2026-07-22T09:12:17.331083Z INFO host exchange session started 2026-07-22T09:12:17.331224Z INFO invoking streaming host exchange call call="initialize" command=0 phases=24646 2026-07-22T09:12:21.244450Z INFO invoking streaming host exchange call call="graph" command=0 phases=11663 thread 'main' (442087) panicked at crates/ipu-runtime/src/bin/ipu-siglip-patch-e2e.rs:552:6: called `Result::unwrap()` on an `Err` value: "generated host call graph: device timeout: host call graph phase 4860/11663: device timeout: HSP register 0x3030: expected 0, observed 1; supervisor states: 0=1466 [0, 1, 2, 3, 4, 5, 6, 7], 1=6 [256, 258, 320, 578, 640, 642], 2=0 [], 3=0 [], errors=0, supervisor_exceptions=[], active_contexts=[\"256:[1, 3, 3, 3, 3, 3, 3]/[\\\"c1:TEXCPT_CONFLICT@0x681d0\\\", \\\"c2:TEXCPT_CONFLICT@0x681d0\\\", \\\"c3:TEXCPT_CONFLICT@0x681d0\\\", \\\"c4:TEXCPT_CONFLICT@0x681d0\\\", \\\"c5:TEXCPT_CONFLICT@0x681d0\\\", \\\"c6:TEXCPT_CONFLICT@0x681d0\\\"]\", \"258:[1, 3, 3, 3, 3, 3, 3]/[\\\"c1:TEXCPT_CONFLICT@0x681d0\\\", \\\"c2:TEXCPT_CONFLICT@0x681d0\\\", \\\"c3:TEXCPT_CONFLICT@0x681d0\\\", \\\"c4:TEXCPT_CONFLICT@0x681d0\\\", \\\"c5:TEXCPT_CONFLICT@0x681d0\\\", \\\"c6:TEXCPT_CONFLICT@0x681d0\\\"]\", \"320:[1, 3, 3, 3, 3, 3, 3]/[\\\"c1:TEXCPT_CONFLICT@0x681d0\\\", \\\"c2:TEXCPT_CONFLICT@0x681d0\\\", \\\"c3:TEXCPT_CONFLICT@0x681d0\\\", \\\"c4:TEXCPT_CONFLICT@0x681d0\\\", \\\"c5:TEXCPT_CONFLICT@0x681d0\\\", \\\"c6:TEXCPT_CONFLICT@0x681d0\\\"]\", \"578:[1, 3, 3, 3, 3, 3, 3]/[\\\"c1:TEXCPT_CONFLICT@0x681d0\\\", \\\"c2:TEXCPT_CONFLICT@0x681d0\\\", \\\"c3:TEXCPT_CONFLICT@0x681d0\\\", \\\"c4:TEXCPT_CONFLICT@0x681d0\\\", \\\"c5:TEXCPT_CONFLICT@0x681d0\\\", \\\"c6:TEXCPT_CONFLICT@0x681d0\\\"]\", \"640:[1, 3, 3, 3, 3, 3, 3]/[\\\"c1:TEXCPT_CONFLICT@0x681d0\\\", \\\"c2:TEXCPT_CONFLICT@0x681d0\\\", \\\"c3:TEXCPT_CONFLICT@0x681d0\\\", \\\"c4:TEXCPT_CONFLICT@0x681d0\\\", \\\"c5:TEXCPT_CONFLICT@0x681d0\\\", \\\"c6:TEXCPT_CONFLICT@0x681d0\\\"]\", \"642:[1, 3, 3, 3, 3, 3, 3]/[\\\"c1:TEXCPT_CONFLICT@0x681d0\\\", \\\"c2:TEXCPT_CONFLICT@0x681d0\\\", \\\"c3:TEXCPT_CONFLICT@0x681d0\\\", \\\"c4:TEXCPT_CONFLICT@0x681d0\\\", \\\"c5:TEXCPT_CONFLICT@0x681d0\\\", \\\"c6:TEXCPT_CONFLICT@0x681d0\\\"]\"], milestones=[\"0:error(invalid device data: TDI instruction failed with status 0x1)\", \"1:error(invalid device data: TDI instruction failed with status 0x1)\", \"2:error(invalid device data: TDI instruction failed with status 0x1)\", \"3:error(invalid device data: TDI instruction failed with status 0x1)\", \"4:error(invalid device data: TDI instruction failed with status 0x1)\", \"5:error(invalid device data: TDI instruction failed with status 0x1)\", \"6:error(invalid device data: TDI instruction failed with status 0x1)\", \"7:error(invalid device data: TDI instruction failed with status 0x1)\"]; device outputs: patches@576:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@578:0x88000=error(device timeout: stopping tile context), patches@640:0x88000=error(device timeout: stopping tile context), patches@642:0x88000=error(device timeout: stopping tile context), patches@704:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@706:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@768:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@770:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@832:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@834:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@320:0x88000=error(device timeout: stopping tile context), patches@322:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@384:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@386:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@448:0x88000=error(invalid device data: TDI instruction failed with status 0x1), patches@450:0x88000=error(invalid device data: TDI instruction failed with status 0x1)" note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace