time=2026-06-10T12:57:29.937+08:00 level=INFO source=routes.go:1919 msg="server config" env="map[HTTPS_PROXY: HTTP_PROXY: LLAMA_ARG_FIT: LLAMA_ARG_FIT_TARGET: NO_PROXY: OLLAMA_CONTEXT_LENGTH:0 OLLAMA_DEBUG:INFO OLLAMA_DEBUG_LOG_REQUESTS:false OLLAMA_EDITOR: OLLAMA_FLASH_ATTENTION:false OLLAMA_GO_TEMPLATE:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_IGPU_ENABLE: OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_TRANSFER_STREAMS:4 OLLAMA_MODELS:/Users/admin/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NO_CLOUD:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false http_proxy: https_proxy: no_proxy:]" time=2026-06-10T12:57:29.937+08:00 level=INFO source=routes.go:1921 msg="Ollama cloud disabled: false" time=2026-06-10T12:57:29.938+08:00 level=INFO source=images.go:864 msg="total blobs: 10" time=2026-06-10T12:57:29.938+08:00 level=INFO source=images.go:871 msg="total unused blobs removed: 0" time=2026-06-10T12:57:29.939+08:00 level=INFO source=routes.go:1981 msg="Listening on 127.0.0.1:11434 (version 0.30.7)" time=2026-06-10T12:57:29.941+08:00 level=INFO source=runner.go:60 msg="discovering available GPUs..." time=2026-06-10T12:57:29.942+08:00 level=INFO source=model_list_cache.go:111 msg="model list cache hydration complete" models=2 failures=0 elapsed=3.169583ms time=2026-06-10T12:57:30.096+08:00 level=INFO source=types.go:32 msg="inference compute" id=0 filter_id=0 library=Metal compute=0.0 name=MTL0 description="Apple M2 Pro" libdirs="" driver=0.0 pci_id="" type=iGPU total="11.8 GiB" available="11.8 GiB" time=2026-06-10T12:57:30.096+08:00 level=INFO source=routes.go:2031 msg="vram-based default context" total_vram="11.8 GiB" default_num_ctx=4096 [GIN] 2026/06/10 - 12:57:30 | 200 | 57.458µs | 127.0.0.1 | GET "/api/version" [GIN] 2026/06/10 - 12:57:30 | 200 | 36µs | 127.0.0.1 | GET "/api/version" [GIN] 2026/06/10 - 12:57:31 | 401 | 1.009553667s | 127.0.0.1 | POST "/api/me" time=2026-06-10T12:57:31.116+08:00 level=INFO source=model_recommendations.go:177 msg="model recommendations cache sleep scheduled" wait=3h21m49.049065494s consecutive_failures=0 [GIN] 2026/06/10 - 12:58:35 | 200 | 19.540708ms | 127.0.0.1 | POST "/api/create" [GIN] 2026/06/10 - 12:58:40 | 200 | 1.6585ms | 127.0.0.1 | GET "/v1/models" [GIN] 2026/06/10 - 12:58:58 | 404 | 14.75µs | 127.0.0.1 | GET "/api/v1/models" [GIN] 2026/06/10 - 12:58:58 | 200 | 1.0325ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/06/10 - 12:58:59 | 200 | 110.717583ms | 127.0.0.1 | POST "/api/show" time=2026-06-10T12:59:00.698+08:00 level=INFO source=sched.go:1148 msg="disabling mmap for llama-server load by default" model=/Users/admin/.ollama/models/blobs/sha256-96c415656d377afbff962f6cdb2394ab092ccbcbaab4b82525bc4ca800fe8a49 reason=metal_partial_offload time=2026-06-10T12:59:00.698+08:00 level=INFO source=server.go:109 msg="using llama-server for model" model=/Users/admin/.ollama/models/blobs/sha256-96c415656d377afbff962f6cdb2394ab092ccbcbaab4b82525bc4ca800fe8a49 time=2026-06-10T12:59:00.699+08:00 level=INFO source=llama_server.go:403 msg="starting llama-server" cmd="/Applications/Ollama.app/Contents/Resources/llama-server --model /Users/admin/.ollama/models/blobs/sha256-96c415656d377afbff962f6cdb2394ab092ccbcbaab4b82525bc4ca800fe8a49 --port 52427 --host 127.0.0.1 --no-webui --offline -c 131072 -np 1 --log-verbosity 4 --no-log-prefix --no-log-timestamps --no-mmap --flash-attn auto -b 512 -ub 512" time=2026-06-10T12:59:00.701+08:00 level=INFO source=sched.go:613 msg="system memory" total="16.0 GiB" free="6.8 GiB" free_swap="0 B" time=2026-06-10T12:59:00.701+08:00 level=INFO source=sched.go:620 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-06-10T12:59:00.701+08:00 level=INFO source=llama_server.go:886 msg="loading model via llama-server" model=/Users/admin/.ollama/models/blobs/sha256-96c415656d377afbff962f6cdb2394ab092ccbcbaab4b82525bc4ca800fe8a49 time=2026-06-10T12:59:00.701+08:00 level=INFO source=llama_server.go:1131 msg="waiting for llama-server to start responding" time=2026-06-10T12:59:00.701+08:00 level=INFO source=llama_server.go:1186 msg="waiting for llama-server to become available" status="llm server not responding" common_params_print_info: build 1 (6f3a9f3de) with AppleClang 21.0.0.21000099 for Darwin arm64 log_info: verbosity = 4 (adjust with the `-lv N` CLI arg) device_info: - MTL0 : Apple M2 Pro (12124 MiB, 12123 MiB free) - BLAS : Accelerate (0 MiB, 0 MiB free) - CPU : Apple M2 Pro (16384 MiB, 16384 MiB free) system_info: n_threads = 6 (n_threads_batch = 6) / 10 | MTL : EMBED_LIBRARY = 1 | CPU : NEON = 1 | ARM_FMA = 1 | FP16_VA = 1 | DOTPROD = 1 | LLAMAFILE = 1 | ACCELERATE = 1 | REPACK = 1 | srv init: using 9 threads for HTTP server srv init: The UI is disabled srv init: Use --ui/--no-ui (or deprecated --webui/--no-webui) to enable/disable srv start: binding port with default address family srv llama_server: loading model srv load_model: loading model '/Users/admin/.ollama/models/blobs/sha256-96c415656d377afbff962f6cdb2394ab092ccbcbaab4b82525bc4ca800fe8a49' common_init_result: fitting params to device memory ... common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) common_params_fit_impl: getting device memory data for initial parameters: common_memory_breakdown_print: | memory breakdown [MiB] | total free self model context compute unaccounted | common_memory_breakdown_print: | - MTL0 (Apple M2 Pro) | 12124 = 12123 + (11589 = 4168 + 7168 + 253) + -11588 | common_memory_breakdown_print: | - Host | 576 = 292 + 0 + 284 | common_params_fit_impl: projected to use 11589 MiB of device memory vs. 12123 MiB of free device memory common_params_fit_impl: cannot meet free memory target of 1024 MiB, need to reduce device memory by 489 MiB common_params_fit_impl: context size set by user to 131072 -> no change common_params_fit_impl: id=0, target=11099 MiB time=2026-06-10T12:59:00.953+08:00 level=INFO source=llama_server.go:1186 msg="waiting for llama-server to become available" status="llm server loading model" common_memory_breakdown_print: | memory breakdown [MiB] | total free self model context compute unaccounted | common_memory_breakdown_print: | - MTL0 (Apple M2 Pro) | 12124 = 12123 + ( 0 = 0 + 0 + 0) + 0 | common_memory_breakdown_print: | - Host | 7995 = 293 + 7168 + 534 | common_memory_breakdown_print: | - CPU_REPACK | 4166 = 4166 + 0 + 0 | common_params_fit_impl: memory for test allocation by device: common_params_fit_impl: id=0, n_layer= 0, n_part= 0, overflow_type=4, mem= 0 MiB common_params_fit_impl: filling dense layers back-to-front: common_memory_breakdown_print: | memory breakdown [MiB] | total free self model context compute unaccounted | common_memory_breakdown_print: | - MTL0 (Apple M2 Pro) | 12124 = 12123 + (11589 = 4168 + 7168 + 253) + -11588 | common_memory_breakdown_print: | - Host | 576 = 292 + 0 + 284 | common_params_fit_impl: memory for test allocation by device: common_params_fit_impl: id=0, n_layer=29, n_part= 0, overflow_type=4, mem= 11589 MiB common_params_fit_impl: start filling device 0, delta=29 common_memory_breakdown_print: | memory breakdown [MiB] | total free self model context compute unaccounted | common_memory_breakdown_print: | - MTL0 (Apple M2 Pro) | 12124 = 12123 + (10792 = 3883 + 6656 + 253) + -10792 | common_memory_breakdown_print: | - Host | 1338 = 292 + 512 + 534 | common_memory_breakdown_print: | - CPU_REPACK | 284 = 284 + 0 + 0 | common_params_fit_impl: memory for test allocation by device: common_params_fit_impl: id=0, n_layer=27, n_part= 0, overflow_type=4, mem= 10792 MiB common_params_fit_impl: set ngl_per_device[0].n_layer=27 common_memory_breakdown_print: | memory breakdown [MiB] | total free self model context compute unaccounted | common_memory_breakdown_print: | - MTL0 (Apple M2 Pro) | 12124 = 12123 + (11190 = 4025 + 6912 + 253) + -11190 | common_memory_breakdown_print: | - Host | 1082 = 292 + 256 + 534 | common_memory_breakdown_print: | - CPU_REPACK | 142 = 142 + 0 + 0 | common_params_fit_impl: memory for test allocation by device: common_params_fit_impl: id=0, n_layer=28, n_part= 0, overflow_type=4, mem= 11190 MiB common_params_fit_impl: set ngl_per_device_high[0].n_layer=28 common_params_fit_impl: - MTL0 (Apple M2 Pro): 27 layers, 10792 MiB used, 1331 MiB free common_fit_params: successfully fit params to free device memory common_fit_params: fitting params to free memory took 0.70 seconds llama_model_loader: loaded meta data with 26 key-value pairs and 339 tensors from /Users/admin/.ollama/models/blobs/sha256-96c415656d377afbff962f6cdb2394ab092ccbcbaab4b82525bc4ca800fe8a49 (version GGUF V3 (latest)) llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. llama_model_loader: - kv 0: general.architecture str = qwen2 llama_model_loader: - kv 1: general.type str = model llama_model_loader: - kv 2: general.name str = DeepSeek R1 Distill Qwen 7B llama_model_loader: - kv 3: general.basename str = DeepSeek-R1-Distill-Qwen llama_model_loader: - kv 4: general.size_label str = 7B llama_model_loader: - kv 5: qwen2.block_count u32 = 28 llama_model_loader: - kv 6: qwen2.context_length u32 = 131072 llama_model_loader: - kv 7: qwen2.embedding_length u32 = 3584 llama_model_loader: - kv 8: qwen2.feed_forward_length u32 = 18944 llama_model_loader: - kv 9: qwen2.attention.head_count u32 = 28 llama_model_loader: - kv 10: qwen2.attention.head_count_kv u32 = 4 llama_model_loader: - kv 11: qwen2.rope.freq_base f32 = 10000.000000 llama_model_loader: - kv 12: qwen2.attention.layer_norm_rms_epsilon f32 = 0.000001 llama_model_loader: - kv 13: general.file_type u32 = 15 llama_model_loader: - kv 14: tokenizer.ggml.model str = gpt2 llama_model_loader: - kv 15: tokenizer.ggml.pre str = qwen2 llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,152064] = ["!", "\"", "#", "$", "%", "&", "'", ... llama_model_loader: - kv 17: tokenizer.ggml.token_type arr[i32,152064] = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ... llama_model_loader: - kv 18: tokenizer.ggml.merges arr[str,151387] = ["Ġ Ġ", "ĠĠ ĠĠ", "i n", "Ġ t",... llama_model_loader: - kv 19: tokenizer.ggml.bos_token_id u32 = 151646 llama_model_loader: - kv 20: tokenizer.ggml.eos_token_id u32 = 151643 llama_model_loader: - kv 21: tokenizer.ggml.padding_token_id u32 = 151643 llama_model_loader: - kv 22: tokenizer.ggml.add_bos_token bool = true llama_model_loader: - kv 23: tokenizer.ggml.add_eos_token bool = false llama_model_loader: - kv 24: tokenizer.chat_template str = {% if not add_generation_prompt is de... llama_model_loader: - kv 25: general.quantization_version u32 = 2 llama_model_loader: - type f32: 141 tensors llama_model_loader: - type q4_K: 169 tensors llama_model_loader: - type q6_K: 29 tensors print_info: file format = GGUF V3 (latest) print_info: file type = Q4_K - Medium print_info: file size = 4.36 GiB (4.91 BPW) llama_prepare_model_devices: using device MTL0 (Apple M2 Pro) (unknown id) - 12123 MiB free load: 0 unused tokens load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden load: printing all EOG tokens: load: - 128247 ('') load: - 151643 ('<｜end▁of▁sentence｜>') load: - 151662 ('<|fim_pad|>') load: - 151663 ('<|repo_name|>') load: - 151664 ('<|file_sep|>') load: special tokens cache size = 23 load: token to piece cache size = 0.9310 MB print_info: arch = qwen2 print_info: vocab_only = 0 print_info: no_alloc = 0 print_info: n_ctx_train = 131072 print_info: n_embd = 3584 print_info: n_embd_inp = 3584 print_info: n_layer = 28 print_info: n_head = 28 print_info: n_head_kv = 4 print_info: n_rot = 128 print_info: n_swa = 0 print_info: is_swa_any = 0 print_info: n_embd_head_k = 128 print_info: n_embd_head_v = 128 print_info: n_gqa = 7 print_info: n_embd_k_gqa = 512 print_info: n_embd_v_gqa = 512 print_info: f_norm_eps = 0.0e+00 print_info: f_norm_rms_eps = 1.0e-06 print_info: f_clamp_kqv = 0.0e+00 print_info: f_max_alibi_bias = 0.0e+00 print_info: f_logit_scale = 0.0e+00 print_info: f_attn_scale = 0.0e+00 print_info: f_attn_value_scale = 0.0000 print_info: n_ff = 18944 print_info: n_expert = 0 print_info: n_expert_used = 0 print_info: n_expert_groups = 0 print_info: n_group_used = 0 print_info: causal attn = 1 print_info: pooling type = -1 print_info: rope type = 2 print_info: rope scaling = linear print_info: freq_base_train = 10000.0 print_info: freq_scale_train = 1 print_info: n_ctx_orig_yarn = 131072 print_info: rope_yarn_log_mul = 0.0000 print_info: rope_finetuned = unknown print_info: model type = 7B print_info: model params = 7.62 B print_info: general.name = DeepSeek R1 Distill Qwen 7B print_info: vocab type = BPE print_info: n_vocab = 152064 print_info: n_merges = 151387 print_info: BOS token = 151646 '<｜begin▁of▁sentence｜>' print_info: EOS token = 151643 '<｜end▁of▁sentence｜>' print_info: EOT token = 151643 '<｜end▁of▁sentence｜>' print_info: PAD token = 151643 '<｜end▁of▁sentence｜>' print_info: LF token = 198 'Ċ' print_info: FIM PRE token = 151659 '<|fim_prefix|>' print_info: FIM SUF token = 151661 '<|fim_suffix|>' print_info: FIM MID token = 151660 '<|fim_middle|>' print_info: FIM PAD token = 151662 '<|fim_pad|>' print_info: FIM REP token = 151663 '<|repo_name|>' print_info: FIM SEP token = 151664 '<|file_sep|>' print_info: EOG token = 128247 '' print_info: EOG token = 151643 '<｜end▁of▁sentence｜>' print_info: EOG token = 151662 '<|fim_pad|>' print_info: EOG token = 151663 '<|repo_name|>' print_info: EOG token = 151664 '<|file_sep|>' print_info: max token length = 256 load_tensors: loading model tensors, this can take a while... (mmap = false, direct_io = false) load_tensors: offloading output layer to GPU load_tensors: offloading 26 repeating layers to GPU load_tensors: offloaded 27/29 layers to GPU load_tensors: CPU model buffer size = 292.45 MiB load_tensors: CPU_REPACK model buffer size = 284.32 MiB load_tensors: MTL0 model buffer size = 3883.68 MiB ................................................................................... common_init_result: added logit bias = -inf common_init_result: added <｜end▁of▁sentence｜> logit bias = -inf common_init_result: added <|fim_pad|> logit bias = -inf common_init_result: added <|repo_name|> logit bias = -inf common_init_result: added <|file_sep|> logit bias = -inf llama_context: constructing llama_context llama_context: n_seq_max = 1 llama_context: n_ctx = 131072 llama_context: n_ctx_seq = 131072 llama_context: n_batch = 512 llama_context: n_ubatch = 512 llama_context: causal_attn = 1 llama_context: flash_attn = auto llama_context: kv_unified = false llama_context: freq_base = 10000.0 llama_context: freq_scale = 1 llama_context: n_rs_seq = 0 llama_context: n_outputs_max = 1 ggml_metal_init: allocating ggml_metal_init: found device: Apple M2 Pro ggml_metal_init: picking default device: Apple M2 Pro ggml_metal_init: use fusion = true ggml_metal_init: use concurrency = true ggml_metal_init: use graph optimize = true llama_context: CPU output buffer size = 0.58 MiB llama_kv_cache: CPU KV buffer size = 512.00 MiB time=2026-06-10T12:59:05.411+08:00 level=INFO source=llama_server.go:1186 msg="waiting for llama-server to become available" status="llm server not responding" llama_kv_cache: MTL0 KV buffer size = 6656.00 MiB time=2026-06-10T12:59:07.476+08:00 level=INFO source=llama_server.go:1186 msg="waiting for llama-server to become available" status="llm server loading model" llama_kv_cache: size = 7168.00 MiB (131072 cells, 28 layers, 1/1 seqs), K (f16): 3584.00 MiB, V (f16): 3584.00 MiB llama_kv_cache: attn_rot_k = 0, n_embd_head_k_all = 128 llama_kv_cache: attn_rot_v = 0, n_embd_head_k_all = 128 sched_reserve: reserving ... sched_reserve: Flash Attention was auto, set to enabled sched_reserve: resolving fused Gated Delta Net support: sched_reserve: fused Gated Delta Net (autoregressive) enabled sched_reserve: fused Gated Delta Net (chunked) enabled sched_reserve: MTL0 compute buffer size = 253.01 MiB sched_reserve: CPU compute buffer size = 267.01 MiB sched_reserve: graph nodes = 958 sched_reserve: graph splits = 2 sched_reserve: reserve took 430.88 ms, sched copies = 1 common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) srv load_model: initializing slots, n_slots = 1 common_speculative_init: no implementations specified for speculative decoding slot load_model: id 0 | task -1 | new slot, n_ctx = 131072 srv load_model: prompt cache is enabled, size limit: 8192 MiB srv load_model: use `--cache-ram 0` to disable the prompt cache srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 srv load_model: context checkpoints enabled, max = 32, min spacing = 256 srv init: --cache-idle-slots requires --kv-unified, disabling init: chat template, example_format: 'You are a helpful assistant<｜User｜>Hello<｜Assistant｜>Hi there<｜end▁of▁sentence｜><｜User｜>How are you?<｜Assistant｜>' srv init: init: chat template, thinking = 1 srv llama_server: model loaded srv llama_server: server is listening on http://127.0.0.1:52427 srv update_slots: all slots are idle time=2026-06-10T12:59:10.805+08:00 level=INFO source=llama_server.go:1198 msg="llama-server started in 10.10 seconds" time=2026-06-10T12:59:10.855+08:00 level=INFO source=images.go:354 msg="template selection" model=registry.ollama.ai/library/deepseek-r1-7b-131k:latest selected=gguf_chat_template renderer="" parser="" go_template=[completion] chat_template="[tools thinking completion]" harmony=null renderer_parser=null time=2026-06-10T12:59:10.858+08:00 level=INFO source=sched.go:729 msg="loaded runners" count=1 time=2026-06-10T12:59:10.859+08:00 level=INFO source=llama_server.go:1131 msg="waiting for llama-server to start responding" time=2026-06-10T12:59:10.859+08:00 level=INFO source=llama_server.go:1198 msg="llama-server started in 10.16 seconds" srv log_server_r: done request: POST /apply-template 127.0.0.1 200 srv log_server_r: done request: POST /tokenize 127.0.0.1 200 srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=20863, media=0, n_before_user=5042 slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = -1 srv get_availabl: updating prompt cache srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 131072 tokens, 8589934592 est) srv get_availabl: prompt cache update took 0.00 ms slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 0 | processing task, is_child = 0 slot update_slots: id 0 | task 0 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 5054 slot update_slots: id 0 | task 0 | cached n_tokens = 0, memory_seq_rm [0, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 0 | cached n_tokens = 512, memory_seq_rm [512, end) slot update_slots: id 0 | task 0 | cached n_tokens = 1024, memory_seq_rm [1024, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 1536, progress = 0.30, t = 4.41 s / 348.10 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 1536, memory_seq_rm [1536, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 2048, progress = 0.41, t = 6.07 s / 337.28 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 2048, memory_seq_rm [2048, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 2560, progress = 0.51, t = 7.77 s / 329.58 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 2560, memory_seq_rm [2560, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 3072, progress = 0.61, t = 9.50 s / 323.44 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 3072, memory_seq_rm [3072, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 3584, progress = 0.71, t = 11.26 s / 318.27 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 3584, memory_seq_rm [3584, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 4096, progress = 0.81, t = 13.07 s / 313.49 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 4096, memory_seq_rm [4096, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 4608, progress = 0.91, t = 14.91 s / 309.10 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 4608, memory_seq_rm [4608, end) slot print_timing: id 0 | task 0 | prompt processing, n_tokens = 5042, progress = 1.00, t = 17.02 s / 296.28 tokens per second slot update_slots: id 0 | task 0 | cached n_tokens = 5042, memory_seq_rm [5042, end) slot init_sampler: id 0 | task 0 | init sampler, took 0.75 ms, tokens: text = 5054, total = 5054 slot print_timing: id 0 | task 0 | prompt eval time = 18906.48 ms / 5054 tokens ( 3.74 ms per token, 267.32 tokens per second) slot print_timing: id 0 | task 0 | eval time = 3190.19 ms / 76 tokens ( 41.98 ms per token, 23.82 tokens per second) slot print_timing: id 0 | task 0 | total time = 22096.67 ms / 5130 tokens slot print_timing: id 0 | task 0 | graphs reused = 74 slot release: id 0 | task 0 | stop processing: n_tokens = 5129, truncated = 0 srv update_slots: all slots are idle [GIN] 2026/06/10 - 12:59:33 | 200 | 32.502736s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2026/06/10 - 12:59:33 | 404 | 386.125µs | 127.0.0.1 | GET "/api/v1/models" [GIN] 2026/06/10 - 12:59:33 | 200 | 5.405ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/06/10 - 12:59:33 | 200 | 3.697084ms | 127.0.0.1 | GET "/v1/models" [GIN] 2026/06/10 - 12:59:42 | 404 | 18µs | 127.0.0.1 | GET "/api/v1/models" [GIN] 2026/06/10 - 12:59:42 | 200 | 1.4115ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/06/10 - 12:59:42 | 200 | 8.886833ms | 127.0.0.1 | POST "/api/show" srv log_server_r: done request: POST /apply-template 127.0.0.1 200 srv log_server_r: done request: POST /tokenize 127.0.0.1 200 srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=20863, media=0, n_before_user=5042 slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 1.000 (> 0.100 thold), f_keep = 0.983 slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 87 | processing task, is_child = 0 slot update_slots: id 0 | task 87 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 5045 slot update_slots: id 0 | task 87 | cached n_tokens = 5043, memory_seq_rm [5043, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot init_sampler: id 0 | task 87 | init sampler, took 0.60 ms, tokens: text = 5045, total = 5045 slot print_timing: id 0 | task 87 | prompt eval time = 254.91 ms / 2 tokens ( 127.45 ms per token, 7.85 tokens per second) slot print_timing: id 0 | task 87 | eval time = 701.42 ms / 19 tokens ( 36.92 ms per token, 27.09 tokens per second) slot print_timing: id 0 | task 87 | total time = 956.33 ms / 21 tokens slot print_timing: id 0 | task 87 | graphs reused = 91 slot release: id 0 | task 87 | stop processing: n_tokens = 5063, truncated = 0 srv update_slots: all slots are idle [GIN] 2026/06/10 - 12:59:45 | 200 | 1.161088584s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2026/06/10 - 12:59:45 | 404 | 8.167µs | 127.0.0.1 | GET "/api/v1/models" [GIN] 2026/06/10 - 12:59:45 | 200 | 2.980041ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/06/10 - 12:59:45 | 200 | 3.243792ms | 127.0.0.1 | GET "/v1/models" [GIN] 2026/06/10 - 13:02:39 | 404 | 616.666µs | 127.0.0.1 | GET "/api/v1/models" [GIN] 2026/06/10 - 13:02:39 | 200 | 14.189ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/06/10 - 13:02:40 | 200 | 9.4665ms | 127.0.0.1 | POST "/api/show" srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=0, media=0, n_before_user=1 slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 52424055893 srv get_availabl: updating prompt cache srv prompt_save: - saving prompt with length 5063, total state size = 276.941 MiB (draft: 0.000 MiB) srv load: - looking for better prompt, base f_keep = 0.000, sim = 0.000 srv update: - cache state: 1 prompts, 276.941 MiB (limits: 8192.000 MiB, 131072 tokens, 149764 est) srv update: - prompt 0x9731a1550: 5063 tokens, checkpoints: 0, 276.941 MiB srv get_availabl: prompt cache update took 154.41 ms slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 107 | processing task, is_child = 0 slot update_slots: id 0 | task 107 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 12285 slot update_slots: id 0 | task 107 | cached n_tokens = 1, memory_seq_rm [1, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 107 | cached n_tokens = 513, memory_seq_rm [513, end) slot update_slots: id 0 | task 107 | cached n_tokens = 1025, memory_seq_rm [1025, end) slot print_timing: id 0 | task 107 | prompt processing, n_tokens = 1536, progress = 0.13, t = 3.88 s / 396.23 tokens per second slot update_slots: id 0 | task 107 | cached n_tokens = 1537, memory_seq_rm [1537, end) [GIN] 2026/06/10 - 13:02:45 | 500 | 4.942936459s | 127.0.0.1 | POST "/v1/chat/completions" srv stop: cancel task, id_task = 107 srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=0, media=0, n_before_user=1 slot release: id 0 | task 107 | stop processing: n_tokens = 2049, truncated = 0 slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.167 (> 0.100 thold), f_keep = 1.000 slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 113 | processing task, is_child = 0 slot update_slots: id 0 | task 113 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 12285 slot update_slots: id 0 | task 113 | cached n_tokens = 2049, memory_seq_rm [2049, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 113 | cached n_tokens = 2561, memory_seq_rm [2561, end) slot print_timing: id 0 | task 113 | prompt processing, n_tokens = 1024, progress = 0.25, t = 3.40 s / 301.55 tokens per second slot update_slots: id 0 | task 113 | cached n_tokens = 3073, memory_seq_rm [3073, end) [GIN] 2026/06/10 - 13:02:50 | 500 | 4.907341583s | 127.0.0.1 | POST "/v1/chat/completions" srv stop: cancel task, id_task = 113 slot release: id 0 | task 113 | stop processing: n_tokens = 3585, truncated = 0 srv update_slots: all slots are idle srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=0, media=0, n_before_user=1 slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.292 (> 0.100 thold), f_keep = 1.000 slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 118 | processing task, is_child = 0 slot update_slots: id 0 | task 118 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 12285 slot update_slots: id 0 | task 118 | cached n_tokens = 3585, memory_seq_rm [3585, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 118 | cached n_tokens = 4097, memory_seq_rm [4097, end) slot update_slots: id 0 | task 118 | cached n_tokens = 4609, memory_seq_rm [4609, end) [GIN] 2026/06/10 - 13:02:56 | 500 | 4.8857475s | 127.0.0.1 | POST "/v1/chat/completions" slot print_timing: id 0 | task 118 | prompt processing, n_tokens = 1536, progress = 0.42, t = 4.86 s / 315.81 tokens per second slot update_slots: id 0 | task 118 | cached n_tokens = 5121, memory_seq_rm [5121, end) srv stop: cancel task, id_task = 118 srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=0, media=0, n_before_user=1 slot release: id 0 | task 118 | stop processing: n_tokens = 5633, truncated = 0 slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.459 (> 0.100 thold), f_keep = 1.000 slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 124 | processing task, is_child = 0 slot update_slots: id 0 | task 124 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 12285 slot update_slots: id 0 | task 124 | cached n_tokens = 5633, memory_seq_rm [5633, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 124 | cached n_tokens = 6145, memory_seq_rm [6145, end) [GIN] 2026/06/10 - 13:03:01 | 500 | 4.876265208s | 127.0.0.1 | POST "/v1/chat/completions" srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=0, media=0, n_before_user=1 slot print_timing: id 0 | task 124 | prompt processing, n_tokens = 1024, progress = 0.54, t = 3.92 s / 261.51 tokens per second slot update_slots: id 0 | task 124 | cached n_tokens = 6657, memory_seq_rm [6657, end) srv stop: cancel task, id_task = 124 slot release: id 0 | task 124 | stop processing: n_tokens = 7169, truncated = 0 slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.584 (> 0.100 thold), f_keep = 1.000 slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 127 | processing task, is_child = 0 slot update_slots: id 0 | task 127 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 12285 slot update_slots: id 0 | task 127 | cached n_tokens = 7169, memory_seq_rm [7169, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 127 | cached n_tokens = 7681, memory_seq_rm [7681, end) [GIN] 2026/06/10 - 13:03:07 | 500 | 4.867307708s | 127.0.0.1 | POST "/v1/chat/completions" srv stop: cancel task, id_task = 127 srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=0, media=0, n_before_user=1 slot release: id 0 | task 127 | stop processing: n_tokens = 8193, truncated = 0 slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.667 (> 0.100 thold), f_keep = 1.000 slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 133 | processing task, is_child = 0 slot update_slots: id 0 | task 133 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 12285 slot update_slots: id 0 | task 133 | cached n_tokens = 8193, memory_seq_rm [8193, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 133 | cached n_tokens = 8705, memory_seq_rm [8705, end) slot print_timing: id 0 | task 133 | prompt processing, n_tokens = 1024, progress = 0.75, t = 4.29 s / 238.61 tokens per second slot update_slots: id 0 | task 133 | cached n_tokens = 9217, memory_seq_rm [9217, end) [GIN] 2026/06/10 - 13:03:13 | 500 | 4.933066958s | 127.0.0.1 | POST "/v1/chat/completions" srv stop: cancel task, id_task = 133 srv log_server_r: done request: POST /apply-template 127.0.0.1 200 srv log_server_r: done request: POST /tokenize 127.0.0.1 200 srv params_from_: Chat format: peg-native srv prompt_get_n: message_spans: last user message: byte_pos=106040, media=0, n_before_user=35043 slot release: id 0 | task 133 | stop processing: n_tokens = 9729, truncated = 0 slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = 52634300656 srv get_availabl: updating prompt cache srv prompt_save: - saving prompt with length 9729, total state size = 532.167 MiB (draft: 0.000 MiB) srv load: - looking for better prompt, base f_keep = 0.000, sim = 0.000 srv load: - found better prompt with f_keep = 0.708, sim = 0.102 srv update: - cache state: 1 prompts, 532.167 MiB (limits: 8192.000 MiB, 131072 tokens, 149765 est) srv update: - prompt 0x9731a0c90: 9729 tokens, checkpoints: 0, 532.167 MiB srv get_availabl: prompt cache update took 2573.29 ms slot launch_slot_: id 0 | task -1 | sampler chain: logits -> penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> ?top-p -> ?min-p -> ?xtc -> ?temp-ext -> dist slot launch_slot_: id 0 | task -1 | sampler params: repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000 dry_multiplier = 0.000, dry_base = 1.750, dry_allowed_length = 2, dry_penalty_last_n = 131072 top_k = 40, top_p = 1.000, min_p = 0.000, xtc_probability = 0.000, xtc_threshold = 0.100, typical_p = 1.000, top_n_sigma = -1.000, temp = 1.000 mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000, adaptive_target = -1.000, adaptive_decay = 0.900 slot launch_slot_: id 0 | task 138 | processing task, is_child = 0 slot update_slots: id 0 | task 138 | new prompt, n_ctx_slot = 131072, n_keep = 4, task.n_tokens = 35047 slot update_slots: id 0 | task 138 | cached n_tokens = 3584, memory_seq_rm [3584, end) srv log_server_r: done request: POST /v1/chat/completions 127.0.0.1 200 slot update_slots: id 0 | task 138 | cached n_tokens = 4096, memory_seq_rm [4096, end) slot update_slots: id 0 | task 138 | cached n_tokens = 4608, memory_seq_rm [4608, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 1536, progress = 0.15, t = 4.51 s / 340.82 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 5120, memory_seq_rm [5120, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 2048, progress = 0.16, t = 6.41 s / 319.61 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 5632, memory_seq_rm [5632, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 2560, progress = 0.18, t = 8.35 s / 306.55 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 6144, memory_seq_rm [6144, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 3072, progress = 0.19, t = 10.32 s / 297.71 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 6656, memory_seq_rm [6656, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 3584, progress = 0.20, t = 12.33 s / 290.74 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 7168, memory_seq_rm [7168, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 4096, progress = 0.22, t = 14.51 s / 282.25 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 7680, memory_seq_rm [7680, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 4608, progress = 0.23, t = 16.63 s / 277.17 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 8192, memory_seq_rm [8192, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 5120, progress = 0.25, t = 18.79 s / 272.54 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 8704, memory_seq_rm [8704, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 5632, progress = 0.26, t = 20.95 s / 268.87 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 9216, memory_seq_rm [9216, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 6144, progress = 0.28, t = 23.15 s / 265.44 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 9728, memory_seq_rm [9728, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 6656, progress = 0.29, t = 25.39 s / 262.13 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 10240, memory_seq_rm [10240, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 7168, progress = 0.31, t = 27.68 s / 258.96 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 10752, memory_seq_rm [10752, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 7680, progress = 0.32, t = 30.02 s / 255.82 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 11264, memory_seq_rm [11264, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 8192, progress = 0.34, t = 32.41 s / 252.78 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 11776, memory_seq_rm [11776, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 8704, progress = 0.35, t = 34.81 s / 250.01 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 12288, memory_seq_rm [12288, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 9216, progress = 0.37, t = 37.26 s / 247.34 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 12800, memory_seq_rm [12800, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 9728, progress = 0.38, t = 39.76 s / 244.67 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 13312, memory_seq_rm [13312, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 10240, progress = 0.39, t = 42.28 s / 242.22 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 13824, memory_seq_rm [13824, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 10752, progress = 0.41, t = 44.85 s / 239.73 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 14336, memory_seq_rm [14336, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 11264, progress = 0.42, t = 47.46 s / 237.34 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 14848, memory_seq_rm [14848, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 11776, progress = 0.44, t = 50.08 s / 235.16 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 15360, memory_seq_rm [15360, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 12288, progress = 0.45, t = 52.73 s / 233.05 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 15872, memory_seq_rm [15872, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 12800, progress = 0.47, t = 55.41 s / 231.00 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 16384, memory_seq_rm [16384, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 13312, progress = 0.48, t = 58.14 s / 228.98 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 16896, memory_seq_rm [16896, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 13824, progress = 0.50, t = 60.91 s / 226.97 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 17408, memory_seq_rm [17408, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 14336, progress = 0.51, t = 63.71 s / 225.00 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 17920, memory_seq_rm [17920, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 14848, progress = 0.53, t = 66.55 s / 223.12 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 18432, memory_seq_rm [18432, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 15360, progress = 0.54, t = 69.42 s / 221.26 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 18944, memory_seq_rm [18944, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 15872, progress = 0.56, t = 72.34 s / 219.42 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 19456, memory_seq_rm [19456, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 16384, progress = 0.57, t = 75.28 s / 217.63 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 19968, memory_seq_rm [19968, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 16896, progress = 0.58, t = 78.35 s / 215.65 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 20480, memory_seq_rm [20480, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 17408, progress = 0.60, t = 81.37 s / 213.94 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 20992, memory_seq_rm [20992, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 17920, progress = 0.61, t = 84.42 s / 212.26 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 21504, memory_seq_rm [21504, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 18432, progress = 0.63, t = 87.63 s / 210.33 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 22016, memory_seq_rm [22016, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 18944, progress = 0.64, t = 90.79 s / 208.65 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 22528, memory_seq_rm [22528, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 19456, progress = 0.66, t = 94.05 s / 206.86 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 23040, memory_seq_rm [23040, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 19968, progress = 0.67, t = 97.33 s / 205.16 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 23552, memory_seq_rm [23552, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 20480, progress = 0.69, t = 100.66 s / 203.46 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 24064, memory_seq_rm [24064, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 20992, progress = 0.70, t = 103.96 s / 201.93 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 24576, memory_seq_rm [24576, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 21504, progress = 0.72, t = 107.30 s / 200.41 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 25088, memory_seq_rm [25088, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 22016, progress = 0.73, t = 110.69 s / 198.90 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 25600, memory_seq_rm [25600, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 22528, progress = 0.75, t = 114.11 s / 197.42 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 26112, memory_seq_rm [26112, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 23040, progress = 0.76, t = 117.59 s / 195.93 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 26624, memory_seq_rm [26624, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 23552, progress = 0.77, t = 121.10 s / 194.48 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 27136, memory_seq_rm [27136, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 24064, progress = 0.79, t = 124.68 s / 193.01 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 27648, memory_seq_rm [27648, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 24576, progress = 0.80, t = 128.29 s / 191.57 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 28160, memory_seq_rm [28160, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 25088, progress = 0.82, t = 131.98 s / 190.09 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 28672, memory_seq_rm [28672, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 25600, progress = 0.83, t = 135.67 s / 188.69 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 29184, memory_seq_rm [29184, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 26112, progress = 0.85, t = 139.39 s / 187.33 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 29696, memory_seq_rm [29696, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 26624, progress = 0.86, t = 143.13 s / 186.02 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 30208, memory_seq_rm [30208, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 27136, progress = 0.88, t = 146.91 s / 184.71 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 30720, memory_seq_rm [30720, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 27648, progress = 0.89, t = 150.72 s / 183.44 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 31232, memory_seq_rm [31232, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 28160, progress = 0.91, t = 154.57 s / 182.18 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 31744, memory_seq_rm [31744, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 28672, progress = 0.92, t = 158.44 s / 180.96 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 32256, memory_seq_rm [32256, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 29184, progress = 0.93, t = 162.39 s / 179.71 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 32768, memory_seq_rm [32768, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 29696, progress = 0.95, t = 166.37 s / 178.50 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 33280, memory_seq_rm [33280, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 30208, progress = 0.96, t = 170.35 s / 177.33 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 33792, memory_seq_rm [33792, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 30720, progress = 0.98, t = 174.37 s / 176.18 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 34304, memory_seq_rm [34304, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 31232, progress = 0.99, t = 178.44 s / 175.03 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 34816, memory_seq_rm [34816, end) slot print_timing: id 0 | task 138 | prompt processing, n_tokens = 31459, progress = 1.00, t = 182.55 s / 172.33 tokens per second slot update_slots: id 0 | task 138 | cached n_tokens = 35043, memory_seq_rm [35043, end) slot init_sampler: id 0 | task 138 | init sampler, took 4.40 ms, tokens: text = 35047, total = 35047 slot print_timing: id 0 | task 138 | n_decoded = 100, tg = 11.91 t/s slot print_timing: id 0 | task 138 | n_decoded = 134, tg = 11.72 t/s slot print_timing: id 0 | task 138 | n_decoded = 171, tg = 11.83 t/s slot print_timing: id 0 | task 138 | n_decoded = 207, tg = 11.83 t/s slot print_timing: id 0 | task 138 | n_decoded = 245, tg = 11.90 t/s slot print_timing: id 0 | task 138 | n_decoded = 282, tg = 11.95 t/s slot print_timing: id 0 | task 138 | n_decoded = 319, tg = 11.96 t/s slot print_timing: id 0 | task 138 | n_decoded = 355, tg = 11.95 t/s slot print_timing: id 0 | task 138 | n_decoded = 392, tg = 11.96 t/s slot print_timing: id 0 | task 138 | n_decoded = 429, tg = 11.98 t/s slot print_timing: id 0 | task 138 | n_decoded = 464, tg = 11.95 t/s slot print_timing: id 0 | task 138 | n_decoded = 501, tg = 11.96 t/s slot print_timing: id 0 | task 138 | n_decoded = 537, tg = 11.96 t/s slot print_timing: id 0 | task 138 | n_decoded = 573, tg = 11.95 t/s slot print_timing: id 0 | task 138 | n_decoded = 609, tg = 11.95 t/s slot print_timing: id 0 | task 138 | n_decoded = 645, tg = 11.94 t/s slot print_timing: id 0 | task 138 | prompt eval time = 184655.35 ms / 31463 tokens ( 5.87 ms per token, 170.39 tokens per second) slot print_timing: id 0 | task 138 | eval time = 55222.14 ms / 659 tokens ( 83.80 ms per token, 11.93 tokens per second) slot print_timing: id 0 | task 138 | total time = 239877.49 ms / 32122 tokens slot print_timing: id 0 | task 138 | graphs reused = 745 slot release: id 0 | task 138 | stop processing: n_tokens = 35705, truncated = 0 srv update_slots: all slots are idle [GIN] 2026/06/10 - 13:07:17 | 200 | 4m3s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2026/06/10 - 13:07:18 | 404 | 338.084µs | 127.0.0.1 | GET "/api/v1/models" [GIN] 2026/06/10 - 13:07:18 | 200 | 10.718833ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/06/10 - 13:07:18 | 200 | 2.070083ms | 127.0.0.1 | GET "/v1/models"