You might want to use the file markers that the model outputs while being loaded by ollama:

    lm_load_print_meta: general.name     = Qwen2.5 7B Instruct 1M
    llm_load_print_meta: BOS token        = 151643 '<|endoftext|>'
    llm_load_print_meta: EOS token        = 151645 '<|im_end|>'
    llm_load_print_meta: EOT token        = 151645 '<|im_end|>'
    llm_load_print_meta: PAD token        = 151643 '<|endoftext|>'
    llm_load_print_meta: LF token         = 148848 'ÄĬ'
    llm_load_print_meta: FIM PRE token    = 151659 '<|fim_prefix|>'
    llm_load_print_meta: FIM SUF token    = 151661 '<|fim_suffix|>'
    llm_load_print_meta: FIM MID token    = 151660 '<|fim_middle|>'
    llm_load_print_meta: FIM PAD token    = 151662 '<|fim_pad|>'
    llm_load_print_meta: FIM REP token    = 151663 '<|repo_name|>'
    llm_load_print_meta: FIM SEP token    = 151664 '<|file_sep|>'
    llm_load_print_meta: EOG token        = 151643 '<|endoftext|>'
    llm_load_print_meta: EOG token        = 151645 '<|im_end|>'
    llm_load_print_meta: EOG token        = 151662 '<|fim_pad|>'
    llm_load_print_meta: EOG token        = 151663 '<|repo_name|>'
    llm_load_print_meta: EOG token        = 151664 '<|file_sep|>'
    llm_load_print_meta: max token length = 256