[Jinja] GPT4All-Chat 3.6.1 bartowski/Phi-3.5-mini-instruct

[ThiloteE]

Meta-issue: #3340

Bug Report

Model does not work out of the box.

Steps to Reproduce

1. Download the gguf
2. sideload it in GPT4All-Chat
3. start chatting

Expected Behavior

Model works out of the box.

Your Environment

• GPT4All version: 3.6.1
• Operating System: Windows 10
• Model used (if applicable): microsoft/Phi-3.5-mini-instruct
• Link to model: https://huggingface.co/microsoft/Phi-3.5-mini-instruct
• Link to gguf of model: https://huggingface.co/bartowski/Phi-3.5-mini-instruct-GGUF

Original Jinja chat template in tokenizer_config.json of https://huggingface.co/microsoft/Phi-3.5-mini-instruct

{% for message in messages %}{% if message['role'] == 'system' and message['content'] %}{{'<|system|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'user' %}{{'<|user|>\n' + message['content'] + '<|end|>\n'}}{% elif message['role'] == 'assistant' %}{{'<|assistant|>\n' + message['content'] + '<|end|>\n'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>\n' }}{% else %}{{ eos_token }}{% endif %}

Jinja chat template out of the box in GPT4All-Chat 3.6.1, but still has EOS issues:

{%- for message in messages %}
    {%- if message['role'] == 'system' and message['content'] %}
        {{- '<|system|>\n' + message['content'] + '<|end|>\n' }}
    {%- elif message['role'] == 'user' %}
        {{- '<|user|>\n' + message['content'] + '<|end|>\n' }}
    {%- elif message['role'] == 'assistant' %}
        {{- '<|assistant|>\n' + message['content'] + '<|end|>\n' }}
    {%- endif %}
{%- endfor %}
{%- if add_generation_prompt %}
    {{- '<|assistant|>\n' }}
{%- else %}
    {{- eos_token }}
{%- endif %}