[jinja] GPT4All 3.6.1 GPT4All-Community_Phi-3.1-mini-128k-instruct (ready for substitution)

[ThiloteE]

Meta-issue: #3340

Bug Report

Model does not work out of the box

Steps to Reproduce

1. Download the gguf
2. sideload it in GPT4All-Chat
3. start chatting

Expected Behavior

Model works out of the box.

Your Environment

• GPT4All version: 3.6.1
• Operating System: Windows 10
• Link to gguf of model: https://huggingface.co/GPT4All-Community/Phi-3.1-mini-128k-instruct-GGUF

Jinja template out of the box in GPT4All-Chat 3.6.1 (does not work)

{% for message in messages %}{% if message['role'] == 'system' %}{{'<|system|>
' + message['content'] + '<|end|>
'}}{% elif message['role'] == 'user' %}{{'<|user|>
' + message['content'] + '<|end|>
'}}{% elif message['role'] == 'assistant' %}{{'<|assistant|>
' + message['content'] + '<|end|>
'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>
' }}{% else %}{{ eos_token }}{% endif %}

Jinja template made by ThiloteE (works)

{%- for message in messages %}
    {%- if message['role'] == 'system' %}
        {{- '<|system|>\n' + message['content'] + '<|end|>\n' }}
    {%- elif message['role'] == 'user' %}
        {{- '<|user|>\n' + message['content'] + '<|end|>\n' }}
    {%- elif message['role'] == 'assistant' %}
        {{- '<|assistant|>\n' + message['content'] + '<|end|>\n' }}
    {%- endif %}{% endfor %}
    {%- if add_generation_prompt %}
        {{- '<|assistant|>\n' }}
    {%- else %}
    {{- eos_token }}
    {%- endif %}