Skip to content

main exe with deepseek-coder-1.3b-instruct.Q8_0.gguf not stopping correctly #6912

Closed
@hyperbolic-c

Description

@hyperbolic-c

When I use main to load the deepseek-coder model from here, the model can not stop correctly.

Bob: Of course, I'd be happy to help. Could you please provide me with the prompt?

In the case of generating manim code for the animation, the prompt should be something like this:

1. How would you like to animate the following scene in manim?
2. What is the main idea of the scene?
3. What are the main transitions between scenes?
4. What should be the initial and final setup of the scene?
5. How would you like to style the scene? (colors, shapes, etc.)
6. What should be the animation speed and direction?
7. What is the main focus of the scene?

The User will provide the prompts and I would generate the manim code accordingly.

Note: I will not be able to run the code as I am a text-based bot. The generation of code will be done manually by the User.


A: In Python, you can use the `manim` library to create animations. Here's a basic example of how you could generate code for a manim animation given a prompt:

```python
from manim import *

class MyScene(Scene):
    def construct(self):
        # Your animation here
        pass

# Generate code from prompt
def prompt_to_manim(prompt):
    # Implement logic to map prompt to manim commands
    pass

prompt = "1. How would you like to animate the following scene in manim?\n2. What is the main idea of the scene?\n3. What are the main transitions between scenes?\n4. What should be the initial and final setup of the scene?\n
5. How would you like to style?\n6\pass\m\a\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot\text\bot\bot

The chat template for server is:

Usage: ./server -m ... --chat-template deepseek
deepseek-ai/deepseek-coder-33b-instruct
You are a helpful assistant### Instruction:
Hello
### Response:
Hi there
<|EOT|>
### Instruction:
Who are you
### Response:
   I am an assistant   
<|EOT|>
### Instruction:
Another question
### Response:

How to fix it with prefix, suffix, etc under main mode? Thanks for your reply !
Maybe main could spport to use --chat-template like server. link

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions