Skip to main content

04.6.13.19 tinyllama-1.1b-chat-v1.0

Model description​

The @cf/tinyllama/tinyllama-1.1b-chat-v1.0 model includes two nodes:

  • tinyllama-1.1b-chat-v1.0 Prompt (preview)
  • tinyllama-1.1b-chat-v1.0 With History (preview)
note

Model ID: @cf/tinyllama/tinyllama-1.1b-chat-v1.0. The TinyLlama project aims to pre-train a 1.1 billion Llama model on 3 trillion tokens. It is a chat model refined from TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T.

The tinyllama-1.1b-chat-v1.0 model is a chat model that was trained based on a pre-trained TinyLlama model with 1.1 billion parameters.

The main features of this model are:

  1. It was pre-trained on 3 trillion tokens as part of the TinyLlama project. This allowed the model to gain extensive background knowledge.
  1. The model was then further trained (fine-tuned) specifically for chatbot tasks. This improved its ability to dialog, generate relevant and coherent responses.
  1. The result is a model that combines the powerful language base of TinyLlama with additional improvements for chatbot applications.

Thus, this model is intended for use in chatbots and other dialog systems where it is necessary to generate meaningful and context-sensitive responses.

Example of launching a node​

A description of the node fields can be found here.

Let's run the tinyllama-1.1b-chat-v1.0 Prompt (preview) node to process the text and generate a response with parameters:

  • User Prompt - What's the best way to start the day?;
  • Max Tokens (Answer Size) - 256.

The output of the node execution is JSON:

  • with a response to the "response" request;
  • with the status of the action "success": true.
JSON
{
  "result": {
    "errors": [],
    "messages": [],
    "result": {
      "response": "The best way to start the day is to make a list of things you want to accomplish that day - the goals you've set for yourself. Break those goals into smaller, more achievable tasks and schedule them so they start within an hour. Then, at the start of your day, take a deep breath, stretch, and thank yourself for committing to yourself to make these improvements to yourself. This will set the tone for your day and help you feel more motivated and unstoppable. Walking, taking a walk outside, or simply walking throughout your household for a while, could also be a really great start to any morning, depending on your situation."
    },
    "success": true
  }
}