About Single-Prompt Example¶

Important

Before you proceed with the example, make sure you followed all steps for setting up the environment.

In this example, we will write a program that will read user input (prompt in our context) from stdin and supply it to the LLM. Then, the LLM will give the response.

It may look complex at first and the explanations may be dull. The reason for that is to keep the examples short and to the point. To get further explanation and better understanding refer to Inference Information Reference

What will you learn¶

After you finish this example, you will understand:

How to download and access to open-source models.
Initializing and running models.
How the MBASE inference works in general.