Getting started with the Model Gallery models

To use the examples of requests using SDK:

1. Create a service account and assign the ai.languageModels.user role to it.

2. Get and save the service account's API key with yc.ai.foundationModels.execute for its scope.

   The following examples use API key authentication. Yandex Cloud ML SDK also supports IAM token and OAuth token authentication. For more information, see Authentication in Yandex Cloud ML SDK.

   Note

   If you are using Windows, we recommend installing the WSL shell first and using it to proceed.

3. Install Python 3.10 or higher.

4. Install Python venv to create isolated virtual environments in Python.

5. Create a new Python virtual environment and activate it:

   python3 -m venv new-env
   source new-env/bin/activate
   

6. Use the pip package manager to install the ML SDK library:

   pip install yandex-cloud-ml-sdk
   

1. Create a file named generate-text.py and paste the following code into it:

   #!/usr/bin/env python3
   
   from __future__ import annotations
   from yandex_cloud_ml_sdk import YCloudML
   
   messages = [
       {
           "role": "system",
           "text": "Find errors in the text and correct them",
       },
       {
           "role": "user",
           "text": """Laminate flooring is sutiable for instalation in the kitchen or in a child's 
   room. It withsatnds moisturre and mechanical dammage thanks to 
   a 0.2 mm thick proctive layer of melamine films and 
   a wax-treated interlocking system.""",
       },
   ]
   
   
   def main():
       sdk = YCloudML(
           folder_id="<folder_ID>",
           auth="<API_key>",
       )
   
       result = (
           sdk.models.chat("yandexgpt").configure(temperature=0.5).run(messages)
       )
   
       for alternative in result:
           print(alternative)
   
   
   if __name__ == "__main__":
       main()
   

   Where:

   Note

   As input data for a request, Yandex Cloud ML SDK can accept a string, a dictionary, an object of the TextMessage class, or an array containing any combination of these data types. For more information, see Yandex Cloud ML SDK usage.

   • messages: List of messages that set the context for the model:

     • role: Message sender's role:

       • user: To send user messages to the model.
       • system: To set the request context and define the model's behavior.
       • assistant: For responses generated by the model. In chat mode, the model's responses tagged with the assistant role are included in the message to save the conversation context. Do not send user messages with this role.

     • text: Message text.

   • <folder_ID>: ID of the folder in which the service account was created.

   • <API_key>: Service account API key you got earlier required for authentication in the API.

     The following examples use API key authentication. Yandex Cloud ML SDK also supports IAM token and OAuth token authentication. For more information, see Authentication in Yandex Cloud ML SDK.

   For more information about accessing a specific model version, see Accessing models.

2. Run the file you created:

   python3 generate-text.py
   

   Result:

   Alternative(role='assistant', text='Laminate flooring is suitable for installation in the kitchen or in a child's room. It withstands moisture and mechanical damage thanks to a 0.2 mm thick protective layer of melamine films and a wax-treated interlocking system.', status=<AlternativeStatus.FINAL: 3>)