Models
While using Yandex DataSphere, a VM's memory stores the interpreter state, as well as computing and training results. You can save these computations to a separate resource named model.
In DataSphere, there are two types of models available:
- Models trained in projects.
- Foundation models tuned based on the Fine-tuning method.
Once created, the model is available for the project. Like any other resource, you can publish the model in the community to use it in other projects. To do this, you need at least the Editor role in the project and the Developer role in the community you want to publish it in. You can open the access on the Access tab on the model view page. The resource available to the community will appear on the community page under Community resources.
Supported variable types
You can create a model based on different library types supported by serialzy. The table below provides a list of supported data and variable types.
| Library | Types | Data format |
|---|---|---|
| CatBoost | CatBoostRegressor, CatBoostClassifier, CatBoostRanker | cbm |
| CatBoost | Pool | quantized pool |
| Tensorflow.Keras | Sequential, Model with subclasses | tf_keras |
| Tensorflow | Checkpoint, Module with subclasses | tf_pure |
| LightGBM | LGBMClassifier, LGBMRegressor, LGBMRanker | lgbm |
| XGBoost | XGBClassifier, XGBRegressor, XGBRanker | xgb |
| Torch | Module with subclasses | pt |
| ONNX | ModelProto | onnx |
Information about models as a resource
All information about models created in a project is available under Resources and in the JupyterLab right-hand menu in the Models tab.
The following information is stored about each model:
- Name.
- Name of the notebook the model was created in.
- Name of the variable the model was created from.
- Model size in bytes.
- Name of the user who created the model.
- Dataset creation date in UTC format, e.g.,
July 18, 2023, 14:23.
To view model details, click its name in the project's model list.