Work with assets¶

When you add a dataset, DataRobot ingests the source data and runs EDA1 to register the asset and make it available from the catalog.

This page describes how you can interact with your data once it's registered in DataRobot:

• Update asset details (name, tags, and descriptions).
• View and create feature lists.
• View and manage configured relationships.
• View version history.
• Add comments and have discussions within individual assets.
• Create a snapshot of a dynamic dataset.
• Keep data up-to-date by scheduling snapshots.
• Create a project from a catalog asset.

See also:

• Add data to the AI Catalog
• Understand asset states
• Schedule snapshots

Additionally, when Composable ML is enabled, you can save blueprints to the AI Catalog. From the catalog, a blueprint can be edited, used to train models in compatible projects, or shared.

Find existing assets¶

Once in the AI Catalog, there are a variety of tools to help quickly locate the data assets you want to work with. You can:

View asset information¶

Click an asset in the catalog to view an overview of the asset's details as well as metadata.

Profile your data¶

The Profile tab allows you to preview dataset column names and row data. It can be useful for finding or verifying column names when writing Spark SQL statements for blended datasets.

Note that the preview is a random sample of up to 1MB of the data and may be ordered differently from the original data. To see the complete, original data, use the Download Dataset option.

To preview a dataset, select it in the main catalog and click the pencil icon () to access dataset information (if available).

1. Click the Profile tab to preview the contents of the dataset:

   

2. Use the Columns dropdown to select the number of columns to display on the page and the scroll bars to scroll through those columns. Additionally, you can use the Rows dropdown to cycle through available data, 20 rows at a time.

The Profile tab also displays details for all features in the dataset. To view details for a particular feature, scroll to it in the display and click. The Feature Details listed in the right panel update to reflect statistics for the feature. (These are the same statistics as those displayed on the Data for EDA1.)

View and create feature lists¶

You can create new lists and feature transformations for features of any dataset in the catalog. To work with the tools, select the dataset in the main catalog and Feature Lists in the left panel.

When you create feature lists, they are copied to a project upon creation. You can then set the list to use for the project from the Feature List dropdown at the top of the Project Data list. See the section on working with Feature Lists for complete details on creating, modifying, and understanding these lists.

The Feature List tab also provides access to a tool for creating variable type feature transformations. While DataRobot bases variable type assignments on the values seen during EDA, there are times when you may need to change the type. Refer to feature transformations documentation for complete details.

To create a feature list:

1. Use the checkboxes to the left of feature names to select a set of features.

2. Click the Create new feature list from selection link, which becomes active after you select the first feature.

   

3. In the resulting dialog, provide a name for the new list and click Submit. The new list becomes available through the dropdown.

You can delete or rename any feature list you created. You cannot make any changes to the DataRobot default feature lists.

Manage relationships¶

DataRobot’s Feature Discovery capability guides you through creating relationships, which define both the included datasets and how they are related to one another. The end product is a multitude of additional features that are a result of these linkings. The Feature Discovery engine analyzes the included datasets to determine a feature engineering “recipe” and, from that recipe, generates secondary features for training and predictions. Once these relationships are established, you can view them from the catalog.

To view relationships, select the dataset in the main catalog and click the Relationships tab to view, modify, or delete existing relationships:

See complete details of working with relationships before modifying relationship details.

View version history¶

The Version History tab lists all versions of a selected asset. The Status column indicates the snapshot status—green if successful, red if failed, gray if the original version did not have a snapshot.

Click a version to select it. Once selected, you can create a project from the version and download or delete the contents.

Add comments¶

The Comments tab allows you to add comments to—even host a discussion around—any item in the catalog that you have access to. Comment functionality is available in the AI Catalog (illustrated below), and also as a model tab from the Leaderboard and in use case tracking. With comments, you can:

• Tag other users in a comment; DataRobot will then send them an email notification.
• Edit or delete any comment you have added (you cannot edit or delete other users' comments).

Create a snapshot¶

You can uncheck Create Snapshot when adding external data connections, to meet certain security requirements, for example. Snapshotted materialized data is stored on disk; unmaterialized data is stored remotely as your asset and only downloaded when needed.

To determine whether an asset has been snapshotted, click on its catalog entry and check the details on the right. If it has been snapshotted, the last snapshot date displays; if not, a notification appears:

To create a snapshot for unmaterialized data:

1. Select the asset from the main catalog listing.

2. Expand the menu in the upper right and select Create Snapshot.

   

   You cannot update the snapshot parameters that were defined when the catalog entry was added; snapshots are based on the original SQL.

3. DataRobot prompts for any credentials needed to access the data source. Click Yes, take snapshot to proceed.

4. DataRobot runs EDA. New snapshots are available from the version history, with the newest ("latest") snapshot becoming the one used by default for the dataset.

Once EDA completes, the displayed status updates to "SNAPSHOT" and a message appears indicating that publishing is complete. If you want the asset to no longer be snapshotted, remove the asset and add it again, making sure to uncheck Create Snapshot.

Create a project¶

You can create new projects directly from the AI Catalog; you can also use listed datasets as a source for predictions.

To create a project, from the catalog main listing, click on an asset to select it. In the upper right, click Create project.

DataRobot runs EDA1 and loads the project. When complete, DataRobot displays the Start screen.