Module markov.dispatchers.common_dispatch
Functions
def archive_dataset(ds_id: str) ‑> bool-
Archive the dataset info in the handler backend. Archived datasets would not be retrieved. These datasets can be deleted by going to the hub and manually deleting them. This extra step is there to prevent accidental deletes, and enable restoration. Restoration has to be done manually on the HUB.
Args
ds_id- dataset id of the dataset that needs to be archived.
Returns
True if the dataset has been archived.
def mkv_data_cred_check(data_check: DataSetRegistrationRequest)-
Check with Markov has access to the stored credentials for this specific data_set segment
Args
data_check:DataSetRegistrationRequest- DataSetStorageCred object
Returns:
-
Given the list of tags, find all the column_stats that match one or more tags.
Args
tags- List of tag strings. Note that only exact tag names would be matched.
Returns
List of URL's matching matching the column_stats that this user has access to
def mkv_find_metrics_uris_by_tag(tags: List[str]) ‑> List-
Given the list of tags, find all the metrics that match one or more tags.
Args
tags- List of tag strings. Note that only exact tag names would be matched.
Returns
List of URL's matching matching the column_stats that this user has access to.
def mkv_get_datasets_top_k(pattern, top_n=-1) ‑> List-
Return top_n datasets matching the pattern specified.
Args
pattern- pattern to search the datasets against
top_n- number of results to return. -1 means return all
Returns
List containing top_n datasets
def mkv_get_schema(df_id: str) ‑> Any-
Return the schema of the DataFamily given by the id.
Args
df_id- data_set family id of the dataFamily that we want to fetch the schema of. All dataSets of a datafamily
must adhere to a specific schema. Schema is defined as TODO
Returns
Schema of the dataset family.
def mkv_get_usage() ‑> str-
Display the quota page of this organization to this user, if they have access.
Returns:
def mkv_register_model_family(mf_reg_config: ModelFamilyRegisterConfig) ‑> Anydef mkv_register_model_record(model_reg_config: ModelRegistrationConfig)-
Given the ModelRegistrationConfig, register the model with Markov.
Args
model_reg_config- ModelRegistrationConfig object containing information about the Model to be Registered
Returns:
def mkv_run_model_evaluation(model_reg_config: ModelEvaluationRunConfig)def mkv_search_data_families_by_tag(tags: List[str]) ‑> List-
Find all the DataFamilies that match one or more user defined tags defined by the input 'tags.
Args
tags- List of tags to search for. Note that only exact tag names would be matched.
Returns
List of DataFamilies that have been tagged by one or more tags provided as input. If no datafamily matches the tag empty list would be returned.
def mkv_search_datasets_by_tag(tags: List[str]) ‑> List-
Find all the datasets that match one or more user defined tags defined by the input 'tags'.
Args
tags- List of tags to search for. Note that only exact tag names would be matched.
Returns
List of DataSets that have been tagged by one or more tags provided as input. If no dataset matches the tag empty list would be returned.
def new_ds_id() ‑> str-
Create a new DataSetID to associate with a dataset for this org/customer.
Returns
Unique data_set_id to unique identify a dataset.
def update_cli_version(cli_version: str)-
Update the CLI version on the backend for this user
Args
cli_version:str- user specified CLI version to be updated
Returns
cli_version response