Databricks Databricks-Machine-Learning-Professional Exam Databricks-Machine-Learning-Professional Exam Questions

Feature drift is a change in the distribution of the input data over time, which can affect the performance and accuracy of the model. Monitoring feature drift is important to ensure that the model is still valid and reliable for the current data. One simple and low-cost method of monitoring numeric feature drift is to track the summary statistics trends of the input features, such as mean, standard deviation, minimum, maximum, etc. These statistics can be computed easily and efficiently, and can provide a quick overview of the changes in the data distribution. If the summary statistics deviate significantly from the baseline values, it may indicate a feature drift. However, summary statistics trends may not capture all the nuances of the data distribution, such as outliers, multimodality, skewness, etc.  Therefore, other methods, such as statistical tests or visualizations, may be needed to complement the summary statistics trends and provide a more comprehensive analysis of the feature drift 1 2 3   References :

Monitoring Feature Drift - Databricks

Monitor feature attribution skew and drift | Vertex AI | Google Cloud

Monitoring Model Drift - 6 Different Methodologies - Qualdo

 The mlflow.register_model function takes two arguments: model_uri and name. The model_uri is the URI of the model that was logged to MLflow, which can be obtained from the best run object. The name is the name of the registered model in the MLflow Model Registry. Therefore, the correct line of code to register the model is:

mlflow.register_model(model_uri, “best_model”)

This will create a new registered model with the name “best_model” and register the model version from the best run as the first version of that model.

References:

[mlflow.register_model — MLflow 1.22.0 documentation]

[MLflow Model Registry — Databricks Documentation]

[Manage MLflow Models — Databricks Documentation] Message has links.

Real-time deployment is a paradigm that can centrally compute predictions for a single record with exceedingly fast results. Real-time deployment involves exposing a model as a REST API endpoint that can receive requests and return predictions in milliseconds. This paradigm is suitable for scenarios where low latency and high throughput are required, such as fraud detection, recommendation systems, or chatbots. The other deployment paradigms are not as fast or as centralized as real-time deployment. Streaming deployment involves processing data streams in micro-batches, which can introduce some delay. Batch deployment involves processing large batches of data at scheduled intervals, which can take hours or days. Edge or on-device deployment involves deploying models to edge devices, such as mobile phones or IoT sensors, which can reduce the network overhead but also limit the computational power and model size.  https://docs.databricks.com/en/machine-learning/ml-tutorials.html

Real-time deployment is a type of model deployment where predictions are computed on-demand at query time. This can be useful when the feature values are not available until the time of delivery, and results are needed exceedingly fast for one record at a time.  Real-time deployment can leverage Databricks Model Serving, which allows users to host MLflow models as REST endpoints on Databricks 1 . The other options are incorrect because they either do not meet the requirements or are not supported by Databricks Machine Learning. Edge/on-device deployment is a type of model deployment where predictions are computed on the edge device, such as a smartphone or a sensor. This can be useful when there is limited or no network connectivity, or when privacy and security are important.  However, edge deployment is not supported by Databricks Machine Learning 2 . Streaming deployment is a type of model deployment where predictions are computed on streaming data, such as sensor readings or web logs. This can be useful when the data volume is high and the results need to be updated continuously.  However, streaming deployment is not supported by Databricks Model Serving 1 . Batch deployment is a type of model deployment where predictions are computed in advance and stored for later use. This can be useful when the feature values are known ahead of time and the predictions do not need to be delivered quickly. However, batch deployment does not meet the requirements of this scenario, as the feature values are not available until the time of delivery, and results are needed exceedingly fast for one record at a time.  References:   MLflow Model Serving ,  Model deployment patterns

Label drift is a type of data drift that occurs when there is a change in the probability of a label P(Y). This means that the output distribution of the model’s data source has changed over time, which can affect the performance and accuracy of the model. For example, if a model is trained to classify images of animals, and the data source starts to provide more images of cats than dogs, this would be an example of label drift. Label drift can be caused by various factors, such as changes in user behavior, environmental conditions, market trends, etc.  Label drift can be detected and handled by various methods, such as periodic retraining, online learning, ensemble methods, etc 1 2 3   References :

Monitoring Feature Drift - Databricks

Drift Metrics: How to Select the Right Metric to Analyze Drift

Detect data drift on datasets (preview) - Azure Machine Learning