DP-3014 Implementing a Machine Learning solution with Azure Databricks

1 – Explore Azure Databricks

• Get started with Azure Databricks
• Identify Azure Databricks workloads
• Understand key concepts

2 – Use Apache Spark in Azure Databricks

• Get to know Spark
• Create a Spark cluster
• Use Spark in notebooks
• Use Spark to work with data files
• Visualize data

3 – Train a machine learning model in Azure Databricks

• Understand principles of machine learning
• Machine learning in Azure Databricks
• Prepare data for machine learning
• Train a machine learning model
• Evaluate a machine learning model

4 – Use MLflow in Azure Databricks

• Capabilities of MLflow
• Run experiments with MLflow
• Register and serve models with MLflow

5 – Tune hyperparameters in Azure Databricks

• Optimize hyperparameters with Hyperopt
• Review Hyperopt trials
• Scale Hyperopt trials

6 – Use AutoML in Azure Databricks

• What is AutoML?
• Use AutoML in the Azure Databricks user interface
• Use code to run an AutoML experiment

7 – Train deep learning models in Azure Databricks

• Understand deep learning concepts
• Train models with PyTorch
• Distribute PyTorch training with Horovod