To begin data preparation with the Apache Spark pool, specify the attached Spark Synapse compute name. Launch Synapse Spark pool for data wrangling tasks Link your Azure Machine Learning workspace and Azure Synapse Analytics workspace with the Azure Machine Learning Python SDK or via the Azure Machine Learning studioĪttach a Synapse Spark pool as a compute target. Install the azureml-synapse package (preview) with the following code: pip install azureml-synapse The Azure Machine Learning Python SDK installed.Ĭreate an Azure Machine Learning workspace.Ĭreate an Azure Synapse Analytics workspace in Azure portal.Ĭreate Apache Spark pool using Azure portal, web tools, or Synapse Studio.Ĭonfigure your development environment to install the Azure Machine Learning SDK, or use an Azure Machine Learning compute instance with the SDK already installed. With this integration, you can have a dedicated compute for data wrangling at scale, all within the same Python notebook you use for training your machine learning models. The Azure Synapse Analytics integration with Azure Machine Learning (preview) allows you to attach an Apache Spark pool backed by Azure Synapse for interactive data exploration and preparation. Azure Machine Learning and Azure Synapse Analytics integration If you prefer to use Azure Machine Learning pipelines, see How to use Apache Spark (powered by Azure Synapse Analytics) in your machine learning pipeline (preview).įor guidance on how to use Azure Synapse Analytics with a Synapse workspace, see the Azure Synapse Analytics get started series. In this article, you learn how to perform data wrangling tasks interactively within a dedicated Synapse session, powered by Azure Synapse Analytics, in a Jupyter notebook using the Azure Machine Learning Python SDK. We recommend using Managed (Automatic) Synapse compute and attached Synapse Spark pools available in CLI v2 and Python SDK v2. However, a new Synapse workspace can no longer be registered with Azure Machine Learning as a linked service. Users can continue using Synapse workspace registered with Azure Machine Learning as a linked service. The Azure Synapse Analytics integration with Azure Machine Learning available in Python SDK v1 is deprecated.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |