Skip to main content

Azure Machine Learning Studio is Microsoft's end-to-end platform for building, training, and deploying ML models. This guide covers how to set up a workspace, build pipelines, train models, and deploy them as REST endpoints — with notes on governance and compliance for regulated industries.

Key Facts

  • Azure ML Studio supports no-code (Designer), low-code (AutoML), and full-code (Python SDK, CLI v2) workflows.
  • Models deploy to Azure Kubernetes Service (AKS), Azure Container Instances (ACI), or managed online endpoints.
  • MLflow integration is built in for experiment tracking and model registry.
  • Azure ML computes: serverless compute clusters, compute instances, and Kubernetes inference clusters.
  • HIPAA, FedRAMP, and SOC 2 workloads are supported through Azure's compliance certifications and VNet isolation.
  • EPC Group: enterprise Microsoft consulting since 1997. Our AI team includes certified Azure AI engineers and data scientists.
Back to Blog

Last updated by Errin O'Connor, Founder & Chief AI Architect, EPC Group

Errin O'Connor
8 min read

How to Build Intelligent Apps Using Microsoft Azure ML Studio

Step 1 — Create your Azure ML workspace

Everything in Azure ML lives inside a workspace. Create one before building any model.

  1. Open the Azure portal and search for "Machine Learning."
  2. Click Create and fill in subscription, resource group, region, and workspace name.
  3. Choose your storage account, key vault, container registry, and Application Insights. Azure creates these automatically if you leave them blank.
  4. Set the Network tab to "Private endpoint" for regulated workloads that require VNet isolation.
  5. Click Review + create, then open the workspace in Azure ML Studio.

Step 2 — Prepare your data

Azure ML uses registered datasets and data assets stored in Azure Blob Storage or ADLS Gen2.

  • Data assets — register your training data as a versioned data asset in the workspace. This creates a lineage trail between data and model.
  • Datastores — connect your Azure Storage account, SQL database, or Databricks as a datastore. Credentials are stored in Azure Key Vault.
  • Data labeling — use the built-in labeling tool for image classification, object detection, and text classification tasks.

Step 3 — Build and train your model

Azure ML offers three paths based on skill level.

  • Designer (no-code) — drag-and-drop pipeline canvas. Best for standard classification and regression tasks. Export to YAML pipelines for production.
  • AutoML (low-code) — submit a dataset and a target column. Azure ML runs dozens of algorithms and returns the best model automatically.
  • SDK / CLI (full-code) — write Python scripts, define YAML job specs, and submit runs to compute clusters. Best for custom architectures and PyTorch/TensorFlow models.

All three paths log metrics and artifacts to MLflow. Compare runs in the Experiments view.

Step 4 — Register and version your model

After training, register the model in the Azure ML Model Registry.

  1. In Studio, go to Assets → Models → Register.
  2. Upload the model files (ONNX, pickle, PyTorch checkpoint, or MLflow format).
  3. Add tags for version, framework, and data lineage. Use semantic versioning (v1.0, v1.1).
  4. Attach the training run so downstream teams can trace model provenance.

Step 5 — Deploy as an endpoint

Azure ML supports two endpoint types for serving predictions.

  • Online endpoints — real-time REST inference. Deploy to managed compute or AKS. Set traffic splits for blue/green or canary deployments.
  • Batch endpoints — asynchronous scoring for large data volumes. Scheduled or triggered via Azure Data Factory or Logic Apps.

Test the endpoint directly in Studio using the Test tab before integrating with your application.

Compliance and governance in regulated industries

Healthcare, financial services, and government workloads require additional controls.

  • VNet isolation — use private endpoints for the workspace, storage, and ACR. Block all public access.
  • Customer-managed keys — bring your own Azure Key Vault key for workspace encryption (required for HIPAA and FedRAMP High).
  • Managed identity — use system-assigned managed identity instead of service principal credentials. Eliminates secret rotation risk.
  • Azure Policy — enforce workspace configuration standards across your subscription (e.g., require VNet, prohibit public compute).
  • Audit logs — route Azure Monitor diagnostic logs to Log Analytics for compliance evidence.

Frequently asked questions

What is the difference between Azure ML Studio and Azure AI Studio?

Azure ML Studio focuses on classical ML and custom model training with full MLOps capabilities. Azure AI Studio is built for generative AI — it hosts Azure OpenAI, prompt flows, and model fine-tuning. Most enterprises use both for different workloads.

Does Azure ML support PyTorch and TensorFlow?

Yes. Both frameworks are first-class citizens. Azure ML provides curated environments (Docker images) pre-configured with PyTorch and TensorFlow. You can also bring your own Docker image.

How much does Azure ML cost?

You pay for the underlying compute (VMs), storage, and inference endpoints. There is no charge for the workspace itself. Training on a Standard_DS3_v2 (4 vCPUs, 14 GB RAM) runs approximately $0.27/hour. Managed online endpoints charge per instance-hour plus a small fee per 1,000 requests.

Can I use Azure ML for HIPAA workloads?

Yes, with proper configuration: VNet isolation, customer-managed keys, private endpoints, and a signed Microsoft Business Associate Agreement. Azure ML is included in Microsoft's HIPAA BAA coverage.

What is AutoML and when should I use it?

AutoML runs automated algorithm selection, hyperparameter tuning, and feature engineering on your dataset. Use it when you need a baseline model quickly or when your team lacks deep ML expertise. For production models requiring custom architectures, the Python SDK gives more control.

Talk to an Azure AI architect

EPC Group designs and deploys Azure ML solutions for Fortune 500, healthcare, and federal clients. Call (888) 381-9725 or request a 30-minute discovery call.

Azure Architecture: 2026 Considerations for How To Build Intelligent Apps Using Microsoft Azure Ml Studio

FinOps in Azure 2026 is no longer optional at any meaningful scale: Azure Reservations (1-yr or 3-yr commits) reduce resource costs by up to 72% from pay-as-you-go prices on predictable workloads (Microsoft Learn, What are Azure Reservations?, accessed 2026-10-21), Azure Savings Plans extend the discount to compute portability across instance families, and Azure Hybrid Benefit applies existing Windows Server and SQL Server licenses, which Microsoft states can save up to 85% over the standard pay-as-you-go rate (Microsoft Learn, Azure Hybrid Benefit for Windows Server, SQL Server, and Linux subscriptions, accessed 2026-10-21). What an Azure cost-optimization engagement returns depends on how much of the estate runs steady-state and how much is already covered by commitments; EPC Group sizes it from the usage export of the tenant before quoting a figure.

Azure Confidential Computing (DCadsv5/ECasv5 series) is the privileged-data play for 2026: AMD SEV-SNP and Intel TDX enclaves protect data IN USE (in addition to at-rest and in-transit encryption), enabling regulated workloads (clinical analytics with PHI, financial services M&A modeling, federal IL5) to run on shared Azure infrastructure with cryptographic attestation that the host operator cannot inspect the data.

Decision factors EPC Group evaluates

  • Confidential Computing enclave evaluation for regulated workloads
  • Enterprise-scale landing zone bootstrap via Bicep/Terraform
  • Microsoft Defender for Cloud benchmark alignment
  • Reservation + Savings Plan portfolio for predictable workloads
  • Azure Policy initiative assignment for Azure Government readiness

See related EPC Group services or schedule a discovery call.

AI assistant — not a human