Skip to main content

By Errin O'Connor, Founder & Chief AI Architect, EPC Group

Azure Machine Learning Studio is Microsoft's end-to-end platform for building, training, and deploying ML models. This guide covers how to set up a workspace, build pipelines, train models, and deploy them as REST endpoints — with notes on governance and compliance for regulated industries.

Key Facts

  • Azure ML Studio supports no-code (Designer), low-code (AutoML), and full-code (Python SDK, CLI v2) workflows.
  • Models deploy to Azure Kubernetes Service (AKS), Azure Container Instances (ACI), or managed online endpoints.
  • MLflow integration is built in for experiment tracking and model registry.
  • Azure ML computes: serverless compute clusters, compute instances, and Kubernetes inference clusters.
  • HIPAA, FedRAMP, and SOC 2 workloads are supported through Azure's compliance certifications and VNet isolation.
  • EPC Group: enterprise Microsoft consulting since 1997. Our AI team includes certified Azure AI engineers and data scientists.
Back to Blog

How To Build Intelligent Apps Using Microsoft Azure ML Studio

Errin O'Connor
8 min read

How to Build Intelligent Apps Using Microsoft Azure ML Studio

Azure Machine Learning Studio is Microsoft's end-to-end platform for building, training, and deploying ML models. This guide covers how to set up a workspace, build pipelines, train models, and deploy them as REST endpoints — with notes on governance and compliance for regulated industries.

Key facts

  • Azure ML Studio supports no-code (Designer), low-code (AutoML), and full-code (Python SDK, CLI v2) workflows.
  • Models deploy to Azure Kubernetes Service (AKS), Azure Container Instances (ACI), or managed online endpoints.
  • MLflow integration is built in for experiment tracking and model registry.
  • Azure ML computes: serverless compute clusters, compute instances, and Kubernetes inference clusters.
  • HIPAA, FedRAMP, and SOC 2 workloads are supported through Azure's compliance certifications and VNet isolation.
  • EPC Group: enterprise Microsoft consulting since 1997. Our AI team includes certified Azure AI engineers and data scientists.

Step 1 — Create your Azure ML workspace

Everything in Azure ML lives inside a workspace. Create one before building any model.

  1. Open the Azure portal and search for "Machine Learning."
  2. Click Create and fill in subscription, resource group, region, and workspace name.
  3. Choose your storage account, key vault, container registry, and Application Insights. Azure creates these automatically if you leave them blank.
  4. Set the Network tab to "Private endpoint" for regulated workloads that require VNet isolation.
  5. Click Review + create, then open the workspace in Azure ML Studio.

Step 2 — Prepare your data

Azure ML uses registered datasets and data assets stored in Azure Blob Storage or ADLS Gen2.

  • Data assets — register your training data as a versioned data asset in the workspace. This creates a lineage trail between data and model.
  • Datastores — connect your Azure Storage account, SQL database, or Databricks as a datastore. Credentials are stored in Azure Key Vault.
  • Data labeling — use the built-in labeling tool for image classification, object detection, and text classification tasks.

Step 3 — Build and train your model

Azure ML offers three paths based on skill level.

  • Designer (no-code) — drag-and-drop pipeline canvas. Best for standard classification and regression tasks. Export to YAML pipelines for production.
  • AutoML (low-code) — submit a dataset and a target column. Azure ML runs dozens of algorithms and returns the best model automatically.
  • SDK / CLI (full-code) — write Python scripts, define YAML job specs, and submit runs to compute clusters. Best for custom architectures and PyTorch/TensorFlow models.

All three paths log metrics and artifacts to MLflow. Compare runs in the Experiments view.

Step 4 — Register and version your model

After training, register the model in the Azure ML Model Registry.

  1. In Studio, go to Assets → Models → Register.
  2. Upload the model files (ONNX, pickle, PyTorch checkpoint, or MLflow format).
  3. Add tags for version, framework, and data lineage. Use semantic versioning (v1.0, v1.1).
  4. Attach the training run so downstream teams can trace model provenance.

Step 5 — Deploy as an endpoint

Azure ML supports two endpoint types for serving predictions.

  • Online endpoints — real-time REST inference. Deploy to managed compute or AKS. Set traffic splits for blue/green or canary deployments.
  • Batch endpoints — asynchronous scoring for large data volumes. Scheduled or triggered via Azure Data Factory or Logic Apps.

Test the endpoint directly in Studio using the Test tab before integrating with your application.

Compliance and governance in regulated industries

Healthcare, financial services, and government workloads require additional controls.

  • VNet isolation — use private endpoints for the workspace, storage, and ACR. Block all public access.
  • Customer-managed keys — bring your own Azure Key Vault key for workspace encryption (required for HIPAA and FedRAMP High).
  • Managed identity — use system-assigned managed identity instead of service principal credentials. Eliminates secret rotation risk.
  • Azure Policy — enforce workspace configuration standards across your subscription (e.g., require VNet, prohibit public compute).
  • Audit logs — route Azure Monitor diagnostic logs to Log Analytics for compliance evidence.

Frequently asked questions

What is the difference between Azure ML Studio and Azure AI Studio?

Azure ML Studio focuses on classical ML and custom model training with full MLOps capabilities. Azure AI Studio is built for generative AI — it hosts Azure OpenAI, prompt flows, and model fine-tuning. Most enterprises use both for different workloads.

Does Azure ML support PyTorch and TensorFlow?

Yes. Both frameworks are first-class citizens. Azure ML provides curated environments (Docker images) pre-configured with PyTorch and TensorFlow. You can also bring your own Docker image.

How much does Azure ML cost?

You pay for the underlying compute (VMs), storage, and inference endpoints. There is no charge for the workspace itself. Training on a Standard_DS3_v2 (4 vCPUs, 14 GB RAM) runs approximately $0.27/hour. Managed online endpoints charge per instance-hour plus a small fee per 1,000 requests.

Can I use Azure ML for HIPAA workloads?

Yes, with proper configuration: VNet isolation, customer-managed keys, private endpoints, and a signed Microsoft Business Associate Agreement. Azure ML is included in Microsoft's HIPAA BAA coverage.

What is AutoML and when should I use it?

AutoML runs automated algorithm selection, hyperparameter tuning, and feature engineering on your dataset. Use it when you need a baseline model quickly or when your team lacks deep ML expertise. For production models requiring custom architectures, the Python SDK gives more control.

Talk to an Azure AI architect

EPC Group designs and deploys Azure ML solutions for Fortune 500, healthcare, and federal clients. Call (888) 381-9725 or request a 30-minute discovery call.

Related Resources

Continue exploring azure insights and services

Azure Architecture: 2026 Considerations for How To Build Intelligent Apps Using Microsoft Azure Ml Studio

FinOps in Azure 2026 is no longer optional at any meaningful scale: Azure Reservations (1-yr or 3-yr commits) deliver 30-72% savings on predictable VM workloads, Azure Savings Plans extend the discount to compute portability across instance families, and Azure Hybrid Benefit lets BYOL Windows Server and SQL Server licenses cut compute costs by an additional 40-49%. Typical Azure cost-optimization engagements return 25-40% of annual Azure spend within 90 days.

Azure Confidential Computing (DCadsv5/ECasv5 series) is the privileged-data play for 2026: AMD SEV-SNP and Intel TDX enclaves protect data IN USE (in addition to at-rest and in-transit encryption), enabling regulated workloads (clinical analytics with PHI, financial services M&A modeling, federal IL5) to run on shared Azure infrastructure with cryptographic attestation that the host operator cannot inspect the data.

Decision factors EPC Group evaluates

See related EPC Group services at /services or schedule a discovery call at /contact.

AI assistant — not human