Why Microsoft Fabric for Financial Services Now
Microsoft Fabric (GA late 2024) is an essential data platform for financial services. This release is the most important since the cloud data warehouse. Fabric simplifies tasks related to risk, finance, surveillance, and regulatory reporting. It replaces the disconnected systems that many banks and asset managers currently use, including:
- Risk management systems
- Financial reporting tools
- Surveillance applications
- Regulatory compliance software
- Risk management systems
- Financial reporting tools
- Surveillance applications
- Regulatory compliance solutions
- Teradata
- Oracle
- Hadoop
- Snowflake
- Databricks
- Synapse
The convergence of these technologies is driven by several key features:
- OneLake unified storage: Eliminates data movement between BI, ML, and warehouse workloads.
- Direct Lake on Power BI: Removes import-refresh delays, which are critical for intraday risk dashboards.
- Native Microsoft Purview integration: Provides catalog, lineage, and classification at the data-platform layer.
- Sentinel integration: Enhances audit and compliance capabilities.
- Copilot for Fabric: Introduces natural-language queries for risk and finance analysts.
EPC Group's Fabric FSI practice draws on Errin O'Connor's expertise. He served as the Lead Architect at the Federal Reserve Bank of New York.
Errin is also a 4× Microsoft Press author, focusing on Power BI and data platforms.
The firm has successfully migrated Fortune 500 banks and asset managers from:
- Snowflake
- Teradata
- to Fabric
Reference Architecture
Ingestion. Data is ingested through various methods to ensure comprehensive coverage:
- Trade, order, and market data: Collected in real-time using Eventstream.
- Position, balance, and ledger data: Acquired in batches via Data Factory.
- Customer, counterparty, and sanctions data: Also sourced through Data Factory.
- Communication data: Includes email, chat, and voice transcription, accessed via Microsoft Purview connectors for surveillance workloads.
- Reference data: Covers instruments, counterparties, and market data hierarchies, obtained through custom ingestion or third-party reference data providers.
Storage. OneLake uses a medallion architecture with three levels: bronze (raw), silver (cleansed and validated), and gold (analytics-ready). It consistently employs the Delta Lake format.
Each regulatory domain has its own dedicated workspace, including:
- Risk
- Finance
- Surveillance
- AML
- Treasury
Microsoft Information Barriers ensure restricted cross-domain access when ethical walls are needed.
Compute. The solution includes Fabric Lakehouse, Warehouse, Real-Time Analytics, Notebooks, and Data Science workloads. Notebooks support Python and Spark for risk modeling, including:
- VaR
- Expected shortfall
- PD/LGD/EAD
- FRTB SBM/IMA
- Stress testing
The Warehouse is used for regulatory reporting, covering:
- FRTB
- OATS/CAT
- MiFID II
Real-Time Analytics aids in surveillance and intraday risk. Data Science focuses on AML ML models, fraud detection, and churn prediction.
Serving. Power BI semantic models are available through Direct Lake. We provide row-level security and object-level security to enforce ethical walls.
We provide Copilot for Power BI. This feature lets users ask questions in natural language about risk and finance. It also includes:
- Restricted Search
- IB configuration
- MNPI workspaces
Governance. Microsoft Purview catalog + lineage + classification across the entire Fabric estate. Sensitivity labels for MNPI + customer PII + trade secret content. Audit logs to Sentinel.
High-Value Use Cases
Portfolio risk aggregation. We provide position-level, counterparty-level, and market-data-level aggregation across various asset classes. These include:
- Equities
- Fixed income
- Derivatives
- FX
- Commodities
- Structured products
Our Real-Time Analytics help with intraday risk management. We use a Lakehouse for end-of-day risk, stress testing, and scenario analysis.
We also provide Power BI semantic models for:
- Risk committee reporting
- Regulatory submissions
- Basel III RWA
- CCAR/DFAST stress testing
- ICAAP
Trade surveillance. This involves trade, order, market data, and communication ingestion into Real-Time Analytics and Lakehouse. We use custom KQL and Spark analytics to identify:
- Spoofing
- Layering
- Front-running
- Wash trading
- Insider trading patterns
Our system integrates with NICE Actimize, NASDAQ SMARTS, or custom rule sets. It is documented as the surveillance system of record for the firm's WSPs.
Regulatory reporting. We offer a consolidated regulatory reporting platform that covers various requirements. This includes:
- FINRA OATS / CAT
- MiFID II / MiFIR
- SFTR
- EMIR
- FRTB capital reporting
- LIBOR transition
- CCAR / DFAST
Our Fabric Warehouse serves as the regulatory-grade store of record. It ensures audit-quality lineage through Microsoft Purview.
Counterparty exposure + credit risk. We aggregate counterparty-level exposure across various products, entities, and jurisdictions. Our services include:
- Margining and collateral management
- Pre-trade and post-trade credit risk assessment
- Default risk modeling using PD, LGD, and EAD
We utilize Fabric Notebooks and Azure ML for these processes.
AML transaction monitoring. This involves the ingestion of customer, transaction, counterparty, and sanctions data. It includes:
- Rule sets and machine learning models for detecting suspicious activity.
- Integration of case management with operational AML platforms.
- Documentation as the AML data layer for the firm’s BSA/AML program.
- SAR drafting through the Copilot Studio agent.
Engagement Investment
Foundation ($250K-$500K, 16-24 weeks): Single-workload Fabric implementation — risk OR surveillance OR regulatory reporting OR AML. F64 or F128 capacity. ~50 user pilot.
Enterprise ($550K-$1.4M, 28-44 weeks): Multi-workload + full data platform + Center of Excellence + Managed Microsoft Support. F128 or F256. Mid-size bank or asset manager.
Platform ($1.4M-$4M, 44-72 weeks): Enterprise + Microsoft Cloud for Financial Services + multi-entity federation + DR + audit support across multiple jurisdictions. F256+. Large bank, GSE, large insurance carrier.
Related Pages
FAQ
How does Microsoft Fabric compare to Snowflake + Databricks for financial services?
Fabric is the modern Microsoft replacement for fragmented Teradata + Oracle + Hadoop + Snowflake + Databricks + Synapse stacks. For financial services specifically: (1) OneLake unified storage eliminates data copy between BI + ML + warehouse workloads; (2) Direct Lake on Power BI removes import-refresh delays critical for intraday risk; (3) Native Microsoft Purview integration provides catalog + lineage + classification at the data-platform layer rather than as a bolt-on; (4) Sentinel integration for audit + compliance reporting; (5) Copilot for Fabric brings natural-language queries to risk + finance analysts. EPC Group has migrated Fortune 500 banks + asset managers from Snowflake + Teradata to Fabric.
What is the right Fabric capacity for a mid-size bank?
For a mid-size bank ($10B-$50B assets) running risk + finance + surveillance workloads, EPC Group typically recommends F128 ($10,515/mo reserved) or F256 ($21,030/mo) Fabric capacity. F128 provides 128 capacity units — sufficient for ~50-200 concurrent power users + automated workloads. F256 is required when intraday risk + real-time surveillance + ML training run concurrently. Capacity is elastic — pause/resume + autoscale available. See /power-bi-cost-and-licensing-guide-for-desktop-pro-and-premium for the full F-SKU pricing matrix.
Can Fabric handle trade surveillance for spoofing + layering + front-running?
Yes. EPC Group ships Fabric-based trade surveillance with Real-Time Analytics + KQL + Spark for: spoofing pattern detection, layering, front-running, wash trading, marking-the-close, insider trading patterns. Integration with NICE Actimize, NASDAQ SMARTS, or custom rule sets. Trade + order + market data + communication data ingested via Eventstream (real-time) + Data Factory (batch). Surveillance officer Power BI dashboards on top with case management workflow integration.
Does Fabric support regulatory reporting (FRTB, OATS/CAT, MiFID II, SFTR, EMIR)?
Yes. EPC Group implements Fabric as the consolidated regulatory reporting platform with: FRTB (Fundamental Review of the Trading Book) — capital reporting under SBM + IMA; FINRA OATS / Consolidated Audit Trail (CAT); MiFID II / MiFIR transaction reporting; SFTR (EU + UK); EMIR (EU + UK); LIBOR transition tracking; ICAAP (European entities); CCAR + DFAST (>$100B asset banks). Fabric Warehouse as the regulatory-grade store of record with audit-quality lineage via Microsoft Purview.
How does Fabric handle MNPI in trading workloads?
MNPI controls in Fabric: (1) Microsoft Purview sensitivity labels applied to datasets + reports + Fabric items; (2) Customer Key + Double Key Encryption for the highest-sensitivity MNPI; (3) Workspace + lakehouse-level access controls aligned to Information Barriers; (4) Audit Premium captures every access event for SEC 17a-4; (5) Restricted Search prevents MNPI workspaces from being indexed by Power BI Copilot. EPC Group designs MNPI controls as part of every FSI Fabric deployment.
Can Fabric host AML transaction monitoring?
Yes. Fabric AML transaction monitoring pattern: customer + transaction + counterparty + sanctions data ingested via Data Factory + Eventstream. KQL + Spark rule sets for suspicious activity detection. ML models for false-positive reduction (typical reduction 40-60% vs rule-only AML). Case management integration with operational AML platforms (Actimize, NICE, Oracle Mantas, SAS AML). Documented as the AML data layer in the firm's BSA / AML program. SAR drafting via Copilot Studio agent.
Why EPC Group for FSI Fabric consulting?
4× Microsoft Press Power BI / data platform author. Federal Reserve Bank of New York Lead Architect pedigree (Errin O'Connor). Microsoft Solutions Partner with Data Platform designation. Migrated Fortune 500 banks + asset managers from Snowflake + Teradata to Fabric. Hundreds of financial services Microsoft engagements. See /industries/financial-services for broader FSI practice.
Schedule Fabric for FSI Discovery
FRBNY pedigree. Fortune 500 bank + asset manager migrations from Snowflake + Teradata to Fabric.
