Complete your Databricks User Groups profile!

Fill out a few details about yourself so the community can get to know you.
Hong Kong Databricks FSI group

FSI Skills Badge Execute Level Role-Playing Dialog [ Part 2 ]

Summary: In this detailed conversation between Dan Chan and Keith Oliver, the discussion centers around the FSI Skills Badge and how Databricks can aid financial services in achieving business goals such as increased client retention and AUM growth. Keith Oliver seeks to understand how Databricks supports faster decision-making and implementation in investment and trading analytics. Dan Chan explains the phased technical rollout and strategic benefits of using Databricks, emphasizing the unified data and AI platform's ability to streamline operations and enhance market agility. The discussion concludes with a proposal for a 'Signal Discovery' session to further explore Databricks' application to specific business challenges.
AI Summary

In a detailed discussion, we explored how Databricks can enhance financial services through data-driven solutions. The dialogue covered the importance of using Unity Catalog for 'Customer 360' views, emphasizing proactive client engagement to reduce churn. They discussed acceleration in research-to-production cycles, better decision quality at speed for trading, and implementation timelines for achieving key targets like 2% client retention and 5% AUM growth. Keith sought understanding of the practical implementation process and resource commitments. The conversation highlighted Databricks' core differentiation, urgency for adoption, and proposed the next step as a 'Signal Discovery' session.

-

FSI Skills Badge:

https://credentials.databricks.com/group/799941

Course FSI skills:

https://partner-academy.databricks.com/learn/course/4961/partner-training-industry-fsi-sales-skills?hash=927c394436702e0db2381110ba8ddb06a956684d&generated_by=1315144

FSI Skills Badge Execute Level Role-Playing Dialog [ Part 1 ]

https://usergroups.databricks.com/v0/forum/hong-kong-databricks-fsi-group-92/topic/fsi-skills-badge-execute-level-role-playing-dialog-part-1-57/

-

Keith Oliver:

  • Understands Unity Catalog provides a "Customer 360" view with explainable insights and accurate data, giving advisors confidence.

  • Questions how this translates into actually preventing churn.

  • Requests a walk-through of a specific scenario where an advisor uses this transparency to retain a client, contributing to the 2% target.

  • Asks for an example of the interaction.

-

Me:

Contextual Intelligence:

  • Advisor opens a dashboard (powered by governed data).

  • Sees client’s risk alert was triggered by recent large withdrawals and a decrease in interaction with the digital portal.

Lineage-Backed Strategy:

  • Using the lineage feature, advisor verifies the "churn risk" model utilized real-time transaction data and social sentiment from the last 48 hours.

The Retention Conversation:

  • "I noticed your recent adjustments and that our latest ESG-focused fund options haven't crossed your radar yet. Based on your portfolio's performance over the last quarter, I have a tailored rebalancing strategy that specifically addresses the market volatility we’ve seen."

  • This demonstrates how the advisor uses transparent, explainable data to provide a personalized solution, aiming to retain the client and contribute to the 2% retention target.

-

Keith Oliver:

  • Understands how advisors use governed data to identify churn risk triggers.

  • Recognizes the use of precise information for informed, proactive client conversations and tailored solutions.

  • Shifts focus to "investment analytics" and "trading analytics."

  • Requests a concrete example of how Databricks helps achieve "faster research-to-production cycles" for investment analytics or "better decision quality at speed" for trading analytics.

-

Me:

Databricks Accelerates Research-to-Production Lifecycle:

  • Unifies disparate tools into a single, collaborative ecosystem.

  • Allows investment and trading teams to move from research idea to live strategy in minutes rather than weeks.

Faster Research-to-Production: Quantitative Backtesting:

  • In many firms, research happens in siloed notebooks using one language (e.g., Python), but production requires porting logic into a different language (e.g., C++) for speed and stability.

  • This process is brittle and slow.

The Databricks Difference:

  • Analysts use a single collaborative environment.

  • Codify research ideas and deliver concrete back-tests against massive volumes of historical data almost instantly.

Concrete Example:

  • A quantitative team leverages Serverless compute to run compute-intensive backtesting pipelines for new trading strategies without managing any infrastructure.

  • Because the research and production environments share the same governed data and code base through Unity Catalog, a high-performing strategy can be promoted to production with zero manual "porting" or re-coding.

  • Significantly reduces time-to-market.



-

Keith Oliver:

  • Acknowledges understanding of speeding up the move from research to live strategy by reducing manual effort.

  • Focuses on "trading analytics" and requests a concrete example of how Databricks helps achieve "better decision quality at speed" for trading.

-

Me:

Decision Quality at Speed: Real-Time Trading Analytics:

  • Trading success depends on the recency of strategy and ability to react to volatile market conditions.

  • Databricks combines batch and streaming data into the same pipeline using Delta Lake.

  • Allows traders to perform real-time market analysis and backtest strategies within the same workflow.

Concrete Example:

  • Firm integrates real-time ticker feeds with alternative data (like social sentiment or news feeds) using Delta Sharing.

  • Eliminates the need for complex data copying and ETL.

  • Traders use Databricks SQL to query live datasets in natural language to identify emerging trends.

  • Leads to a 10-20% reduction in large drawdowns because predictive signals allow for earlier de-risking, protecting millions of dollars in capital.

-

Keith Oliver:

  • Understands the benefits of combining real-time data and alternative sources for quickly identifying and reacting to market changes.

  • Expresses concern about the significant undertaking of implementing such a platform.

  • Questions the typical implementation process and realistic timeline for tangible benefits, especially 2% retention increase or 5% AUM growth.

  • Wary of long, drawn-out projects that don’t deliver quickly.

-

Me:

Realistic Timeline for Key Goals:

Target: 2% Higher Client Retention (Timeline: 3–6 Months)

  • Initial Milestone (Month 2): Advisors gain a "Single Source of Truth" dashboard, reducing manual reconciliation time.

  • Impact Realization (Month 4+): Predict churn by identifying at-risk behaviors via Unity Catalog-governed models.

  • Result: Precision retention campaigns drive the incremental 2% increase as advisors move from reactive to predictive client management.

Target: 5% AUM Growth (Timeline: 4–9 Months)

  • Initial Milestone (Month 3): Quants move from research to production in minutes using a unified environment.

  • Impact Realization (Month 6+): Launch highly tailored investment products or "Super-Advisor" natural language tools.

  • Result: Increased proactive client touchpoints and faster time-to-market for funds contribute to the 5% AUM target.

-

Keith Oliver:

  • Appreciates seeing timelines tied directly to goals.

  • Requests details about the actual implementation process.

  • Questions the typical engagement model and necessary resource commitment.

  • Seeks understanding of the full scope of change.

-

Me:

Operational Velocity:

  • 30%–50% reduction in TCO by eliminating redundant legacy pipelines.

Decision Speed:

  • Up to 10x faster data pipelines and 90% faster query execution for risk/financial insights.

Growth & Retention:

  • Targeted intervention to reach 2% retention increase and 5% AUM growth.

-

Keith Oliver:

  • Understands the benefits highlighted.

  • Seeks details about the implementation process itself.

  • Questions the steps involved, team engagement, and typical Databricks engagement model.

  • Needs to understand the practicalities of getting the system up and running.

-

Me:

Typical Implementation for a Firm of Your Scale:

  • Involves a cross-functional squad and a phased technical rollout focused on a Medallion Architecture.

  • Ensures data quality and lineage.

Implementation Steps (The "Lakehouse Way"):

  • Utilizes a three-stage technical journey to move from raw data to 2% retention and 5% AUM growth targets.

Stage 1: Foundational Migration & Unity Catalog (Weeks 1–4):

  • Establishes Unity Catalog as the single source of truth.

  • Centralized access control and auditing.

  • Ingests core datasets (CRM, transactions) into the Bronze layer (raw storage).

Stage 2: Operational Velocity (Months 1–3):

  • Data refined into the Silver layer.

  • Cleansed and deduplicated to create a high-quality "Client 360".

  • Migrates critical research and trading pipelines to Serverless compute.

  • Accelerates execution by up to 10x.

Stage 3: Growth Transformation (Months 3–6+):

  • Business-ready data promoted to the Gold layer for specific use cases like churn prediction or personalized investment agents.

  • Deploys Mosaic AI for hyper-personalization.

  • Enables the "super-advisor" model.

-

Keith Oliver:

  • Appreciates the phased approach giving a better picture of the technical journey.

  • Questions the resources needed from their team at each stage.

  • Asks about the typical Databricks engagement model.

  • Seeks understanding of the commitment required from their side to ensure success.

-

Me:

Typical Databricks Engagement Model:

  • Recommends a Partner-Led Co-Delivery model for firms of their size.

Strategic Advisory:

  • A Databricks Solutions Architect provides high-level reference architecture and ensures best practices for performance and cost.

Implementation Partner (System Integrator):

  • A certified Elite Partner leads day-to-day execution—handling data migration, pipeline configuration, and long-term optimization.

Enablement:

  • Focuses on "Knowledge Parity," training internal teams to independently manage and innovate on the platform after launch.

Summary:

  • Offers to introduce Lead Solutions Architect for Financial Services to review a draft 'Squad' structure for their team.

-

Keith Oliver:

  • Appreciates clarity on the engagement model.

  • Understands the approach: Databricks architect guides, certified partner executes, and internal team is trained.

  • Expresses interest in seeing the draft 'Squad' structure.

  • Questions why Databricks specifically over evolving current stack or other alternatives.

  • Asks about core differentiation.

-

Me:

Why Databricks:

  • Solves the fundamental problem of fragmentation between Data and AI.

  • Traditional tools were built for retrospective reporting; Databricks merges real-time data with predictive AI on a single, open architecture.

Core Differentiation: The Data Intelligence Platform:

AI is Data-Intelligent:

  • Platform inherently understands unique financial semantics, data usage patterns, and governance requirements.

Unification over Evolution:

  • Evolving a legacy stack involves bolting on new tools, increasing complexity and cost.

  • Databricks unifies all workloads (ETL, Warehouse, Data Science, and AI) on one copy of data, eliminating multiple versions of the truth.

Open by Design, Not a "Black Box":

  • Built on open standards (Delta Lake, Apache Spark, MLflow).

  • Ensures long-term flexibility, allowing integration with any tool in the ecosystem and maintaining full ownership of data assets.

Embedded Governance (Unity Catalog):

  • Unity Catalog provides a single governance layer that tracks lineage from raw trade data to client-facing AI recommendation.

  • Satisfies stringent regulatory transparency requirements.

Keith Oliver:

  • Understands technical differentiation and benefits of unification and open standards.

  • Questions the urgency and business perspective for addressing this with Databricks now.

  • Asks how core differentiation translates into faster or more significant impact on revenue growth, cost reduction, or risk mitigation, especially given the discussed timelines.

-

Me:

The Urgency: Why Waiting is No Longer an Option:

  • Continuing to manage existing siloed tools creates a structural bottleneck that slows every revenue-generating initiative.

Market Share Erosion:

  • Every day delayed, competitors capture customer touchpoints with superior, AI-driven personalization.

Expertise Bottleneck:

  • More than 50% of banks say siloed data prevents real-time decision-making.

  • Highly-paid quants and analysts wait days for custom reports instead of analyzing market signals.

Core Differentiation = Faster Business Impact:

  • Our differentiation translates into a steeper "impact curve" across your three core business pillars.

Revenue Growth:

  • Business Pillar, Databricks Impact Advantage, Measurable Metrics:

  • AI for "Money in Motion": Democratized access via natural language tools (Genie) allows frontline bankers to anticipate customer needs and cross-sell treasury or investment products in real-time.

  • Up to 25% increase in cross-selling through personalized recommendations.

Impact Within Your Timeline:

  • Addressing this now ensures hitting FY2026 targets within the 3–9 month window discussed.

Months 1 to 3:

  • Halt the rise of "legacy tech debt" costs by consolidating workloads onto the lakehouse.

Months 4 to 6:

  • Advisors start using the "Single Source of Truth" to hit the 2% retention goal through precision churn intervention.


-

Keith Oliver:

  • Understands the urgency and cost of inaction.

  • Recognizes the risk of losing market share to faster competitors and bottlenecking internal talent.

  • Acknowledges how the platform's differentiation accelerates impact on revenue growth, cost reduction, and risk mitigation.

  • Appreciates the discussion tying platform capabilities to strategic imperatives and desired outcomes.

  • Asks for the logical next step to explore further for the organization.

-

Me:

Next Step:

  • Suggests starting the 'Signal Discovery' session next week to ensure hitting targets within the fiscal year.

-

Keith Oliver:

  • Agrees to a "Signal Discovery" session next week as a productive next step.

  • Expresses interest in exploring applications to specific challenges.

-

Me:

  • Thanks Keith Oliver for his time.

1 comment