Bringing together the Databricks community

The Databricks user community offers a wealth of knowledge and expertise in data, analytics, and AI, so we are pleased to continue our series of in-person Databricks User Group events across Germany.

Join us on the 9th of July 2026 in Cologne at the office of Infomotion . This user group event will feature a 30 min talk (incl. Q&A) by flaschenpost and DAC Digital.

Each session will include an open discussion on the most critical data challenges and solutions, plus insights into the latest technologies including the Databricks Data Intelligence Platform. In addition, you will have the opportunity to network with your peers from across a range of different industries while enjoying some food and beverages.

Call to action: RSVP to safe your spot!

Detailed Agenda

flaschenpost

Speaker:

Tim Wagner (Lead Developer - Cloud Data Engineering)
Stefan Schuler (Team Lead / PO - Cloud Data Engineering)

Title: flaschenpost Eventworker

This talk covers the architecture and implementation of the flaschenpost Eventworker, which currently connects more than 500 events from different business domains to Databricks. The system consists of two clearly separated components: a C# application running in Kubernetes and a Databricks-based processing layer built with Lakeflow Declarative Pipelines. Together, these components provide the technical basis for self-service event onboarding and consumption.

The talk will also cover a number of practical challenges we had to address during the rollout, including duplicates, missing data, and general stability issues. In addition, we had to migrate a large number of existing stakeholder reporting queries to the new setup. This required substantial technical and organizational effort and was supported by a customized AI tool.

Overall, the session focuses on the architectural decisions, operational challenges, and migration work involved in moving from a legacy event processing framework to a scalable event platform on Databricks.

DAC Digital

Speaker:

Pawel Kruk - Senior Data Engineer
Michal Kopczynski - AI/ML Expert

Title: AI Agent Self-Healing System: The Future of Autonomous Data Pipelines

Data pipelines often fail because upstream systems change unexpectedly - for example, when a column is renamed or a data type changes. Fixing these issues usually requires manual investigation and code updates.
This presentation shows a Proof of Concept (POC) for an AI-based self-healing system that detects ETL failures and automatically proposes fixes. The system analyzes historical Data Lake metrics such as null values, cardinality, and schema information to identify what changed and adjust the pipeline code accordingly.
The solution includes a Databricks environment for monitoring pipeline status and a Human-in-the-Loop verification step before changes are applied. The system can also reuse previous fixes to handle similar problems in the future.
The presentation will include a live demo showing how the system responds to real pipeline failures and restores data flow automatically.

Complete your Databricks User Groups profile!

Databricks User Group Rhein / Ruhr

About

Past events

Organizers

Tania Sennikova