Senior Data & AI Engineer - Microsoft Fabric & RAG

We are looking for a Senior Data & AI Engineer with strong hands-on experience in Microsoft Fabric and Retrieval-Augmented Generation (RAG) systems to support Line Coach, an AI assistant used in brewery production environments.

This is a production-focused engineering role, not a research or chatbot-only position. You will be responsible for building, maintaining, and improving real-world AI data pipelines and operational AI agents.

Build and maintain Microsoft Fabric pipelines to ingest, process, and structure data within Fabric workspaces

Ingest structured and unstructured data using Fabric Shortcuts (ADLS, SharePoint, manuals, procedures, and technical documents)

Prepare, chunk, and vectorize unstructured content for downstream AI use cases

Store, manage, and query embeddings using Azure AI Search (vector and hybrid search)

Design, implement, and continuously improve RAG pipelines for operational AI agents

Apply prompt engineering best practices to improve accuracy, reliability, and relevance of AI outputs

Collaborate with data, AI, and product stakeholders to ensure solutions meet production and operational requirements

Monitor, troubleshoot, and optimize AI pipelines for performance, scalability, and reliability

Strong hands-on experience with Microsoft Fabric (Pipelines, Lakehouse, OneLake, Shortcuts)

Proven experience building LLM-based RAG systems in production environments

Practical experience with Azure AI Search, including vector and hybrid search

Solid understanding of embeddings, document retrieval, and prompt engineering

Strong programming skills in Python and/or SQL

Experience designing and maintaining data pipelines and AI systems in real-world environments

Fluent in English (written and spoken)

NICE TO HAVE:

• Experience with Azure OpenAI Service
• Background in industrial, manufacturing, or operational data
• Experience with agent-based or workflow-driven AI systems