Mid Senior Data Engineer

We are an innovative AI SaaS startup that develops cutting-edge AI solutions and provides expert consulting services. Our mission is to empower businesses with state-of-the-art AI technologies and data-driven insights. We're seeking a talented Data Engineer to join our team and help drive our product development and consulting initiatives.

A Mid-Senior Azure Data Engineer will play a key role in designing, building, and optimizing data pipelines and architectures within the Azure ecosystem. This role involves working with Azure Data Factory (ADF), Databricks, PySpark, Scala, and Python to support data ingestion, transformation, and orchestration workflows. While collaborating with senior team members, they will enhance data solutions, contribute to AI-driven projects, and ensure scalability and performance. Additionally, they will provide technical guidance to junior engineers and help implement best practices for data security and compliance.

Key Responsibilities

• Design and deploy scalable data pipelines using Azure Synapse, Azure Databricks, and Azure Stream Analytics, Azure ML, Azure Data Fctory.
• Optimize data storage (e.g., partitioning in ADLS, Cosmos DB for real-time data).
• Implement DevOps practices (CI/CD, IaC) via Azure DevOps or GitHub Actions.
• Integrate data solutions with AI/ML services (e.g., Azure Machine Learning, OpenAI models).
• Develop data governance frameworks (security, RBAC, encryption).
• Troubleshoot performance bottlenecks and automate monitoring/alerting.
• Collaborate with AI engineers to productionize GenAI models

Required Qualifications

• 3–5 years of Azure data engineering experience.
• Proficiency in advanced SQL, PySpark, and data orchestration tools (e.g., Airflow).
• Expertise in performance tuning (partitioning, indexing, caching).
• Strong understanding of DevOps and IaC (Terraform, ARM templates).
• Experience with AI/ML workflows and real-time data streaming.

Preferred Qualifications

• Azure Data Engineer Associate (DP-203) certification.
• Familiarity with GenAI tools (Azure OpenAI, LangChain).
• Bachelor in any stream mentioned in (Engineering, Science & Commerce).

What We Offer

• Cutting-edge Technology: Opportunity to work on cutting-edge AI projects and shape the future of data visualization
• Rapid Growth: Be part of a high-growth startup with endless opportunities for career advancement.
• Impactful Work: See your contributions make a real difference in how businesses operate.
• Collaborative Culture: Join a diverse team of brilliant minds from around the world.
• Flexible Work Environment: Enjoy remote work options and a healthy work-life balance.
• Competitive Compensation as per market.

We look forward to your application and will contact you for the next steps.