AI Test Engineer (f/md)

NDI – Neue Deutsche Infrastruktur GmbH is a Berlin-based technology company building digital infrastructure for a resilient and sovereign Germany. We develop, integrate and operate software solutions that simplify access to administrative processes, automate them and connect them with one another. Our work ranges from secure data exchange to applications for citizens, businesses and public authorities. Our goal is a public administration that is simple, secure and digitally accessible for everyone.

To support the growth of our organization, we are looking for an AI Test Engineer (f/md) who is passionate about ensuring the reliability, security, and quality of AI-driven applications in the public sector. In this role, you will help validate and optimize AI systems that directly impact digital government services and citizen experiences.

In this role, you will design, develop, and optimize AI-powered solutions that help modernize public administration and create seamless digital experiences for citizens and institutions.

Tasks

• Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems

• Evaluate AI model performance, accuracy, robustness, and reliability across different use cases

• Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities

• Develop automated test frameworks and quality assurance processes for AI solutions

• Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle

• Analyze datasets and outputs to ensure compliance with quality and ethical standards

• Support continuous improvement of AI systems through structured feedback and testing insights

• Document testing methodologies, findings, and recommendations for internal and external stakeholders

• Contribute to establishing best practices for responsible and trustworthy AI within public administration environments

Requirements

• Degree in Computer Science, Software Engineering, AI, Data Science, or a related field

• Experience in software testing, quality assurance, or AI/ML system evaluation

• Strong understanding of machine learning concepts, AI system behavior, and testing methodologies

• Familiarity with automated testing tools, scripting languages, and test frameworks

• Experience analyzing model outputs, performance metrics, and potential biases

• Understanding of security, privacy, and compliance considerations in AI applications

• Strong analytical thinking and problem-solving skills

• Excellent communication skills and the ability to work in interdisciplinary teams

• Fluent in German; good English skills

Benefits

• Attractive above-average compensation package

• Centrally located offices with access to the unique ThinkTank Campus in Berlin-Wannsee

• Free snacks and beverages in our offices

• Flat hierarchies, fast decision-making, and room for your own ideas

• International team spirit with recognition of both collective and individual successes

• Early responsibility and creative freedom from day one

• Structured onboarding with a buddy and experienced mentor

• Continuous training programs and regular development discussions

Join Neue Deutsche Infrastruktur and become part of a mission-driven team building the future of digital public services. If you are passionate about analyzing complex administrative systems and transforming them into meaningful digital solutions with real societal impact, we would love to hear from you.