Data Engineer

About YLD:

Everything we do is to empower our clients to move forward. Great technology companies are built on incredible design, engineering and strategy, working in unison, operating at the very heart of an organisation and its audience. Enabling organisations to become great technology companies is our mission, and our promise to our clients. We aim to leave them with the mindset, tools, skills and expertise they need to go beyond their own expectations, revolutionise their sectors, and for us to be proud of the change we create with them and their customers.

Our Mission:

Our purpose is to help our clients develop the capabilities they need to outperform their competitors. Our success is a consequence of ensuring our clients are successful. Our company is built on extraordinary people; we aim to attract, inspire, develop and retain them. YLD is a software engineering and design consultancy; we create digital capabilities for our clients that last beyond our engagement. We have offices in London, Lisbon, Porto.

About the role:

As a Data Engineer in this role, you will be responsible for building core infrastructure software (pipelines, APIs, data modelling, tracking events) as part of our client's data platform team. Your work will include instrumenting systems for performance, and enhancement throughout. You will work on ensuring these data offerings are to various internal & external stakeholders using secure authentication patterns.

Your role will include choosing and implementing the appropriate technologies for scaling data access patterns, batch processing, handling data from third-party suppliers, supporting documentation, and supplying data to researchers—all while considering the unique domain knowledge of the client's business. As a senior collaborator on the team, you will coach and mentor other engineers to support the growth of their technical expertise.

Technical competencies:

Proven experience writing highly maintainable and performant Python/PySpark code

• Good understanding of Cloud environments, particularly Microsoft Azure and data orchestration systems such as Dagster or Apache Airflow
• Good understanding of containerisation platforms such as Docker and container orchestration systems such as Kubernetes
• Experience working with data lakes; experience with Spark or Databricks
• Understanding of common data transformation and storage formats, e.g. Apache Parquet
• Familiar with version control systems such as Git and GitHub
• Experience with VCL and BCL would be a plus, but not required

Non-Technical competencies:

• Problem-solving skills that balance innovation with pragmatic technology choices to solve business needs
• Comfortable working in a dynamic production environment and taking care of client expectations effectively
• Distinct customer focus and quality mindset
• Experience working closely with engineering leadership and architects to deliver high-quality solutions
• Experience maintaining a high-degree of ownership and transparency in deliverables
• An exemplar of YLD’s brand and safeguarder of our reputation
• Exceptional communication skills, able to communicate complex ideas in a simple fashion

As well as the chance to work with a forward-thinking, ethical, and fun group of people, you’ll also get:

• Company Private Health care
• Enhanced fully paid maternity and paternity leave for up to 6 months
• Company’s Pension Scheme
• 25 days annual holiday (excluding Public Holidays)
• £2000 annual allowance for Training/Conferences
• £300 annual allowance for additional hardware
• Mental Health support: access to Spill app
• Meditation/Sleep support: Headspace or Calm app subscription
• Bonus (depending on Company performance and results)
• Company laptop
• Generous referral schemes

Our typical Recruitment Process looks like this:

• 1st Interview with someone from the Talent team (30/45 mins)
• Technical Interview with our Developers (1h30)

We live and breathe our values, and know you will too:

• Growing every day
• Including everyone
• Relationships built on honesty and ethics
• Inspiring solutions
• Winning together

We’re an equal opportunity employer and value diversity of all kinds. We don’t discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability status. We also believe in work-life balance and offer flexible working around our core hours.