Job Description
Job Description
The position focuses on the design, construction and maintenance of data streams that support research and experimentation work in artificial intelligence. It also includes the development of backend services and APIs that enable reliable and clean access to data at scale.
Responsibilities:
Design, build and maintain data flows that drive research and experimentation work in artificial intelligence.
Develop backend services and APIs that provide reliable access to data at scale.
Collaborate with artificial intelligence researchers and developers to understand data needs and convert them into engineering solutions.
Improve the reliability, observability and performance of data infrastructure.
Debug and resolve data quality problems, identifying causes and sharing learnings.
Contribute to internal tools and the creation of paths that facilitate working with data in a consistent way.
Requirements:
Experience in Python with knowledge of creating data pipelines or backend services in production environments.
Experience with data engineering patterns, including batch processing, streaming, data quality, and pipeline orchestration.
Experience with Kubernetes or similar container orchestration environments.
Software engineering fundamentals, including API design, testing, and observability.
Experience working with research, data science, or machine learning teams.
Ability to debug and solve problems.
Ability to manage multiple workflows and communicate clearly with technical and non-technical stakeholders.
Collaborative mentality with a focus on facilitating other people's work.
Knowledge of PyTorch or other machine learning frameworks is an advantage.
Salary to receive
€70,000 / year