Senior Data Engineer
Role details
Job location
Tech stack
Job description
As a Senior Data Engineer (m/f/d), you play a key role in shaping our cloud-based data platform and ensuring that data from research, pilot lines, and production flows together efficiently. Together with our R&D teams, you transform heterogeneous measurement, process, and metadata into high-quality, reliable, and well-structured information. With us, you won't spend your days building reports - you make data-driven development possible from early research through pilot lines to production., * Design data architectures and models based on Azure services such as Databricks, Data Factory, Event Hubs/Event Grid, and Data Lake.
- Develop and operate scalable pipelines for measurement, process, and metadata from laboratories, test benches, prototypes, and production equipment.
- Prepare data according to the Bronze/Silver/Gold architecture so that it can be directly used by domain teams for analyses and evaluations.
- Ensure data correctness, completeness, and reliability through validations, plausibility checks, and quality controls.
- Develop interfaces and services to deliver processed data to internal systems such as LIMS.
- Support R&D teams in analyzing and further processing their data., If you are ready to take on new challenges and drive innovation, we want to hear from you! At CMBlu, you will work with a passionate team that is committed to excellence and continuous improvement.
Requirements
Do you have experience in Terraform?, * You hold a degree in Computer Science, Data Engineering, Data Science, or a comparable field.
- You bring extensive experience with Python and PySpark and can implement complex data processing workflows.
- You are highly proficient in Databricks and have worked with modern components such as Asset Bundles, Delta Live Tables (DLT), Lakeflow Declarative Pipelines, and Databricks Apps.
- You have practical experience with the Azure Data Engineering stack - particularly Data Factory, ADLS Gen2, and Event Hubs - and in building batch and streaming pipelines.
- You are familiar with CI/CD using GitLab and ideally have experience with Terraform, Docker, and Kubernetes (AKS).
- For you, electricity doesn't just "come out of the socket" - you have a basic understanding of how electrical or battery-related measurement concepts fit together.
- Very good English and German language skills complete your profile.