Senior Data Engineer Databricks
- Published on
About Pulsover
Pulsover is a consulting firm specializing in data, cloud, and delivery. We are partners with Databricks and AWS, assisting businesses of all sizes in their digital transformation through our technical expertise and project management capabilities. Our culture promotes innovation, performance, and a conducive environment for professional development.
About the Role
As a Senior Data Engineer, you will play a crucial role in the creation, implementation, and management of our data pipelines. Your main responsibilities will include:
- Participating in data engineering projects using a methodological framework.
- Developing, industrializing, and maintaining data pipelines, primarily ETL and ML.
- Performing data exploration and rapid prototyping.
- Applying best practices, including versioning, automated testing, and CI/CD.
- Actively participating in automating cloud computing infrastructure.
- Implementing Lakehouse architectures to break down silos.
- Deploying machine learning algorithms at scale on streaming data.
- Collaborating with teams from functional specifications to business validation of implemented solutions.
- Contributing to the establishment of Agile methodologies like Scrum.
About the Candidate
We are looking for a candidate with:
- An engineering degree or equivalent with at least 5 years of experience in data engineering.
- Significant experience as a Data Engineer with in-depth expertise in Spark, Databricks, AWS, and/or GCP.
- Solid understanding of data engineering principles, distributed architectures, and best data management practices.
- Excellent programming skills, particularly in languages like Python.
- Knowledge of database technologies, ETL tools, and data integration.
- The ability to work independently, manage multiple projects simultaneously, and meet deadlines.
- A good level of English for our international projects.
- Above all, a positive attitude and good humor are essential.
Company Culture and Benefits
Working at Pulsover offers a collaborative and stimulating work environment, promoting continuous learning and professional evolution. We provide stimulating missions within major market players and opportunities for training and professional development to stay updated on the latest technologies. You will work on complex data projects that have a direct impact on our company’s strategic decisions. We offer competitive remuneration and attractive social benefits.