Data Engineering Platform Lead
- Published on
About the Role
The Tech Lead, Data Platform Engineer will work closely to lead a pod of Data Engineers to build out new and maintain existing ETL pipelines in Airflow, along with building and maintaining data APIs. They will be part of our Data Technology team, working with an all-new technology stack and closely collaborating with both internal and external stakeholders.
Key Responsibilities
- Design, implement, and maintain scalable and reliable platform infrastructure using cloud technologies such as AWS.
- Develop and manage deployment pipelines using tools like Docker, Kubernetes, and CI/CD systems.
- Monitor system performance, troubleshoot issues, and ensure high availability and reliability of our platform services.
- Prototype and test new technologies to enhance our platform capabilities and support our vision of improving consumer experiences.
- Collaborate with Data Engineers, Data Scientists, and other teams to support their infrastructure needs and resolve technical issues.
- Provide insights and support to ensure optimal performance and scalability of our platform.
About the Candidate
We’re committed to hiring the best talent for the role. Here’s how we will know you’ll be successful:
- Experience in a similar role or function is a bonus.
- Strong communication skills and eagerness to learn new technologies.
- Bachelor’s degree or equivalent in Computer Science, Computer Engineering, Information Systems, or a related field.
- Proficiency in programming languages such as Python; experience with Spark is a bonus.
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes.
- Experience with cloud platforms, preferably AWS.
- Knowledge of CI/CD practices and tools.
- Understanding of system performance monitoring and optimization.
About the Company
Compass Digital is committed to hiring top talent to enhance our data platforms. Join us in leveraging cutting-edge technologies for data management and consumer experience improvements.
Company Culture and Benefits
Our culture emphasizes collaboration, ongoing learning, and leadership within the data technology space. We support personal and professional growth, while providing a work environment that fosters innovation and success.