Data Engineer - Databricks, Apache/Spark
- Published on
About the Role
As a Data Engineer at Infosys, you will design, develop, and maintain scalable data pipelines on Databricks using PySpark. You'll work closely with data analysts and scientists to comprehend data requirements and deliver efficient solutions. Key responsibilities include optimizing existing data pipelines, ensuring data quality, implementing data security practices, and monitoring pipeline performance.
About the Candidate
Expectations and Required Skills:
- 3+/5+ years of experience in data engineering.
- Proficiency with Databricks and Apache Spark.
- Strong SQL skills and experience with relational databases.
- Familiar with big data technologies (e.g., Hadoop, Kafka).
- Knowledge of data warehousing concepts and ETL processes.
- Excellent problem-solving and analytical skills.
- CI/CD tools experience, particularly Jenkins.
Nice to have skills:
- Familiarity with cloud platforms (e.g., AWS, Azure).
- Experience with version control systems (e.g., BitBucket).
- Understanding of DevOps principles and tools (e.g., CI/CD, Jenkins).
- Databricks certification is a plus.
About the Company
Infosys is a global leader in next-generation digital services and consulting, enabling clients across over 50 countries to navigate their digital transformation effectively. With four decades of experience, we help businesses prioritize the execution of change, empowering them with an AI-powered core and agile digital capabilities.
Company Culture and Benefits
At Infosys, we uphold values of learnability and trusted relationships. We foster a dynamic, international, and friendly workplace environment. Employees benefit from free medical care, life insurance, a financial bonus program, and language courses, all while being part of a company committed to embracing diversity and creating an inclusive environment.
Additional Information
Please note that we cannot consider candidates who require company support to legally live and work in Poland.