Posted On Oct 01, 2024
Job Description
Job Description
Data Engineering Lead
Responsibilities
Design, develop, and maintain scalable and reliable data pipelines and architectures that can handle large volumes and variety of data from multiple sources.
Lead and mentor a team of data engineers and provide technical guidance and feedback.
Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet business objectives and quality standards.
Implement best practices and standards for data engineering, such as data quality, testing, documentation, and security.
Research and evaluate new technologies and tools for data engineering and recommend solutions that can improve performance, efficiency, and scalability.
Requirements
Bachelor-s degree or higher in computer science, engineering, or related field.
10-15 years of experience in data engineering, with proven track record of leading and delivering complex data projects.
Expertise in data engineering tools and frameworks, such as Spark, Hadoop, Kafka, Airflow, AWS, GCP, etc.
Proficiency in programming languages, such as Python, Java, Scala, etc.
Strong knowledge of data modeling, data structures, data quality, and data governance.
Excellent communication, collaboration, and problem-solving skills.
Ability to work in a fast-paced and dynamic environment.
All product names, logos, and brands are property of their respective owners.