Posted On Apr 16, 2024
Job Description
Data Engineering Lead
Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines and architectures that can handle large volumes and variety of data from multiple sources.
- Lead and mentor a team of data engineers and provide technical guidance and feedback.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet business objectives and quality standards.
- Implement best practices and standards for data engineering, such as data quality, testing, documentation, and security.
- Research and evaluate new technologies and tools for data engineering and recommend solutions that can improve performance, efficiency, and scalability.
- Bachelor-s degree or higher in computer science, engineering, or related field.
- 10-15 years of experience in data engineering, with proven track record of leading and delivering complex data projects.
- Expertise in data engineering tools and frameworks, such as Spark, Hadoop, Kafka, Airflow, AWS, GCP, etc.
- Proficiency in programming languages, such as Python, Java, Scala, etc.
- Strong knowledge of data modeling, data structures, data quality, and data governance.
- Excellent communication, collaboration, and problem-solving skills.
- Ability to work in a fast-paced and dynamic environment.
All product names, logos, and brands are property of their respective owners.