As a Senior Data Engineer, you'll be at the forefront of our data platform, responsible for designing, building, and maintaining robust data pipelines and infrastructure. This role requires a combination of technical expertise in data engineering, strong problem-solving skills, and the ability to communicate effectively with both technical and non-technical stakeholders
Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions for data processing and analytics
Evaluate and integrate new technologies, tools, and frameworks to enhance our data infrastructure and drive innovation in data engineering practices
Provide technical leadership and mentorship to junior team members, fostering their professional growth and development
Design, develop, and maintain scalable data pipelines workflows to ingest, process, and transform large volumes of data from diverse sources
Bachelor's or Master's degree in Computer Science, Engineering, or a related field
5+ years of experience in software\data engineering or related roles, with a strong track record of designing and implementing data solutions at scale
Proficiency in Python, and experience with data processing frameworks such as Apache Spark or Apache Flink
Hands-on experience with cloud platforms such as AWS and familiarity with related services such as S3, or, EMR
Strong problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment
Excellent communication skills and the ability to effectively communicate technical concepts to non-technical stakeholders