Find Job
Hire Talent
Events
Blogs

Data Engineer

Location

Chennai

HeadQuarters

Chennai

Company Size

453

Established in

2000
Skillsets
AWS
Yarn
PySpark
HQL
Kylin
Airflow
Job Description
  • Proficiency and knowledge of best practices with the AWSs EMR (YARN, PySpark, HQL, Kylin, Airflow)
  • Experience with ETL testing in python Experience w/GIT
  • Design and build data processing pipelines using tools and frameworks in the AWS EMR ecosystem
  • Design and build ETL pipelines to automate ingestion of structured and unstructured data Implement and configure big data technologies as well as tune processes for performance at scale