Principal Data Engineer
Company Name:-
Noodle.ai
Job Location:-
Bengaluru, Karnataka
Job Summary:-
Noodle’s Data Engineers have a strong understanding of database structures, modeling and data warehousing techniques; know how to create SQL queries, stored procedures, views and define best practices for engineering scalable secure data pipelines.
Members of our Data Engineering team are passionate about embracing the challenge of dealing with petabyte or even exabytes of data on a daily basis.
Roles and Responsibilities:-
Support and monitor multiple data pipelines across different customers
Work closely with the development team to understand changes to every release
Contribute to the data engineering development work when needed
Collaboration with multiple stake holders including and not limited to the Infrastructure, DevOps, Data science among other team
Interface with customer facing teams
Qualifications:
Must haves
8+ years of experience with data pipelining and development
BE/B.
Tech or Advanced degree in a relevant field (Computer Science and Engineering, Technology and related fields)
Good knowledge on Python programming language
Good knowledge in SQL queries (Not limited to PostgreSQL)
Experience in data pipeline orchestration tools like Airflow
Basic understanding of containers and familiarity with docker commands
Exposure to distributed systems and basic working knowledge on Spark, Sqoop, Hive
Have been part of at least one data engineering work
Very good debugging skills
Flexible to learn new technologies and adapt to dynamic environment
Nice to haves
Exposure to cloud (preferably AWS, S3, EMR)
Basic understanding and usage of Jenkins for continuous deployment
Understanding of ML model lifecycle and pipelines
Experience with (and excitement for) interdisciplinary collaboration
Want to help shape the future
FOR MORE DETAILS CLICK BELOW LINK [convertful id=”110657″]