Data Engineer (Azure: ADF + DBT + Snowflake) IRC249574

Requirements

ESSENTIAL SKILLS, EDUCATION AND EXPERIENCE

• MUST have expereince in Azure cloud, working on Data warehousing involving ADF, Azure Data Lake, DBT and Snowflake
• 6-8 years of experience in Data Engineering
• Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data
• Creation of necessary infrastructure for ETL jobs from a wide range of data sources
• Hands on experience using Azure Data Factory
• Collecting data requirements, maintaining metadata about data
• Experience with stream-processing systems
• Experience in Data storage technologies like Azure Data Lake (Gen2)
• Data modeling technical awareness
• Conduct research and identify automation tasks
• Good experience developing ETL pipeline using DBT

Good to have

• AWS data services development experience
• Working knowledge on using Bigdata technologies
• Good to have in building Data pipeline using AWS data pipeline service as well as database service
• Experience in collaborating data quality and data governance team.
• Exposure to reporting tools like PowerBI and Tableau
• Apache Airflow, Azure Stream Analytics

Other skills

• Good Communication skills
• Team Player
• Problem solver
• Willing to learn new technologies, share your ideas and assist other team members as needed
• Strong analytical and problem-solving skills; ability to define problems, collect data, establish facts, and draw conclusions.