Data Engineer
Pune
- Azure Data Factory
- Azure Active Directory
- Data Lake
We are looking for a Data Engineer with 5+ years of experience.
Responsibilities
- Deliver data engineering solutions supporting online platform analytics and data science projects
- Incorporate new data sets in the data lake using data integration technologies
- Enable the integration of external data sets based on available formats providing prompt turnaround of user requests including clear guidance on the automation of refreshes or, when not possible, details of the steps required by the user to trigger refreshes
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure technologies
- Model the data to produce comprehensive data models for use by non-IT data analysts
- Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics
Requirements
- B.Tech/B.E. in Any Specialization, BCA in Computers, B.Sc in IT or similar course
- Advanced university degree (Master’s degree or equivalent) in computer science, data science, analytics, statistics, information management, public administration, management or a related field. A first-level university degree in combination with qualifying experience may be accepted in lieu of the advanced university degree
- A minimum of five years of progressively responsible experience in applied analytics, business intelligence, information management or statistics
- Demonstrated experience in modern API platform design is required
- Experience in tools managing version control such as Git is highly required
- Experience with data warehousing, database programming languages like SQL, PL/SQL and NoSQL databases like Cassandra or MongoDB is required