Deloitte – Consulting_SAMA_A&C_Azure Data Engineer_Senior Consultant-Accelerated Hiring

Job Description

Designation: Senior Consultant
Entity: Deloitte Touche Tohmatsu India LLP
With 3-8 years of hands-on experience, the ideal candidate should possess a strong skill set in implementing Azure Cloud data warehouses, Azure and No-SQL databases, and hybrid data scenarios. They should have a deep understanding of the Azure ecosystem and be proficient in developing solutions using various Azure technologies.

One key area of expertise is the implementation and development of Azure Data Factory. The candidate should have experience in designing and building data pipelines using Azure Data Factory, which includes knowledge of Azure Functions, LogicApps, Triggers, and Integration Runtimes (IR). They should be adept at orchestrating data workflows and integrating various data sources and services within Azure.

Additionally, the candidate should have a solid understanding of working with big data technologies such as Databricks, including proficiency in PySpark and Scala. They should be capable of leveraging Databricks for data processing, data engineering, and advanced analytics tasks. Familiarity with Stream Analytics, Event Hub, and HD Insight components is also desired, as these technologies are commonly used in real-time data processing and streaming scenarios.

Furthermore, the candidate should have hands-on experience in working with data lake and data warehousing solutions on Azure. They should be well-versed in designing and implementing scalable and efficient data storage and retrieval mechanisms using Azure Data Lake Storage, Azure SQL Data Warehouse, or other similar services.

In addition to technical skills, the candidate should possess knowledge of managing Azure DevOps pipelines for continuous integration and continuous deployment (CI/CD). They should be proficient in setting up build and release pipelines, configuring automated testing, and managing version control for data and code artifacts.

Security is a crucial aspect of data management, and the candidate should have experience in managing source data access security on Azure. This includes using tools like Vault for securely storing and managing credentials, configuring authentication and authorization mechanisms, and enforcing data policies and standards to ensure data privacy and compliance.

Overall, the ideal candidate should have a strong foundation in Azure data technologies, with hands-on experience in implementing data warehouses, databases, and hybrid data scenarios. They should be well-versed in various Azure services such as Azure Data Factory, Databricks, Stream Analytics, Event Hub, and HD Insight. Moreover, they should possess the necessary skills to manage Azure DevOps pipelines and enforce data security measures.