Job Description
Date posted: Mar 18, 2024
Work site: Up to 50% work from home
Travel: 0-25 %
Role type: Individual Contributor
Profession: Software Engineering
Discipline: Data Engineering
Employment type: Full-Time
Overview:
Microsoft’s Cloud business is experiencing explosive growth, and the Cloud Supply Chain (CSCP) organization is responsible for enabling the infrastructure underlying this growth. Our mission is to deliver the world’s computer with an industry-leading supply chain. CSCP is responsible for strategic sourcing, customer demand forecasting, capacity planning and management, supply chain planning and execution, capacity provisioning, and decommissioning and dispositioning of datacenter assets worldwide.
DEI (Digital Enablement and Innovation) team is responsible for building the next generation platforms and enable the supply chain functional teams by building analytics solutions. These solutions are used by the functional users to make business decisions to drive the organization mission.
Qualifications:
Basic Qualifications:
- Bachelor’s degree in Computer Science, MIS, related technical field, or equivalent work experience.
- 4+ Years’ Experience developing with cloud-based data technologies like message queues, event grids, including relational databases, NoSQL Databases , data warehouse, big data (i.e. Hadoop, Spark), orchestration/data pipeline tools.
- 4+ years of strong experience developing in Spark/Python
- Strong TSQL skills to develop code and also manage complex database objects.
Preferred experience/skills:
- Experience with framework, API and Object-oriented designs
- Experience with Spark on "big data" systems and services.
- Proficient in data modeling, ETL development, and Data warehousing, or similar skills
- Proficient in SQL, Azure Synapse, Azure Data Lake, Azure Data Factory, Azure Analysis Services, SQL , Pyspark
- Experience with Agile software development using the scrum methodology.
- Experience in modern DevOps practices (including Git, CI/CD)
- business acumen and adaptability to partner with the leadership on innovative solutions to constantly changing business requirements
- Good interpersonal and communications (verbal and written) skills, including the ability to effectively communicate with both business and technical teams.
Responsibilities:
The ideal candidate will possess combination of data engineering and strong business acumen skills that will help them be successful in the role. The successful candidate will work in lockstep with Software Engineers, Data scientists, Business analysts, Product Managers and other stakeholders across organization. Your responsibility will include the following
- Design, develop data Ingestion pipelines that will enable insights to analyze and measure the rhythm of business.
- Work with Finance teams in understanding the requirements and developing the technical specifications.
- Design and optimize the data pipelines
- Perform data quality checks
- Migrate the existing legacy BI platforms into the next generation data platforms.
- Identify the gaps between the existing platforms and next gen platform and complete the migration
- Spear head the migration process and ensure the migration is seamless with maximum user satisfaction.
- Developing ETL jobs and framework to acquire and integrate data from diverse sources like Azure Data Lake, Kusto, SQL Server, Cosmos, flat files etc.
- Recognize and adopt best engineering practices in reporting and analysis&; data integrity, test design, analysis, validation, and documentation c
- You will partner and collaborate with engineering groups, business stakeholders to predict Supply Chain; Deployment Milestones and identify risks that will help in proactive mitigation and smooth deployment