Senior Program Manager Analytics

Microsoft's Cloud business is experiencing explosive growth, and the Capacity, Supply Chain & Provisioning (CSCP) organization is responsible for enabling the infrastructure underlying this growth. Our mission is to deliver the world's computer with an industry-leading supply chain. CSCP is responsible for strategic sourcing, customer demand forecasting, capacity planning and management, supply chain planning and execution, capacity provisioning, and decommissioning and dispositioning of datacenter assets worldwide.
Global Capacity Team manages cloud capacity for customers globally across different resources and regions - Compute, Storage, PaaS services, bare metal services etc. The Analytics and Insights team provides backbone analytics views for daily, weekly and monthly processes and operations. To support this a BI analytics platform is built on cloud with various architectural components - data ingestion pipelines, transformation, data quality, analytics and data storage, security and visualization.
The analytics platform provides a environment of high opportunity and impact and we are looking for a strong and experienced Data Engineer who can deliver robust data infrastructure to power world-class analytics solutions at cloud scale to optimize and improve Azure customer capacity experiences working closely with business partners, other engineering teams and data scientists.Responsibilities

• Engaging with stakeholders, defining, and validating requirements
• Designing, developing and maintaining data pipelines and data models
• Driving scale and service improvements
• Reviewing and improving designs/code quality, security, compliance and other production requirements such as performance and scale
• Investigating and integrating new workloads, technologies, etc., and working with stakeholders to apply the required changes
• Participating in team's live-site activities

QualificationsRequired Qualifications:

• Bachelor's degree in Mathematics, Statistics, Engineering, or a related technical field OR equivalent work experience
• 10+ years of experience architecting, designing, and operating large scale big data services
• 5+ year experience with Azure Big Data stack (Data Lake, Spark, Hadoop) and distributed processing like Apache Spark, Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake Storage, Python, .Net / Azure frameworks
• 10+ years development experience on large-scale big data solutions including databases (SQL/No-SQL) and ETL / Data pipelines using cloud services.

Preferred Qualifications:
Data Engineering Experience-

• Hands-on expertise on complex SQL development and Kusto query language
• Modern DevOps practices (including Git, CI/CD, Azure DevOps/VSTS)
• Deep technical knowledge/experience on architecting, developing, and deploying enterprise Big Data engineering solutions.
• Deep practical experience troubleshooting performance problems, tuning and optimizing big data solutions.
• Architecture - the ability to create and explain 3-tier architecture diagrams, system context diagrams, system interaction diagrams, etc.
• Experience in big data workloads like HDInsight, Hadoop, Spark,
• Advanced Analytics including Azure Databricks, visualization tools as Power BI
• Experience working with Azure Machine Learning, Azure Cognitive Services, Azure Databricks
• High throughput logging systems/databases like Azure Log Analytics, ELK Stack or similar
• Experience with any analytical / visualization tool (Power BI, Cognos, OBIEE, etc.) is a plus

Data Architecture experience-

• Leverages a structured approach to architecture projects/improvements using existing methodologies (e.g., Waterfall, Agile, Iterative) that make use of existing reference architecture and established architectural styles and design patterns. Proposes and develops new solutions to scale across multiple customers/partners. Builds and maintains an architecture description document, an architecture decisions log, and a requirements/constraints traceability matrix to ensure the rationale for the business solution's architecture is known and understood.
• Collaborates with the Lead manager to jointly drive project/technical governance of the design, build, and deployment into use of proof of concepts (POCs) and pilots, using enterprise architecture processes and ensuring quality control through peer review.
• Works with the business sponsor and customer/partner stakeholders to gather and ratify requirements and constraints. Manages and resolves complex ambiguity in the requirements and constraints and documents assumptions and implications where it cannot be resolved. Maintains the requirements/constraints traceability matrix to prove that solution components have a rationale/justification for inclusion in the architecture of the business solution. Drives development and execution of test plans to prove that each requirement/constraint has been implemented.

CLOUD SCREENING REQUIREMENT
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
#cscpjobs #gctjobs
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form .
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.