Senior Big Data Engineer

You will be part of the Professional Services team and work with clients on short to medium term customer engagements solving their big data problems using Apache Spark and the Databricks platform. You will be in a customer-facing role that requires deep hands-on expertise in Apache Spark™ and data engineering, along with a variety of knowledge of the big data ecosystem. You will guide our largest customers, implementing pipelines from data engineering through model building and deployment, plus other technical tasks to help customers to get value out of their data with Databricks. You will report to the Regional Leader of the Resident Solutions Architect team.

The impact you will have:

• You will guide customers as they implement transformational big data projects, including end-to-end development and deployment of industry-leading big data and AI applications
• You will assure that Databricks best practices are being used within all projects and that our quality of service and implementation is strictly followed
• You will facilitate technical workshops, discovery and design sessions, customer requirements gathering and scoping for new and existing strategic customers
• Assist the Professional Services leader and project managers with level of effort estimation and mitigation of risk within customer proposals and statements of work
• Architect, design, develop, deploy, operationalize and document complex customer engagements individually or as part of an extended team as the technical lead and overall authority
• Knowledge transfer, enablement and mentoring of other team members, customers and partners, including developing reusable project artifacts
• Provide experience to the consulting team, provide best practices in client engagement to other teams

What we look for:

• 6+ years of experience in Design and Implementation of Big Data technologies (Apache SparkTM) and familiarity with data architecture patterns (data warehouse, data lake, streaming, Lambda/Kappa architecture)
• Deep technical knowledge and comfortable coding in Python or Scala
• Familiarity with Azure/AWS/EC2 cloud deployment models (Public vs. VPC)
• Familiarity with GCP a plus
• Analyze large and complex data systems
• Experience working with teams across a diverse geographic area
• Encourage/persuade through presentation of a well-structured argument (Verbal or written)

Benefits

• Private medical insurance
• Accident coverage
• Employee's Provident Fund
• Equity awards
• Paid parental leave
• Gym reimbursement
• Annual personal development fund
• Work headphones reimbursement
• Business travel insurance
• Mental wellness resources