Engineering Manager, Data Engineering

(This position is based in Trepp's NYC office which operates in a hybrid work schedule)

The Data Engineering Manager is responsible for leading the migration of legacy systems to the Data Lake and providing technical leadership in support of Trepp’s initiatives in data ingestion and pipeline automation, with a focus on the design and implementation of Spark/EMR and streaming platforms. The Data Engineering Manager reports into the Data Engineering organization. 

The ideal candidate will have a bachelor’s degree in Computer Science or closely related subject; an advanced degree is preferred. In addition, 7 or more years’ experience in migrating complex IT systems in enterprise organizations. The position requires strong technical skills and must be able to collaborate effectively with a group of high performing individuals. The position requires an individual who can collaborate on setting mid/long term goals and objectives, then be self-directed to estimate timelines and take ownership of the work, while communicating with stakeholders on a regular basis. The data engineering manager role sets an example for junior team members through modelling best practices and provides guidance during weekly team calls, feedback through code reviews etc., and generally supports the knowledge and skills development of junior team members. 

Data Engineering, Design and Development Requirements: 

• This role is expected to lead & manage a team but will be hands-on 70-80% of the time
• Ensure the delivery and accuracy of data from external vendors and internal data-producing groups.   
• Work within the Platform Pipelines team to implement modern architectures for data collection, processing and storage. You’ll be working with 3rd party partners & vendors along with internal data sources.  
• Consult senior-level stakeholders across the entire organization to identify business and technology needs and to optimize the use of technology, systems, and software tools 
• Provide robust operational support for systems when there are issues or questions with data accuracy or processing. 
• Develop a technology roadmap of projects to enhance current processing and modernize systems taking advantage of Cloud architectures. 
• Analyze existing data operations processes and identify opportunities for efficiency gains. Demonstrate knowledge of batch and streaming pipelines technologies
• Be responsible for core analytics, data lake and date pipeline products.
• Demonstrate knowledge of Data Quality and Data Governance.
• Build data applications, products, integrate with third-party data and technology platforms.
• Demonstrate expertise in comprehension and construction of complex SQL queries
• Act as a Subject Matter Expert to the organization for Trepp’s ingestion frameworks, including AWS and future providers, networking, provisioning, and management 
• Demonstrate leadership ability to back decisions with research and the “why,” and articulate several options, the pros and cons for each, and a recommendation 
• Maintain overall industry knowledge on latest trends, technology, etc.
• Demonstrate application of Realtime vs Batch pipelines

Qualifications: 

• Bachelor’s degree in computer science, systems analysis or a related study, or equivalent experience 
• 4+  years managing an engineering team. 
• 7+ years of experience with Python or Java, or Scala and AWS (Lambda, ECS, EMR)
• 7+ years of experience with SQL (DDL, DML, complex queries)
• Experience with SQL RDBMS implementations and RDS is a plus
• Experience with AWS enterprise implementations (Lambda, ECS, Spark, Kinesis, DMS)
• Experience with Spark / EMR (or similar) implementations
• Exposure to multiple, diverse technologies and processing environments 
• Knowledge of components within a technical architecture
• Experience with Agile and SDLC, Git workflows, and CI/CD
• Strong preference for process and documentation
• Strong understanding of network architecture and application development methodologies

Preferred Skills: 

• A drive to work on financial data systems & pipelines including experience working with structured finance or commercial real estate datasets.  
• Understanding of serverless architectures, containers, and modern application development practices. 
• Ability to quickly learn, understand, and work with new emerging technologies, methodologies, and solutions in the Cloud/IT technology space. 
• Experience working in Financial Services or related industry. 

Salary Range: 

• Base salary range: Starting from $180k plus bonus eligible

Benefits and Perks

• Base + target bonus compensation structure
• Medical, Dental, Vision insurance
• 401K (with employer match)
• Life insurance, long term disability, short term disability all covered by the company
• Flexible paid time off (PTO)
• Sixteen (16) weeks paid primary caregiver leave (Biological, adoptive, and foster parents are all eligible)
• Four (4) weeks paid parental leave
• Pet insurance
• Laptop ​+ WFH equipment​
• Career progression plan
• Pre-tax commuter benefit with company subsidy (For NYC-office based employees only)
• Involvement in Diversity and Inclusion programs
• Fun company events and volunteering opportunities

Workplace Policy: 

NYC, Dallas, and London office-based positions: Trepp’s offices follows a 3-2 hybrid-working policy with the expectation of in-office work on Tuesday-Thursday and the option to work from home on Monday and Friday. 

Remote positions: Employees in remote roles have the option of working remotely and may occasionally travel to a Trepp office or elsewhere for required meetings or team-building events. 

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with Trepp (i.e., H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status). 

Trepp, Inc. is an equal opportunity / affirmative action employer, complying with all laws governing employment in each jurisdiction in which operating, and provides equal opportunity to all applicants and employees. All qualified applicants will be considered without regard to race, color, religion, gender, national origin, age, disability, marital or protected veteran status, sexual orientation, gender identity and other status protected by applicable laws.