Senior Data Engineer

About DAT

DAT is an award-winning employer of choice and a next-generation SaaS technology company that has been at the leading edge of innovation in transportation supply chain logistics for 44 years. We continue to transform the industry year over year, by deploying a suite of software solutions to millions of customers every day - customers who depend on DAT for the most relevant data and most accurate insights to help them make smarter business decisions and run their companies more profitably. We operate the largest marketplace of its kind in North America, with 227 million freight posts in 2021, and a database of $126 billion of annual global shipment market transaction data. We have co-headquarters in Portland, OR and Denver, CO, and additional offices in MO, TX, and Bangalore, India. For additional information, see www.DAT.com/company.

The Opportunity

AT DAT, Our leaders optimistically share future possibilities to inspire and motivate others toward their full potential. We expect our employees to find ways to embrace positive change, be curious and challenge the status quo, and provide solutions to unmet problems. Joining DAT means joining a culture focused on fostering development, building genuine connections, recognizing each other’s strengths and sharing in successes.

As a Sr Data Engineer, you will be responsible for developing data engineering patterns and practices within the organization and in the team. You will support us in designing, building, and maintaining our data infrastructure, with special focus on reusability, availability and scalability in AWS. You will have the opportunity to work on challenging platform and data-related problems and to have a measurable impact on the organization. Designing and building the evolution of data as a product including coordination across multiple systems, data privacy, data quality, and discoverability while introducing new ideas, patterns and technologies in support of our customers and internal stakeholders.

What You’ll Do

• Actively develop data pipelines from source systems to Snowflake 
• Supporting us with evolving our data platform architecture
• Developing, documenting and communicating methods and processes to be utilized by the broader team(s)
• DW modeling knowledge (kimball, inmon, data vault and concepts such as data mesh) 
• Knowledge of AWS
• Providing solutions for complex business problems, enabling insights that can empower better decision-making
• Takes an active role in fostering a culture of learning and excellence

The Skills and Experience You’ll Bring

• Bachelor’s degree in Computer Science, Computer Engineering or related technical discipline
• 4+ years of relevant engineering experience
• SME with DBT, Astronomer, Snowflake
• You bring hands-on experience in creating and managing an enterprise-scale Data Platform, while setting best practices for development teams, including security, privacy, monitoring & alerting, and CI/CD (ideally, AWS, Terraform, MySQL, Airflow, Tableau, Oracle, Snowflake)
• You are a strong data engineer having worked with Kafka, cloud based services (AWS S3, EMR, Glue) and with containers (Docker, Kubernetes, ECS, EKS).
• Willing to implement change and improvements when seeing an opportunity
• Knowledge of professional software engineering practices and best practices for the full software development and technology management life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations; Agile a plus.
• Excellent verbal and written communication skills
• Interest in continuous learning and improvement

(Colorado only) In compliance with Colorado's Equal Pay for Equal Work Act, the minimum salary for this role is $170,000 + benefits. The maximum compensation for this role can vary significantly depending on your job-related skills and experience. DAT considers factors such as scope and responsibilities of the position, candidate's work experience, education and training, core skills, internal equity, and market and business elements when extending an offer.

DAT embraces the value of a diverse workforce, and believes it is a core strength of our company that we encourage those values in every DAT employee, at every level of our organization, regardless of tenure or rank. We provide equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)