Senior Data Engineer (Remote)

Who is Trace3?

Trace3 is a leading Transformative IT Authority, providing unique technology solutions and consulting services to our clients. Equipped with elite engineering and dynamic innovation, we empower IT executives and their organizations to achieve competitive advantage through a process of Integrate, Automate, Innovate.

Our culture at Trace3 embodies the spirit of a startup with the advantage of a scalable business. Employees can grow their career and have fun while doing it!

Trace3 is headquartered in Irvine, California. We employ more than 1,000 people all over the United States. Our major field office locations include Atlanta, Denver, Detroit, Indianapolis, Grand Rapids, Lexington, Los Angeles, Louisville, Texas, San Diego, San Francisco, and Scottsdale.  

Ready to discover the possibilities that live in technology?

Come Join Us!

Street-Smart - Thriving in Dynamic Times

We are flexible and resilient in a fast-changing environment. We continuously innovate and drive constructive change while keeping a focus on the “big picture.” We exercise sound business judgment in making high-quality decisions in a timely and cost-effective manner. We are highly creative and can dig deep within ourselves to find positive solutions to different problems.

Juice - The “Stuff” it takes to be a Needle Mover

We get things done and drive results. We lead without a title, empowering others through a can-do attitude. We look forward to the goal, mentally mapping out every checkpoint on the pathway to success, and visualizing what the final destination looks and feels like.

Teamwork - Humble, Hungry and Smart

We are humble individuals who understand how our job impacts the company's mission. We treat others with respect, admit mistakes, give credit where it’s due and demonstrate transparency. We “bring the weather” by exhibiting positive leadership and solution-focused thinking. We hug people in their trials, struggles, and failures – not just their success. We appreciate the individuality of the people around us.

About the Role:

We’re looking to add a Senior Data Engineer to the LAMP Development Team. You will work with a team of big data and software engineers to build data solutions utilizing data technologies such as Databricks, MongoDB, and other databases. Leveraging python, you will develop data pipelines to transform/wrangle/integrate the data into different data zones. You will enhance your skillset by learning from your teammates and share your knowledge to build sustainable solution. You will hold accountability for technical decisions.

To be successful in this role, you will need to hold extensive knowledge of ETL pipelines and big data fundamentals; especially with Databricks experience. The ideal candidate will also be a strong independent worker and learner.

This position is remote.

What You’ll Do:

• Analyze data from multiple sources and negotiate differences in storage schema using the ETL process.
• Analyze the data sources, design, and develop Databricks pipelines to ingest the data.
• Develop and support our ETL environment by recommending improvements, monitoring, and deploying quality and validation processes to ensure accuracy and integrity of data.
• Design, develop, test, deploy, maintain, and improve data integration pipelines.
• Create technical solutions that solve business problems and are well engineered, operable, and maintainable.
• Design and implement tools to detect data anomalies (observability). Ensure that data is accurate, complete, and high quality across all platforms.
• Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues.
• Assembles large and complex data sets; develops data models based on specifications using structured data sets.
• Develops familiarity with emerging and complex automations and technologies that support business processes.
• Leads evaluations of new tools and solutions.
• Develops scalable and re-usable frameworks for ingestion and transformation of large datasets.
• Work within an Agile delivery / DevOps methodology to deliver product increments in iterative sprints.
• Working with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues.
• Develop data models and mappings and build new data assets required by users. Perform exploratory data analysis on existing products and datasets.
• Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Engage in logical and physical design of databases, table creation, script creation, views, procedures, packages, and other database objects.
• Create documentation for solutions and processes implemented or updated to ensure team members and stakeholders can correctly interpret it.
• Design and implement processes and/or process improvements to help the development of technology solutions.

Qualifications & Interests:

• 5+ years of professional work experience designing and implementing data pipelines in a cloud environment.
• 5+ years of professional experience developing, implementing, and maintaining solutions for Big Data or data warehousing systems, with a specific focus on Databricks.
• 3+ years of hands-on professional work experience implementing data pipeline solutions into Databricks.
• 3+ years of experience with cloud platforms (AWS, Azure, or GCP).
• 3+ years of technical experience developing with Python (development of ETLs and/or streaming pipelines a strong plus).
• 2+ years of experience with NoSQL databases (esp. MongoDB).
• Experience designing/implementing solutions using one or more databases (i.e. Snowflake, AWS Redshift, Synapse, Big Query, Oracle, SQL Server, Teradata, Netezza, Hadoop, Mongo DB or Cassandra).
• Experience implementing and maintaining data workflow tools at scale.
• Strong knowledge and understanding of Databricks Lakehouse Platform.
• Experience in managing, using and scheduling notebooks in Databricks.
• Experience in integrating and ingesting data from external data sources with Databricks including automating ETL using Delta Live Tables and Databricks Autoloader.
• Strong SQL (Hive/Spark/Databricks) skills and experience tuning complex queries.
• Strong diagnostic skills and ability to research, troubleshoot, and logically determine solutions.
• Ability to effectively prioritize tasks in a fast-paced, high-volume, and evolving work environment.
• Comfortable managing multiple and changing priorities, and meeting deadlines.
• Highly organized, detail-oriented, excellent time management skills.
• Polished written and verbal communication skills.
• Fun and enjoyable to work with!

The Perks:

• Comprehensive medical, dental and vision plans for you and your dependents
• 401(k) Retirement Plan with Employer Match, 529 College Savings Plan, Health Savings Account, Life Insurance, and Long-Term Disability
• Competitive Compensation
• Training and development programs
• Stocked kitchen with snacks and beverages
• Collaborative and cool office culture
• Work-life balance and generous paid time off

***To all recruitment agencies: Trace3 does not accept unsolicited agency resumes/CVs. Please do not forward resumes/CVs to our careers email addresses, Trace3 employees or any other company location. Trace3 is not responsible for any fees related to unsolicited resumes/CVs.