Data Engineer - Commodities

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world.  We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk. 

Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets. 

We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it.  DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.  

DRW is looking for a Data Engineer to join its Commodities trading group to build data pipelines to manage the ingestion and transformation of data sets used by our analysts and traders to support fundamental research and trading. 

You will work with trading desks in the Commodities group to understand and manage their data requirements and build ETL pipelines for data sets that they will consume. You’ll work in a group with other data engineers and have the support of software engineers to build tooling to help you get your job done. 

What you will do 

• Build data ETL pipelines in Python to ingest 3rd party data sets and make them accessible and useful inside our analytics and trading environments
• Work with software engineers to build tools to make the ETL process productive, scalable & robust
• Monitor ETL pipelines & data sets, ensuring availability & integrity of our data
• Work with database and storage engineers to design storage solutions for data sets across SQL, NoSQL, and distributed file systems on-prem and in the cloud
• Work with traders, analysts and researchers to capture new data requirements and work with our data program manager to organize our data engineering projects
• Understand how teams are using our data and constantly optimize to improve user experience (latency tuning, schema improvements, documentation, etc)

Projects you will be involved with 

You will be working on building an efficient, scalable data warehouse for analyzing public and proprietary data feeds across a number data providers and data sets to support analytics and trading across many commodities products including: 

• Crude oil & refined products balances & forecasting
• Global & regional natural gas and LNG flows
• Agriculture production, exports & forecasting
• Global shipping of commodities
• Demand data for US & European Power

What you bring to the team 

• Experience building ETL pipelines for 3rd party data sets
• SQL database usage, schema design and query optimization experience
• Python development experience
• Familiarity with NoSQL databases and distributed file systems
• Experience working in a trading environment a strong plus
• An engineering mindset and experience writing software

For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice.

California residents, please review the California Privacy Notice for information about certain legal rights at https://drw.com/california-privacy-notice.

#LI-SK1