Data Engineer
DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.
Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.
We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.
As a Data Engineer in our Unified Platform organization, you will play an integral role in building data products and defining platform capabilities used by Traders, Quantitative Researchers, and Back-Office personnel to analyze financial markets, determine trading opportunities, establish new strategies, and ensure smooth back-office processes.
Technical requirements summary:
- Have experience designing and building data pipelines and systems
- Have experience working within modern batch or streaming data ecosystems
- An expert in SQL and have expertise in Java/Scala or Python
- Can apply data modeling techniques
- Able to own the delivery of data projects, working with analysts and stakeholders to understand requirements and implement solutions
- Able to contribute to project management and project reporting
What you will do in this role:
- Help model, build, and manage data products built atop DRW’s Unified Data Platform.
- Work alongside domain experts to gain and leverage knowledge of the relevant project’s domain to design optimized data products that meet the needs of many different research and trading strategies.
- Work closely with Traders and Researchers to determine appropriate data sources and implement processes to onboard and manage new data sources for analysis to unlock future trading opportunities.
- Design and develop data solutions to help discover, purchase, organize, track usage, manage rights, and control quality of data sets to address the needs of various DRW trading teams and strategies.
- Continually monitor data ingestion pipelines and data quality to ensure stability, reliability, and quality of the data. Contribute to the monitoring and quality control software and processes.
What you will need in this role:
- 3+ years of experience working with modern data technologies and/or building data-first products
- Extensive familiarity with SQL with a proven ability to construct maintainable queries and productionalize them as ongoing pipelines.
- Experience leveraging data modeling techniques on complex datasets and ability to articulate the trade-offs of different approaches.
- Strong skill in Java/Scala or Python
- Familiarity with cloud-native technologies used for scalable data processing.
- Experience with one or more data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.)
- Experience with multiple data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.) and knowledge of their associated trade-offs.
- Experience with multiple data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.)
- Experience managing data pipeline orchestration systems (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.)
- Proven experience in managing the operational components of large data pipelines such as backfilling datasets, rerunning batch jobs, and handling dead letter queues.
- Prior experience triaging data quality control processes, correcting data gaps and inaccuracies.
- Strong technical problem-solving skills
- Proven ability to work in a collaborative, agile, and fast-paced environment, prioritizing multiple tasks and projects, and efficiently handle the demands of a trading environment
- Excellent written and verbal communication skills.
Location: Chicago or New York
The annual base salary range for this position is $150,000 to $200,000 depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.
For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at .
California residents, please review the California Privacy Notice for information about certain legal rights at .
Recommended Jobs
Insurance Agent
HealthMarkets Overview If you’re looking for an exciting opportunity where you can change people’s lives and achieve financial success as an independent insurance agent, you’ve come to the right p…
Family Practice Physician
Job Description Job Description POSITION SUMMARY Under direction of the Chief Medical Officer, provides professional medical services in the community health center. ESSENTIAL DUTIES AND …
Dishwasher
Job Description Job Description Do you want to work for a great company with competitive benefits and salary? The Embassy Suites by Hilton Chicago Northshore Deerfield is looking to hire a Dishwa…
Senior Financial Planning Analyst
At Tricoci Salon & Spa, we believe in the power of beauty, self-care, and a sense of belonging. We're a leading name in the beauty industry, offering an experiential space where our clients and team …
Engineering Associate (Junior)
Join our dynamic aviation team and make a lasting impact! Altimeter Associates is seeking a talented Airfield Engineering Associate to join our team in Chicago, IL. You'll work collaboratively with e…
Assistant Route Service Sales Representative (4-Day Workweek)
Requisition Number: 207123 Job Description Cintas is seeking an Assistant Route Service Sales Representative. Responsibilities include providing route service to a set customer base, through t…
Automotive Technician Sponsorship Opportunity
Ford ASSET Student Recruiting for Fall of 2022! Become a Certified Auto Technician through a partnership between Auffenberg Dealer Group, Ford Motor Company, and Ranken Technical College. We are curr…
Medical Assistant at Heartland Foot & Ankle Associates
Job Description Job Description Full Podiatric Medical Assistants Are you an outgoing ‘People Person’ who loves to smile? Do you want to work in a small office where you are an integral pa…
ReGeneration Schools, Chief of Staff
Job Description Job Description ORGANIZATION ReGeneration, founded in 2016, is a nationally ranked charter program with nine charter schools located in Illinois and Ohio. ReGeneration serves o…
Greeter / Information Desk - Tinley Park
37 Acre campus, 20 minutes south of Chicago. DNV Accredited - licensed for 582 beds. Ingalls Family Care Centers in Flossmoor, Tinley Park, and Calumet City. , Responsible for greeting, wayfindi…