Software Engineer III - AWS & Data Bricks
- Implements data solutions to make high-quality data available for analytics and reporting,
- Collaborates with data analysts, architects, engineers and business stakeholders to understand data requirements.
- Ensures data quality and consistency by identifying and resolving data issues and creating data reconciliations.
- Optimizes data workflows and processing for performance, scalability, and reliability.
- Monitors data pipelines and proactively addresses issues to minimize downtime and disruptions.
- Documents data engineering processes, data lineage, and data dictionaries
- Stays current with data engineering technologies, best practices, and industry trends.
- Designs and develops complex data pipelines, ETL (Extract, Transform, Load) processes and decision support systems' data procedures.
- Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and Skills
- Formal training or certification on Data Engineering concepts and 3+ years applied experience.
- Experience using technologies such as Databricks , Pyspark, and AWS
- Experience in working with AWS (Lambda, Step Function, SQS, SNS, API Gateway, secrets manager and storage services )
- Strong software engineering and object-oriented programming skills with expertise in Python and Terraform
- Familiar with development tools such as Jenkins, Jira, Git/Stash, spinnaker
- Hands on experience with open-source frameworks/libraries, such as Apache NiFi, Apache Airflow and Autosys.
- Strong understanding of REST API development using FASTAPI or equivalent frameworks.
- Familiarity with unit testing frameworks such as pytest or unittest.
- Advanced at SQL (e.g., joins and aggregations)
- Extensive experience in statistical data analysis, with the ability to select appropriate tools and identify data patterns for effective analysis, as well as experience throughout the data lifecycle.
Preferred Qualifications, Capabilities, and Skills
- Data modeling skills.
- Familiarity with Kubernetes, Kafka.
- Experience with containers and container-based deployment environment (Docker, Kubernetes, etc.)
- Exposure to Oracle Database, Pl/SQL programming & Informatica.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans Base Pay/Salary
Chicago,IL $114,000.00 - $155,000.00 / year
Recommended Jobs
Full Time Cardiology Interventional Job IL
Memorial Health has a well-respected, highly reputable Cardiology program and is seeking a motivated, dynamic Interventional Cardiologist to join its team due to demand and volumes. Work alongside 2 …
Data Architect: EPIC VBPM & Population Health (Remote)
Hi Hope you are doing well !! I have an urgent position. Kindly go through the Job description and let me know if this would be of interest to you. Title : Data Architect: EPIC VBPM &…
Senior eDiscovery Technical Services Engineer
Job Description Job Description POSITION OVERVIEW The Senior Technical Services Engineer is a high-level technical role responsible for overseeing the support and upgrade activities of missio…
ERCS Data & Tech - UX Designer - Experienced Associate Save for Later Remove job
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their o…
M365 AI Developer
Job Type: FTE Location: Remote (US or Canada) Company Overview: We are a consulting company specializing in implementing innovative Microsoft 365 and Generative AI solutions to empower client…
Salesforce Software Engineer
Resource Innovations is seeking a Salesforce Software Engineer with development experience to join our growing software team. We are seeking a highly skilled and motivated Salesforce Software Engi…
Spanish Speaking Caregiver - Immediate Start
Looking for Spanish Speaking Female Caregiver Full Time M-F 1pm-8pm in 60620 area Caregiver Responsibilities (including, but not limited to): * Companionship & conversation * Light housekeeping * Pe…
Outside Sales Representative - Facility Services
Ready to join a dynamic and growing organization with unlimited potential? UniFirst is seeking an Outside Sales Representative to join our team! Work for an international leader in the $18 b…
Help Desk Analyst are looking for transition their carrer in Oracle HCM Analyst
Oracle HCM Analyst- Entry Level (Career Transition Opportunity) Role: Oracle HCM Analyst Location: US(Remote) Visa Status: US Citizen, Work permit/Citizen/PR Pay Rate: $60/hr- $73/…
Accounts Payable & Human Resources Assistant
Description Peoples National Bank of Kewanee is a long-time financial institution in Kewanee, Illinois. We opened our doors on March 1st 1928, and have been serving our communities for over 95 years…