Senior Data Engineer

Job Description

The Senior Data Engineer will be responsible for delivering high quality modern data solutions through collaboration with our engineering, analysts, data scientist, and product teams in a fast-paced, agile environment leveraging cutting-edge technology to reimagine how Healthcare is provided. You will be instrumental in designing, integrating, and implementing solutions on-premise as well supporting migrations of existing workloads to the cloud. The Senior Data Engineer is expected to have extensive knowledge of modern programming languages, designing and developing data solutions.

The position is open in a data engineering team that is responsible for processing various healthcare related data from both internal and external data sources into our data warehouse and other systems.

Required Qualifications

10+ years of experience working with SQL and relational database management systems 10+ years of experience in Microsoft SQL server 4+ years of experience in Cloud technologies 3+ years of experience in Databricks

Familiarity with Azure

Programming and modifying code in languages like SQL, Python, and PySpark to support and implement Cloud based and on-prem data warehousing services.

Hands-on experience with dimensional data modeling, schema design, and data warehousing

Hands-on experience with troubleshooting data issues

Hands-on experience with various performance improvement techniques

Willingness to identify and implement process improvements, and best practices as well as ability to take ownership to work within a fast-paced, collaborative, and team-based support environment

Excellent oral and written communication skills

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

Core competencies:

Must haves:

Senior data engineer - 10 years of experience within SQL and BI in general, 3-4 years of data engineering work

Moving from SQL server to databricks.

Python, azure

3 years of experience with databricks

Python is preferred - c# is also acceptable.

Azure services - ADF - supporting cloud based ETL efforts =