at Zurich American Insurance Company in Schaumburg, Illinois, United States
Job Description
Zurich (Schaumburg, IL) seeks a Senior Enterprise Data Engineer to be responsible for enabling data-driven decision-making through improved data flows and enhancing the suite of data and analytic tools and capabilities. Specific duties include: transform and curate raw data into analysis-ready datasets; partner with Data Scientists to optimize and harden code and queries; support, enhance, and upgrade the analytic tools and environment; provide day-to-day troubleshooting and technology support for the data science environment; develop data solutions that meet the business needs; evaluate data source tables and files; determine needed configurations for CDI pipeline notebooks and runbooks; design/develop pipeline processes; coordinate with SIT team for QA review and create deployment plan; design/develop new curation processes; perform deep-dive review of business requirements; determine proper technology/configurations/formats to use to optimize processing and adherence to Big Data Ecosystem standards and principles; coordinate development activities/timelines; enhance the balancing routines for critical premium and claim data sources; identify opportunities and pursue enhancement of existing curations; and collaborate with team to share ideas/recommendations and refine solutions. Option to work remotely is available.
Position requires a Bachelor’s degree, or foreign equivalent, in Computer Science, Information Systems Security, or a closely related field of study, plus 6 years of experience in the job offered, or as a Software Developer, Financial and Admin Business Analyst, or similar position responsible for enabling data-driven decision-making. Must have 6 years of experience working in Enterprise Data Engineering. Must also have 5 years of experience working with programming languages including Scala, Python, Spark SQL, and Shell. Additionally, must have 3 years of experience with each of the following: working with data ingestion and data curation and cloud based computer platforms including databricks and HDInsights; resolving issues in the Azure data lake platform from data ingestion till data enablement for user reporting; designing and building Azure data pipelines through configuration driven development methods; working with ETL technologies; and working with SQL and stored procedure. Option to work remotely is available.
Full time position. Apply by submitting your resumes at Zurichna.com/en/careers, Job ID: 114401
