at Digital Intelligence Systems, LLC (DISYS) in Chicago, Illinois, United States
Job Description
Hybrid
Hadoop ETL Developer
Job details
Posted
10 June 2024
Location
Chicago, IL
Job type
Contract
Reference
923069
Job description
Job Summary:
Dexian is seeking a Hadoop ETL Developer for an opportunity with a client located in Chicago, IL.
Responsibilities:
As a Hadoop ETL Developer to support production (L3) in Treasury ADS, individual will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical problems arise during the real time in production
Individual should be flexible to work on the weekends at least once in a month
As an individual contributor in BAU, person should have good analytical skills to take a quick decision during the tough times
Engage in discussions with information architecture team for coming out with design solutions, proposing new technology adoption ideas, attending project meetings, partnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, upstream and downstream partners, etc
BAU support activities like analysis, coding, propose improvement ideas, drive the development activities at offshore
Able to think over in a quick turnaround time to address the situation in production
Work on multiple projects concurrently, take ownership pride in the work done by them, attending project meetings, understanding requirements, designing solutions, developing code
Partnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, up/down stream partners, etc
Work with the Business Analysts to understand the requirements work on high level detailed design to address the real time issues in production
Work with Information Architecture team for proposing technical solutions to business problems
Identify gaps in technology and propose viable solutions
Take accountability of the technical deliveries from offshore
Understand Hadoop, Spark, Python and other Eco Systems like Impala, Hive, Oozie, Pig etc., Autosys and UNIX Shell Scripting
Work with the development teams and QA during the post code development phase
Identify improvement areas within the application and work with the respective teams to implement the same
Ensuring adherence to defined process quality standards, best practices, high quality levels in all deliverables
Adhere to team's governing principles and policies
Requirements:
Strong working knowledge of ETL, database technologies, big data and data processing skills
3+ years of experience developing ETL solutions using any ETL tool like Informatica, SSIS, etc
3+ years of experience developing applications using Hadoop, Spark, Impala, Hive Python
3+ years of experience in running, using and troubleshooting the ETL Cloudera Hadoop Ecosystem i.e. Hadoop FS, Hive, Impala, Spark, Kafka, Hue, Oozie, Yarn, Sqoop, Flume
Experience on Autosys JIL scripting
Proficient scripting skills i.e. Unix shell Perl Scripting
Experience troubleshooting data-related issues
Experience processing large amounts of structured and unstructured data with MapReduce
Experience in SQL and Relation Database developing data extraction applications
Experience with data movement and transformation technologies
Good to have experience in Python / Scaln programming
Have a good understanding of the E2E process of the application
Have a good understanding of all aspects of the application like upstream, database model, data processing and data distribution layers
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.
Digital Intelligence Systems, LLC. is an Equal Opportunity Employer/Affirmative Action employer. It is our policy to provide equal opportunity to all applicants and to prohibit any discrimination because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or veteran status.