at Capgemini America, Inc. in Chicago, Illinois, United States
Job Description
Capgemini America, Inc. (Sogeti division) seeks Senior Consultant (Data Engineering), multiple positions, various levels. Duties: Produce financial and market intelligence by querying data repositories and generating periodic reports. Devise methods for identifying data patterns and trends in available information sources. Develop and implement a set of techniques or analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualization software. Apply data mining, data modeling, natural language processing, and machine learning to extract and analyze information from large structured and unstructured datasets. Visualize, interpret, and report data findings. Effectively communicate support ticket information to team members and stakeholders in a timely and clear fashion. Proactively monitor, maintain, and support platform for any bottlenecks and timely resolution. Monitor and support daily batch which generate reports - Zaloni/ADL data pipelines. Perform remediation of any failures including identification of failures job restarts and working with source/target teams to resolve the issues. Analyze and provide timely resolution to any failures to ensure SLAs are met. Deploy and coordinate with corresponding team for backup and restoration of jobs across environments. Utilize experience with Languages: SQL, Python, Unix Shell Scripting; Databases: MySQL, Mongo DB, Hive, Rapid SQL; Version Control Tools: GIT; Platforms: Windows, Linux; Big Data Technology: HDFS, HIVE, YARN, Cloudera Manager, Spark, Apache Spark, DataFrames, SparkSql, Pyspark; Operating Systems: Unix (putty).
