at EGEN SOLUTIONS INC in Naperville, Illinois, United States
Job Description
Senior Data Architects - Naperville, IL.
Strategize, plan, and architect effective methods and models for high-budget, large or enterprise-level, mission-critical infrastructure deploying diverse technologies and data-intensive applications that must accommodate high availability, high concurrent user load, and heterogeneous environments. Stay updated on, and ensure implementation of technical best practices. Review existing infrastructure for data repositories and sources. Review the systems requirements for detecting and analyzing patterns in big data. Create strategy documents for enterprise/corporate data analytics. Review and approve systems analysis documents. Confer with systems analysts, engineers, programmers, and others to design efficient data systems and to assess project limitations and capabilities, performance requirements and interfaces. Optimize data architecture for highest operational efficiency and security. Analyze and design highly secure OLTP databases. Coordinate database development as part of a team. Act as a technical resource and SME for programmers. Advise other developers in the team on the performance efficiency and best practices for ETL data pipelines including SQL query optimizations, data modeling, data governance, and overall architecture. Perform code reviews on the pull requests opened by the developers for code quality. Work with other teams and platform architects on the architectural approach and then guide developers to follow the technical plan. Create strategy plans for ETL data pipelines for moving structured and unstructured data from SQL, Flat Files, and API sources. Participate as a senior technical team member in client meetings. Present documents for approval and respond to all technical and functional issues raised during stakeholder meetings. Advise on additions and changes required in information technology workflows and on components of data repositories, middleware, consumption of existing APIs, or introduction of third-party API tools. Review implementation for data warehouse systems. Work on designing and developing applications using: Python/Bash/SQL; Pandas/Spark/Databricks; SQL Server/PostgreSQL/MySQL; Jenkins/GitHub Actions/Azure Pipelines; Airflow/StreamSets/Informatica/Azure Data Factory; GitHub/Bitbucket/Azure DevOps; AWS S3/Azure Data Lake/Google Cloud Storage; AWS Redshift/Snowflake/GoogleBigQuery; AWS IAM/Azure Active Directory/Google IAM; AWS SNS/Azure EventHubs/Google PubSub/Kafka; AWS ECS/Azure AKS/Google GKE; and AWS Lambda/Azure Functions/Google Function. Other similar duties as assigned.