at CVTech Innovations LLC in Lisle, Illinois, United States
Job Description
Performing all aspects of the Software Development Life Cycle (SDLC), including requirements gathering, design framework, business process analysis, scripting, code deployments,
enhancement validation, triage of defects, escalations and urgent issues utilizing Jira, Confluence, Python, SQL, PySpark, AWS services like Glue, Elastic Map reduce ( EMR), Athena,
Redshift Spectrum etc. Manage various data integration and technology projects across Teradata & AWS platforms like Redshift and S3. Identify design and implement internal process
improvements, automate manual processes optimizing data delivery, re-designing infrastructure for greater scalability using AWS services like cloud formation. Design data structures
required for optimal data extraction, storage, transformation and loading of data from wide variety of data sources like Teradata, CRM and utilize AWS tools like database migration
service(DMS) and Schema Conversion tool (SCT) to reengineer and transform data from legacy systems into cloud architectures. Build and design lake house architecture and ingest data
to build analytical applications using databricks. Build, maintain and orchestrate data pipelines using Airflow for real time streaming and batch. Work under supervision.