at Cloudstall Inc in Warrenville, Illinois, United States
Job Description
Develop and maintain high volume streaming ingestion pipelines using Python, Flink, AWS EKS, Kafka, Apache Iceberg and AVRO. Implement data migration from On-prem (Hadoop) to AWS S3 using HDFS commands. Implement and manage end-end CI/CD pipeline using Rio to integrate data across multiple domains. Migrate and transform large scale datasets across multiple cloud platforms (AWS, GCP, Azure) using Scalable ETL Frameworks. Automate data ingestion workflows, reducing efforts and improving pipeline efficiency. Deploy and manage Kubernetes clusters to enable scalable data pipelines. Master’s degree in Science, Technology, or Engineering (any) is required. Work location: Warrenville, IL and various unanticipated locations throughout the U.S.
Email Resume to HR Dept., Cloudstall, LLC., at hr@cloudstall.net
To view full details and how to apply, please login or create a Job Seeker account