AWS Data Engineer
- Job Category: Engineering/Technical
- Education: N/A
- FT/PT: Full-Time
- Company: CGI
Position ID: J0421-1729
CGI is looking for an AWS Data Engineer who can join in our emerging technology group in the digital insight practice. The AWS Data Engineer with 2-5 years of experience will be responsible for designing & developing data ingestion and data transformation framework for modern data lake solutions.
Design and build production data pipelines from ingestion to consumption within a big data architecture, using, Python, Scala, GLUE. Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming. Code & Unit test, and design continuous integration/development.
Candidates with the skills (not all but some) AWS Step Functions, S3, Glue, EMR, Redshift, Dynamo DB, Aurora, Athena, Big data on AWS.
AWS data services, Hadoop, Pyspark,
Secondary Skill: Glue, Data Pipe Line, Databricks, Virtual Machine
Role Description: Design & develop solution on AWS Cloud for data lake/integration using PaaS services like Glue, data pipe line etc Hadoop, Pyspark platform.
7+ years of work experience with ETL, and business intelligence AWS data architectures.
3+ years of hands-on Spark/Scala/Python development experience.
Experience developing and managing data warehouses on a terabyte or petabyte scale.
Experience with core competencies in Data Structures, Rest/SOAP APIs, JSON, etc.
Strong experience in massively parallel processing & columnar databases.
Expert in writing SQL.
Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.
Experience with common software engineering tools (e.g., Git, JIRA, Confluence, or similar)
Ability to manage numerous requests concurrently and strategically, prioritizing when necessary.
Good communication and presentation skills.
Dynamic team player.
500 West Summit Hill Drive
Knoxville TN 37902
Job Link: Apply Here!