Python Developer with React
Jersey City, New Jersey, United States
Contract
Primary Skill: AWS Glue,Python,PySpark
Experience : Min 8 years
Job Description :- We are seeking a python AWS Glue developer responsible for designing, developing, and maintaining scalable data pipelines using AWS Glue and Python.
- The role involves working closely with data engineers, architects, and business stakeholders to ensure data integration, transformation and loading processes within the cloud environment.
- Design, develop and maintain scalable ETL pipelines using AWS glue and python, write PySpark scripts for extraction, transformation and loading, configure glue jobs, crawlers and workflows for automated data processing.
- Cloud Data Engineeing: Work with AWS S3 for data stoareg and management.
- Use AWS IAM for access control and security, Leverage AWS Lambda for serverless orchestration and event driven processing.
- Monitor Glue jon metrics, using AWS cloudwatch, Tune Spark configurations for Optimal performance.Document ETL processses, data flows, and technical decisionsExperience with infrastructure as code (Terraform, CloudFormartion)
