This role involves collaborating with users to build data solutions, managing AWS data technologies, and automating workflows for efficiency.
This is a remote position.
Responsibilities:
• Partner with our users and other data product teams to understand business needs to build impactful data/analytics solutions
• Build the infrastructure required for optimal extraction, transformation, and loading of data from various data sources using AWS ‘big data’ technologies
• Uses standardized processes for requirements definition, analysis, design, construct, and test activities
• Automate repeatable tasks to create efficiencies in our workflows and enable freedom for innovation
• Modifies existing systems or integrates packaged systems with existing infrastructure to meet business requirements
• Development and support of multiple AWS solutions to support critical business applications
Requirements
Essential Requirements:
- Experience with Data Warehousing, Data Lake, Analytic processes, and methodologies.
- Proficient in writing and optimizing SQL queries and other procedures/scripts
- Strong data model design and implementation experience
- Strong experience with AWS data technologies (such as Aurora Postgres, S3, Lambda, Redshift & other AWS Data Services) covering security, policies, access management
- Experience with AWS ETL/File Movement tools such as GLUE, Athena and other AWS integration products.
- Experience with Agile Development, Jira, CI/CD and GitHub
- Programming experience with SQL and Python
Similar Jobs
Fintech • Financial Services
The Data Engineer will design, develop, and maintain data pipelines and solutions, ensuring data quality and collaborating with cross-functional teams to meet analytics needs.
Top Skills:
Apache AirflowSparkAWSAzureDockerDynamoDBGCPGitHadoopJavaJenkinsKafkaKubernetesLuigiMongoDBMySQLNode.jsPostgresPythonTerraform
.jpg)
Fintech • Analytics
As a Lead AWS Data Engineer, you'll design and develop scalable data pipelines, orchestrate data workflows using AWS tools, and collaborate with business teams to create data-driven solutions. You'll apply modern software engineering practices and continuously learn about the finance domain.
Top Skills:
Apache IcebergSparkAws EmrAws GlueAws LambdaAws S3Python
Fintech • Analytics
The Lead AWS Software Data Engineer will design scalable data pipelines, orchestrate workflows in AWS, apply engineering practices, and collaborate with teams to deliver data solutions for financial indices.
Top Skills:
Apache IcebergSparkAurora PostgresqlAWSEmr ServerlessGlueLambdaPythonS3
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
