Optum Logo

Optum

Senior Data Engineering Analyst-Azure, Pyspark, SQL

Posted 3 Hours Ago
Be an Early Applicant
In-Office
Bangalore, Bengaluru Urban, Karnataka
Mid level
In-Office
Bangalore, Bengaluru Urban, Karnataka
Mid level
The Senior Data Engineering Analyst will develop data pipelines in Azure Databricks, manage database architecture, and optimize data storage and retrieval processes.
The summary above was generated by AI
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Data Engineer Working with a team of engineers (offshore and onshore), this position will assist in the loading and transforming of data into an established Azure Databricks environment, creating data pipelines using Azure data factory.
Functions may include database architecture, engineering, design, optimization, security, and administration; as well as data modeling, big data development, Extract, Transform, and Load (ETL) development, storage engineering, data warehousing, data provisioning and other similar roles
Primary Responsibilities:
  • Responsibilities may include Platform-as-a-Service and Cloud solution with a focus on data stores and associated eco systems
  • Duties may include management of design services, providing sizing and configuration assistance, ensuring strict data quality, and performing needs assessments. Analyzes current business practices, processes and procedures as well as identifying future business opportunities for leveraging data storage and retrieval system capabilities
  • Manages relationships with software and hardware vendors to understand the potential architectural impact of different vendor strategies and data acquisition
  • May design schemas, write SQL or other data markup scripting and helps to support development of Analytics and Applications that build on top of data
  • Selects, develops and evaluates personnel to ensure the efficient operation of the function
  • Basic, structured, standard approach to work
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:
  • Graduate degree or equivalent experience
  • 3+ years of experience with Python
  • 3+ years of experience with SQL
  • 3+ years of experience with Azure cloud, Databricks, Spark
  • 2+ years of experience working on Azure Cloud and other Azure Services
  • 2+ years of experience in PySpark
  • AI/ML integration
  • Data Modeling experience
  • Experience in Scrum teams
  • Worked in Spark Optimization
  • Good knowledge in Python
  • Demonstrated ability to create Data pipelines
  • Demonstrated ability to independently write/tune/optimize complex SQL queries

Preferred Qualifications:
  • Git-Hub knowledge
  • Knowledge in Airflow
  • Working knowledge in Snowflake

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Top Skills

Airflow
Azure
Databricks
Git-Hub
Pyspark
Python
Snowflake
Spark
SQL

Similar Jobs at Optum

3 Hours Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design and optimize data architectures and pipelines, ensure data quality, support cloud solutions, and lead project delivery in a scalable environment.
Top Skills: AWSAzureBig Data FrameworksEltETLGCPJavaPythonSQL
3 Hours Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
As a Senior Software Engineer, you'll enhance code quality, develop solutions, automate processes, manage technical debt, and ensure deliverables meet user needs and business objectives.
Top Skills: AWSEksJavaJenkinsKafkaMongoDBReactTerraform
3 Hours Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Senior Data Scientist will optimize machine learning models, build data pipelines, and mentor junior scientists, focusing on AI and ML solutions.
Top Skills: AWSAzureDatabricksGCPJupyterMlflowNumpyPandasPythonScikit-LearnSparkSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account