Design, maintain, and improve web scrapers for alternative datasets; clean, transform, validate, and load data into databases or warehouses; orchestrate pipelines with Airflow; and build quality checks, alerts, and data tools. Collaborate with analysts and cross-functional teams to define data requirements, investigate time-sensitive incidents, and support investment decision-making through reliable datasets and notifications.
This is a remote position.
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and expected to make your voice heard.
Role Summary
Perform web scraping using various scraping techniques and then utilize Python’s Pandas library for data cleaning and manipulation. Then ingest the data into a Database/Warehouse and schedule the scrapers using Airflow or other tools.
Role Summary
Perform web scraping using various scraping techniques and then utilize Python’s Pandas library for data cleaning and manipulation. Then ingest the data into a Database/Warehouse and schedule the scrapers using Airflow or other tools.
Requirements
Role Overview
The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone self-motivated, self-sufficient, with a passion for tinkering and a love for automation.
In your role, you will:
- Collaborate with analysts to understand and anticipate requirements.
- Design, implement, and maintain web scrapers for a wide variety of alternative datasets.
- Perform data cleaning, Exploration, transformation, etc., of scraped data.
- Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.
- Author QC checks to validate data availability and integrity. Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day- today operations.
- Design and implement products and tools to enhance the Web scraping Platform.
Qualifications
Must have
- Bachelors/master’s degree in computer science or in any related field
- 4-6 years of experience in the data engineering field
- Strong Python and SQL/Database skills
- Strong expertise in using the Pandas library (Python) is a must
- Strong expertise with scraping and common scraping tools(Selenium, Scrappy, Fiddler, Postman, XPath)
- Strong expertise in using the Apache Airflow platform for workflow orchestration and data pipeline management is a must.
- Experience with web technologies(HTML/JS, APIs, etc.)
- Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.
- Excellent verbal and written communication skills
- Aptitude for designing infrastructure, data products, and tools for Data Scientists
Preferred
- Experience containerizing workloads with Docker(Kubernetes a plus)
- Experience with building automation (Jenkins, GitHub Actions, CI/CD)
- Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc
The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone self-motivated, self-sufficient, with a passion for tinkering and a love for automation.
In your role, you will:
- Collaborate with analysts to understand and anticipate requirements.
- Design, implement, and maintain web scrapers for a wide variety of alternative datasets.
- Perform data cleaning, Exploration, transformation, etc., of scraped data.
- Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.
- Author QC checks to validate data availability and integrity. Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day- today operations.
- Design and implement products and tools to enhance the Web scraping Platform.
Qualifications
Must have
- Bachelors/master’s degree in computer science or in any related field
- 4-6 years of experience in the data engineering field
- Strong Python and SQL/Database skills
- Strong expertise in using the Pandas library (Python) is a must
- Strong expertise with scraping and common scraping tools(Selenium, Scrappy, Fiddler, Postman, XPath)
- Strong expertise in using the Apache Airflow platform for workflow orchestration and data pipeline management is a must.
- Experience with web technologies(HTML/JS, APIs, etc.)
- Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.
- Excellent verbal and written communication skills
- Aptitude for designing infrastructure, data products, and tools for Data Scientists
Preferred
- Experience containerizing workloads with Docker(Kubernetes a plus)
- Experience with building automation (Jenkins, GitHub Actions, CI/CD)
- Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Own and lead Rubrik's engagement with Indian Global Systems Integrators (GSIs), drive strategic partnerships, create services and enablement, manage financial models and negotiations, accelerate partner adoption and bookings, coordinate cross-functional stakeholders, build OEM/ISV ecosystems, and execute partner account strategies and KPIs. Frequent travel required.
Top Skills:
AWSCloudGCPAzureNutanixPure StorageRubrik Agent CloudRubrik Security CloudSaaSSalesforce
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The role involves managing program conflicts, facilitating communication across programs, process mapping, conducting quality assurance deep dives, and optimizing resource management, ensuring alignment and efficiency in financial transformation projects.
Top Skills:
Azure DevopsClarityMS OfficeTableau
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Maintain books of accounts, close monthly financial records, prepare reports, process invoices, vendor payments, reconciliations, payroll, and employee reimbursements. Manage GST, TDS, income tax, EPF, and ESIC compliance, including filings and reconciliations. Support financial statements, budgets, tax calculations, and client, vendor, banker, and auditor queries using Tally and related accounting systems.
Top Skills:
ExcelGstMS OfficePayroll Processing SoftwareSAPTallyTdsZoho
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
