CrewBloom Logo

CrewBloom

Social Media Data Crawler

Posted 4 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
Design, build, and maintain automated tools and scripts to extract social media data, ensure platform compliance, monitor crawlers, analyze trends, and deliver datasets to marketing and data teams.
The summary above was generated by AI

We are looking for a detail-oriented and technically proficient Social Media Data Crawler to design and manage tools that automate data extraction from social media platforms such as LinkedIn, Facebook, X (formerly Twitter), Instagram, and others. The ideal candidate will have strong skills in web scraping, data analysis, and working with social media APIs. This role is vital for providing valuable data insights to support our marketing, research, and analytics teams.

  • Develop and maintain automated scripts and tools for extracting data from social media platforms, including LinkedIn, Facebook, X, Instagram, and more.
  • Ensure compliance with the terms of service and privacy policies of each platform.
  • Continuously monitor and troubleshoot crawling systems to ensure consistent, accurate data collection.
  • Analyze collected data to identify key trends, insights, and patterns aligned with business goals.
  • Work closely with data scientists, marketing, and research teams to deliver relevant data for their initiatives.
  • Optimize crawling systems for performance, scalability, and adaptability to platform changes.
  • Stay up-to-date with changes in social media platforms and APIs to adjust crawling strategies as needed.

Requirements
    • Bachelor’s degree in Computer Science, Information Technology, or a related field.
    • Proven experience in web crawling, scraping, or data extraction from social media.
    • Proficiency in programming languages such as Python, Java, or similar.
    • Familiarity with social media APIs (e.g., LinkedIn API, Facebook Graph API, Twitter API, Instagram API).
    • Strong understanding of HTML, CSS, and JavaScript.
    • Knowledge of data privacy laws and ethical considerations related to data scraping.
    • Excellent problem-solving skills with keen attention to detail.
    • Ability to work independently and collaboratively within a team.

Preferred Skills:

    • Experience with big data technologies such as Hadoop or Spark.
    • Familiarity with data visualization and reporting tools.
    • Understanding of natural language processing (NLP) techniques.

Minimum Technical and Work Environment Requirements:

  • Internet Connection:
    • Primary internet connection with a minimum speed of 15 Mbps.
    • Backup internet connection with at least 10 Mbps.
    • Backup connection must be capable of supporting work during a power outage.
  • Primary Device:
    • Desktop or laptop equipped with at least:
      • Intel Core i5 (8th generation or newer), Intel Core i3 (10th generation or newer), AMD Ryzen 5, or an equivalent processor.
      • A minimum of 8 GB RAM.
  • Backup Device:
    • Must meet or exceed the performance of an Intel Core i3 processor.
    • Must be functional during power interruptions.
  • Peripherals and Workspace:
    • A functioning webcam.
    • A noise-canceling USB headset.
    • A quiet, dedicated home office space.
    • A smartphone for communication and verification purposes.

Benefits

Join Our Dynamic Team: Experience our fun, inclusive, innovative culture that values your unique contributions and supports your professional growth.

Embrace the Opportunities: Seize daily chances to learn, innovate, and excel. Make a real impact in your field.

Limitless Career Growth: Unlock a world of possibilities and resources to propel your career forward.

Fast-Paced Thrills: Thrive in a high-energy, engaging atmosphere. Embrace challenges and reap stimulating rewards.

Flexibility, Your Way: Embrace the freedom to work from home or any location of your choice. Create your ideal work environment.

Work-Life Balance at Its Best: Say goodbye to stressful commutes and hello to quality time with loved ones. Achieve a healthy work-life integration to perform at your best.

Similar Jobs

2 Hours Ago
Remote or Hybrid
Senior level
Senior level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Lead and manage Service of Process operations to ensure accurate receipt, validation, tracking, and delivery of litigation documents. Drive operational excellence, SLA adherence, KPI reporting, process improvements, compliance, client escalation handling, and team performance through coaching, workload allocation, and cross-functional collaboration.
Top Skills: ExcelPowerPointSharepoint
2 Hours Ago
Remote or Hybrid
Senior level
Senior level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
The Manager of Technology leads Lifecycle Management services, driving operational excellence, team performance, and continuous improvement while ensuring high-quality operational alert response and service delivery.
Top Skills: AzureElasticNutanixServicenow
3 Hours Ago
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
The role involves overseeing manufacturing methods, resources, and personnel; enhancing operational performance; and driving continuous improvement initiatives while managing budgets and customer relations.

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account