Data Scraper & SME

Job Description

Job Title: Subject Matter Expert (SME) – Data Scraping & Cyber Security

Experience: 8+ Years

Location: [Remote / Onsite / Hybrid – Specify]

Employment Type: [Full-time / Contract]

Job Description
We are looking for a highly experienced Subject Matter Expert (SME) with strong expertise in data scraping, data scrolling/automation, and cyber security. The ideal candidate will design, implement, and govern secure data extraction solutions while ensuring compliance with cyber security standards, data privacy laws, and ethical scraping practices.

Key Responsibilities

Design, develop, and optimize web data scraping solutions across complex and dynamic websites.

Implement data scrolling, pagination handling, AJAX/API-based extraction, and bot evasion techniques where legally permitted.

Build and maintain scalable scraping frameworks using industry-standard tools and languages.

Ensure data accuracy, validation, cleansing, and transformation post-extraction.

Define and enforce secure scraping practices to prevent data leaks and vulnerabilities.

Apply cyber security best practices including encryption, secure credential management, and access controls.

Conduct risk assessments related to data extraction, storage, and transmission.

Ensure compliance with legal, regulatory, and ethical standards (robots.txt, ToS, data privacy laws).

Monitor scraping systems for performance, failures, and security threats.

Provide technical leadership and SME guidance to development and data teams.

Create technical documentation, SOPs, and security guidelines.

Required Skills & Qualifications

8+ years of hands-on experience in data scraping, automation, and cyber security.

Strong proficiency in Python, JavaScript, or similar scripting languages.

Experience with scraping tools and frameworks such as Scrapy, Selenium, Playwright, Puppeteer, BeautifulSoup, etc.

Expertise in handling dynamic content, infinite scrolling, CAPTCHA challenges, and APIs.

Solid understanding of web technologies (HTML, CSS, DOM, HTTP/HTTPS, REST APIs).

Strong knowledge of cyber security principles:

Data encryption

Secure authentication & authorization

Vulnerability management

Network and application security

Experience with cloud platforms and secure data storage (AWS, Azure, GCP – preferred).

Familiarity with data privacy regulations (GDPR, CCPA, etc.).

Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

Cyber security certifications (CEH, CISSP, CISM, or equivalent).

Experience in large-scale data extraction programs.

Knowledge of proxy management, IP rotation, and rate-limiting strategies.

Prior experience as an SME or technical lead.

What We Offer

Opportunity to work on high-impact, complex data and security projects

Collaborative and innovative work environment

Competitive compensation based on experience