Deskripsi Pekerjaan
DataExtract Indonesia is seeking a highly motivated Senior Scraper Operator to join our dynamic data acquisition team in Jakarta. The ideal candidate will be responsible for the operation and maintenance of our industrial-scale web scraping infrastructure. This role requires a keen eye for detail and a passion for data accuracy.
You will be working with a team of data engineers to ensure high-volume data extraction, processing, and delivery in a fast-paced environment. If you are looking to take your technical career to the next level, apply now.
Tanggung Jawab
- Infrastructure Management: Monitor and maintain 500+ scraper bots to ensure continuous operation.
- Failure Recovery: Quickly diagnose and resolve anti-bot bypass issues and IP rotation failures.
- Data Quality Control: Validate extracted data integrity and accuracy using automated scripts.
- Pipeline Optimization: Improve scraping speed and efficiency through resource allocation tuning.
- Proxy & Network Health: Manage proxy pools and network health checks to prevent service interruptions.
- Technical Documentation: Maintain technical documentation for the scraping environment and workflows.
Kualifikasi
- Experience: Minimum 4 years of experience in large-scale data processing and scraping operations.
- Technical Skills: Proficient in Bash, Python, or SQL for scripting and automation.
- Tooling: Expertise with Selenium, Puppeteer, or similar headless browser tools.
- Database Knowledge: Experience with NoSQL and SQL databases.
- Communication: Excellent written and verbal communication skills in English and Bahasa Indonesia.
- Teamwork: Ability to work in a 24/7 rotating shift environment.