Responsibilities :
- Building robust large-scale social media crawler for various social media platforms
- Maintain day-to-day operation of said crawlers alongside our data quality team to make sure the completeness and timeliness of incoming data
- Work in team along with several stakeholders to better understand and communicate about data requirements and issues
Qualifications :
- Intermediate or advanced understanding of SQL
- Have ample experience using Linux-based system
- Have understanding on several data acquisition techniques such as webscraping, API-based data consumption, and so on