Big Data Engineer - TikTok Ecommerce Recommendation Infrastructure job description summary: Big Data Engineer is required to design and implement offline data architecture for large-scale recommendation systems, build industry-leading distributed systems, and apply data mining and machine learning techniques to extract and analyze information from large datasets.
Requirements
- Design and implement a reasonable offline data architecture for large-scale recommendation systems
- Design and implement flexible, scalable, stable and high-performance storage and computing systems
- Trouble-shooting of the production system
- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
- Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
- Visualise, interpret, and report data findings and may create dynamic data reports as well