Senior Software Engineer in Big Data
Type Full Time
Salaries Negotiable
Education Bachelor's Degree or above
Location Shanghai
Qualifications
  • BSc/MSc in Computer Science or other related field.
  • 2+ years working experience in data related systems, e.g. data warehouse, ETL, etc.
  • Strong Background in Java/Scala/Python.
  • Solid understanding and working knowledge of relational and non-relational databases is a must.
  • Experienced in Spark, Hadoop Yarn or similar distributed computation framework is a plus.
  • Experienced in search engine development and familiar with ElasticSearch is a plus.
Responsibilities
  • Large-scale data ingestion and integration – design, implement scalable ETL processes to collect and store large amounts of data from multiple data centers and diverse external partners.
  • Real-time query engine – design, implement our state-of-the-art in-memory query engine to bring quick insights to customers.
  • Data Reporting – design, implement our internal BI reporting platform and provide insights to clients.