Senior Software Engineer in Big Data
Qualifications
- BSc/MSc in Computer Science or other related field.
- 2+ years working experience in data related systems, e.g. data warehouse, ETL, etc.
- Strong Background in Java/Scala/Python.
- Solid understanding and working knowledge of relational and non-relational databases is a must.
- Experienced in Spark, Hadoop Yarn or similar distributed computation framework is a plus.
- Experienced in search engine development and familiar with ElasticSearch is a plus.
Responsibilities
- Large-scale data ingestion and integration – design, implement scalable ETL processes to collect and store large amounts of data from multiple data centers and diverse external partners.
- Real-time query engine – design, implement our state-of-the-art in-memory query engine to bring quick insights to customers.
- Data Reporting – design, implement our internal BI reporting platform and provide insights to clients.