Senior Software Engineer, Data Platform

Job Description

• Be the team SME expert in Data pipelines • Develop and realize the overall data strategy for the company • Develop and manage ETL/ELT pipelines and infrastructure of analytics databases • Cooperate with the product team, data science team to design data features to enable product improvement and timely business KPI measurements • Be involved in data technology and security to be able to help design the next generation of data platform infrastructure • Determine the importance of each dataset and take appropriate measures to ensure data reliability and quality according to priority • Improve the reliability and speed of queries for ever-increasing volumes of data • Implement new types of data workflows (e.g. automatic retraining of machine learning models for predicting user churn) • Build dashboards to visualize key metrics

Qualifications

• At least 2 years of team lead experience • Able to prioritize and work on data issues ranging from overall data strategy to detailed data modification • Experience with data warehousing and business intelligence systems • 5 years of programming experience (understand multiple languages) • Experience with Hive, Airflow, Scylla, Redis, Elastic search • Experience in development related to Spark, Hadoop, Flink, Clickhouse, Presto/Trino • Experience with data processing related to an app or website • Experience with Modern Machine Learning technologies • Have architected/implemented a data warehouse • Experience designing and creating data tables • BS degree or above in related fields • Experience with AWS (EC2, Kinesis, EMR, S3, etc.) • Eligible to work in the US

Benefits

• 401(k) with employer matching • Up to 100% medical, dental, and vision insurance for you and your family • A benefits plan with monthly allowances • Complimentary lunch, snacks, and beverages in the office