Senior Data Engineer, Data Platform

Job Description

• Develop event-driven data infrastructure on AWS • Build data pipelines for ingesting, processing, and routing events using Kafka, Spark streaming, and other technologies • Build a data lakehouse architecture • Create unified frameworks for stream, batch, and real-time processing • Develop data models, schemas, and standards for event data • Optimize data replication and loading across systems • Optimize data storage and access patterns for fast querying • Improve data reliability, discoverability, and observability • Improve planning, development, and deployment processes • Mentor, coach, and inspire a team of engineers of various levels • Collaborate with software engineers, product managers, and data scientists • Communicate team priorities and strategy to engineering and cross-functional leadership teams

Qualifications

• Have 5+ years experience building large scale data platforms • Have hands-on experience with event-driven architecture and streaming data processing frameworks • Have experience building lakehouse architecture on cloud storage • Have experience with storage layers like Hudi, Delta Lake, and Iceberg • Familiarity with infrastructure tooling such as Terraform/Pulumi and Kubernetes • Experienced with SQL, Python, Java • Experienced with time-series databases like Clickhouse, InfluxDB • Experienced working with dbt and Snowflake, BigQuery, Redshift or other data warehouses • Have familiarity with Kimball’s dimensional modeling techniques • Excellent organization and communication skills, both verbal and written

Benefits

• Equity ownership (RSUs) in a growing, privately-owned company • 100% employer-paid healthcare, vision, and dental insurance coverage • 12 weeks of paid parental leave for both birthing and non-birthing caregivers • Flexible PTO with a mandatory annual minimum of 10 days paid time off • Access to mental wellness and professional coaching • Monthly stipends to support health and wellness, smart work, and professional growth • Professional career coaching and development programs • 401k plan and pension schemes • Discounted Pet Insurance offering (US only) • Commuter benefits for in-office employees