Senior Python Engineer

Job Description

• Understanding the business requirements. • Writing code and implementing the proposed solutions.Creating. • Creating data pipelines, versioning and change management. • Manage the complexity inherent in data pipelines. • Develop ETL/ELT processes to help extract and manipulate data from multiple sources. • Design, build and maintain batch or data pipelines in production. • Automate data workflows such as data ingestion, aggregation, and ETL processing. • Logging and instrumentation of pipelines and services.Ensure. • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures

Qualifications

• Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role. • Advanced SQL skills and experience with relational databases and database design. • Experience working with cloud Data Warehouse solutions (e.g., Snowflake, DataBricks, Redshift, BigQuery, Azure Synapse, etc.) • Python skills with hands-on experience • Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc. • Proficient in data pipeline and workflow management tools e.g. Airflow • Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc. • Experience with the AWS/Azure/GCP data engineering services • Knowledge of AWS services viz., DMS, S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM (or associate Azure services) • Very good exposure of working on Data Lakes & Data Warehouses solutions • Excellent problem-solving, communication, and organizational skills. • Proven ability to work independently and with a team • Ability to guide other data engineers.

Benefits

• Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach. • You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams. • We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best. • Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries. • We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally.