Lead Data Engineer
Desired Experience Range: 7 - 10 years
Location of Requirement: Bangalore
Must Have
- Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience preferably with a digital media or digital advertising company
- Experience delivering products in an agile software development environment including sprint work in Jira
- Excellent interpersonal skills with the ability to collaborate and partner across multiple teams and organizations
- Strong SQL experience including writing/optimizing complex queries against distributed data stores such as Aurora, Hadoop, Hive, Oracle, and Snowflake
- Experience with data pipeline and workflow management tools: Apache NiFi or Apache Airflow
- Expert level knowledge in at least one programming language such as Python, R, Scala, Java.
- Demonstrated experience working with business intelligence tools such as MicroStrategy, Tableau, Business Objects, Looker, etc.
Technologies
Languages - Scala, Python, SQL
Data Processing - Apache Spark, Flink, Airflow
Platforms & Tools - Databricks, Hive, Presto, Snowflake
Cloud - AWS (S3, EMR, Glue, Lambda)