GrowExx is looking for a smart and passionate Lead Data Engineer, who will design and fill a bespoke data warehousing environment for our company.
Key Responsibilities:
- Design architecture for data activation inclusive of an API gateway that can be consumed by client applications.
- Develop and maintain scalable pipelines that deploy data out to product applications, website data Layers, and digital advertising platforms (Salesforce, Google, Facebook, etc.).
- Develop and deploy scalable new features.
- Identify and fix bugs to resolve data quality issues in a timely manner.
- Develop, maintain, update Tableau reporting views and data sources.
- Implement a data monitoring framework that ensures production tables are always accurate.
- Take data science/machine learning model prototypes and prepare them for production deployments.
- Improve real-time data availability on an as-needed basis for activation use-cases.
- Build pipelines that ingest digital advertising data on an as-needed basis.
- Document all pipelines and maintain a data catalogue.
Key Skills:
- Experience in data modelling, ETL development, and data warehousing.
- Expert SQL skills querying and transforming large datasets in Snowflake.
- Expert python programming skills.
- Experience in ETL Tools like Airflow, Glue, Spark, Flink etc.
- Experience with Cloud Platforms like Azure/GCP/AWS.
- Experience with Adobe Experience Cloud, Salesforce, Facebook, Google, Bing developer APIs.
- Experience with Software development lifecycle and using tools such as Airflow and GitHub.
- Experience with real-time event stream data.
- Experience with solving complex problems with multi-layered data sets.
- Experience with data structures, algorithm design, and complexity analysis is preferred.
- Experience with optimizing machine learning libraries and frameworks is preferred.
- Experience with developing an API Gateway is preferred
Education and Experience:
- B Tech or B. E. (Computer Science / Information Technology)
- 7+ years as an ETL Developer or similar roles
- Must have experience in team leading
Analytical and Personal skills:
- Must have sound logical reasoning and analytical skills
- Good communication skills in English – both written and verbal
- Demonstrate Ownership and Accountability of their work
- Attention to details
