Roles and Responsibilities

Location - Bangalore

Exp 5+

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Blob Storage, Data Lake Storage, and SQL Database.
  
• Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures that meet business needs.
  
• Develop complex data transformations using PySpark on Azure Databricks to ensure high-quality data for analysis and reporting purposes.
  
• Troubleshoot issues related to ADF pipeline failures or performance problems by analyzing logs, debugging techniques, and collaborating with other team members.