Databricks, Pyspark

Full Time 1 week ago
Employment Information

Dear Candidate,

Greetings from TATA Consultancy Services!!

Thank you for expressing your interest in exploring a career possibility with the TCS Family.

Hiring For:- Databricks, Pyspark , Azure-Scala, Hadoop

Location: Chennai, Bangalore, Hyderabad

Experience: 8 to 10yrs

About the Role

We are looking for an experienced Data Engineer with strong expertise in SQL, Python, and PySpark with databricks , capable of building and optimizing modern data pipelines on AWS cloud platforms. The ideal candidate will have a strong foundation in data engineering principles, and experience with Databricks

Key Responsibilities

Design, develop, and maintain data ingestion, transformation, and integration pipelines using Python, PySpark, and SQL.

Build scalable ETL/ELT workflows for structured and unstructured data across AWS data ecosystems.

Implement best practices in data quality, performance optimization, and pipeline automation.

Collaborate with architects and analysts to define data models, schemas, and integration frameworks.

Work with cloud-native services such as:

AWS: Glue, Redshift, S3, Lambda, EMR,Databricks

Develop reusable components and frameworks for pipeline orchestration and monitoring.

Troubleshoot data issues and ensure data reliability, security, and governance.