Lead Data Engineer
Tavant Technologies
11-18 Yrs
hyderabad
Not Disclosed By Recruiter
Bachelor Degree
python, spark, airflow, databricks, SQL AWS
Roles and Responsibilities:
- Represent the offshore team and make relationships with customers team leads and managers
- Evolve, test, and deploy ETL data pipelines
- Ensure data accuracy and consistency by working familiar with stakeholders
- Implement data quality and validation processes
- Keep updated on industry best practices and emerging technologies
- Participate with cross-functional teams to understand data requirements and design efficient data processing solutions
- Troubleshoot and resolve data processing and pipeline performance problems
- Optimize and maintain current data pipelines for performance and reliability
- Should have a good ability to analyze data and communicate results to stakeholders
- Having a strong knowledge of Salesforce Datorama is a plus
- Should be proficiency in Airflow, Python, Spark, Databricks, Snowflake, complex SQL queries, and AWS (S3, Glue, Lambda, etc.)
- Should have excellent problem-solving skills
- Should have good communication skills
- Experience developing Airflow DAGs, SQL scripts, Python functions, and PySpark jobs
- Closely with data warehousing concepts and cloud platforms (e.g., AWS, Azure, GCP)
Job Detail
Industry :
IT-Software/Software ServicesJob Function :
IT Software- QA & 0TestingEmployment Type :
Full TimeOther Skills :
hr@itsws.comCompany Name :
Tavant TechnologiesCompany Address :
Cyber Crown, 3rd floor, Sector-II Village HUDA Techno Enclave, Madhapur Hyderabad, Telangana 500081 India