Data Engineer/QA (Strong Databricks/Pyspark)

Indore, Madhya Prades, India

Full Time

Experienced

Hello Sr Data QA Professional!

Hope you are doing well!

We are looking for an "Sr Data Engineer/QA (Databricks & Pyspark) in Indore, MP."

Below is the JD for review.

Job Title: Sr Data Engineer/QA (Databricks & Pyspark)
Location: Indore, MP
Full Time
Experience: 5-10 Years

Must have:

Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.
Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake
Must have hands-on experience in PySpark, SparkSQL, T-SQL
Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines.
Should be able to write reusable PySpark and T-SQL script to validate data across layers.
Experience of working in Databricks Delta Lake will be highly desirable.
Ideally should have worked in a team using Agile methodology.
Appreciation of data, its quality, and its usage for business benefit
Very good communication and written skills

Nice to Have
• Experience in the Banking/Finance domain

📩 Interested candidates can apply or share their profiles with us at "[email protected]"

Required*

First Name*

Last Name*

Email Address*

Phone*

Address

Resume*

We've received your resume. Click here to update it.

Attach resume or Paste resume

Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Human Check*

Submit Application

Benefits