Data / Big Data Testing Engineer

Role Summary:
We are seeking a skilled and experienced Data / Big Data Testing Engineer to join our dynamic team at NPCI. The ideal candidate will be responsible for ensuring the quality, integrity, and reliability of our data pipelines, big data platforms, and associated applications. You will play a crucial role in validating data accuracy, performance, and security throughout the entire data lifecycle.

Key Responsibilities:

Design and execute comprehensive test plans and test cases for data warehousing, ETL processes, and big data solutions (e.g., Hadoop ecosystem, Spark).

Perform data validation, data integrity checks, and data quality assessments across various data sources and platforms.

Develop and automate data quality checks and reconciliation processes.

Test data migration processes to ensure accuracy and completeness.

Collaborate with data engineers, data scientists, and business analysts to understand data requirements and identify potential issues.

Identify, document, and track defects, and work with development teams to resolve them.

Evaluate and recommend testing tools and methodologies for big data environments.

Participate in performance testing and tuning of data pipelines and big data applications.

Ensure compliance with data governance and security policies.