Big Data Engineer - Power Sector

We are seeking a motivated Big Data Engineer with 3-4 years of experience to join our dynamic team in Noida. As a Big Data Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines and infrastructure that support our critical power operations. You will work with vast datasets to extract insights, optimize processes, and drive data-informed decision-making within the Indian power sector.

Key Responsibilities:

Design, develop, and implement robust and scalable big data solutions using technologies like Hadoop, Spark, and Kafka.

Build and optimize data pipelines for ingestion, transformation, and processing of large volumes of structured and unstructured data.

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.

Ensure data quality, integrity, and security across all data platforms.

Monitor and troubleshoot big data systems to ensure optimal performance and availability.

Develop and maintain ETL/ELT processes for data warehousing and data lake solutions.

Contribute to the development of data governance policies and best practices.