Big Data Engineer

Role Summary:
We are seeking a skilled and experienced Big Data Engineer to join our dynamic team at Larsen & Toubro. The ideal candidate will be responsible for designing, building, and maintaining scalable and robust big data solutions to support our manufacturing and production operations. You will work with large datasets, implement data pipelines, and ensure data quality and accessibility for analytics and business intelligence.

Key Responsibilities:
- Design, develop, and maintain scalable and efficient ETL/ELT pipelines for ingesting and processing large volumes of structured and unstructured data from various manufacturing systems.
- Build and optimize data warehouses, data lakes, and data marts to support analytics and reporting needs.
- Implement and manage big data technologies such as Hadoop, Spark, Kafka, and cloud-based data services (AWS, Azure, GCP).
- Develop data models and schemas for optimal performance and scalability.
- Ensure data quality, integrity, and security across all data platforms.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
- Monitor and troubleshoot data pipeline performance and resolve issues promptly.
- Stay up-to-date with emerging big data technologies and best practices.