Inetum is seeking a seasoned Big Data Engineer to join our team and support the operations of our Hadoop-based data lake environments. This is a critical role for ensuring the performance, reliability, and security of our big data infrastructure.
Key Responsibilities
- Operate, monitor, and support Hadoop-based data lake platforms.
- Provide L3 incident response, deep troubleshooting, and performance tuning for big data components.
- Ensure data integrity, replication, and capacity management within HDFS clusters.
- Develop and automate monitoring and alerting for service health and node performance.
- Collaborate with platform and data teams to onboard new workloads with optimal resource allocation.
- Apply patches, upgrades, and configuration changes to maintain platform security and stability.
- Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption.
- Work with storage, network, and security teams to optimize throughput and access controls.
- Maintain cluster documentation and share knowledge across teams.