Note: The job is a remote job and is open to candidates in USA. Dice is seeking a highly skilled Cloudera Public Cloud Platform Engineer to operate and manage the end-to-end CDP platform ecosystem. This role is responsible for ensuring availability, scalability, security, and performance of all platform services supporting data, analytics, and AI workloads across environments.
Responsibilities
- Own end-to-end operational responsibility for Cloudera Public Cloud services across Dev / Stage / UAT / Prod:
- Ensure multi-cluster stability, workload isolation, and SLA adherence
- Support onboarding and operations of multiple applications across environments
- Manage and support multi-environment, multi-cluster deployments with strict isolation, governance, and release coordination across Dev/UAT/Prod
- Operate and support Cloudera AI (CAI) environments:
- Troubleshoot:
- Operate CDP services running on Cloudera-managed Kubernetes infrastructure
- Apply strong understanding of containerized workloads and Kubernetes concepts for troubleshooting
- Diagnose and resolve:
- Analyze logs and metrics to identify runtime failures and performance issues
- Collaborate with Cloudera support for managed service-level issues
- Operate and support:
- Ensure reliability and performance of data pipelines and integrations
- Monitor and troubleshoot Kafka environments:
- Implement and manage:
- Administer SDX for:
- Support Atlas and Octopai integration
- Manage and troubleshoot user access and identity mapping across layers, including:
- Resolve access-related issues impacting:
- Troubleshoot:
- Ensure secure and reliable connectivity across services
- Understand and troubleshoot S3-based data lake patterns, including:
- Manage and troubleshoot cross-account IAM roles and access patterns for CDP environments
- Support and validate disaster recovery and failover strategies across CDP environments
- Implement and manage end-to-end observability:
- Monitor:
- Enable proactive issue detection and prevention
- Support high-severity (P1/P2) incident response, triage, and resolution within defined SLAs
- Participate in on-call rotation to support 24/7 platform operations
- Respond to production incidents, alerts, and service disruptions within defined SLAs
- Handle P1/P2 incidents, including triage, troubleshooting, and resolution
- Execute:
- Perform:
- Optimize:
- Drive:
- Utilize and support existing automation frameworks for:
- Work with infrastructure teams that manage Infrastructure-as-Code (Terraform) for environment setup and changes
- Leverage scripting (Python / Shell) for:
- Maintain and follow runbooks, SOPs, and operational procedures to ensure consistent platform operations
Skills
- 4–6 years of experience in Big Data Platform / Cloud Operations / Infrastructure Support roles
- 3+ years of experience with Cloudera ecosystem (CDH/CDP)
- Hands-on experience with CDP services (CDE, CDW, CDF, CAI)
- Monitoring, alerting, and operational support
- Strong understanding of cloud platforms (AWS/Azure/Google Cloud Platform basics – IAM, storage, networking)
- Kubernetes concepts (pod-level troubleshooting, logs, resource usage)
- Experience in production support and incident handling (P2/P3)
- Platform monitoring, issue triage, and escalation
- Executing day-to-day platform operations
- Supporting deployments, monitoring, and troubleshooting
- Following runbooks and operational procedures
- Strong experience with Cloudera CDP Public Cloud
- Expertise in cloud platforms (AWS/Azure/Google Cloud Platform)
- Kubernetes concepts (troubleshooting-focused)
- Hands-on with CDE, CDW, CDF (NiFi), CAI
- Knowledge of IAM, networking, observability tools
- Platforms operating at multi-terabyte to petabyte scale with high concurrency workloads
- Hands-on experience with Kafka (or similar streaming platforms) including monitoring, troubleshooting, and performance tuning
- Experience with Cloudera CDP CLI (Command Line Interface) for platform operations and administration
- Job execution and service management (CDE/CDW/CDL)
- Automation of routine operational tasks
- Strong working knowledge of cloud IAM (AWS IAM / Azure AD) including roles, policies, and cross-service access
- User and group mapping across CDP, cloud IAM, and Ranger policies
- Troubleshooting access issues across storage (S3/ADLS), CDP services, and data access layers
- Experience with modernization of legacy data platforms/applications to Cloudera CDP Public Cloud
- Migration and onboarding of workloads to CDE, CDW, and CAI environments
- Supporting hybrid or multi-environment transitions (on-prem → cloud)
- Familiarity with cloud platforms (AWS, Azure, Google Cloud Platform) including storage, IAM, and networking concepts
- Kubernetes-based runtime environments (troubleshooting-focused)
- Strong scripting and automation skills (Python, Shell, Terraform) for platform operations
Company Overview
Company H1B Sponsorship