Note: The job is a remote job and is open to candidates in USA. Recorded Future is the world’s most advanced and largest intelligence company, seeking a Principal Software Engineer to join their Engineering team. The role involves building and scaling data pipelines for the Security Intelligence Graph, driving architectural improvements, and ensuring effective platform scalability.
Responsibilities
- Data Pipeline Ownership: Design, build, and maintain scalable data pipelines that collect, transform, and deliver structured threat intelligence data powering the Security Intelligence Graph
- Architecture & Scalability: Drive meaningful architectural improvements across data and platform systems to ensure long-term scalability, reliability, and performance
- Full-Stack Engineering: Work across both application code and infrastructure, contributing to backend services, data systems, and platform capabilities
- Data Processing & Analysis: Apply statistical techniques to large-scale datasets to generate accurate and impactful insights
- Reliability & Observability: Ensure production-grade pipeline reliability through strong observability, error handling, and failure recovery practices
- Infrastructure & Deployment: Build and maintain CI/CD pipelines and contribute to infrastructure-as-code practices to support efficient and repeatable deployments
- Cross-Team Collaboration: Communicate technical concepts clearly and collaborate effectively across teams, geographies, and varying levels of technical expertise
- Technical Leadership: Engage with technical leaders across teams and contribute to raising the engineering bar through knowledge sharing and best practices
Skills
- At least 5 years of experience in data engineering, backend engineering, or platform engineering
- Strong proficiency in Python, with experience in Go or Rust considered a plus
- Experience working with cloud infrastructure, including compute, storage, networking, and IAM fundamentals
- Hands-on experience with message queues and pub/sub systems such as Kafka or RabbitMQ
- Experience with SQL databases such as Postgres or AWS RDS, and NoSQL databases such as MongoDB or Elasticsearch
- Familiarity with data lake storage frameworks such as Delta Lake and graph databases such as AWS Neptune or Neo4j
- Experience developing REST APIs using frameworks such as Flask, Django, or FastAPI
- Proven experience architecting and delivering production-grade applications and ETL/ELT pipelines
- Strong understanding of building reliable data pipelines, including observability, error handling, and failure recovery
- Experience building and maintaining CI/CD pipelines; GitHub Actions experience is a plus
- Familiarity with infrastructure-as-code tools; Terraform experience is a plus
- Comfort working with high-volume, complex, and unstructured data
- Strong problem-solving skills, including the ability to debug both software and data issues
- Excellent attention to detail and ability to work independently while delivering high-quality results
- Interest in or familiarity with security data domains such as threat infrastructure, malware, or network telemetry
- Bachelor's and/or Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience
- Experience or interest in cybersecurity data domains such as malware analysis, phishing detection, or network telemetry
- Experience working with graph-based data systems or security intelligence platforms
Benefits
- This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K.
- Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.
Company Overview
Company H1B Sponsorship