Compliance Data Architecture & Engineering, Manager
Location: San Francisco, California
Country: United States
Category: Technology
Workplace Location: Remote
Employment Type: Contract
Posted Date: November 20, 2026
Job ID: 654072
Job Description
Location: Based on Candidate Location ( Remote)
Pay Rate: $100.00-$105.59
Job Description:
- Build & Operate the Compliance Data Foundation: Serve as a principal individual contributor responsible for further development of newly acquired compliance and security datasets, building the end-to-end Databricks ETL pipelines that transform raw data into highly refined, high-utility data products designed to measure and monitor control performance and effectiveness.
- Implement Medallion Data Pipelines: Design, optimize, and maintain robust ETL orchestration and automated pipelines to curate bronze, silver, and gold data layers. Ensure raw, conformed, and consumption-ready compliance data products are highly structured and standardized.
- Normalize Core Security & Compliance Data: Develop and implement data normalization schemas for diverse, high-volume telemetry feeds ingested from core corporate tools, including ServiceNow, Microsoft Defender, CrowdStrike, Zscaler, Wiz, Microsoft Entra ID, SailPoint, and many others.
- Transform Telemetry to Monitored Logic: Partner with the data source and control domain owners to translate data sets into monitoring enablement and programmatic control-testing logic built directly into the data layer.
- Produce High-Insight Data Products: Develop and maintain specialized compliance data products--including Databricks dashboards, reports, and analytic applications--that provide clear, actionable insights into compliance control performance, coverage gaps, and operational effectiveness enabling future agentic capabilities.
- Support SDLC, Automation & Release Gates: Manage GitHub repositories, branching, and peer review standards. Establish automated job monitoring, exception handling, and code promotion processes to transition pipelines reliably into production.
Qualifications:
- Education & Professional Experience: Bachelor's degree with 5-8 years of experience spanning a hybrid of Cyber Security Operations (e.g., threat detection engineering, security telemetry analysis) and Security Compliance/GRC roles.
- Databricks Engineering Expertise (or similar platform): Advanced technical experience building ETL pipelines, orchestrating data workflows, and developing analytics in Databricks. Prior experience developing, deploying, or managing custom Databricks applications or Databricks Agents is a strong plus.
- Compliance Telemetry & Normalization: Proven capability to normalize, correlate, and test data structures sourced from security, identity, and governance platforms (ServiceNow, Defender, CrowdStrike, Zscaler, Wiz, Entra ID, and SailPoint).
- Control Assurance & Data Strategy: Solid understanding of security compliance frameworks, policy-to-control translation logic, and the deployment of continuous control monitoring (CCM) strategies within a secure cloud data lake.
- Agile Software Delivery (SDLC): Hands-on experience with modern software development workflows, including version control (Git/GitHub), peer review cycles, and release testing/approval gates.
- Communication & Collaboration: Excellent verbal and written communication skills with a proven ability to bridge the gap between complex engineering requirements and business-facing risk management objectives.
- Relevant certifications include: CISSP, CRISC, or Databricks Certified Data Engineer Associate/Professional
EEO Statement
The staffing industry has seen an increase in people falsely representing themselves as recruiters to gather personal information from job seekers. For your safety, do not provide sensitive data to anyone you have not spoken with thoroughly, never provide banking information during the application process, and always double check the email address of the Recruiter to ensure it’s from an official Planet domain (@theplanetgroup.com or @launchcg.com) - and not a domain with an alternative extension like .net, .org, or .jobs.
The Planet Group and our companies are equal opportunity employers. It is our practice not to discriminate against any employee or applicant based on any criteria, condition or basis protected by laws or regulations in the locations where we do business. All qualified applicants are encouraged to apply. We celebrate diversity and are committed to providing an environment of mutual respect. We believe that diversity, equity, and inclusion enable us to better meet our mission and values while serving our clients across the globe. If you have a disability or handicap and would like us to accommodate you in any reasonable way, please inform your recruiter, or contact us, so that we can discuss the appropriate alternatives available.
Apply Now
Apply Via
Stay Up To Date With The Latest Jobs.
Similar Jobs
About The Planet Group
The Planet Group is a global professional services firm delivering strategic staffing and advisory solutions. We operate at the intersection of talent and transformation – connecting the right people with the right opportunities in the areas of technology, engineering, accounting & finance, digital marketing, and manufacturing.
As one of the largest staffing companies in the US, we operate with a global reach and a performance-first mindset. We partner with clients to move fast, stay agile, and drive measurable results – building high-impact teams that fuel transformation and growth.