Senior Python Engineer, DataHub Ingestion Framework Job at Acryl Data, Palo Alto, CA

TldRL1lqaktzYUR3d211RHB3WUxPUkI4M3c9PQ==
  • Acryl Data
  • Palo Alto, CA

Job Description

DataHub, built by Acryl Data, is an AI & Data Context Platform adopted by over 3,000 enterprises, including Apple, CVS Health, Netflix, and Visa. Innovated jointly with a thriving open-source community of 13,000+ members, DataHub's metadata graph provides in-depth context of AI and data assets with best-in-class scalability and extensibility. The company's enterprise SaaS offering, DataHub Cloud, delivers a fully managed solution with AI-powered discovery, observability, and governance capabilities. Organizations rely on DataHub solutions to accelerate time-to-value from their data investments, ensure AI system reliability, and implement unified governance, enabling AI & data to work together and bring order to data chaos. The Challenge As AI and data products become business-critical, enterprises face a metadata crisis: No unified way to track the complex data supply chain feeding AI systems Engineering teams struggling with data discovery, lineage, and governance Organizations needing machine-scale metadata management, not just human-browsable catalogs Why This Matters This is where infrastructure meets impact. The metadata layer you'll build will directly power the next generation of AI systems at massive scale. Your code will determine how safely and effectively thousands of organizations deploy AI, affecting millions of users worldwide. The Role We're looking for an exceptional Python engineer to lead development of DataHub's ingestion framework – the core that connects diverse data systems and powers our metadata collection capabilities. You'll Build Clean, intuitive APIs for our connector ecosystem Event-driven architectures for real-time metadata processing Schema mapping between diverse systems and DataHub's unified model Versioning systems for AI assets (training data, model weights, embeddings) You Have 4+ years building production-grade distributed systems Advanced Python expertise with a focus on API design Experience with high-scale data processing or integration frameworks Strong systems knowledge and distributed architecture experience A track record of solving complex technical challenges Bonus Points Experience with DataHub or similar metadata/ETL frameworks (Airflow, Airbyte, dbt) Open-source contributions Early-stage startup experience Location and Compensation Bay Area (hybrid, 3 days in Palo Alto office) Salary Range: $225,000 to $300,000 Equity Medical, dental, and vision insurance (99% coverage for employees, 65% coverage for dependents; USA-based employees) Carrot Fertility Program (USA-based employees) Remote friendly Work from home and monthly co-working space budget Apply for this job * indicates a required field First Name * Last Name * Preferred First Name Email * Phone * Resume/CV * Enter manually Accepted file types: pdf, doc, docx, txt, rtf Enter manually Accepted file types: pdf, doc, docx, txt, rtf #J-18808-Ljbffr Acryl Data

Job Tags

Remote job, Work from home, Worldwide,

Similar Jobs

LHH

Administrative Clerk (Part-Time) Job at LHH

 ...support specialist for a client in the Cincinnati Ohio area. This part-time role focuses on scanning, indexing, and verifying documentation...  ...scanned documents are legible and correctly categorized Assist with title processing, including reviewing and preparing title... 

Pasona N A, Inc.

Corporate Planning Analyst - Japanese Bilingual Job at Pasona N A, Inc.

 ...Position: Corporate Planning Analyst Location: Plano, TX or McAllen, TX Work Model: Hybrid Languages: Japanese & English Visa Support: Available A leading automotive parts manufacturer is seeking a Corporate Planning Analyst to support strategic initiatives... 

Teneo Linguistics Company

French Interpreter Job at Teneo Linguistics Company

 ...Description Job Description Language forms the bedrock of understanding, empathy, and connection. We are searching for a versatile French Interpreter, specifically African French, who can bridge the linguistic gap in diverse scenarios ranging from medical, legal,... 

Postal Jobs Resource

Mail Carrier - Rural - No Experience Required Job at Postal Jobs Resource

Explore a World of Career Opportunities as a Mail Carrier with USPS Role Overview: USPS is accepting applications for Rural Carrier Associates nationwide. This role involves delivering and collecting mail while interacting with customers along the route. USPS offers training... 

Northrop Grumman

Staff Test Pilot 5 - R10197439 (Baltimore) Job at Northrop Grumman

 ...Join to apply for the Staff Test Pilot 5 - R10197439 role at Northrop Grumman 1 week ago Be among the first 25 applicants Join to apply for the Staff Test Pilot 5 - R10197439 role at Northrop Grumman RELOCATION ASSISTANCE: Relocation assistance may be available...