Data and AI Engineer

The Doctors Company is seeking a Data and AI Engineer to join our team. This is a hybrid or remote opportunity depending on the final candidate's location from the company's offices.

The Data and AI Engineer will build and automate high-reliability data pipelines on Microsoft Fabric/Azure to unify data and enable governed analytics and AI. This role is central to the strategic development and operationalization of enterprise data and AI capabilities across the TDC Medical Malpractice Enterprise. The position requires deep cross-functional collaboration and a strong grasp of healthcare, legal, and actuarial data domains.

Education & Experience

• Advanced degree in Computer Science, Data Engineering, or related field
• 5–8 years of experience in data engineering and pipeline development.
• Proven leadership in designing scalable data platforms and governance frameworks
• Advanced proficiency in SQL and Python for ETL/ELT workflows.
• Hands-on experience with Microsoft Fabric, Azure Data Factory, and orchestration tools (e.g., Airflow).
• Strong understanding of DataOps practices and Git-based CI/CD.
• Familiarity with event-driven architecture, APIs, and microservices.
• Knowledge of data governance, lineage, and security (RLS/CLS).

Other Competencies 

• DuckCreek and Insurance Domain Knowledge 
• Ability to optimize performance and cost in cloud environments. 
• Strong problem-solving and debugging skills. 
• Excellent collaboration and communication skills for cross-functional teams. 

 Responsibilities 

Workflows, Pipeline Reliability and Throughput

• Design and deploy automated ETL/ELT pipelines in Microsoft Fabric and Azure Data Factory to integrate data sources.
• Implement monitoring and alerting for pipeline health and latency.
• Design efficient end-to-end pipeline latency through optimization and parallelization.

Governed Data Products

• Deliver curated, governed data products with documented SLAs and lineage.
• Ensure semantic models and metadata are published for analytics and AI consumption.
• Collaborate with business units to validate data product requirements and adoption.

Automation and DevOps

• Implement CI/CD pipelines for data workflows using Git-based DevOps. 
• Automate deployment and rollback processes across dev, UAT, and production environments.
• Reduce manual runbooks through automation.

Data Quality and Cost Control

• Establish validation checks for schema, null values, and referential integrity. 
• Monitor compute and storage costs; optimize scheduling and caching to reduce spend.
• Implement appropriate dashboards for cost and performance tracking.

Security and Compliance Enablement

• Apply RLS/CLS security policies to sensitive datasets.
• Complete quarterly compliance reviews with zero critical findings.
• Collaborate with security teams to enforce data governance standards.

Other duties as assigned/needed

• Support adhoc data engineering tasks as assigned.
• Participate in team knowledge-sharing sessions.

Salary Range: $93,378 - $122,559. Compensation varies based on skills, knowledge, and education. We consider factors such as specialized skills, depth of knowledge in the field, and educational background to ensure fair and competitive pay. 

Benefits 

We offer competitive compensation, an incentive bonus plan, outstanding career opportunities, an exceptional work environment, and an impressive benefits package, which starts with medical, family and bereavement leave; same-sex domestic partner benefits; short- and long-term disability programs; and an employee assistance program. There's more:  

• Health, dental, and vision insurance
• Health care tax-free spending accounts with a company match
• 401(k) and Roth IRA with company match, as well as catch-up plans for both
• Vacation days, sick days, and paid personal days each calendar year (with vacation increases based on length of service)
• Paid holidays each calendar year
• Life and travel insurance
• Tax-free commuter benefits
• In-person and online learning opportunities
• Cross-function career opportunities
• Business casual work environment
• Time off to volunteer
• Matching donations to qualifying nonprofit organizations
• Company-sponsored participation at non-profit events

About The Doctors Company

The Doctors Company is the nation’s largest physician-owned medical malpractice insurer. Founded and led by physicians, we are committed to advancing, protecting, and rewarding the practice of good medicine. 

The Doctors Company is proud to be Certified™ by Great Place to Work®.