All roles

Open role

[Remote] Agentic AI/LLM Engineer, Coverage Intelligence

Remote · Japan Full-time

Note: The job is a remote job and is open to candidates in USA. Bold Penguin hires an Agentic AI/LLM Engineer for its Coverage Intelligence team to build production AI systems that turn complex insurance documents into reliable, explainable coverage intelligence. The role owns document understanding and coverage-analysis workflows end to end, evaluates system accuracy, and partners with coverage and ontology specialists to guide technical development.

Responsibilities

  • Design, build and own production AI systems for document understanding and coverage analysis
  • Build agentic workflows that combine models, tools and human review, and recognize when a decision needs an expert
  • Ground outputs in source documents and domain knowledge so every result is traceable and explainable
  • Drive accuracy through evaluation, experimentation and error analysis against expert-labeled data
  • Make sound trade-offs across models and providers on accuracy, cost and latency
  • Partner with domain experts and engineers to turn expert judgment into durable system behavior
  • Help set the team’s technical direction as LLM and agent capabilities evolve
  • Other duties and responsibilities as assigned

Skills

  • 5+ years' experience in software engineering or applied machine learning, including 2+ years building LLM applications in production
  • Strong Python skills, including typed schemas for structured output (e.g., Pydantic)
  • Hands-on experience extracting structured data from complex documents using PDF parsing, OCR and vision-language models
  • Experience with agentic patterns such as tool use, multi-step workflows, self-verification and human-in-the-loop review
  • Experience with retrieval-augmented generation, embeddings and source-grounded output
  • A rigorous approach to evaluation: defining metrics, building test sets and doing systematic error analysis
  • Excellent written and verbal communication skills, including working directly with domain experts
  • Works autonomously with minimal direction, sets a clear path through ambiguity, and holds a high bar for quality
  • Thrives on the energy of a start up: comfortable with pace, changing priorities, and building the function while running it
  • Experience with insurance, legal, financial or other contract-heavy documents (strongly preferred)
  • Experience with LangGraph or similar agent frameworks (preferred)
  • Experience with LLM observability and evaluation tooling (preferred)

Benefits

  • Fully remote role, with the exception of onboarding and optional in-office events.
  • Travel costs are covered for New Hire Onboarding & Orientation in Dublin, Ohio (2 days, 2 nights).
  • Medical, Dental, and Vision
  • Flexible PTO Policy
  • 401(k) with a company match
  • Employee Assistance Program
  • Parental Leave
  • Disability and Life Benefits
  • Slack channels for work and play
  • Regular video conferences and all-hands “Waddles”
  • Penguin-themed swag

Company Overview

  • Bold Penguin is a commercial insurance exchange that connects customers, agents, and carriers to match the right quote in record time. It is a sub-organization of American Family Insurance. It was founded in 2016, and is headquartered in Columbus, Ohio, USA, with a workforce of 201-500 employees. Its website is http://boldpenguin.com/.
  • Company H1B Sponsorship

  • Bold Penguin has a track record of offering H1B sponsorships, with 4 in 2026, 1 in 2025, 2 in 2024, 7 in 2023, 3 in 2022, 10 in 2021. Please note that this does not guarantee sponsorship for this specific role.
  • More open positions

    [Remote] Sr Platform Engineer (GitLab practice)

    Work from home Full-time role

    [Remote] Backend/Data Engineer, Coverage Intelligence

    Work from home Full-time role

    [Remote] AI Engineer

    Work from home Full-time role

    [Remote] Healthcare Regulatory Assurance Lead

    Work from home Full-time role

    [Remote] Senior CLM Application Administrator

    Work from home Full-time role

    Seasoned Customer Success Manager – 12‑Month Fixed‑Term Contract Driving Enterprise SaaS Adoption, Customer Growth, and Strategic Partnerships at brighthush

    Work from home Full-time role

    Director, Finance - Profitable Growth Strategy) (46208)

    Work from home Full-time role

    Criminal Defense Attorney - Remote

    Work from home Full-time role

    Lead Integration Engineer (Field)

    Work from home Full-time role

    Entry‑Level Live Chat Support Specialist – Remote Customer Success & Troubleshooting Expert for brighthush

    Work from home Full-time role

    Customer Care Coordinator

    Work from home Full-time role

    TAX AUDITING ASSOCIATE

    Work from home Full-time role

    Financial Planning & Analysis Manager (Remote)

    Work from home Full-time role

    Production Coordinator - Sleepwear

    Work from home Full-time role

    Polygon Movie and TV News Writer

    Work from home Full-time role

    English-Korean Interpreter

    Work from home Full-time role

    Life Insurance Sales Position (Work From Home)

    Work from home Full-time role

    PRN Cardiac Device Specialist I - Remote Position

    Work from home Full-time role

    Virtual Legal Intake Specialist (Call Center)

    Work from home Full-time role

    Growth Retention Manager - Apparel

    Work from home Full-time role

    [Remote] Sales Representative & Field Trainer — Educators Welcome

    Work from home Full-time role