AI-Driven Data Profiling Engineer

Description

The company is a global consulting firm that uses digital technology to change how businesses work. Its services cover AI, consulting, digital, cloud and DevOps, data, and software engineering, mainly for financial services and technology clients.

Its FinLabs group builds new solutions in areas such as AI, blockchain, data science, digital underwriting, and mobile-first apps. The company has operated for 20+ years, employs 17,000+ people, and has 58 offices in 22 countries.

The team is running a proof of concept that profiles MGA BDX data with an autonomous agent workflow. The goal is to speed up onboarding of MGA programs into the BDX management platform and the enterprise data hub.

Responsibilities

• Improve the autonomous agent workflow used to profile MGA BDX data.
• Set profiling requirements and expected outputs with data profiling teams and business data consumers.
• Review and tune the behavior, prompts, instructions, controls, and outputs of the Kiro agents.
• Help find and extract PMA-related information in MGA BDX data.
• Build profiling plans for each MGA program.
• Run profiling across a backlog of 80 to 100 MGA programs.
• Spot recurring data quality problems, structural differences, missing fields, anomalies, and business rule exceptions.
• Refine the workflow after each profiling cycle based on what it uncovers.
• Check profiling results through reviewer-agent checks and human review.
• Make sure outputs are clear, actionable, traceable, and usable by downstream teams.
• Hand profiling results to the teams loading data into the BDX management platform and the enterprise data hub.
• Document profiling rules, patterns, exceptions, decisions, and workflow changes.
• Help define dashboards, metrics, and reports on profiling progress and data quality.
• Work with business, data, engineering, and platform stakeholders to resolve issues and clarify requirements.
• Advise on whether to adopt the autonomous-agent approach more widely.

Requirements

• Hands-on experience designing, configuring, testing, and refining AI agent workflows, including planning, execution, review, exception handling, and iterative improvement.
• Proficiency in agentic engineering and autonomous workflow design.
• Experience with the Kiro agents: Discovery Agent, PMA Extraction Agent, Planning Agent, Profiling Agent, Reviewer Agent, and Dashboard Updater Agent.
• Experience with other generative AI, coding-agent, or orchestration tools.
• Ability to write effective prompts, agent instructions, task breakdowns, validation steps, and review mechanisms.
• Understanding of human-in-the-loop controls and ways to keep AI outputs reliable and auditable.
• Ability to troubleshoot agent behavior and improve consistency, accuracy, and explainability.
• Strong background in the insurance industry.
• Experience with MGAs and/or insurance distribution data.
• Knowledge of BDX data, bordereaux, program data, and insurance data onboarding.
• Familiarity with insurance data structures such as policy, premium, claims, exposure, and related concepts.
• Experience with data used in insurance operations, reporting, underwriting, finance, or enterprise data platforms.
• Strong data analysis and profiling experience.
• Experience spotting data quality issues such as anomalies, inconsistencies, missing values, duplicates, and structural variations.
• Ability to work with complex, semi-structured, and inconsistent data sources.
• Experience defining profiling rules, validation logic, business rules, and data quality metrics.
• Ability to turn profiling results into clear recommendations for technical and business readers.
• Solid grasp of data lineage, metadata, mappings, data contracts, and onboarding requirements.
• Experience working with data consumers to sharpen requirements and make outputs more useful.

Conditions

Base salary varies by geography and other factors. For a role filled in New York, NY, the base salary is $120k to $130k per year plus benefits, as required by law.

The company is an equal opportunity and affirmative action employer that makes employment decisions based on business needs, job requirements, and individual qualifications.

Benefits

• Competitive compensation and benefits.
• Opportunity to work abroad across the company's 58 offices in 22 countries.
• 10 days of paid annual leave, plus sick leave and national holidays.
• Maternity and paternity leave plans.
• Medical, dental, vision, life insurance, and long- and short-term disability cover, varying by region.
• Retirement savings plans.
• Higher education certification policy.
• Commuter benefits, varying by region.
• Training in skills, core knowledge, and personal development.
• On-demand Udemy for Business with free access to more than 5000 curated courses.
• Coaching from colleagues in FinLabs and Centers of Excellence.
• Work on projects for leading tier-one banks, financial institutions, and insurers.
• Flat, approachable organization.
• Diverse, global culture.
• Flexible workplace arrangements, mentoring, internal mobility, and learning programs.