The senior technical engineer leads the design, rollout, and ongoing development of observability across cloud, infrastructure, application, and AI-driven platforms. You will work with architecture, security, platform engineering, and business stakeholders to set observability standards, improve operations, and raise reliability across the technology estate.
You will lead the design, build, and evolution of monitoring, logging, tracing, and telemetry platforms and promote reliability engineering and cloud-native operations. The role sets technical direction for observability strategy, builds scalable monitoring, lowers operational risk, and helps the organization make decisions based on data.
The company is a mutual insurer that has operated for more than 80 years, and its technology team is modernizing its systems and how it works.
Responsibilities
Act as the escalation point for engineers of all levels on troubleshooting and resolving issues across multiple applications and systems, working with cloud engineers, developers, security, architects, and other stakeholders.
Lead the design and evolution of processes and patterns, and design new ones where needed.
Coordinate and lead the build and installation of services and platforms that keep the environment stable.
Apply current best-practice technology, design, and methodology to create platform-specific technical designs, and research and recommend emerging tools and techniques.
Lead the design of technical improvements to existing services and processes, including advanced automation scripts that keep the cloud environment resilient and scalable.
Ensure systems are available and perform well, report system health to leadership and engineering peers, and open incidents for remediation.
Advise business and technical stakeholders on process and technical solutions, coordinating with engineering peers and subject-matter specialists to deliver cost-conscious solutions that meet business needs.
Escalate for offshore administration teams on technical design and cloud implementation, including reviews and quality assurance, and coordinate vendor issues and escalations with engineering peers and Procurement, including contract reviews where needed.
Serve as escalation for resolving third party risk analysis and vendor management contractual obligations.
Create architectural patterns that confirm alignment with cloud service code templates, and draft and publish team documentation such as processes, runbooks, and diagrams, keeping them current with peers.
Help establish and monitor processes that keep the team compliant with legal, regulatory, licensing, governance, and contractual requirements, and stay current on technology policies, including updates for non-enterprise systems, team processes, and diagrams.
Take on other duties as assigned.
Requirements
Required: A bachelor's degree or directly applicable work experience.
Required: At least 5 years of system engineering or architecture experience across multiple platforms, including advanced scripting and coding.
Required: Advanced experience using multiple scripting tools and concepts in an enterprise environment.
Required: Proven experience with a range of virtualization technologies in multi-tenant, private, and hybrid cloud environments, and hands-on experience building reusable patterns using design-for-failure approaches.
Required: Ability to work across technical and business teams to define IT solution scope, business, system, and non-functional requirements, and to write and run test cases.
Required: Strong written and verbal communication, the ability to influence change and tailor messages to the audience, and experience presenting complex technical concepts to senior technical leaders.
Required: Advanced troubleshooting skills for finding the root cause of enterprise issues and proposing creative fixes.
Required: Understanding of risk and how enterprise-level changes affect the organization, and the ability to mentor and coach others on the impact of changes.
Required: Initiative in helping design and implement new processes and solutions, and in measuring their impact.
Required: Proactive, curious, and willing to learn new skills.
Required: Working knowledge of DevOps and CI/CD methods and tools.
Preferred: 7+ years in cloud engineering, Site Reliability Engineering, DevOps, observability engineering, or related fields.
Preferred: Proven experience designing and running enterprise-scale observability platforms in complex production environments.
Preferred: A track record of leading technical initiatives that improved reliability, availability, scalability, and operational efficiency.
Preferred: Experience with observability platforms such as Dynatrace, Splunk, Datadog, Grafana, Prometheus, OpenTelemetry, New Relic, AppDynamics, Elastic, Honeycomb, or equivalent.
Preferred: Strong grasp of metrics, logging, distributed tracing, service health, SLIs, SLOs, error budgets, and reliability engineering.
Preferred: Experience architecting observability for cloud-native and distributed systems on AWS, Azure, or GCP.
Preferred: Advanced knowledge of Kubernetes, containers, microservices, networking, and modern application architectures.
Preferred: Experience with Infrastructure as Code and CI/CD practices that build in observability controls and instrumentation.
Preferred: Experience meeting observability needs for AI, machine learning, and intelligent agent platforms.
Preferred: Strong consulting, stakeholder management, and influence skills.
Preferred: Experience mentoring engineers and leading technical communities of practice.
Preferred: Industry certifications in cloud platforms and/or observability technologies.
Conditions
Travel is less than 5%.
Applicants who meet the definition of a Covered DoD official should say so.
The company is an equal opportunity employer, and all information is kept confidential under EEO guidelines.