Job Description
Your new role We are recruiting for an experienced Observability & Automation Engineer, this is a permanent hybrid position with 1 day a week on site in Cardiff. As an Observability & Automation Engineer, you will play a key role in improving how the organisation monitors, understands and operates its technology estate. The existing environment includes a range of monitoring and automation technologies, including Ansible, AWX, Oracle Enterprise Manager, ServiceNow, GitHub, VisualCron and API-based integrations, but these capabilities are currently at different stages of maturity. Your challenge will be to help move the organisation away from individual monitoring tools, alerts and standalone automation towards a more integrated observability and automation capability. You will help develop monitoring around overall service health and customer impact, bringing together metrics, events, logs and other telemetry to provide greater operational insight and faster root cause identification. You will improve dashboards and operational views, reduce unnecessary alert noise and develop better alerting, correlation and actionable context. You will also help establish measurable service indicators, including SLIs and SLOs, availability, latency, error rates, MTTD and MTTR, creating a more consistent approach to observability across multiple technology environments. Automation will be equally important. You will identify manual, repetitive and error-prone operational processes and develop robust, reusable automation to replace them. Working with Ansible, AWX, APIs and orchestration technologies, you will integrate automation with platforms such as ServiceNow, monitoring solutions and configuration data. Over time, you will also help develop event-driven automation and automated remediation, allowing appropriate operational issues to be resolved with reduced manual intervention. This is an engineering-led position rather than a scripting role. You will introduce and improve testing, source control, peer review and CI/CD practices around operational automation, ensuring solutions are secure, supportable and suitable for production use. This will include appropriate logging, exception handling, security controls and safe rollback or failure behaviour. A key part of your role will be making these capabilities sustainable across the wider technology function. You will establish reusable automation patterns, improve Git-based development practices, introduce engineering and documentation standards and share your knowledge with other engineers. You will work across infrastructure, database, middleware, identity and application teams, challenging manual processes and demonstrating improvements through measurable operational outcomes. What you'll need to succeed You will already have hands-on experience within observability, Site Reliability Engineering, infrastructure automation, platform engineering or a closely related discipline, ideally gained within a complex enterprise or large-scale technology environment. However, this is also a great opportunity for someone to take that next step in their technology career as our customer is looking for someone who can also demonstrate aptitude for learning new skills and ways of working. You will be able to demonstrate where you have previously improved observability or automation rather than simply having worked with the associated tools. You should be comfortable assessing an existing environment, identifying weaknesses and taking ownership of improvements through from initial concept to production implementation.You will have strong practical experience with a combination of Ansible and AWX, Python, PowerShell or Bash, REST APIs, Git, CI/CD and enterprise monitoring or observability technologies. Experience integrating monitoring, automation and ITSM platforms such as ServiceNow will be particularly relevant. You should also understand infrastructure and application telemetry, dashboarding, alert correlation and operational analytics across Linux, Windows, cloud or hybrid infrastructure. Experience within environments incorporating large enterprise databases or Oracle technologies would be advantageous. Alongside your technical experience, you will need a practical and tenacious approach. You should be comfortable working through legacy technology, fragmented tooling and established operational processes, while constructively challenging where things could be improved. You will be expected to take ownership and work effectively across multiple technical teams, balancing innovation with the security, stability and governance requirements of a production environment. Ultimately, you should be able to demonstrate the value of your work through outcomes such as reduced manual effort, improved service visibility, fewer avoidable incidents, better alert quality and faster diagnosis and recovery. What you'll get in return Salary up to £67,000 (possibly some flexibility in this for the ri