5 observability gaps that could blindside your organisation
To operate effectively and keep up with the ever-growing demand for digital services, IT teams need to clearly see and understand what is happening in their organisation’s IT environment. However, traditional monitoring solutions and manual approaches are struggling to keep up with the dynamic nature of today’s hybrid, cloud-native environments, which makes gaining and maintaining insight far more difficult than ever before.
As a result, more organisations are shifting towards new approaches that support the three key pillars of observability: metrics, logs, and traces. However, these approaches are only effective if the data being gathered can be fully understood in its wider context. As such, gaps in observability can impact digital teams’ ability to understand, monitor, and manage their services effectively.
Here are five of the biggest areas where observability gaps occur that can blindside organisations.
1. Containers, microservices, and Kubernetes
Using cloud-native architectures based on microservices, containers, and Kubernetes can massively benefit organisations, offering increased agility, efficiency, and scalability, to drive faster innovation. However, they also result in an extremely dynamic environment that is constantly changing. has found that 61 per cent of CIOs say their IT environment changes every minute or less, and that per centage will only increase as more organisations adopt cloud-native architectures. It’s near impossible for teams to keep up with this pace of change using manual approaches to configure and instrument apps, or to script and source the data they need to maintain observability – leaving them with blind spots. In fact, 63 per cent – nearly two-thirds – of CIOs say the complexity of their cloud environment has surpassed human ability to manage. As such, automation is becoming critical to manage cloud-native environments.
2. Real user experience
A key focus for modern organisations is the ability to create excellent user experiences by continuously improving their digital services. However, if organisations don’t monitor the way real users experience their applications and software, they create an observability blind spot, which makes it difficult to effectively optimise user experiences. Without measuring the experience from the perspective of the user, it’s impossible to know if applications are working as they should, or if changes are needed to optimise the user journey. Organisations also need to be able to put this information in context, so they can see the full picture of how digital service performance impacts user experience. That can only be achieved with a single platform and a unified data model, not the multiple tools that many organisations rely on to maintain observability and manage user experience.
3. IT operates in a silo
In our recent research, 56 per cent of CIOs said IT is becoming more of a business imperative, while 64 per cent said they’re under more pressure from an increased demand for digital services. Despite this, most organisations look at observability data in isolation of business metrics, such as revenue and conversions. This siloed approach to IT operations creates a blind spot, as the relationship between key IT and business metrics can easily be missed, meaning crucial context falls through the cracks. For instance, business teams may notice a sudden drop or a spike in e-commerce conversions after the IT team deploys a new software update to a back-end application. If IT and business metrics aren’t considered in context of one another, organisations can miss these correlations, meaning users often find out about problems before the business does, through a poor digital experience.
4. Too many tools
In their efforts to maintain observability into their multi-cloud environments, many organisations use an average of 10 different monitoring tools to keep track of individual platforms and services. However, IT teams are struggling to keep up with the huge volume, velocity and variety of data this creates, and to make sense of the often-conflicting alert noise that results from it. 72 per cent of CIOs have said they can’t keep plugging monitoring tools together to maintain observability. 84 per cent say the only effective way forward is to reduce the number of tools and the amount of manual effort IT teams invest in monitoring and managing the cloud. They’re calling for a single platform that can provide end-to-end observability. However, that won’t solve all their problems, as IT teams still need to interpret vast quantities of data quickly enough to understand what it’s telling them. That’s why AI is becoming so critical in this area, enabling IT teams to instantly turn observability data into actionable insights that can be used to optimise services and resolve issues before users are impacted.
5.Manual, DIY approaches
Many organisations take a DIY approach to observability, manually building instrumentation into application code as they go along. Not only is this a time-consuming process that takes up team resources that could be better spent elsewhere, but it also usually creates blind spots. While newer systems often have observability built in, many older ones don’t, as IT teams would need to go back to their existing applications and instrument them retrospectively. This leaves a fragmented view of the environment, with research showing digital teams only have full observability into 11% of their application and infrastructure environments. This means teams won’t have the full context of what is happening and how IT service performance impacts users and the business. It’s therefore essential to automate the process of instrumentation to ensure that observability is end-to-end and continuous. This will enable IT teams to focus their efforts on more valuable tasks that drive better outcomes for the business.
Observability is essential to success for modern organisations, providing the insight they need to ensure services deliver the frictionless experiences that users and the business demand. As such, these five observability blind spots pose a significant threat to the business if they remain unchecked. AI and automation hold the key to closing observability gaps and enabling IT teams to reduce risk and drive better business outcomes.
Abdi Essa is regional vice president, UK&I, for Dynatrace
Dark Wolf: accelerating security for USAF
As a small company whose biggest customers are the Department of Defense and the Intelligence Community, Dark Wolf Solutions (Dark Wolf) is a triple-threat, specializing in Cybersecurity, Software and DevOps, and Management Solutions. Dark Wolf secures and tests cloud platforms, develops and deploys applications, and offers consultancy services performing system engineering, system integration, and mission support.
The break for Dark Wolf came when the Department of Defense decided to explore software factories. Rick Tossavainen, Dark Wolf’s CEO, thinks it was an inspired path for the DoD to take. “It was a really great decision,” he says, “Let’s pull our people together as part of this digital transformation and recreate what Silicon Valley startup firms typically have. Let’s get into commercial facilities where we have open windows and big whiteboards and just promote ideation and collaboration. And it creates this collaborative environment where people start creating things much more rapidly than before.”
It has been, Tossavainen says, “amazing to watch” and has energized the Federal Contracting Sector with an influx of new talent and improved working environments that foster creativity and innovative ways of approaching traditional problems.
“We originally started working with the US Air Force about three years ago. The problem was at the time you could develop all the software you wanted but you couldn’t get it into production – you had to go through the traditional assessment and authorization process. I talked to Lauren Knausenberger and she told me about Kessel Run and what eventually came out of this was the DoD’s first continuous ATO [Authority To Operate].”
The secret to Dark Wolf’s success – and its partnerships with USAF and Space Force – lies in a client-first attitude. “We’re not looking to maximise revenue,” Tossavainen explains. “We tell all of our employees, if you’re ever faced with an issue and you don’t know how to resolve it, and one solution is better for the customer and the second is better for Dark Wolf, you always do number one. We’ve just got to take care of our customers, and I look for other partners that want to do that. And let’s work together so that we can bring them the best answer we can.”
Rapid releases and constant evolution of software are common themes among USAF’s partners. Like many firms operating in the commercial and public sector spaces, Dark Wolf leads with a DevSecOps approach.
“Failure is tolerated,” says Tossavainen. “If it’s not going the right way in three months, let’s adjust. Let’s rapidly change course. And you can tell really quickly if something’s going to be successful or not, because they’re doing deployments multiple times a day – to the customer.”