Q&A: Nastel Talks About Smart Logging
October 31, 2013
Share this

In APMdigest's exclusive interview, Charley Rich, VP Marketing and Product Management at Nastel, talks about logging and application performance.

APM: How can logging be used for troubleshooting application misbehavior?

CR: Application developers can write log events about their attempted acquisition of system resources, shortage of resources, current state or errors to a log file. By reading and analyzing the log, one can determine to some extent the problems the application is experiencing.

In addition there are additional logs, including those for: the physical server, the application server and the database. Manually, an expert can examine each of these logs and string together a picture of what is happening when a problem has been reported. But, this is not for the faint of heart and often adds considerable trouble to the troubleshooting process.

APM: Are standard logging facilities such as log4j and syslog insufficient for problem determination?

CR: Yes. Manually correlating the information an application logs along with system and other logs can be quite laborious. In addition, many of these logs have multiple unrelated writers posting entries to these logs. Tracing the information pertaining to specific applications is not easy. It is sort of a signal-to-noise problem with the extraneous information in the log acting as noise. All the sources write log events as they happen and thus, each entry may have no relation at all to the prior entry. Deciphering what is relevant to your task is hard.

Standard logging facilities such as Log4j and syslog do not help resolve this issue. They are not sufficiently structured to perform effective problem determination. The burden is on the developer to include enough detail in the log message for effective root cause analysis. They also do not help with the problem of relating application activity messages spread across multiple applications in multiples tiers and multiple logs.

As a result, standard logging can be a burden on development due to the long time it takes to correlate activities manually. Thus, standard logging facilities are somewhat unhelpful in reproducing production problems.

APM: What are “Smart Events”?

CR: Standard logging can be augmented to become “Smart Events”. Smart events are members of a flow of events and can have location, timing, source, correlation information embedded in them (such as IP, server, GPS, geo, etc.). Such augmentation is a combination of an enhanced logging methodology, combined with a simple programming model that allows recording of relevant information that can aid in fast root cause analysis and inter and intra log correlation.

APM: What happens when a Smart Event is created?

CR: Once a Smart Event has been created, the necessary context is provided for an analytics process to correlate these events into a more meaningful format that will make troubleshooting considerably easier.

APM: When are Smart Events most useful?

CR: Smart Events are most useful for applications that require fast root cause diagnostics for performance problems and application misbehavior using logging facilities.

They are also very useful for applications running in cloud or mobile where very little control exists over application behavior.

APM: How much effort is required to change an application to create Smart Events?

CR: Not a lot is required. The developer must use an enhanced programing model that allows for generation of Smart Events where context, time and location are combined into a single concept. Instead of using logging frameworks directly and write to an event log, the developer uses a simplified interface that supports Smart Event methodology. It is important to note that correlation comes from the application's standpoint and not from the technology point of view

APM: What happens when a developer is unable or not permitted to change existing applications?

CR: Smart Events can be used for existing applications that make use of log4j or other logging frameworks. A post processor could be applied to their current logs where data is mined from the existing set of logs and transformed into smart events. Of course, the value of such transformation will largely depend on the level of detail available in the log entries themselves.

APM: Are Smart Events still helpful if a developer is already using Log4j or one of the log file management tools such as Splunk or Loggly?

CR: Yes. If a user has these installed, the processed or consolidated log files can be used as the source without a need to add API calls to the applications.

APM: Does the smart logging approach track thread interdependencies?

CR: As activities are traced down to the thread level, it becomes even more important to know where that thread is executing and how that relates to the activity produced by other threads. As these multi-threaded applications execute in multiple locations, the complexity in using log files for debugging becomes far greater. Awareness of location, context and behavior would be very helpful.

APM: Can smart logging capture elapsed time for activities?

CR: An auto-processing logging framework would imitate the way the application works and automatically time how long it takes from start to completion. It can also measure the timing in detail between, for example event 1, event 2 and event 3. There are a lot of implicit values in a timing perspective and using this model, as well capturing exceptions and errors associated with application activities.

APM: How does someone know if smart logging is right for their organization?

CR: They should evaluate their current logging process and framework and determine the delta between what they are doing and what has been described here. They should consider how the value described can be garnered across all their applications by evolving their logging.

ABOUT Charley Rich

Charley Rich, Vice President of Product Management and Marketing at Nastel, is a software product management professional who brings over 20 years of experience working with large-scale customers to meet their application and systems management requirements. Earlier in his career, he held positions in Worldwide Product Management at IBM, as Director of Product Management at EMC/SMARTS, and Vice President of Field Marketing for eCommerce firm InterWorld. Rich is a sought after speaker and a published author with a patent in the application management field.

Related Links:

Click here for a white paper with more information on Smart Logging

www.nastel.com

Share this

The Latest

May 02, 2016

For years the IT industry debated about whether and when IT organizations would move everything to the cloud. Today's answer to this question is the hybrid cloud or hybrid IT – a combination of private and public clouds with traditional on-premise infrastructure, leveraging the best of all three worlds. It is clear that hybrid cloud offers many advantages. However, as more enterprises move to hybrid cloud, they face new challenges for managing the performance of applications, such as limited visibility and control. To address this new set of challenges, APMdigest asked experts from across the industry – including consultants, analysts and the leading vendors – for recommendations on the best way to ensure application performance in the hybrid cloud. The result is a detailed list of tools and approaches, and related insights, to guide enterprises as they migrate to hybrid cloud. Part 1 covers APM and End-User Experience Monitoring ...

April 29, 2016

A majority (80 percent) of organizations receiving 500 or more severe/critical alerts per day currently investigate less than one percent of those alerts, according to new research from Enterprise Management Associates (EMA), sponsored by Savvius ...

April 28, 2016

Ipswitch recently released a report, The Challenges of Controlling IT Complexity, that reveals IT teams feel they are at risk of losing control of their company’s IT environment in the face of new technologies. But what exactly is it about new technologies that is vexing today’s IT teams? A deeper dive into the research uncovers two major themes that teams are grappling with to better manage increasing IT complexity ...

April 27, 2016

The findings outlined in Part 1 of this blog point to a need for "smart" APM solutions supporting automation of change monitoring, performance and availability management, and production troubleshooting functions. With such capabilities in place, Dev and Ops resources could be freed up to deliver the new software products that have become the lifeblood of the agile business ...

April 26, 2016

At a time when software is becoming increasingly business relevant, IT teams are, in too many cases, retreating to the silo monitoring techniques of the past to track and troubleshoot application performance ...

April 25, 2016

DevOps is hot. This sizzling buzzword is on the tip of every tongue in the IT world, from Development, Testing and QA through IT Operations. At DEVOPSdigest, we have talked a lot about what DevOps is, and how you get there – but what's the point? Why go through all this trouble? What advantages can be gained from adopting a DevOps strategy? To explore the answers to these questions, DEVOPSdigest asked experts from across the industry – including consultants, analysts and the leading vendors – for their opinions on the most significant advantages of DevOps ...

April 22, 2016

Here are some common recommendations to optimize the steps of a web page request ...

April 21, 2016

The performance of your website is obviously very important. When visitors comes to your company website, they won't stick around very long if it's slow. If those visitors are users of your web application, they may not be for long if they encounter a consistently slow performing app. So we want to make our websites and web applications fast. But how can we go about doing that? ...

April 20, 2016

CEOs have underlined that growth will be their top business priority for 2016, according to a recent survey by Gartner, Inc. The 2016 Gartner CEO and senior business executive survey found that despite indications that the global economy is struggling in early 2016, CEOs do not plan to significantly change their priorities. After growth (54 percent), the second and third business priorities are customers (31 percent) and workforce (27 percent) ...

April 19, 2016

A bad onboarding experience can be a nightmare for a new user. Bad website design, absent customer support, a poorly implemented tutorial, all of this can turn into a Kafkaesque nightmare for the unsuspecting customer. Here are four of the most common customer onboarding pitfalls in the SaaS world and the equivalent nightmares we've all experienced at one time or another ...