New Loggly Derived Fields Automatically Inject Intelligence and Structure into Any Log
June 16, 2015
Share this

Loggly announced Loggly Derived Fields, a new capability within Loggly Pro and Enterprise that allows users to specify custom parsing rules that generate derived fields as metadata during the ingestion process.

The derived fields provide intelligence and structure that is then used by Loggly Dynamic Field Explorer; to automatically catalog and summarize logs for one-click navigation and analysis. With derived fields and Field Explorer, development and DevOps teams can troubleshoot problems faster, more effectively monitor their log data for emerging issues, and do sanity checks after code releases without relying on cumbersome, manual queries.

A significant proportion of logs in organizations today are unstructured; the data is not separated into discrete data elements that allow for focused searching or aggregate metrics. Unstructured logs create considerable manual effort for DevOps professionals who traditionally have had to create one-off regular expressions and custom analyses. Many log management solutions require users to develop queries from scratch for each analysis, which is time consuming and inhibits sharing with less technical team members. Derived fields are different because once users create their rules, Loggly automatically applies those rules to all log data it receives, for all users of the account. Any user is then able to use Field Explorer to navigate by field names and values and to create sophisticated analyses without doing any additional work.

Derived fields expand the functionality of the flagship interface of Loggly, Loggly Dynamic Field Explorer. While most traditional log management solutions are designed with the search box as the primary interface, Field Explorer generates navigable lists and summaries to deliver a guided search experience. With Field Explorer, users get a bird’s-eye view of what’s happening, can quickly spot anomalies, understand the magnitude of issues, and search their logs with greater precision. Loggly Derived Fields extend the capabilities of Field Explorer to virtually any log type, structured or unstructured.

Derived fields are metadata, allowing for the original log data to stay intact so that logs can be analyzed in multiple ways. A user may create as many derived fields as needed from the same log events. Derived fields and Dynamic Field Explorer together help DevOps and IT professionals identify and resolve systems issues faster through more flexible and efficient log analytics.

“Unstructured logs are a reality for most cloud-centric companies, yet being able to efficiently mine those logs is critical for troubleshooting and delivering high application responsiveness to the business and end customers,” says Hector Angulo, Head of Product at Loggly. “Derived fields are another step in our unique ‘summarize first’ strategy. Customers can now gain insight even faster and spend more of their time solving or preventing IT issues rather than finding them.”

Loggly Derived Fields are currently in beta and will be generally available by the end of June 2015. Derived fields are a feature of the Loggly Pro and Enterprise subscription plans.

Share this

The Latest

November 26, 2024

In the heat of the holiday online shopping rush, retailers face persistent challenges such as increased web traffic or cyber threats that can lead to high-impact outages. With profit margins under high pressure, retailers are prioritizing strategic investments to help drive business value while improving the customer experience ...

November 25, 2024

In a fast-paced industry where customer service is a priority, the opportunity to use AI to personalize products and services, revolutionize delivery channels, and effectively manage peaks in demand such as Black Friday and Cyber Monday are vast. By leveraging AI to streamline demand forecasting, optimize inventory, personalize customer interactions, and adjust pricing, retailers can have a better handle on these stress points, and deliver a seamless digital experience ...

November 21, 2024

Broad proliferation of cloud infrastructure combined with continued support for remote workers is driving increased complexity and visibility challenges for network operations teams, according to new research conducted by Dimensional Research and sponsored by Broadcom ...

November 20, 2024

New research from ServiceNow and ThoughtLab reveals that less than 30% of banks feel their transformation efforts are meeting evolving customer digital needs. Additionally, 52% say they must revamp their strategy to counter competition from outside the sector. Adapting to these challenges isn't just about staying competitive — it's about staying in business ...

November 19, 2024

Leaders in the financial services sector are bullish on AI, with 95% of business and IT decision makers saying that AI is a top C-Suite priority, and 96% of respondents believing it provides their business a competitive advantage, according to Riverbed's Global AI and Digital Experience Survey ...

November 18, 2024

SLOs have long been a staple for DevOps teams to monitor the health of their applications and infrastructure ... Now, as digital trends have shifted, more and more teams are looking to adapt this model for the mobile environment. This, however, is not without its challenges ...

November 14, 2024

Modernizing IT infrastructure has become essential for organizations striving to remain competitive. This modernization extends beyond merely upgrading hardware or software; it involves strategically leveraging new technologies like AI and cloud computing to enhance operational efficiency, increase data accessibility, and improve the end-user experience ...

November 13, 2024

AI sure grew fast in popularity, but are AI apps any good? ... If companies are going to keep integrating AI applications into their tech stack at the rate they are, then they need to be aware of AI's limitations. More importantly, they need to evolve their testing regiment ...

November 12, 2024

If you were lucky, you found out about the massive CrowdStrike/Microsoft outage last July by reading about it over coffee. Those less fortunate were awoken hours earlier by frantic calls from work ... Whether you were directly affected or not, there's an important lesson: all organizations should be conducting in-depth reviews of testing and change management ...

November 08, 2024

In MEAN TIME TO INSIGHT Episode 11, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Secure Access Service Edge (SASE) ...