Poor performance can now degrade your business in an even more real and meaningful way.  Recent changes by Google will allow site performance to affect whether traffic is driven to your site.  This places a new urgency on the ability to accurately measure performance in terms of the end user.

Recently, the Mashable blog reported on a decision by Google to add performance as another deciding factor in how they rank their search results.  This marks a significant milestone in which performance will affect your site’s ability to attract visitors.  Essentially, the faster sites will receive more attention.  By taking this action, Google hopes to shine a spotlight on performance and drive better overall development practices.  I have no doubt that this is a direct result of Steve Souders‘ move to Google from Yahoo, where he had been busy leading the YUI best practices effort that produced YSlow.  Since that time, Google has become much more of an advocate for web performance.  Here’s a direct quote from their blog that sums up their current perspective:

“We encourage you to start looking at your site’s speed … not only to improve your ranking in search engines, but also to improve everyone’s experience on the Internet.”

Essentially, Google has now made performance an important factor in driving business to your site.  At the same time, performance is one of the hardest things to accurately and properly measure for web-based traffic.  Google suggests a number of very good tools, most of which run inside your browser.  These tools look at performance in terms of the end user, which is now a recognized best practice.  However, they only measure the performance of your site while you are actively browsing it.  They won’t tell you anything about how your site performs for others or how it performs during the other 99% of the time when you are not personally measuring it with your browser.  Synthetic testing suffers from the same drawbacks.

More importantly, these approaches miss the elusive problems that affect specific people or that occur at specific times.  Nor will they find the problems that only occur under specific circumstances.  The fact is, these elusive issues are the most common.  They are the ones that plague every web site administrator because they are hard to find and nearly impossible to reproduce.  They eat up days of investigation time and are the biggest destroyer of public confidence in your site.  To find these problems, you need to be watching ALL traffic on your site every second of every day.  Moreover, you must do so while maintaining the end user perspective.

There are very few solutions out there that can do this effectively.  Consequently, we are justifiably proud of our TrueSight product line and it’s ability to tackle this very difficult problem.  Once installed in your data center behind your firewall, TrueSight is able to monitor all traffic from your load balancer all the way back to your database and 3rd party tiers – from web request right down to code, SOA and SQL calls.  We auto-discover new applications and web servers as they are deployed without any need for additional configuration.  Moreover, our monitoring solution continues to perform its duties, even as you gradually virtualize your infrastructure or integrate back-end cloud services.

In fact, using a unique ground-breaking integration, we can provide full visibility of any deployments using Akamai’s Application Delivery Assurance services, like acceleration or caching.  Our unique relationship with Akamai has also recently led to the first co-developed solution that is being offered directly from Akamai for managing their services.

Furthermore, our technology is capable of providing accurate overall performance measurements for mashups or hybrid solutions.

If you have blind spots in your performance monitoring, you will not be protected from the negative consequences of this new trend.  If you lack insight on your end users’ actual experience on your site, you should seriously start planning to acquire it.

Akamai and Coradiant have developed a practical approach to show how performance across the Cloud produces real value. In an industry first, Akamai is offering cloud visibility assurance by making the jointly-developed Coradiant TrueSight Edge for Akamai available to their APS Enterprise customers.  Akamai customers can understand how effective Web application delivery is to any area around the globe, and gauge where and when to implement Akamai application acceleration services to normalize end-user experience across the globe.

This marks an important milestone for the cloud. How effective is it? How is it supporting my business?

Coradiant TrueSight Edge for Akamai includes a software-based virtual appliance that is easy-to-deploy at the customer’s data center. Interactive, built-in dashboards and detailed statistics permit IT folks to monitor the end user performance of their applications. And it provides a side-by-side comparison of performance of applications delivered with and without Akamai.

Coradiant TrueSight Edge for Akamai offers detailed viewer of traffic and performance metrics with interactive dashboards and geographic drill-down capabilities. The product is designed to help enterprises gain greater visibility into end user performance to ensure consistent experience and better adoption of Web applications across the globe.

Key benefits include:

•  Executive-level global map displays with bubble charts to reflect critical business delivery and response
•  Dynamic views of response times and traffic volumes (real-time and historical)
•   Playback to help assess problems, and for planning and delivery optimization
•  “Vanity Displays” for lobbies, demo centers and for employees.
•  Comparison so customers can see the Akamai acceleration benefits for all users

Perhaps the most striking feature is the intuitive visual displays. Displays reveal the overall health and the quality of the end-user experience of a global application. Easy-to-interpret dashboards show traffic patterns and service level achievement around the globe. A scrolling traffic ticker displays relative changes in traffic volume or service levels over the last five minutes.

These allow executives and line of business managers an instant view of delivery success for live application traffic and may also be used to view historical data for up to 30 days. Marketing can also assess campaign interaction and balance the need for delivering rich content while maintaining good performance and a good user experience.

Accelerate your online business globally with confidence with Coradiant TrueSight Edge for Akamai.

I had the opportunity a few weeks ago at the Cloud Connect conference to co-chair a half-day workshop on Cloud Performance Optimization. The consensus from the mix of site operators, content providers and vendors is that monitoring and measuring the performance of cloud applications is critical.

“Cloud-served” applications can be a complex mix of content and application logic that is served from multiple locations. Unlike “conventional” client-server applications of the past, no single set of server- or application- oriented performance optimization metrics would be relevant for cloud-served online applications.  In the cloud, the only constant is where the application comes together – at the end user’s browser.

Often the cloud-served portion of an application is outside of a site operator’s direct control, even though they are ultimately responsible for the delivery performance of that content. A universal topic of discussion was about how to be sure that users are getting the application performance and availability that keeps users satisfied.

Managing cloud environments brings many challenges that traditional monitoring options can’t solve because the metrics they measure like CPU, memory and disk utilization, network bandwidth, etc. aren’t meaningful in the virtualized cloud computing model as far as application performance is concerned.

Ultimately, the goal is to overcome the visibility gap between IT executives and their web applications no matter how the applications are served. What’s abundantly clear is that understanding the user experience provides a single point with which to judge how effective sites are – and understand how effective the cloud actually is. Knowing the user perspective assists in governing IT effectiveness at the senior executive level and also helps find problems so that IT operations professionals can fix performance issues quickly.  Coradiant has been dedicated to the approach of knowing the user experience since 2000. It’s great to see this approach taking hold as more and more applications move to the cloud.

Web analytics practitioners, myself included, often express site behavior in terms of the number of unique visitors to a site.  Statements such as “we had 14,000 unique visitors to our site between the 1^st and the 15^th of February 2010” are quite common and, on the face of it, impressive.  After all, if unique visitor volume, in the lingua franca of web analytics, is considered a proxy for site popularity – why not use it?

However, the concept of a “unique” visitor gets confusing.  The more I think about it, the more I wonder if this concept is accurate. For example, if I go to the espn.com site from my desktop in the morning and then read a story in the afternoon from my mobile device, and return to buy merchandise late in the evening from my laptop – can I really be considered as three different individuals? Or should I be considered as one person making three visits in the course of a day?

In the absence of any reliable way to connect my identity across three independent visits to the espn.com site, a unique visitor count of three is wrong.  Second, even when repeat visits are from the same device, the counting of unique visitors becomes problematic given that cookies may get blocked or deleted.  Web analytics experts estimate that after about four weeks, about a third of cookies are missing (see http://www.advanced-web-metrics.com/accuracy-whitepaper).  This implies that when a visitor returns to a site from the same device after four weeks she is accounted for as another unique visitor. That’s bizarre, but true.

So, what is an analyst to do? The simple solution is to forget the unique visitor metric and simply use the visit count. In most cases, for sites that do not invite individual visitors to self identify simply doing away with the unique visitor count and using the visit metric allows the site owners to take the same business decisions.  For sites that do invite self identification a solution would be to take the ratio of logged in visits to the total visit volume among that group and apply the same split to the non-identified visitors to estimate an overall visitor volume. The overall point, however, is still the same.  Most decisions in today’s business environment that leverage web analytics data are not likely to be negatively impacted simply because we choose to substitute unique visitor data with visit information.

Coradiant started out several years ago with a single clear message – that understanding the end user experience (whether actual human beings or back-office clients) was fundamental to managing any application.  Since that time, the industry has evolved significantly, as it always does, leaving in its wake the broken remains of once-rising companies and rejected approaches.  Often, as experience and depth-of-understanding increases, initial ideas are overthrown in favor of more accurate theories that reflect lessons learned in the field.  Not so with end user experience.  Not only has this idea won through unscathed, it has seen wide adoption at every level of the performance monitoring space.  Analysts write about its importance and vendors of all sizes have integrated it into their solutions.  There is not a single first-tier or second-tier vendor of APM solutions that has not built or acquired end-user monitoring technology and added it to their solution – e.g. CA, HP, Compuware and Quest all have an end-user component in their solutions.  Companies in North America no longer doubt its value and expect to have such intelligence out-of-the-box.  Europe is trailing behind this trend but I expect that they will rapidly catch up over the next two years.

The fact that end user experience has survived indicates that it is a fundamental truth of application monitoring – if you don’t understand how your user is being impacted by your application, you cannot effectively assess whether you have an actual problem.  For example, if a primary database that has a backup goes down over a holiday weekend, should the IT manager agree to pay double overtime to have it fixed immediately?  If, in an attempt to prevent a repeat of the failure, the IT manager presents the CTO with a purchase order for a clustered set of industrial servers with fibre-channel connections, should he agree to that very expensive purchase?  These questions cannot be answered unless the impact of the problem is well understood and this impact must be expressed in terms of how it affected the end users of the business.  No other metric is nearly as important.  If few or no end users were affected, the expense of an emergency repair or a massive upgrade may not be truly justified.  The days of watching CPU, RAM and disk usage as a means of determining real impact are over.  Those metrics, although good to know and important in their own right, cannot effectively reflect the impact to the business the same way that user experience does.

The fact is that some truths never change.

Companies spend an inordinate amount of money setting up complex IT systems to manage and optimize service offerings to customers.  Often these management systems only look at a single metric, like conversions or performance. What if both could be correlated?

Imagine you are a high-traffic on-line ticket vendor for major events nationwide.  As the head of IT operations, you want to maximize conversions by ensuring that you can handle the traffic volumes generated by a major concert event or marketing push and that the response times for customer queries remain optimal. In spite of your best efforts, however, the latest concert promotion brought your site to its knees and some of your systems went down for a short period of time.  The impact of that outage on your users might be unacceptably slow response times or actual system errors in their browser.  In either case, if they risk losing out on good seats for the concert while waiting for your systems to recover, they will abandon your site in favor of a competitor that is more responsive and you will have lost that revenue. On the assumption that you could have sold 1000 tickets at $100 apiece during that outage, you could lose up to $100k of revenue, depending on the number of users affected.  That’s a lot of crumpets, as they say.

Poor response times and unreachable sites are bad for revenue. But there is also a third reason why your site traffic could be impacted that is not caused by the performance issues described above.  It may be that your site content is unappealing to the average eye or that your offerings are priced out of reach for the average consumer.  This is the typical explanation that marketing gives to conversion dips, but it is clearly not the only root cause.

This is where Coradiant Analytics In A Box can help.  Our passive capture technology combined with the included Google Urchin software collects performance and availability metrics about your site while it is tracking user behavior. This allows you to look at conversions (e.g. ticket purchases) in the context of performance and availability, thus allowing you to categorize conversion dips into those that are infrastructure related and those that are marketing and content related.  For example, your analytics data tells you that the 22% of your users bought tickets between 12-2 PM on Monday afternoon. You also see that this is about 35% less than the norm for a corresponding period.  Coradiant allows you to correlate this event with an increase in page load time or availability problems.

End-user monitoring coupled with analytics provides a powerful solution that helps to maximize customer visits and conversions.  It places those responsible for business results and for performance in the driver’s seat by providing them with the data they need to understand the real business impact of system outages, thus enabling them to provide the best possible service to their Line-of-Business managers.

I feel real sympathy for Marketing departments.  They are saddled with the enormously difficult task of profiling users in order to achieve more effective marketing efforts.  In order to do that, they must understand who the user is, what they did on the site and how they reacted to various marketing efforts.  Up to now, they have been relying on traditional Web Analytics solutions to get that data.  However, the price for that data is the insertion of page tags and tracking cookies.  Cloud-based services add on an additional price – the exporting of analytic data out to the cloud.  All of that might seem like a small price, but it is actually a true Faustian deal.

To start with, Marketing must subject itself to the busy timelines of Development, QA and IT whenever it wants to change its tagging or cookies.  Since those departments are often busy rolling out new features, Marketing often has to wait weeks or even months to get their new data.  In many cases, Marketing discovers a problem with the page tagging during the course of a campaign and are unable to roll out a fix quickly enough. In companies where this problem is recognized, the problem is reversed and Marketing is allowed to hijack the roll-out process with an emergency patch to its analytics tagging, often negatively impacting the delivery of important new features.  Both Marketing and IT would benefit if this link could be severed.

The other problem that Marketing is facing comes from Europe, where a wave of privacy regulation is forcing existing Web Analytics solutions to run for cover, leaving Marketing departments with little to help them.  Germany has passed very strict laws prohibiting the use of page tagging and tracking cookies without the user’s consent.  Moreover, shipping analytics data to a hosted service for processing is specifically forbidden.  Although privacy is often talked about in every part of the world, Europe is the first to have passed these kinds of laws about it – a trend that could easily spread outside EMEA.

The irony is that most of the data that Marketing often requires is already contained within the traffic stream before any tagging or tracking takes place – where the user is from, what browser and OS they use, which ISP they used, where they came from, where they went, what they looked at, what they bought, etc.  It’s either embedded in the HTTP protocol or as part of a web server’s natural ability to maintain a stateful application or it is directly within the request or response content.

Consequently, as announced last week, Coradiant has teamed up with Google to create our Analytics In A Box (AIB) solution.  This revolutionary new product uses Coradiant’s existing technology to passively process all user traffic to and from the web site, producing full-featured web analytics data that remains in-house.  Instead of inserting page tags or using special cookies, Marketing can define AIB rules that will extract the information directly from the traffic stream. This approach will allow Marketing to define new metrics whenever they want to – even in the middle of a campaign during peak hours.  Moreover, the solution refreshes its data every hour, providing Marketing with immediate results from any changes.  No other department has to be involved.  Moreover, the data is 100% secure and kept in-house, which means no privacy violations.

As Bogey said, “this could be the start of a beautiful friendship”.

Coradiant is holding an informative afternoon executive event in the Penthouse at Gary’s Loft in Manhattan focused on end-to-end Web application visibility.

You can register for the event here (https://www.123signup.com/event?id=jbxhq).
Presenters include:

• Dave Anderson, Principal Architect/Co-founder of Peopleclick,
• Dennis Callaghan of The 451 Group,
• Fred Dumoulin of Coradiant
• Andreas Grabner, dynaTrace software,

Gary’s Loft in Manhattan features a stunning 360 degree view of the Manhattan skyline.  Light food, beverages and hospitality will be provided by Tip Of The Tongue NYC.

Date: Thursday, November 12, 2009
Time: 4:30 PM to 6:30 PM ET

Gary’s Loft
28 West 36th Street
Penthouse
New York, New York 10018

Another traffic jam this morning. As I inched forward, I brooded over the similarity between highway design engineering and the design of Web applications.  It may look good on paper, but when the real world intervenes, all bets are off.

In the world of the Web it’s the same way. Sure the testing and pre-deployment steps are critical, but as Web applications become more complex, it’s not enough. It’s important to thoroughly test your Web applications.  But it’s even more important to “test” your Web applications after deployment to make sure that they continue to run correctly.

In the pre-deployment world there is a lot to manage; make sure that all the application logic and algorithms are sound, have users run through the UI, hunt and kill a load of bugs, load-test the application, perform integration testing to ferret out conflicts with other applications, make sure all the system components required to run the application are there and that you’re running the right version in the targeted infrastructure, and so on and so forth. It’s a daunting task. But at least then you have full control.

But after it goes live, you’ve lost some of that control. That’s the unpredictable nature of the Web.  You don’t have much say in how networks perform, or which devices may be running your application on the user side.  And Web users are fickle, with hard to predict usage patterns. Turn on your perfect application and soon you’ll get a call from your IT operations people passing on a customer complaint relating to some totally unexpected thing.  Real users always do the unexpected. You can’t always predict every scenario. Similarly, no amount of testing using traditional IT tools can possibly find all the hidden problems that can pop out in live deployment situation.  Throw in the complexity of the Web application infrastructure, and you’ll be spending a lot of time looking for hidden problems that might have nothing to do with your code.

Knowing the end-user experience is key. Organizations that run web applications have discovered that the end-user experience is the key metric for success. By understanding what is being delivered in real-time, you can prevent dissatisfaction and application abandonment.  If you serve your users well, the application is perceived as successful. If you fail in delivering the service expected by users the application is deemed a failure.

OK – so we can’t really test our highways and make dynamic changes after it’s built  – yet, but you can certainly do that with Web applications.

The key is to provide the right tools. Web Application Performance Management solves the dilemma of gaining real-time visibility into end-user performance, and providing the actionable information you need to make decisions and changes to keep everything running at the speed limit.