[200 OK]: A Port80 Software Blog

We're all 200 OK: Web, HTTP and IIS Insights
posts - 199, comments - 719, trackbacks - 95

It’s like Google for log files.

WebTrends, Urchin, ClickTracks, etc.  They “make sense” of Web transaction data so we can figure out what is going on at the Web server.  Often, though, this type of software gets in to the non-technical folks’ hands and can become a problem.  Have you ever had this conversation or heard a version of it?:

Marketing Mark:  Hey, Dan, we did not get any visitors last night on the Web site -- and everybody kept requesting this page, errors/404.html.   Is there something wrong with the site or something?

Admin Adam: I hate Mondays.  Why did I ever give you nimrods a Web analysis program?

We feel for you, Adams of the World.

What’s worse is that there is no analytics program designed for Adam, for an admin -- software that server admins love, that gets down in the sticks of real server/app data that we can derive meaning (and hopefully a solution) from.

What about a log and system analysis program for the more technically-minded out there?  Hell, if our server goes down, we at Port80 go to the actual log files themselves, not a proxy.  We check out the event log, not some watered down report.  What if there was a analysis tool out there that brought all this together and made sense?  What if it could connect the dots like a good admin could (or at least go farther down that road)?

Oh wait, somebody is already on the job with the new Splunk Server, and splunking is on the rise -- there is hope out there. 

Splunk will consume and make sense of Web server stuff: (logs, configuration files, -messages, and database transactions) and also cross-server systems analysis (any type of machine data including Web servers, application servers, email servers, databases, and network devices).  They have developed an algorithm that reconstructs what happened on a network that “dynamically discovers event relationships across diverse domains of machine data and build a searchable web of events to trace the real behavior of running systems.”  Sweet.

Have you tried it?  What do you think?  The software runs on Linux, but can be accessed currently for client reports on Firefox and Netscape on Windows (and they plan IE support soon). 

No Windows version planned for the server, so if you like it, maybe we will develop it.

: )

Best,
Port80 Software

posted on Monday, August 08, 2005 4:18 PM

Feedback

# re: It’s like Google for log files.

Yes, a Windows version of Splunk would be great!
8/8/2005 11:24 PM | oVan

# re: It’s like Google for log files.

A windows version, yes please!
8/30/2005 9:33 AM | Cumulus

# re: It’s like Google for log files.

We are waiting for a Windows Server version...
8/31/2005 2:28 AM | Marc

# re: It’s like Google for log files.

Good grief, yes, a Windows version. Can't come soon enough. Geez.
11/27/2005 5:13 PM | Scott Marquardt

# re: It’s like Google for log files.

Yes PLEASE! I've got QA people trying to open 300+MB log dumps and then complaining that "it's too hard to work with". A Windows version would save me (and them).
11/24/2006 8:43 AM | Chad

# re: It’s like Google for log files.

Puhleese.. if not they're going to make me extract the data into a database and write a Business Objects universe around it. I hate recreating the wheel.. especially when you guys have done such a good job of it.

4/24/2007 6:09 AM | NyQuist Frequency

# re: It’s like Google for log files.

thanks nice text
4/7/2008 7:36 AM | software

Post Comment

Title:  
Name:  
Url:  
Comment:  
Verify:
(Enter the word as it appears in the box above.)