Edited transcript of BriefingsDirect Analyst Insights Edition podcast, Vol. 31, on the outlook for IT in the face of the economic downturn, recorded October 10, 2008.
Listen to the podcast. Download the podcast. Find it on iTunes/iPod. Learn more. Sponsors: Active Endpoints, Hewlett-Packard.
Special offer: Download a free, supported 30-day trial of Active Endpoint's ActiveVOS at www.activevos.com/insight.
Dana Gardner: Hello, and welcome to the latest BriefingsDirect Analyst Insights Edition podcast, Volume 31. This periodic discussion and dissection of IT infrastructure related news events with a panel of industry analysts and guests comes to you with the help of our charter sponsor, Active Endpoints, makers of the ActiveVOS visual orchestration system.
I’m your host and moderator Dana Gardner, principal analyst at Interarbor Solutions, and our panel this week consists of Jim Kobielus, senior analyst of Forrester Research. Welcome, Jim.
Jim Kobielus: Hi, Dana. Hi, everybody.
Gardner: Tony Baer, senior analyst at Ovum. Welcome back, Tony.
Tony Baer: Hey, Dana, good to be here again.
Gardner: And, Dave Linthicum, independent consultant with the Linthicum Group. Is that the correct designation these days, Dave?
Dave Linthicum: That's right. Thanks guys, good to be back.
Gardner: Very good. We’re going to talk primarily today about the burning issue of the moment, and hopefully not for the next 10 years, and that's the financial situation of fairly well-defined panic. We‘re not sure why, but there’s certainly a panic at this point in the global markets, and bailouts and other attempts by governments around the world not necessarily helping, so far. We’re coming to you on October 10, 2008.
Hopefully, when you hear this in the next few weeks, things won't seem quite as dire, but we are going to take a pulse of whether this is panic or whether this is a prelude. We’re certainly not going to look at this through the full lens of the economy. We’re not economists, and people will probably think we don't know what we are talking about, but we wouldn't be alone in that category right now.
So, we will focus it on what we do know a little about, and that is the IT sector, the software business, how this will affect IT vendors, users and enterprises.
First, we've heard a couple of different takes on this whole situation. IBM just came out with some fairly encouraging results, 2 percent real top-line growth and 20 percent bottom-line growth. So IBM says, “Not so bad,” HP had similar results and Oracle as well. They’re saying that we’re seeing some bumps in the road, but certainly not a meltdown. On the other hand, companies like SAP and Dell are saying that they’re really feeling it.
For my first question, I want to take this out to Tony Baer. Is this going to be something that drops the tide on all boats in IT? If not, who are the winners and losers likely to be?
Baer: Well, I think the winners are those who are likely to be more diversified into services, services that can help companies harvest more of what they already have. I was actually doing a mental comparison before we got on the call between, for example, IBM and SAP. In other words, why has IBM reported positive results and SAP hasn't. On first blush, they are both global companies, they both have incredible penetration into the Global 2000.
So, part of it is fairly hard to explain, you have to drill down a little bit deeper into the SAP’S acquisition of Business Objects, a two-product company With maybe some exceptions on the Business Objects side, it’s not so much new sales, but essentially maintenance and upgrades to new versions In a tightening economy, putting in a new version of SAP or NetWeaver is probably a discretionary expense.
Just look at IBM, which, besides the fact that it's much more diversified, has services. The fact is that in an economic situation like this, especially where there are a lot of known unknowns, having a services business is a good way of helping clients to discover new economies. And it's also potentially a much more flexible arrangement than having to put in an upgrade of a new version of SAP software.
Gardner: What I think I hear you saying is that companies that are in the services business, and that have primarily revenue through subscription, might fare better than those who are in a product cycle, where licensing and actual product upgrade, in addition to their maintenance, might be in a situation where people will postpone those upgrades.
Baer: Absolutely!
Gardner: Where does that put Microsoft?
Baer: Good question, because they are in a transition. I just had a fairly detailed briefing with them yesterday on their Software Plus Services strategy and that's clearly where they want to go, and they do have some impressive early wins. But it's obviously still not the majority of their business. In the short-term, I think it's going to hurt their business, because clearly take-up of Vista has pretty well-flagged, especially on the corporate side.
Obviously they are trying to cultivate the Software Plus Services side, but that business is still very much in its early in its cycle. In the long run, it will be a good strategy for Microsoft, but they are so early along that it accounts for a pretty slow proportion of their revenue. In the short-term, Microsoft is more vulnerable.
Gardner: I was at a Red Hat conference earlier this week. Their model built very much on subscription and support, not on licensing the software. They give it away essentially. They felt pretty confident too that this wasn't going to be a cliff for them. So, I guess that further substantiates our trend.
Jim Kobielus, how do you see the shaping up for IT vendors? Is there going to be a dichotomy between those who have a recurring revenue model around subscriptions, versus those who have little bit more reliance on software licensing?
Kobielus: By the way, full disclosure, I have a degree in economics from way long ago and I am not going to even try to be dangerous. . . .
Gardner: Well, you might as well, because they don't see that what's going on either, right.
Linthicum: There’s an instant CNN gig out there for you, dude.
Gardner: By the way Jim, you are pretty dangerous, so go right ahead.
Kobielus: Okay, I do see in any economic downturn in the things that get cut from corporate budgets, for example, large capital expenditure (CAPEX) projects. That's going to hurt a number of IT vendors in particular niches, for example the hardware vendors, and where it's a discretionary software upgrade purchase. Those are going to feel the crunch.
Ongoing maintenance of existing systems, existing solutions that will relatively weather the storm. In other words, just to keep on keeping on.
So, the business model that open-source companies like Red Hat have established, and likewise, very mature software vendors like SAP and also Business Objects in the business intelligence (BI) space, they will do relatively okay because a large percentage of their revenue is from maintenance and support.
Those who will get hurt are those vendors who rely on new-product sales, especially new product sales that are very much hardware-centric. And where that comes in now ties in with my core focus areas, BI and data warehousing. We see in the data warehousing arena more of a focus on appliances, the hardware-software bundles that are pre-configured and so forth.
So, all the vendors in the data-warehousing space, pretty much all of them have re-geared their entire go-to-market strategy around hardware optimization of their own with turnkey solutions.
How will this economic crunch shake out the data warehousing appliance industry, really the data warehousing market? In any downturn, users, large corporate IT, look to rationalize and streamline their vendor commitments. In other words, they consolidate to a few very large, very strategic vendors. So, the big guys will get bigger and the small, pure-play data-warehousing appliance vendors will be acquired or will vanish.
Gardner: Is that the flight-to-quality kind of effect, do you think?
Kobielus: “Flight-to-quality,” explain that Dana?
Gardner: Well, you are not sure about where vendors might be and you might want to have one throat to choke, a bit more opportunity to deal with them, and that they can bargain with you because they want you long-term business. They are in a more powerful position and so quality, not unnecessarily the buy side but on the sell side, makes some sense.
Kobielus: Okay, yes, it's very much the phenomenon. They are the dynamic in play here. I think that the larger data-warehousing vendors will do relatively okay, especially those who are well-established and have a substantial amount of maintenance and support revenue themselves. I’m talking about the likes of Teradata and Oracle and IBM and a few others.
But, right now, with the data warehousing and BI vendors, every time I talk to them, I ask them, “Okay, a substantial proportion of your business is in the financial services vertical. How are you feeling? Are you seeing any softness in demand for your solutions?” And pretty much uniformly, they say, “Well, so far so good. We’re not really seeing a huge cut back in orders, or even any substantial delays in placement of orders that were expected,” but everybody is sort of bracing for the worst.
Gardner: Alright, so what I heard from you is that there is certainly a benefit of subscription, but there are also certain niches within IT that are specialized and that are hot right now, like BI and warehousing, that adds such a competitive advantage that they are probably going to continue to invest there.
Let’s look at this not necessarily just through the selling but on the buy side, those people who are in IT shops. Let's go to Dave Linthicum. You have been in the situation of specifying and buying. About 70-80 percent of these budgets are already locked into maintenance, not a lot of discretionary spending. What kind of pressure do you think they are going to feel?
Linthicum: They are going to feel a lot of pressure with anything that can be cut in the short-term. It's really going to be more that there is so much stress in there, instead of just definite cutting, just tactical pulling of expenses. They are looking to morph the way in which they consume IT. I just did a survey yesterday. I basically talked about the economic downturn and their plans to implement strategic technology into their enterprise. And everybody came back with, it's going to increase in interest but decrease in cost.
In other words, people are going to move into more efficient technologies. They are going to look at a little bit more at cloud computing and other ways to save money and start moving aggressively in those directions.
I think IT and some of the IT leadership were just waiting for an excuse to drive in this unfamiliar, risky area. If their budgets are sliced, they still have the responsibility for doing very intense IT business processing, and they are looking for new innovative ways to do that. That's inclusive of cloud computing and services-oriented architecture (SOA).
I don’t know if you looked at the SOA market just in terms of services, but it seems to be exploding right now. I’m not sure about the adoption of technology and the selling of technology. That may be an after effect, after all of these SOAs start taking more strategic positions within these enterprises. It's definitely a game changer right now. I’m not sure if it's positive or negative, but it's changing the game.
Gardner: When we look at how these organizations, these enterprises will move to, as you say risky, unproven, or just innovative new ways. What aspects of IT do you think they are going to be more willing to offload to a cloud first? Clearly, there is going to be too much risk in some areas and acceptable risk in others. Where do you think we are first going to start to see business activities and IT functional sets and applications offloaded -- just because it's so much cheaper to do it that way?
Linthicum: I think it's initially going to be the office-automation technologies, moving to more of the lighter-weight processes, and then moving to more of the heavy-weight processes.
Gardner: Can you be more specific on an application-by-application basis?
Linthicum: Yeah. Instead of having a huge Microsoft infrastructure just for e-mail and calendar-sharing in groupware, and those sorts of things, moving to things that are in the cloud. This is obviously Google, but there is also a ton of other guys that are offering some pretty good technology -- information-sharing using similar infrastructure. They’ll start outsourcing that, versus maintaining all these data centers that are just dealing with e-mail and communication between people within the company.
Gardner: Sure, there are plenty of hosted exchange too. Even if you don’t want to move from Microsoft, you can go off-premises.
Linthicum: You can go off-premises with lots of stuff and the cost is always cheaper, and also it allows you to upgrade and innovate into new technological areas you haven’t driven before.
Next, would be tactical, software-as-a-service (SaaS) applications. Take some of the HR processing, which is driven by some kind of in-house system in the data center, and outsource that to the dozen or so SaaS vendors who are offering HR processing. That's kind of a light-weight business process.
Then, the next generation is even more risky, and I don’t see a ton of guys doing that initially. It involves some of the core business processes, and getting into an SOA kind of an initiative. Re-automating those, but also outsourcing a tremendous number that haven’t been done before for the primary reason of cost saving.
Gardner: I think I’m hearing from Dave here that not only we are now going to make baby steps towards significant innovation, but the economic pressure that's going to come down on CIOs and IT departments forces them more towards that transformational level of change. So, that could include a lot more SOA, a lot more virtualization, internal on-premises cloud infrastructures, and so on.
Jim or Tony, how do you feel about the possibility that more economic pressure is actually a catalyst towards transformation rather than iterative change?
Kobielus: You mentioned my name first so I’ll respond first and I’ll be brief, so Mr. Tony can go right after me. I see definitely the economic downturn is going to expand the footprint, as it were, for the cloud in data warehousing, where data warehouses are becoming ever larger in the hundreds of terabytes and now into the petabyte.
I’m seeing an upsurge in the number of start-ups and data warehousing vendors that now have cloud based offerings. For example Vertica and Oracle now support databases that can run in the Amazon EC2. There are other vendors, like 1010data, that are very much pure plays in the fact that they only operate in the cloud and they are very highly scalable, share nothing, and parallel process.
There are, of course, SaaS-based offerings on a subscription basis. In other words, where there is a capital expenditure crunch or a budget crunch, and users can’t afford to pay the millions of dollars to bring one of these petabyte-scale data warehouses in house, they are going to go outside to the likes of a 1010data or using Amazon EC2 to aggregate, persist these huge datasets.
They can do very complex analyses and also run a greater degree of their data mining and predictive analytics algorithms in that very cloud. It just saves them money, and it's not a huge capital expenditure. It's a pay-as-you-go kind of thing. I think that's going to be the trend and those vendors who are already out there could be the major beneficiaries of this current economic crunch.
Gardner: So, that might mean if you are going to go to market, you want to have a cloud avenue for your go-to-market activities in addition to on-premises, or even say an open-source support model, right?.
Kobielus: Yes, for sure.
Gardner: Tony, what's your take on the possibility of harsh economic times as actually a catalyst towards the increased transformation?
Baer: Well, I am going to pair a couple of words that would otherwise seem like an oxymoron, which is tactical transformation. In times like these, obviously you have changing economic conditions, changing in a very unpredictable manner. On the other hand, the financial crunch and the credit crunch is going to restrict the amount of resources you have at your disposal. So, you’re basically going to look very opportunistically. You are going to look at, let's say, the low-hanging fruit that will give you the greatest gain in savings or a way to respond to the market in a more agile manner.
That will be very much in the way that Dave and Jim mentioned, which is that you will be taking advantage of specific services in the cloud. You won’t necessarily do a global top down or enterprise-architectural SOA transformation, if you haven't done SOA already. But, opportunistically, if you are trying to take advantage of some of these cloud-based services to start doing mining on a more massive scale, at the same time trying to lower your risk, it will require certain applications or data source that you may have. You may need to conduct a transformation, where you will implement, more flexible architectures, data SOA architecture.
But you will do it opportunistically in these tactical areas, where you can take advantage of services in the cloud that give you the advantages of the transformation to solve the problem you need to deal with, and at the same time, minimizing your risk.
Gardner: So, they are going to be looking for innovation without a big CAPEX, and if they can do that at the same time they are shutting down their own high-cost, high-labor applications in data centers that will be particularly attractive.
Baer: Or put it another way, “Capital, what capital?”
Gardner: Remember, not all companies are like banks. They have cash on hand, or they have ability to raise capital in a variety of different ways, rather than just going to a bank. So, we don't need to lump all these different types of enterprises into just the financial crisis problem.
Baer: Agreed. It's not to say that capital is totally shut-off, but the fact is that it's going to be rationed and a lot more carefully. I was just reading the advice that all these VCs are reading, and what they are saying is that if you have capital, find ways of stretching it.
Gardner: Save more cash, hold your cash basically. Speaking of verticals, let's look at this now through the lens of verticals, which verticals will do well and which will not.
My first take on this is that the government vertical is actually going to explode and might even start going down this road towards transformation in a much more significant way. Now, we can't read the tea leaves entirely on the economy, but politically we do start to see quite a momentum around the Democratic ticket and potentially a substantial majority for Democrats in Congress. They have put down platforms that include significant investments in such things as energy, healthcare, and of course they are going to need to transform how the government and the financial sector work together to calm the markets down.
On the other hand some, verticals that don't look good include retail and manufacturing. The auto industry is getting whacked. So, as IT spending is sliced and diced according to vertical, do we get a net-net up, down, or flat, when we look across verticals. I want to take a look at that. Dave Linthicum.
Linthicum: Yeah, it’s great living in Washington DC, let me tell you, because I think no matter where this thing goes, there is going to be full employment. The housing prices have actually crept up.
I think that you’re absolutely right. People are going to look to government to solve some of these issues and bureaucratic changes are going to be built here in different divisions, and people are going to have oversight of the financial industry.
If the Democratic administration comes in, there is going to be more civilian spending, and there is going to be probably a little shift from the spending in the Department of Defense on the military side.
So, this area is going to be explosive yet again, based on some things that are occurring and based on the government taking power in particular industries that they think they can be helpful in taking power. You can argue whether that's a good thing or a bad thing, but you are definitely going to see a lot of job shifts as things shift to that vertical.
The retail space is going to suffer tremendously. They already have very narrow razor-thin margins. I think we are going to see a lot of the larger retailers suffer and perhaps go away. I think healthcare is going to remain fairly static, and I think some of their costs maybe reduced. As they start moving into more of a socialized medicine, if the Democrats take it there, there is going to be some big shifts there.
Believe it or not, even though you are moving into a healthcare-for-everyone kind of an environment, you are going to see that actually cost probably will go up, as a bureaucracy is put in place to maintain and administer that.
Finance is obviously going to be killed for a long time, especially the banking industry. That's going to be an area that isn't going to recover very quickly from what's going on right now, but I think that manufacturing ultimately will recover and we are going to see some good growth in the year 2009-2010.
Gardner: Why do you see manufacturing as doing okay?
Linthicum: Because, the need for products worldwide is down right now, because people don't have the capital or access to the credit to make that happen. However, they are going to continue to have to replace airplanes, factory equipment, those sorts of things. It's just going to be a pent-up demand, and I think that's going to basically get unleashed in 2009-2010.
You’re going to see the large durable goods, large manufacturing kind of systems. People are going to just spend money on that area and that's going to be a worldwide driven thing. It's not going to be just driven from the United States.
Gardner: Great. Jim Kobielus, you mentioned earlier that you saw financial organizations buying data warehousing services and solutions as sort of still growing, if not at the same rate. I'd like to have your take on the financial sector alone Sure, there’s lots of turmoil, lots of contraction, but that doesn't necessarily mean you can shut off your IT systems. Mergers and acquisitions, consolidation sometimes can have a short-to-medium increase in IT requirement.
Kobielus: Right, and one of the things, Dana, that occurred to me is that the financial vertical and the government vertical are becoming overlapped. There is a degree of nationalization already that's taking place. The government is taking back Fannie Mae and Freddie Mac. I think they have taken over AIG, but all around the world, you hear governments, especially in Europe saying, “Hey, we need to re-nationalize or, to some degree, exert tighter control over the financial vertica., I think this is everywhere in the world.
What we’re already seeing is that the government vertical, as they have indicated, will continue to grow, because it's going to exercise much greater oversight and equity positions within the financial vertical. I think the early part of this decade is a prelude to what we’re going to see in even greater abundance in the next 10 years.
After the whole Enron fiasco, with Sarbanes-Oxley and so forth, we saw the growth of this market and this technology called governance, risk management, and compliance (GRC) to exert tighter control over the financials of private enterprise, and bring greater transparency.
I think we are going to see now, the government exert ever tighter GRC reigns over the financial sector, to a degree unprecedented, because we now have government actually owning or controlling a number of the key firms in that space. So, the whole GRC sector is in an embryonic stage. There are a number of vendors like SAP and Oracle who have taken sort of a leading-edge position in that area. That will expand greatly, and we are going to see more of these risk dashboards and controls being implemented in the context of BI and the data warehousing investments that enterprises have already made.
In terms of the horizontals, the GRC sector will come into its own, and it will be primarily the driver. There will be the financials, and then it will be around the world. All governments will enforce the use of this kind of technology.
Gardner: Right, and at a higher abstraction, that really means governance, and as much as internal governance it's perhaps governance from the extended enterprise sense, where there is going to be governance that crosses organizational boundaries. That's not going to be done with folks holding clipboards. That's going to be largely automated.
It’s going to have to be enforced through policies and rules and governance engines, it sounds an awful lot like SOA, but we are not going to apply the infrastructure we have developed for SOA. Just like services, we can apply it across a multitude of different business processes and activities in order to satisfy what you are talking about.
Baer: This reminds of something I heard from Microsoft this week. I was in Seattle at their BI conference, and they were talking about how Microsoft internally is using their own BI tools and stack. They described a number of roles -- like marketing, sales, and finance -- and how they use BI. Then, I asked the person, “Okay, your CEO, Steve Ballmer, obviously uses BI, but does he have a risk dashboard or a compliance dashboard or tools?”
Clearly, Microsoft is under a number of legal and regulatory mandates, compliance and so forth, and the people from Microsoft couldn’t answer that question immediately. They weren't really quite sure what's on Steve's dashboard.
In three years time, every CEO in the world will have a GRC dashboard that tells them on any given day the hoops they need to jump through to satisfy the regulators, I think that's coming fairly soon.
Gardner: Not just regulators, but the market doesn’t want to be caught unaware, as we apparently have been with this meltdown. In the future, they are going to want to know not just what they have to do to comply, but what the unknown risks are in terms of how the markets themselves are behaving.
Let's go to Tony Baer. Tony, what's your take on the opportunity for governance infrastructure to move beyond SOA, and is the new environment for business a growth area for SOA governance infrastructure?
Baer: Yeah, big time. I was talking before about these opportunistic areas. In the case of governance, I don't know if I would call it “opportunistic,” but it is an area in which you do not have an option as to whether you comply or not. Therefore, the only economic way to provide all the information and to do all the audits without having to rip apart all of your existing back-end infrastructure is through a service's layer on top of all that.
Maybe I can come up with a cheap buzzword here, a buzz-line or a tag-line, such as “Son of SOX,” for what's going to become a changing regulatory environment. You’ll need a governance layer that can contend with changes in this moving target.
Obviously, the only feasible way, from an architectural standpoint, to deal with that is do a flexible architecture, and that's essentially what a SOA is.
I very much agree with Dave and with Jim in terms of what are likely to be the growth sectors, but there are a couple of extra points I want to plug in there. This ties in with this question. The financial industry itself will not be a growth sector over the next few years, it will be very much a consolidating sector, but guess what, as you consolidate, you need to invest in consolidation.
Imagine all these huge mergers going on. Wells Fargo just finally got the agreement to acquire Wachovia, but of course there will be a some litigation from Citibank. Also, Bank of America acquired Merrill and there’s the whole reorganization of Wall Street, from investment banks into banking institutions.
The fact is, there is going to be a lot of transformation going on, and it's not transformation to support a growing business. It's transformation to support a changing business. There will be a lot of investment there, in addition to whatever investment will be necessary to deal with the new governance risks in compliance requirements.
Another area -- and I wanted to slip this in because it's nothing intuitive -- but if you look back at past history during economic downturns, and I hate to use the 'D' word but back in the depression, and I hope we are not heading into one, what area boomed during that era? Hollywood, the film industry. People were going out to the movies for cheap thrills.
In today's environment, the equivalent of that is, if you already have an Xbox 360 out there, you are going to be buying more games. Those are cheap thrills. It's going to be cheaper than going out and buying a new HDTV or going out to Six Flags.
Gardner: That's interesting. We haven't talked about one sector, and that is the Entertainment/Web 2.0/Internet. We’ve seen some downturn in advertising, including Internet advertising, but is there an opportunity for buying $3 movie and downloading it, a $2 song, a $3 game. How might our Internet /Media/Entertainment economy fare and will it be sliced and diced between those who depend on advertising and those who are not?
Baer: Very much so. The only downward pressure on this would be downward pressure on households to cut expenses and, if they consider that broadband is a discretionary expense, that would be the ceiling there. My sense though is that today to participate in the modern economy, broadband is becoming a necessity.
Gardner: Yeah, it's a utility. It’s like water, electricity. It's one of the last things that will go, right?
Gardner: My mother is 93, and I finally got her to get broadband. So we won’t give it up.
Kobielus: I have to jump in here and be dangerous one more time. I have another degree in Journalism and I was primarily a student of the mass media. If you look at the depression of the 1930s, historians and people who lived through the period talk about, what kept them company, in the dust bowl or wherever when they didn't have a job. It was the radio, which had been introduced in the previous decade.
Now, if gosh forbid, we have something similar coming up in the teens of this decade, what is the new radio? It's the Web. And so, who are the new entertainers? Well, actually in many ways it will be each other. I mean, through the whole Web 2.0 user-generated content paradigm. If you think about it, that's cheap entertainment, because it's generated for free and there is an unlimited supply of it available over some pipe that you've got coming into your home.
Gardner: I'd like to point out that this podcast is coming to you completely free. Continue.
Kobielus: And we are free to say what we want on this podcast.
Gardner: Does anybody else have some thoughts out there on the impact on Internet and startups? What's the impact with startups? We have seen this slide deck from Sequoia Capital saying “batten down the hatches, no discretionary spending, hoard your cash. Is this the VCs overreacting, because it's their pool of money that's its stake, or aare there actually opportunities beyond what they are saying in these dire predictions?
Linthicum: There are huge opportunities out there. If you saw my column I did in SOA World Magazine, I think this is a great time to do a startup.
Number one, VCs be damned at this point. You don't need their money at all, just some angel investors to invest in some very minute infrastructure. With cloud computing out there and the number of things you can do from a marketing, application developer's, and outsourcing perspective, you can basically get a technology company up and running -- and profitable -- probably for the least real cost we've seen in years. It's a great time for people who are innovative, able, and resourceful to get out there and start technology companies.
There are two types of companies out there right now. There seemed to be the big behemoths that are very slow and cumbersome and strategically challenged, even though they are making a lot of money and grabbing a large share of the market. Then, there are the old maids and basically a lot of small startups that just haven't been able to get acquired to do their exits.
Now is a great time for small innovative new startups to get out there and help create new spaces, such as Web 2.0, and I think there are a number of SOA problems that needs solving as well. I'd love to see some startups get out there and take those problems on.
Gardner: So, unintended consequence of the VCs contracting might be laying off a bunch of engineers and entrepreneurs. They'll go out there and say, “Okay, what am I going to do, sit in my garage and cry or am I going to look for platform-as-a-service (PaaS) providers and cloud providers that will allow me to develop a whole new set of applications on the cheap that I could put on my credit card. Then, I only pay for infrastructure as I need it and as I can create a business model?
Linthicum: Yeah, one of the things I would love to see come out of this whole mess that we are in right now is some of the Sarbanes-Oxley stuff contracting a bit. Quite frankly, a lot of the startups out there are unable to do any kind of exit other than acquisitions. You have no chance to take anything public. It's economically not viable for you to do so, because of the cost of maintaining the regulations around the whole publicly traded company opportunity.
I would love to see the government reopen that market a bit and make it much easier for startups that are profitable, that have a good track record and good technology to get access to the public marketplaces. Right now, they have to keep going back to the venture capital community. In many instances, those guys are strategically challenged. They are not focused on a particular industry, they are basically just focused on investment. That's going to be difficult to going forward.
Gardner: So in the ‘30s, we had the Works Progress Administration (WPA), which got people out there with shovels -- and my grandfather was one of them -- moving stuff around in the city in order to create works. Perhaps with an Internet Public Assistance Program, we can let the government be the seed and even steer them towards solutions of the government’s needs.
Now, the government wants to hire investment bankers to solve the problem that investment bankers created, but perhaps there is an opportunity for technologists to be brought in to solve some of these problems too.
Linthicum: Absolutely. What if a couple of the billions of dollars we are pumping back into the banks just went off to assist organizations and start-up companies around the technology space. I think there would be a huge boom in the area, and it would create jobs and be profitable fairly quickly.
I think some of them would probably go away, but overall, I think that it would have a positive effect on the economy. If you think about 1999, we were doing so well, because of the innovations around the Internet technology and other things that were booming. I think we are able to do that again, but we are just putting so many regulations, so much bureaucracy out there, that it makes it very difficult for the upstarts to get going.
Gardner: One little subset on this media discussion would be the press. Jim Kobielus, press has been under a tremendous amount of pressure lately. How are folks like Sam Zell going to fare on their traditional media, as advertising dries up, going to the Internet, seeing appreciable advertising business uptake there. It seems to me they are in the dead-end situation.
Kobielus: There is an ongoing crunch in the whole media sector that continues to ripple and ripple. It forces people out of being full-time journalists. So, it's not a happy thing. There was a Doonesbury cartoon recently in which Rick Redfern had been forcibly retired from the Washington Post. He was told, “Go and be a blogger!” He said, “Yeah, I will be one of a trillion bloggers out there.” “Well, you have a special differentiation. You are ex-Washington Post.”
Everybody is going to be from the journalism space, and even publishers are going to be “ex-journalists.” They have to find some next stage in their career, and I think a lot of smart people are going to become, as Dave indicates, entrepreneurs, but who will be self-funded from whatever remaining savings they have. It's not going to be a happy thing until the credit crunch eases.
Gardner: We only have a few more minutes. Let's look at some other potentially unintended consequences of all this.
If technology company stocks plummet some more, we might see some interesting things there. Somebody floated the idea that Sun Microsystems might just take its cash and buy itself out when its stock is trading at $5 -- and that was a stock that had a reverse four-way split. So it's down like a buck and change from what it was a few years ago.
Also RIM, still a strong company, a potentially for a takeover, is looking back to the buy side. What sort of interesting unintended consequences might we see among the vendors. Any thoughts?
Kobielus: I have no thoughts. Guys?
Linthicum: Just from your first point, I think you’re going to see some guys who are going to buy themselves off from the market for now, and I can't blame them.
If I were CEO of a publicly traded company, and my stock price was below my market capital, with cash in the bank -- where some of them are -- I’d get off the market quick, because it's a good deal.
Gardner: Absolutely.
Kobielus: I think we've talked in a previous podcast about the upsurge of private investing, of companies going private. I think the difference this time will be that if companies are going to go private, they are going to have to basically bootstrap it. They are not to be able to get a Silver Lake or anybody like that in the short-term.
Gardner: So a takeaway might be, if you can ride this out for two or three years, there is a buying opportunity, even buying yourself.
Kobielus: Right, if you get cheap enough. The other dividend of all that is once you go private, of course, you don't have to worry about all the GRC.
Gardner: One other subject that we haven't talked about is the analysis business. Is this an opportunity for people that need to know more about what's going on, and are folks like us going to be okay? Any thoughts?
Baer: Folks like us. Yeah. I think everybody is becoming an analyst. There is a whole blogosphere. Everybody in the blogosphere, to some degree, is an analyst. So, we’re going to be okay in the sense that we can still do analysis to our hearts delight for free, if we so choose.
In terms making a living on it, I think more-and-more analysts need to be half analyst, half consultant, doing projects for those who will pay us to actually show up and attend to only their needs and help them out with projects and also to make sense of what's going on in the space.
In any good time or bad time, analysts are essentially like reporters or journalists. We not only are in the industry, but we are in a sense above the industry, surveying what's going on and reporting to everybody else what we can see in terms of broad patterns and trends.
So I think there is a greater requirement on analyst to come in and offer reassurances or to tell people, “Okay, this strategy that you have been taking is not going to pan out. You better jump ship and try something different.”
Gardner: So changes are growth engines.
Kobielus: Yeah, and from that standpoint, it basically supplements the fact that there is going to be a decline in the journalist population, essentially a migration towards the extremes, which is on one hand journalism and this is not a development.
I’m very happy to see is that, as the financial base and the business model for journalism businesses is evaporating at this point, you are seeing more-and-more citizen journalists taking up more of the load. People are reading more blogs. They are not buying newspapers.
On the other end, it will create an appetite, and it will create a demand for people who are above the level of citizen blogger to say, “I have some professional credentials, and I can provide you some value-added analysis on your positions, so that you can essentially improve the competitiveness of your business.”
Gardner: Traditional and trade media will contract, which opens up a vacuum that can be filled by the expert-blogger function.
Kobielus: Right, expert blogger, but also the fact is that you get what you pay for. If you are a business and you are trying to improve your chance of surviving the market, you are going to work with key experts, key thought leaders out there, and you will pay for that.
It's not to say this is an infinite market for analysts. The business model for analyst firms is going through some stresses. Especially when you take a look at blogging. A lot of analyst firms have really not adapted to the blogosphere very well, or the more rapid flow of information.
So, even though I think they will continue to be a need for analysis and for paid analysis. The analyst industry or the analyst-firm industry needs to adapt to the new world of faster more instantaneous communications.
Gardner: Well, great. We've had a well-rounded discussion about the situation. We found some bright spots and some counter-cyclical possible growth areas within this sad situation we find ourselves in. But, as we exit I want to go around the panel and on a 1-to-10 scale, with 10 being flush, financial nirvana, and 1 being a dead-pool bankruptcy, where on a scale of 1 to 10 at a median level will the software business be in a year from now, let's start with you, Jim Kobielus.
Kobielus: I give it 5, straight down in the middle. I am trying not to lean towards either the manic or the depressive ends of the spectrum here. I think that some will do quite well and some will not. It's just a matter of taking a deep breath and recognizing that the economy goes through cycles, and the economy occasionally goes through panics -- the banking panics of the early 1900s and the late 1800s. We are sort of in the middle of one right now, which is an interesting phenomenon. I say interesting in the old Chinese sense of may you live through interesting times.
This has been a harsh decade. We started off with a tech-crunch and we are going to end with a tech-crunch, and a financial crunch, and it's going to take some time to sort it through, so just breathe easy.
Gardner: Tony Baer, 1 to 10, software industry.
Baer: Well, I'll give it 4, only because there are different headwinds on this go around. On the positive side, as Dave was mentioning before, the fact is that the barriers to entry are so much lower. So, if you can take advantage of the cloud, you can start in your own garage, and essentially marshal resources for very little cost. Basically, if you can sustain yourself and live close to the ground for the next two or three years, you and many others who are taking advantage of platform-as-a-service will have a whole new generation of solutions that will be ready for the next uptake.
Gardner: Dave Linthicum.
Linthicum: I am going to say 7.5. There are huge opportunities for the innovative and resourceful few out there in the market space. I think that technology shift, moving to higher regulations, you’ve got this “mother of all Sarbanes-Oxley” coming. Everybody is going to need folks in there to re-architect and re-automate and re-cast these businesses.
Then I think if there is going to be some upside in the future. Every cloud has a silver lining and those who are smart out there can certainly find the silver linings in this cloud. I think IT is going to stumble a bit, but a lot of more innovation is going to come into play, and people are going to use the cost-reduction capabilities, become a little bit more modernized and innovative in moving to cloud computing and SOA. All that stuff is going to accelerate tremendously in the next couple of years.
Gardner: I am going to go with 6.5. I agree that this is a transformation period, not just a contraction. I think this is going to necessitate a lot of the things that people have been working towards, but accelerate that, and force them to cut bait on the old stuff that doesn't work and adopt the new stuff that does. So, I’ m fairly bullish on IT, but with a lot of spottiness. There are going to be some pockets of certain failure and the ability in people to move among and between those is what's going to become essential.
I want to thank our panel for a very interesting discussion about the IT sector in this economic maelstrom.
We have been talking with Jim Kobielus, senior analyst of Forrester Research. Thanks, Jim.
Kobielus: Thank you. It was great!
Gardner: Tony Baer, senior analyst at Ovum. Thank you, sir.
Baer: Hey, thanks, Dana!
Gardner: Dave Linthicum, independent consultant with Linthicum Group. Thank you.
Linthicum: Thank you!
Gardner: I also want to thank our sponsor, the charter sponsor for the BriefingsDirect Analyst Insights Edition is Active Endpoints, makers of the ActiveVOS visual orchestration system. I am Dana Gardner, principal analyst at Interarbor Solutions. Thanks for listening, and come back next time.
Listen to the podcast. Download the podcast. Find it on iTunes/iPod. Learn more. Sponsors: Active Endpoints, Hewlett-Packard.
Special offer: Download a free, supported 30-day trial of Active Endpoint's ActiveVOS at www.activevos.com/insight.
Transcript of BriefingsDirect podcast on the outlook for IT in the face of the economic downturn. Copyright Interarbor Solutions, LLC, 2005-2008. All rights reserved.
Showing posts with label Sun Microsystems. Show all posts
Showing posts with label Sun Microsystems. Show all posts
Friday, October 17, 2008
Tuesday, February 06, 2007
Transcript of BriefingsDirect Podcast on Music Search Technology and Implications
Edited transcript of BriefingsDirect[TM] B2B informational podcast on music search with Sun Labs, recorded Jan. 10, 2007.
Listen to the podcast here.
If you'd like to learn more about BriefingsDirect B2B informational podcasts, or to become a sponsor of this or other B2B podcasts, contact Dana Gardner at 603-528-2435.
Dana Gardner: Hi, this is Dana Gardner, principal analyst at Interarbor Solutions, and you're listening to BriefingsDirect. Today, a discussion with Paul Lamere, a staff engineer at Sun Microsystems Labs and principal investigator for Search Inside the Music.
This interesting research project is taking search to quite a new level. Instead of using lists of data about the music author, album, or composer, Search Inside the Music actually digs into the characteristics of the music, finding patterns, and then associating that with other music.
The possibilities here are pretty impressive. I want to thank Paul Lamere for joining us. Welcome to the show, Paul.
Paul Lamere: Hi, Dana. Thanks for having me.
Gardner: I had the opportunity to see your presentation face-to-face when I visited the Sun Labs’ campus in Burlington, Mass., back in December, 2006, and it really had me thinking for a few days after. I kept coming back to it and thinking, “Wow! What about this and what about that?” I thought it would be good to bring this to a wider audience and to use the medium of audio, seeing as it is so germane to this project.
Let’s get a little historical context. Tell us how you got involved with this project, why music, and how does that relate to IT in general?
Lamere: Okay, as you know, I work in Sun’s research lab, and our role as researchers is to be the eyes and ears for Sun. We’re trying to look out on the distant horizon for Sun to keep an eye on the interesting things that are happening in the world of computers. Clearly music has been something that's been greatly changed by computers since Napster and iTunes.
So I started to look at what's going on in the music space, especially around music discovery. The thing that I thought was really interesting is looking at Chris Anderson’s book and website, The Long Tail. You know, music is sort of the sweet spot for the long tail; the audio is a nice conveniently sized packet, and people want them. What we’re seeing right now is the major labels putting out 1,000 songs a week. If you start to include some of the independent labels and the music that's happening out on MySpace and that sort of thing, you may start to see more like 10,000 songs a week.
Chris Anderson said, “The key to The Long Tail is just to make everything available.” Now imagine not just every indie artist, but every kid with a drum machine in their basement and a PC putting on their tracks, and every recording of every performance of "Louie Louie" on the Web, and that same thing happening all over the world and sticking that on the Web. Now we may start having millions of songs arriving on the Web every week.
Gardner: Not to mention the past 800 or 1,000 years’ worth of music that has been recorded in the last 50 or 100 years.
Lamere: That’s right. So, we have many orders of magnitude, more music to sift through and 99.9 percent of that music is something you would never ever want to listen to. However, there is probably some music in there that is our favorite songs if we could just find them.
I’m really interested in trying to figure out how to get through this slush pile to find the gems that are in there. Folks like Amazon have traditionally used collaborate filtering to work through content. I’m sure you’re familiar with Amazon’s “customers who bought this book also bought this book,” and that works well if you have lots of people who are interested in the content. You can take advantage of the Wisdom of Crowds. However, when you have…
Gardner: They are working on the "short head," but not the long tail.
Lamere: That’s right. When you have millions of songs out there, some that people just haven’t listened to, you have no basis for recommending music. So, you end up with this feedback where, because nobody’s listening to the music, it’s never going to be recommended -- and because it’s never recommended, people won’t be listening to the music. And so there is no real entry-point for these new bands. You end up once again with the short head, where you have U2 and The Beatles who are very, very popular and are recommended all the time because everyone is listening to them. But there is no entry point for that garage band.
Gardner: Yes. When I use Amazon or Netflix and they try to match me up, they tell me things I already know; they haven't told me things that I don’t know.
Lamere: That’s right. Did you really need to know that if you liked The Beatles, you might like The Rolling Stones? So, we’re taking a look at some alternative ways to help weed through this huge amount of music. One of the things that we’re looking at is the idea of doing content-based recommendation. Instead of relying on just the Wisdom of Crowds -- actually rely on the audio content.
We use some techniques very similar to what a speech recognizer does. It will take the audio and will run signal processing algorithms over it and try to extract out some key features that describe the music. We then use some machine-learning techniques basically to teach this system how to recognize music that is both similar and dissimilar. So at the end, we have a music similarity model and this is the neat part. We can then use this music similarity model to recommend music that sounds similar to music that you already like.
Gardner: Yes, this is fascinating to me because you can scan or analyze music digitally and come out and say, this is blues, this is delta blues; this is jazz, this is New Orleans jazz. I mean, it’s amazing how discreet you can get on the type of music.
Lamere: Yes, that’s right, and the key is that you can do this with any kind of music without having any metadata at all. So, you can be given raw audio and you can either classify it into rather rich sets of genres or just say, "Hey, this sounds similar to that Green Day song that you’ve been listening to, so you might like to listen to this, too."
Gardner: Fascinating. So once we’re able to get characteristics and label and categorize music, we can scan all sorts of music and help people find what is similar to what they want. Perhaps they’re experimenting and might listen to something and think, “I wonder if I am interested in that,” and do all kinds of neat things. So, explain the next step.
Lamere: Well, there are lots of ways to go. One of the things that we can do with this similarity model is to provide different ways of exploring their music collections. If you look through current music interfaces, they look like spreadsheets. You have lists of albums, tracks, and artists and you can scroll through them much like you would through Lotus 1-2-3 or whatever spreadsheet you are using.
It should be fun; it should be interesting. When people look for music, they want to be engaged in the music. Our similarity model gives people new and different ways of interacting with their music collections.
We can now take our music collection and essentially toss it into a three-dimensional space based on music similarity, and give the listener a visualization of the space and actually let them fly through their collection. The songs are clustered based on what they sound like. So you may see one little cluster of music that’s your punk and at the other end of the space, trying to be as far away from the punk music, might be your Mozart.
Using this kind of visualization gives you a way of doing interesting things like exploring for one thing, or seeing your favorite songs or some songs that you forgot about. You can make regular playlists or you can make playlists that have trajectories. If you want to listen to high-energy music while driving home from work, you can play music in the high-energy, edgy space part of your music space. If you like to be mellowed out by the time you get home, you have a playlist that takes you gradually from hard-driving music to relaxing and mellow music by the time you pull into the driveway.
Gardner: Now, for those who are listening, I’m going to provide some links so you see some of these visualizations. It’s fascinating because it does look like some of these Hubble Telescope cosmos-wide diagrams where you see clusters of galaxies, and then you’re shown the same sort of visualization with clusters of types of music and how they relate.
If we take the scale in the other direction -- down into our brains and with what we know now about brain mapping and where activities take place and how brain cells actually create connections across different parts of the brain -- there is probably a physical mapping within our brains about the music that we like. We’re almost capturing that and then using that as a tool to further our enjoyment of music.
Lamere: That’s an interesting idea.
Gardner: Now, I’m looking here on my PC at my iTunes while we’re talking and I’ve got 4,690 items, 15 days of music, and 26.71GB. And it turns out -- even when I use shuffle and I’ve got my playlists and I’ve dug into this -- I’m probably only listening to about 20 percent or 30 percent of my music. What’s up with that?
Lamere: Yes, exactly. We did a study on that. We looked at 5,000 users and saw that the 80-20 rule really applies to people’s music collections: 80 percent of their listening time is really concentrated in about 20 percent of their music. In fact, we found that these 5,000 users had about 25 million songs on their iPods and we found that 63 percent of the songs had not been listened to even once. So, you can think of your iPod as the place that your music goes to die, because once it’s there, the chances are you will never listen to it again.
Gardner: I don’t want it to be like that. So, clearly we can use some better richer tools. Is that right?
Lamere: That’s right. Shuffle play is great if you have only a few hundred songs that you can pick and put on there, but your iPod is a lot like mine. It has 5,000 songs and it also has my 11-year-old daughter’s high-school musical and DisneyMania tracks. I have Christmas music and some tracks I really don’t want to listen to.
When I hit shuffle play, sometimes those come up. Also with shuffle play, you end up going from something like Mozart to Rammstein. I call that the iPod whiplash. A system that understands a little bit about the content of the music can certainly help you generate playlists that are easier to listen to and also help you explore your music collection.
So you can imagine instead of hitting shuffle play or just playing the same albums over again, you could have a button on your iPod, or your music player, that lets you play music you like. That’s something that is really needed out there.
Gardner: So, instead of a playlist, you could have a "moodlist." For example, I’m stressed and I need to relax, or I really want to get pumped up because I’m going to a party and I want to feel high-energy, or I have the kids in the back seat and I want them to relax. Your mood can, in a sense, dictate how you assemble a playlist.
Lamere: That’s right. Imagine that a few years from now, (it’s not hard to extrapolate with the new iPhone), we’re going to have wireless iPods that are probably connected to a cloud of millions of tracks. It’s not hard to imagine all of the world’s music will be available on your hand-held audio player in a few years. Try using shuffle play when you have 500 million songs at your disposal; you’ll never find anything.
Gardner: I don’t have the benefit of a DJ to pick out what I want either, so I’m sort of stuck. I’m not in the old top 40 days, but I’m in the 40 million tracks days.
Lamere: That’s right.
Gardner: Now let’s look at some practical and commercial uses. Professional playlists assemblers who are creating what goes into these channels that we get through satellite, cable probably could use this to advantage. However, that doesn’t strike me as the biggest market. Have you thought about the market opportunity? Would people be willing to pay another five dollars a month to add it to their service so they have all their music readily accessible? How do you foresee it commercializing?
Lamere: I’m sure you’ve heard of Netflix. They are probably one of the biggest DVD shippers and one of their biggest advantages is their recommendation engine. I’m not sure if you’ve heard about the Netflix contest. Any researcher who can improve their recommendation by just 10 percent will receive $1 million from Netflix. I think that really represents how valuable good recommendations are to companies trying to deliver Long Tail content.
Amazon has built their business around helping connect people with their content as well. The same things are going to happen (or are happening now) within the music world. There is a lot of value hooking up to people with music; getting them into the Long Tail.
Gardner: Can we easily transfer this into a full multi-media experience -- video and audio? Have you tried to use this with tracks from a movie or a television show? Is there an option to take just from the audio alone; a characteristic map that people could say, "I like this TV show, now give me ones that are like it?" Is that too far-fetched? How do we go to full multi-media search with this?
Lamere: Those are all really interesting research questions. We haven't got that far yet. There are so many interesting spaces to bring this -- for instance, digital games. People are interacting with characters, monsters, and things like that. Currently, they may be in the same situation 50 times because they keep playing the game over and over again.
Wouldn’t it be nice to hook up to music that matches the mood and knows changes or may even push the latest songs that match the mood into the games, so that instead of listening to the same song, you get new music that does not detract from the game? There are all sorts of really interesting things that could happen there.
Gardner: I saw you demonstrating a 3D map in real time that was shifting as music was going in and out of the library as different songs were playing. It was dynamic; it was visual; there were little icons that represented the cover art from the albums floating around. It was very impressive. Now, that doesn’t happen with a small amount of computer power. Is this a service that could be delivered with the required amount of back-end computational power?
Lamere: Yes. We can take advantage of all of the nifty gaming hardware out there to give us the whiz bang with the 3D visualizations. The real interesting stuff, the signal processing and the machine learning when dealing with millions of songs, is going to use vast computer resources.
If you think music is driving a lot of bandwidth now in storage and computation, in a few years when people start really gravitating toward this content-based analysis, music will be driving lots and lots of CPU cycles. A small company with this new way of content-based recommendation can rent time on a grid at a per-CPU hour rate and get an iTunes-sized music collection (a few million songs) in a weekend as opposed to the five or 10 years it would take on a couple of desktop systems.
Gardner: Interesting. The technology that you’ve applied to music began with speech. Is there a way of moving this back over to speech? We do have quite a bit of metadata and straight text and traditional search capabilities. What if we create an overlay of intonation, emphasis, and some of the audio cues that we get in language that don’t show up in the written presentation or in what is searchable? Does that add another level of capability or "color" to how we manage the spoken word and/or the written word? With my podcasting, for example, I start with audio -- but I go to text, and then try to enjoy the benefits of both.
Lamere: Right. These are all great research questions; the things that researchers could spend years on in the lab. I think one interesting application would be tied to meetings; work meetings, conference meetings, just like when you visited Sun last month.
If we had a computer that was listening to the meeting and maybe trying to do some transcripts, but also noting some of the audio events in the meeting such as when everybody laughed or when things got really quiet. You could start to use that as keys for searching content in the meetings. So, you could go back to a recording of the meeting and find the introductions again very easily so you can remember who was at the meeting or find that summary slide and the spoken words that went with the conclusion of the talk.
Gardner: Almost like a focus group ability from just some of these audio cues.
Lamere: That’s right.
Gardner: Hey, I’ve got something that you could take to the airlines. I tend to sit on planes for long periods of time and after my battery runs out, I am stuck listening to what the airline audio provides through those little air tubes. Wouldn’t it be nice if there were audio selections that were rich and they really fit my mood. This is a perfect commercialization.
Lamere: Yes, you can have your favorite music as part of your travel profile.
Gardner: This could also work with automakers. Now that everyone has found a way to hook up to their iPods or their MP3 equivalent in their automobile, the automakers can give you what you want off of the satellite feed.
Lamere: Definitely.
Gardner: There are many different directions to take this. Obviously you’ve got some interest in promoting Sun’s strategic direction. There must be some other licensing opportunities for something like this. Is this patented or are you approaching it from an intellectual property standpoint? If our listeners have some ideas that we haven’t thought of, what should they do?
Lamere: When you’re in the labs, the people who run the lab really like to make sure that the researchers are not tempted by other people’s ideas because it can make it difficult down the road. If people have some ideas they want to send my way, it’s always great to hear more things. We do have some patents around the space. We generally don’t try to exploit the patents to charge people entry into a particular space.
Gardner: Since this does fall under the category of search, there are some big companies out there that are interested in that technology. We have a lot of Google beta projects, for example, such as Google News, Google Blogs, Google Podcasts, and Google base. Why not Google Music?
Lamere: Google has two -- I guess, you may call them Friday projects -- on their labs site around music. One is Google Trends, and the idea there is they’re trying to track which music is popular. If you use Google’s instant messenger, you can download a plug-in that will also track your listening behavior. So every time you play a song, it sends the name of the artist and the track to Google and they keep track of that. They give you charts of top 100 music, top 100 artists, whatever. The other thing they have is a Music Search tailored toward music.
If you type in Coldplay or The Beatles, you’ll get a search result that’s oriented toward music. You’ll see links of the artist page and links to lyrics but, interestingly enough, they haven't done anything in public to my knowledge about indexing music itself. This is interesting because Google has never been shy about indexing.
Its mission is to index all the world’s information, and certainly music falls into that category. They haven't been shy about going up against publishers when it comes to their library project, where they’re scanning all the books in all the libraries despite some of the objections of the book publishers. But for some reason they don’t want to do the same with music. So, it’s an open question. But probably they’ll be announcing the Google Music Search tomorrow.
Gardner: At least we can safely say we’re in the infancy of music search, right?
Lamere: That’s right. I see a lot of companies trying to get into the space. Most of them are trying to use the collaborate filtering models. The collaborate filtering models really require lots of data about lots of users. So they have a hard time attracting users because until they get a lot of users, their recommendations are not that good. And because their recommendations are not that good, they don’t get a lot of users.
Gardner: The classic chicken-and-egg dilemma.
Lamere: Yes, it’s called the "cold start" problem.
Gardner: I firmly believe in the "medium is the message"-effect, and not just for viewing news or getting information. When I was getting my music through the AM radio, that characterized a certain way that I listened and enjoyed music. I had to be in a car, or I had to be close to a radio, and then I might avoid sitting under a bridge.
Then I had my LPs and my eight tracks and they changed from one song into an album format for me. We’re going back a number of years here. I’ve been quite fond of my iPod and iTunes for the last several years and that has also changed the way I relate to music. Now, you have had the chance to enjoy your Search Inside the Music benefit. How has using this changed the way you relate to and use music?
Lamere: That’s a good question. I agree that the media is the message, and that really affects our way of dealing with music. As we switch over to MP3s, I think listening to music has shifted from the living room to the computer. People are now jogging with their iPod and listening experiences are much more casual.
They may have access to 10,000 tracks. They’re not listening to the same track over and over like we used to. So I think over time music is going to shift back from the computer to the living room, back to the living spaces in our house and away from the computer.
I try to use our system away from the computer -- just because I like to listen to music when I’m living, not just when I’m working. So I can use something like Search Inside the Music to generate interesting playlists that I don’t have to think about.
Instead of just putting the shuffle play on The Beatles, I can start from where I was yesterday, and since we were eating dinner, let’s circle around this area of string quartets and then when we’re done, we will ramp it up to some new indie music. You still have the surprise that you get with shuffle, which is really nice, but you also have some kind of arc to the listening.
Gardner: So you are really creating a musical journey across different moods, sensibilities, and genres. You can chart that beyond one or two songs or a half-dozen songs into a full-day playlist.
Lamere: That’s right.
Gardner: Very interesting. Well, thanks for joining us, Paul. We’ve been talking with Paul Lamere, a researcher and staff engineer at the Sun Microsystems Research Labs in Burlington, Mass. We’ve been discussing Search Inside the Music, a capability that he’s been investigating. A lot of thoughts and possibilities came from this. Paul is the principal investigator. I wish you well on the project.
Lamere: Thanks, Dana. It’s been great talking to you.
Gardner: This is Dana Gardner, principal analyst at Interarbor Solutions. You’ve been listening to BriefingsDirect. Come back next time.
If any of our listeners are interested in learning more about BriefingsDirect B2B informational podcasts or to become a sponsor of this or other B2B podcasts, please fill free to contact Dana Gardner at 603-528-2435.
Listen to the podcast here.
Transcript of BriefingsDirect podcast on music search with Sun Labs. Copyright Interarbor Solutions, LLC, 2005-2007. All rights reserved.
Listen to the podcast here.
If you'd like to learn more about BriefingsDirect B2B informational podcasts, or to become a sponsor of this or other B2B podcasts, contact Dana Gardner at 603-528-2435.
Dana Gardner: Hi, this is Dana Gardner, principal analyst at Interarbor Solutions, and you're listening to BriefingsDirect. Today, a discussion with Paul Lamere, a staff engineer at Sun Microsystems Labs and principal investigator for Search Inside the Music.
This interesting research project is taking search to quite a new level. Instead of using lists of data about the music author, album, or composer, Search Inside the Music actually digs into the characteristics of the music, finding patterns, and then associating that with other music.
The possibilities here are pretty impressive. I want to thank Paul Lamere for joining us. Welcome to the show, Paul.
Paul Lamere: Hi, Dana. Thanks for having me.
Gardner: I had the opportunity to see your presentation face-to-face when I visited the Sun Labs’ campus in Burlington, Mass., back in December, 2006, and it really had me thinking for a few days after. I kept coming back to it and thinking, “Wow! What about this and what about that?” I thought it would be good to bring this to a wider audience and to use the medium of audio, seeing as it is so germane to this project.
Let’s get a little historical context. Tell us how you got involved with this project, why music, and how does that relate to IT in general?
Lamere: Okay, as you know, I work in Sun’s research lab, and our role as researchers is to be the eyes and ears for Sun. We’re trying to look out on the distant horizon for Sun to keep an eye on the interesting things that are happening in the world of computers. Clearly music has been something that's been greatly changed by computers since Napster and iTunes.
So I started to look at what's going on in the music space, especially around music discovery. The thing that I thought was really interesting is looking at Chris Anderson’s book and website, The Long Tail. You know, music is sort of the sweet spot for the long tail; the audio is a nice conveniently sized packet, and people want them. What we’re seeing right now is the major labels putting out 1,000 songs a week. If you start to include some of the independent labels and the music that's happening out on MySpace and that sort of thing, you may start to see more like 10,000 songs a week.
Chris Anderson said, “The key to The Long Tail is just to make everything available.” Now imagine not just every indie artist, but every kid with a drum machine in their basement and a PC putting on their tracks, and every recording of every performance of "Louie Louie" on the Web, and that same thing happening all over the world and sticking that on the Web. Now we may start having millions of songs arriving on the Web every week.
Gardner: Not to mention the past 800 or 1,000 years’ worth of music that has been recorded in the last 50 or 100 years.
Lamere: That’s right. So, we have many orders of magnitude, more music to sift through and 99.9 percent of that music is something you would never ever want to listen to. However, there is probably some music in there that is our favorite songs if we could just find them.
I’m really interested in trying to figure out how to get through this slush pile to find the gems that are in there. Folks like Amazon have traditionally used collaborate filtering to work through content. I’m sure you’re familiar with Amazon’s “customers who bought this book also bought this book,” and that works well if you have lots of people who are interested in the content. You can take advantage of the Wisdom of Crowds. However, when you have…
Gardner: They are working on the "short head," but not the long tail.
Lamere: That’s right. When you have millions of songs out there, some that people just haven’t listened to, you have no basis for recommending music. So, you end up with this feedback where, because nobody’s listening to the music, it’s never going to be recommended -- and because it’s never recommended, people won’t be listening to the music. And so there is no real entry-point for these new bands. You end up once again with the short head, where you have U2 and The Beatles who are very, very popular and are recommended all the time because everyone is listening to them. But there is no entry point for that garage band.
Gardner: Yes. When I use Amazon or Netflix and they try to match me up, they tell me things I already know; they haven't told me things that I don’t know.
Lamere: That’s right. Did you really need to know that if you liked The Beatles, you might like The Rolling Stones? So, we’re taking a look at some alternative ways to help weed through this huge amount of music. One of the things that we’re looking at is the idea of doing content-based recommendation. Instead of relying on just the Wisdom of Crowds -- actually rely on the audio content.
We use some techniques very similar to what a speech recognizer does. It will take the audio and will run signal processing algorithms over it and try to extract out some key features that describe the music. We then use some machine-learning techniques basically to teach this system how to recognize music that is both similar and dissimilar. So at the end, we have a music similarity model and this is the neat part. We can then use this music similarity model to recommend music that sounds similar to music that you already like.
Gardner: Yes, this is fascinating to me because you can scan or analyze music digitally and come out and say, this is blues, this is delta blues; this is jazz, this is New Orleans jazz. I mean, it’s amazing how discreet you can get on the type of music.
Lamere: Yes, that’s right, and the key is that you can do this with any kind of music without having any metadata at all. So, you can be given raw audio and you can either classify it into rather rich sets of genres or just say, "Hey, this sounds similar to that Green Day song that you’ve been listening to, so you might like to listen to this, too."
Gardner: Fascinating. So once we’re able to get characteristics and label and categorize music, we can scan all sorts of music and help people find what is similar to what they want. Perhaps they’re experimenting and might listen to something and think, “I wonder if I am interested in that,” and do all kinds of neat things. So, explain the next step.
Lamere: Well, there are lots of ways to go. One of the things that we can do with this similarity model is to provide different ways of exploring their music collections. If you look through current music interfaces, they look like spreadsheets. You have lists of albums, tracks, and artists and you can scroll through them much like you would through Lotus 1-2-3 or whatever spreadsheet you are using.
It should be fun; it should be interesting. When people look for music, they want to be engaged in the music. Our similarity model gives people new and different ways of interacting with their music collections.
We can now take our music collection and essentially toss it into a three-dimensional space based on music similarity, and give the listener a visualization of the space and actually let them fly through their collection. The songs are clustered based on what they sound like. So you may see one little cluster of music that’s your punk and at the other end of the space, trying to be as far away from the punk music, might be your Mozart.
Using this kind of visualization gives you a way of doing interesting things like exploring for one thing, or seeing your favorite songs or some songs that you forgot about. You can make regular playlists or you can make playlists that have trajectories. If you want to listen to high-energy music while driving home from work, you can play music in the high-energy, edgy space part of your music space. If you like to be mellowed out by the time you get home, you have a playlist that takes you gradually from hard-driving music to relaxing and mellow music by the time you pull into the driveway.
Gardner: Now, for those who are listening, I’m going to provide some links so you see some of these visualizations. It’s fascinating because it does look like some of these Hubble Telescope cosmos-wide diagrams where you see clusters of galaxies, and then you’re shown the same sort of visualization with clusters of types of music and how they relate.
If we take the scale in the other direction -- down into our brains and with what we know now about brain mapping and where activities take place and how brain cells actually create connections across different parts of the brain -- there is probably a physical mapping within our brains about the music that we like. We’re almost capturing that and then using that as a tool to further our enjoyment of music.
Lamere: That’s an interesting idea.
Gardner: Now, I’m looking here on my PC at my iTunes while we’re talking and I’ve got 4,690 items, 15 days of music, and 26.71GB. And it turns out -- even when I use shuffle and I’ve got my playlists and I’ve dug into this -- I’m probably only listening to about 20 percent or 30 percent of my music. What’s up with that?
Lamere: Yes, exactly. We did a study on that. We looked at 5,000 users and saw that the 80-20 rule really applies to people’s music collections: 80 percent of their listening time is really concentrated in about 20 percent of their music. In fact, we found that these 5,000 users had about 25 million songs on their iPods and we found that 63 percent of the songs had not been listened to even once. So, you can think of your iPod as the place that your music goes to die, because once it’s there, the chances are you will never listen to it again.
Gardner: I don’t want it to be like that. So, clearly we can use some better richer tools. Is that right?
Lamere: That’s right. Shuffle play is great if you have only a few hundred songs that you can pick and put on there, but your iPod is a lot like mine. It has 5,000 songs and it also has my 11-year-old daughter’s high-school musical and DisneyMania tracks. I have Christmas music and some tracks I really don’t want to listen to.
When I hit shuffle play, sometimes those come up. Also with shuffle play, you end up going from something like Mozart to Rammstein. I call that the iPod whiplash. A system that understands a little bit about the content of the music can certainly help you generate playlists that are easier to listen to and also help you explore your music collection.
So you can imagine instead of hitting shuffle play or just playing the same albums over again, you could have a button on your iPod, or your music player, that lets you play music you like. That’s something that is really needed out there.
Gardner: So, instead of a playlist, you could have a "moodlist." For example, I’m stressed and I need to relax, or I really want to get pumped up because I’m going to a party and I want to feel high-energy, or I have the kids in the back seat and I want them to relax. Your mood can, in a sense, dictate how you assemble a playlist.
Lamere: That’s right. Imagine that a few years from now, (it’s not hard to extrapolate with the new iPhone), we’re going to have wireless iPods that are probably connected to a cloud of millions of tracks. It’s not hard to imagine all of the world’s music will be available on your hand-held audio player in a few years. Try using shuffle play when you have 500 million songs at your disposal; you’ll never find anything.
Gardner: I don’t have the benefit of a DJ to pick out what I want either, so I’m sort of stuck. I’m not in the old top 40 days, but I’m in the 40 million tracks days.
Lamere: That’s right.
Gardner: Now let’s look at some practical and commercial uses. Professional playlists assemblers who are creating what goes into these channels that we get through satellite, cable probably could use this to advantage. However, that doesn’t strike me as the biggest market. Have you thought about the market opportunity? Would people be willing to pay another five dollars a month to add it to their service so they have all their music readily accessible? How do you foresee it commercializing?
Lamere: I’m sure you’ve heard of Netflix. They are probably one of the biggest DVD shippers and one of their biggest advantages is their recommendation engine. I’m not sure if you’ve heard about the Netflix contest. Any researcher who can improve their recommendation by just 10 percent will receive $1 million from Netflix. I think that really represents how valuable good recommendations are to companies trying to deliver Long Tail content.
Amazon has built their business around helping connect people with their content as well. The same things are going to happen (or are happening now) within the music world. There is a lot of value hooking up to people with music; getting them into the Long Tail.
Gardner: Can we easily transfer this into a full multi-media experience -- video and audio? Have you tried to use this with tracks from a movie or a television show? Is there an option to take just from the audio alone; a characteristic map that people could say, "I like this TV show, now give me ones that are like it?" Is that too far-fetched? How do we go to full multi-media search with this?
Lamere: Those are all really interesting research questions. We haven't got that far yet. There are so many interesting spaces to bring this -- for instance, digital games. People are interacting with characters, monsters, and things like that. Currently, they may be in the same situation 50 times because they keep playing the game over and over again.
Wouldn’t it be nice to hook up to music that matches the mood and knows changes or may even push the latest songs that match the mood into the games, so that instead of listening to the same song, you get new music that does not detract from the game? There are all sorts of really interesting things that could happen there.
Gardner: I saw you demonstrating a 3D map in real time that was shifting as music was going in and out of the library as different songs were playing. It was dynamic; it was visual; there were little icons that represented the cover art from the albums floating around. It was very impressive. Now, that doesn’t happen with a small amount of computer power. Is this a service that could be delivered with the required amount of back-end computational power?
Lamere: Yes. We can take advantage of all of the nifty gaming hardware out there to give us the whiz bang with the 3D visualizations. The real interesting stuff, the signal processing and the machine learning when dealing with millions of songs, is going to use vast computer resources.
If you think music is driving a lot of bandwidth now in storage and computation, in a few years when people start really gravitating toward this content-based analysis, music will be driving lots and lots of CPU cycles. A small company with this new way of content-based recommendation can rent time on a grid at a per-CPU hour rate and get an iTunes-sized music collection (a few million songs) in a weekend as opposed to the five or 10 years it would take on a couple of desktop systems.
Gardner: Interesting. The technology that you’ve applied to music began with speech. Is there a way of moving this back over to speech? We do have quite a bit of metadata and straight text and traditional search capabilities. What if we create an overlay of intonation, emphasis, and some of the audio cues that we get in language that don’t show up in the written presentation or in what is searchable? Does that add another level of capability or "color" to how we manage the spoken word and/or the written word? With my podcasting, for example, I start with audio -- but I go to text, and then try to enjoy the benefits of both.
Lamere: Right. These are all great research questions; the things that researchers could spend years on in the lab. I think one interesting application would be tied to meetings; work meetings, conference meetings, just like when you visited Sun last month.
If we had a computer that was listening to the meeting and maybe trying to do some transcripts, but also noting some of the audio events in the meeting such as when everybody laughed or when things got really quiet. You could start to use that as keys for searching content in the meetings. So, you could go back to a recording of the meeting and find the introductions again very easily so you can remember who was at the meeting or find that summary slide and the spoken words that went with the conclusion of the talk.
Gardner: Almost like a focus group ability from just some of these audio cues.
Lamere: That’s right.
Gardner: Hey, I’ve got something that you could take to the airlines. I tend to sit on planes for long periods of time and after my battery runs out, I am stuck listening to what the airline audio provides through those little air tubes. Wouldn’t it be nice if there were audio selections that were rich and they really fit my mood. This is a perfect commercialization.
Lamere: Yes, you can have your favorite music as part of your travel profile.
Gardner: This could also work with automakers. Now that everyone has found a way to hook up to their iPods or their MP3 equivalent in their automobile, the automakers can give you what you want off of the satellite feed.
Lamere: Definitely.
Gardner: There are many different directions to take this. Obviously you’ve got some interest in promoting Sun’s strategic direction. There must be some other licensing opportunities for something like this. Is this patented or are you approaching it from an intellectual property standpoint? If our listeners have some ideas that we haven’t thought of, what should they do?
Lamere: When you’re in the labs, the people who run the lab really like to make sure that the researchers are not tempted by other people’s ideas because it can make it difficult down the road. If people have some ideas they want to send my way, it’s always great to hear more things. We do have some patents around the space. We generally don’t try to exploit the patents to charge people entry into a particular space.
Gardner: Since this does fall under the category of search, there are some big companies out there that are interested in that technology. We have a lot of Google beta projects, for example, such as Google News, Google Blogs, Google Podcasts, and Google base. Why not Google Music?
Lamere: Google has two -- I guess, you may call them Friday projects -- on their labs site around music. One is Google Trends, and the idea there is they’re trying to track which music is popular. If you use Google’s instant messenger, you can download a plug-in that will also track your listening behavior. So every time you play a song, it sends the name of the artist and the track to Google and they keep track of that. They give you charts of top 100 music, top 100 artists, whatever. The other thing they have is a Music Search tailored toward music.
If you type in Coldplay or The Beatles, you’ll get a search result that’s oriented toward music. You’ll see links of the artist page and links to lyrics but, interestingly enough, they haven't done anything in public to my knowledge about indexing music itself. This is interesting because Google has never been shy about indexing.
Its mission is to index all the world’s information, and certainly music falls into that category. They haven't been shy about going up against publishers when it comes to their library project, where they’re scanning all the books in all the libraries despite some of the objections of the book publishers. But for some reason they don’t want to do the same with music. So, it’s an open question. But probably they’ll be announcing the Google Music Search tomorrow.
Gardner: At least we can safely say we’re in the infancy of music search, right?
Lamere: That’s right. I see a lot of companies trying to get into the space. Most of them are trying to use the collaborate filtering models. The collaborate filtering models really require lots of data about lots of users. So they have a hard time attracting users because until they get a lot of users, their recommendations are not that good. And because their recommendations are not that good, they don’t get a lot of users.
Gardner: The classic chicken-and-egg dilemma.
Lamere: Yes, it’s called the "cold start" problem.
Gardner: I firmly believe in the "medium is the message"-effect, and not just for viewing news or getting information. When I was getting my music through the AM radio, that characterized a certain way that I listened and enjoyed music. I had to be in a car, or I had to be close to a radio, and then I might avoid sitting under a bridge.
Then I had my LPs and my eight tracks and they changed from one song into an album format for me. We’re going back a number of years here. I’ve been quite fond of my iPod and iTunes for the last several years and that has also changed the way I relate to music. Now, you have had the chance to enjoy your Search Inside the Music benefit. How has using this changed the way you relate to and use music?
Lamere: That’s a good question. I agree that the media is the message, and that really affects our way of dealing with music. As we switch over to MP3s, I think listening to music has shifted from the living room to the computer. People are now jogging with their iPod and listening experiences are much more casual.
They may have access to 10,000 tracks. They’re not listening to the same track over and over like we used to. So I think over time music is going to shift back from the computer to the living room, back to the living spaces in our house and away from the computer.
I try to use our system away from the computer -- just because I like to listen to music when I’m living, not just when I’m working. So I can use something like Search Inside the Music to generate interesting playlists that I don’t have to think about.
Instead of just putting the shuffle play on The Beatles, I can start from where I was yesterday, and since we were eating dinner, let’s circle around this area of string quartets and then when we’re done, we will ramp it up to some new indie music. You still have the surprise that you get with shuffle, which is really nice, but you also have some kind of arc to the listening.
Gardner: So you are really creating a musical journey across different moods, sensibilities, and genres. You can chart that beyond one or two songs or a half-dozen songs into a full-day playlist.
Lamere: That’s right.
Gardner: Very interesting. Well, thanks for joining us, Paul. We’ve been talking with Paul Lamere, a researcher and staff engineer at the Sun Microsystems Research Labs in Burlington, Mass. We’ve been discussing Search Inside the Music, a capability that he’s been investigating. A lot of thoughts and possibilities came from this. Paul is the principal investigator. I wish you well on the project.
Lamere: Thanks, Dana. It’s been great talking to you.
Gardner: This is Dana Gardner, principal analyst at Interarbor Solutions. You’ve been listening to BriefingsDirect. Come back next time.
If any of our listeners are interested in learning more about BriefingsDirect B2B informational podcasts or to become a sponsor of this or other B2B podcasts, please fill free to contact Dana Gardner at 603-528-2435.
Listen to the podcast here.
Transcript of BriefingsDirect podcast on music search with Sun Labs. Copyright Interarbor Solutions, LLC, 2005-2007. All rights reserved.
Subscribe to:
Posts (Atom)