Book cover © Amazon & Wrox

Over due by several years, Wrox just published a book about Microsoft Enterprise Search, including the different FAST flavours. Bravo!

You can ask how all the users of FAST technology could have managed for so many years without some public source of learning the products. Up until now FAST/MS and their partners have been the sole source of learning FAST Search [1]. Now, we’re part of that eco-system and may have profited on the lack of material available, but that’s another story.

The book is written by Jeff Fried (Ex-FAST), Mark Bennett, Natalya Voskresenskaya and Miles Kehoe and covers the chapters

1. What is Enterprise Search
2. Developing a strategy – the business process of search
3. Overview of Microsoft Enterprise search products
4. Search within Sharepoint 2010
5. FAST Search within Sharepoint 2010
6. Customizing search with Sharepoint 2010
7. Introduction to FAST ESP
8. Customnization and deployment of FAST ESP 5.x
9. Advanced topics
10. Enterprise search is social search
11. Search and business intelligence
12. The future of search

I have not read the book yet – but I have bought it to my Kindle and will flip though it on my iPad if time allows. I could of course, humble as I am, have authored much of this book myself, but maybe I can learn a thing or two as well

Click the book cover to go to Amazon.com’s book page.

[1]: Except from http://www.fastforum.info/ (owner) and http://fastesphelp.com/ (by Anand Kumar Pandey)

But what about non Sharepoint users? MS has an offering to them as well, called FAST Search for Internet Sites. Read Comperio’s excellent blog article about it. A bit disappointing that the core is still the more than three year old ESP5.3 wrapped in new MS APIs, but cool that you can still hack the ESP internals..

This figure from the book “Professional Microsoft Search” shows an overview of where the ESP  based offerings fit into the overall product offerings from MS:

20©10 Wrox publishing

Question is; what is the long term outlook for FSIS? It can obviously not stay on the aging ESP5.3 core forever. Will Microsoft upgrade this product or just put it on the last page of the price sheet to have an answer if someone asks? Can the SP version be adapted to work standalone? Perhaps. But it too is in desperate need of a new modern search core. I guess we can assume that since a new book pops up mentioning FAST ESP explicitly, we can expect it to stick around for some while… Give your thoughts about the future of non-sharepoint search from Microsoft.

As an example, we recently migrated the Norwegian financial newspaper Dagens Næringsliv and several other online newspapers from FAST to Solr, including Norwegian linguistics and Escenic integration.

Our friends in Lucid Imagination will host a free webinar on this topic on November 18th, don’t miss it if you want to hear more success stories.

Also see our migration slides.

Jan will be speaking about “Key topics when migrating from FAST to Solr”, pitched towards a Solr audience. There will be a short overview of FAST ESP, and a walkthrough of the migration process including what pain-points you could expect and how to handle them.

Perhaps it’s time for a faster, bigger, more feature rich, more extensible or more affordable search engine? A migration requires good and structured planning and deep knowledge of the existing solution as well as the target technology.

With almost 10 years of full-time, hands-on consulting experience within all kinds of enterprise search solutions, Jan Høydahl at Cominvent has what it takes. See our new migration page for more info.

As a part of that planning process, we have decided that in order to deliver more innovation per release in the future, the 2010 products will be the last to include a search core that runs on Linux and UNIX.

This should not be a shock to anyone, and I hinted to this danger in my blog post about the acquisition:

Let us not hope that the Linux, AIX and Solaris versions will be discontinued. I don’t expect that to happen in the short term, as the press release clearly states that they will be supported…

I guessed back then that Linux support would continue for another five years, but it turned out to be less than two While it is an expected and understandable, I think we all hoped that the press release following the acquisition hinted for a new, more open policy from the software giant, but that turned out to be too optimistic. But existing customers are not left completely alone; Olstad continues:

We will support ESP 5.3—the cross-platform search core in the 2010 products—for 10 years as per our standard support policy (5 years mainstream support and 5 years extended support).  Non-Windows customers on ESP 5.3 can continue running their core on Linux and UNIX and add Windows-only innovations or cloud-based services by using a mixed-platform architecture.

Many search consultant with experience from FAST ESP have experienced that the product is more capable under Linux than under Windows when you start pushing the boundaries. ESP is also easier to manage on a Linux platform due to SSH and friends. But that is not the major selling point anyway.

What this will mean for the existing and potential future customers is hard to predict. Obviously some organizations, especially smaller ones, demand Linux only in their data centers – these will start looking for another vendor.  Some of the bigger companies already have mixed environments and will easily be able to migrate, and may be happy.

Last but not least, the hint of cloud-support from the blog post opens another opportunity for existing customers running on Linux: Outsource the whole search hosting to Microsoft and don’t worry about the servers or OS at all. This may be the best option for many? Expect to see more references to hosted search going forward!

Office 14

The main news is that ESP will be included in Office 14, to serve as the advanced/extended search server of Sharepoint. It has long been a problem that the Sharepoint Search Server can only handle about 50 million documents, and by offering the FAST-based extension, this will be extended to almost infinite number of docs, as well as enabling some features which Sharepoint did not have as well (faceted navigation being one of them). The product will be more limited than the full-fledged ESP in that you cannot tune as many parameters. Much of the middleware and administrative components of ESP are stipped out and replaced with Windows/Sharepoint/MSSQL components, for a tighter integration.

But Office14 will not ship before 2010, so as a gap-filler Microsoft will sell ESP for Sharepoint for as little as USD 25.000 per server, which is a fraction of the typical license cost for such a system. This product is basically the same as today’s ESP, but if you intend to upgrade to Office 14 Extended Search, you better not use all the features of ESP, but stick to the recommended customization options which are compatible with the coming Office 14 search.

FAST Search for Internet Business

The second product announced is “FAST Search for Internet Business”, intended to fill the needs of the typical existing FAST customer within site search or e-commerce. Even the Linux versions of this product will be developed and maintained alongside the Windows versions.

A good question is how MS/FAST is going to maintain all these code bases going forward. I’d expect a consolidation sooner or later, and perhaps also an end-of-life announcement for the Linux platform support within the next 5 years. But that will only be speculations anyway

Here’s Sesam’s own description of the software:

“SESAT is search middleware and a search portal framework. SESAT enables a single user query to be dispatched to multiple information sources. The result is analysed, weighted and presented to the user according to configurable business rules.”

Congratulations with contributing to Open Source, Sesam! And good luck with creating a community around this important piece of middleware, we’ll see more and more demand for it in the future!

Now, go check it out on http://sesat.no/ if this is something that can be useful to you!

PS: Learn more about other federated search solutions at the federatedsearchblog.com

As of feb 8th it is official, Microsoft has aquired 97,2% of FAST, and can now legally force the buyout of the rest. Microsoft have been very active on the acquisition front lately, also trying a hostile takeover of Yahoo to gain a share of the global online advertising market which Google currently dominates. There is definitely a cosolidation in the search market towards fewer, bigger players.

With the FAST ESP technology, Microsoft will be able to compete better in the Enterprise search space. It is strange how come the world’s largest software firm does not manage to be innovative themselves, but have to buy other companies all the time to be able to really compete. It will be interesting to observe MS’s long-term roadmap for the FAST technology.

Nobody knows exactly yet but we all hope that Microsoft (if allowed to acquire FAST) will continue to support FAST ESP on all major Operating Systems going forward.