Tutorial for combining ManifoldCF and Elasticsearch for files search

Posted on by

With the arrival of Manifold CF 1.0 (now already in v1.6.1), the open source community is looking for tutorials to combine it with Elasticsearch. That’s the intent of this tutorial, which will drive you through the different steps required to make it work.

First, we’ll recap the installation process of Manifold CF (we’ll call it MCF later on). Second, we will install ElasticSearch with the attachment plugin so that it handles rich document indexing. Third, we’ll configure MCF so that it crawls a windows file share and indexes documents in ElasticSearch. In this tutorial, when I specify installation directory such as apache-manifoldcf-1.6.1, you have to complete with the absolute path of the installation directory.
Continue reading →

Binary version of SolrMeter for Solr 4

Posted on by

NOTE: English version on top, French version below.

We have noticed that in Solr 4, there is problem with the UI related to cache hit ratio evaluation of SolrMeter. Digging a bit, the problem is due to a type change between Solr 3 and Solr 4. SolrMeter expects a string, whereas Solr4 sends back a float. More precisely, Solr 4 does that within its request handler mbean, in the cache sub category.

We’re now using a patch available for this bug, created by Javier Mendez, see his contribution on this google group.

Still, there is no binary version of SolrMeter, hence this blog. Continue reading →

Hadoop 0.20 and refactoring of the Yahoo sample code on reversed index

Posted on by

There are several MapReduce snippets to test and learn about Hadoop.
One of these samples is the reversed index, i.e. for each word we want to know which file it comes from. Thus the ouptut file should look like this:
hello                                     test.txt
formation formation.txt        test.txt

This example is mentioned on the Yahoo developer network, but it doesn’t work as is on version 0.20 of Hadoop.
We decided to rewrite parts of the code in order to make it compatible. This is what you will find in this blog article.

Continue reading →

Integrating Solr with SPIP

Posted on by

Note: French version available at the second half of this blog entry.

Note Note: don’t hesitate to test our new open source package solution Datafari, which combines Apache ManifoldCF, Apache Solr and AjaxFranceLabs 🙂

SPIP is a well known open source platform. We wanted to share with you how to integrate graphically a Solr server with a SPIP server. The scenario is the following: you already have SPIP based web site, and you want to have a nice search functionnality based on the lastet Solr, to benefit from all its cool functionalities. You have set up a Solr, you have crawled your SPIP content, but now you want to have your Solr search in your SPIP website. This is what we present in this tutorial.

Continue reading →

Constellio dev environment

Posted on by

Disclaimer: This blog is not really new, as it’s just the migration of the technical content of our website – see further down for the French version.

This tutorial explains how to start Constellio in a development environment. The first part shows how to download, setup and start Constellio in Eclipse with the default database (Derby). The second part shows how to install MySQL and to configure Constellio to use this database. Continue reading →

Backup Constellio Collections and Connectors

Posted on by

Disclaimer: This blog is not really new, as it’s just the migration of the technical content of our website – see further down for the French version.

English: This tutorial explains how to backup and restore Collections and Connectors in Constellio.

French: Cette vidéo explique comment sauvegarder puis restaurer des Collections et des Connecteurs dans Constellio. Continue reading →

Create a plugin for Constellio

Posted on by

Disclaimer: This blog is not really new, as it’s just the migration of the technical content of our website – see further down for the French version.

France Labs, the european partner of Doculibre on the Constellio solution, gives you this video explaining how to create a plugin for Constellio. Constellio is currently the most complete open source enterprise search solution available. Continue reading →

Active Directory

Posted on by

Disclaimer: This blog is not really new, as it’s just the migration of the technical content of our website – see further down for the French version.

NOTE: If you are interested in using AD with Solr, you may want to look at our Datafari software (still in Alpha version), which combines Apache ManifoldCF with Solr, so it eases this kind of integration. The code is available on google code: http://code.google.com/p/datafari/

In enterprise environments, enterprise search often needs a security aspect which is not necessary for standard web search. In order to assist you, we release here a small code in order to allow Constellio 1.2 (and probably 1.3 although we didn’t test it) to connect to an Active Directory in order to do the credentials check at authentication time. Here is how it works: Continue reading →

Virtual Image for Constellio 1.3

Posted on by

Disclaimer: This blog is not really new, as it’s just the migration of the technical content of our website – see further down for the French version.

Open source is like that, you want to give it a try by yourself. In order to for you to gain time, we set up a virtual box image of a running Constellio.
This way you can right start playing with the search and with the admin interface. So that it works right away, we even put a sample collection with a connector that crawls by default the France Labs website. So the first customisation we’d recommend is to edit this connector in order to point to the website you desire, for instance your local intranet in case you have one. The image is approx 500 MB big, so please be patient. Continue reading →

Potential security risk if you use Solr together with an internet facing CMS

Posted on by

We recently stumbled upon a detailed article on a Solr attack using SSRF, by Nicolas Grégoire. To summarise: if you think you are safe because you have your Solr hidden behind another system, and that you have only a http server facing the web to make things ok, you may have problems you did not think about.

While reading this article, I was thinking about use cases related to CMS systems with users management, and which are accessible from the web. They are a good fit for such attacks. The good news is that Solr 4.6 solves this vulnerability. The bad news is that you need to do your migration quickly if you want to sleep well 😉