Data Mining

Specific types of data mining

Text Mining

Text mining, or text analytics, is the process of analyzing text to identify and extract the meaningful data and patterns it contains at both an embedded and contextual level. This enriched information is used to make search results more relevant, to automatically classify and cluster data for navigation and filtering, and to support qualitative and qualitative analytics. It also makes it possible to integrate structured and unstructured data into a meaningful whole (for example, integrating CRM data with social media content or website activity logs).

Among vendors providing text analytics, EXALEAD is unique being able to apply advanced processing at a massive scale using an absolute minimal number of commodity servers. It is also unique in the modularity and configurability of its extensive semantic processing pipeline. To learn more about EXALEAD CloudView's semantic processing pipeline, download the EXALEAD CloudView Semantics whitepaper.

Web Data Mining

In Web data mining, one seeks to identify, extract and process relevant Web content according to a specific crawl objective. For example, one may want to extract pertinent details from online supplier catalogs to validate, enrich and extend an internal parts database, or one may wish to glean real estate market intelligence from online classifieds (see the Akerys case study).

To achieve optimal results for mining the world's first and foremost Big Data source-the Web-EXALEAD provides a discriminating crawl ecosystem that yields high quality results while maximizing performance and minimizing the size of the index. It offers:

• Comprehensive Data Capture
  The system can capture Web content in unstructured, semi-structured and structured form, including Deep Web content that is dynamically generated as a result of form input and/or database querying.
• Qualitative Filtering
  The platform provides configurable qualitative filtering, for example, excluding certain document types, treating the content of a site as a single page to avoid crowding out other relevant sources (website collapsing), and detecting and applying special rules for duplicate and near-duplicate content.
• High Performance
  To maximize performance, CloudView enables you to regulate the breadth and depth of a crawl according to your business needs and resources, and to employ a refined update strategy, zeroing in on pertinent new or modified content rather than re-crawling and re-indexing all content.

CloudView is also uniquely designed to help you avoid placing an undue load on the visited site or violating data ownership and privacy policies.

Once your Web content is collected, EXALEAD CloudView primes it for use with the same robust semantic processing pipeline described above under Text Mining.

• Download our Practical Guide to Big Data
• Watch the Webinar "EXALEAD & Big Data: It's All About Usage"

Multimedia Analysis

Multimedia content is the fastest growing type of user-generated content, with millions of photos, audio files and videos uploaded to the Web and enterprise servers daily. Exploiting this type of content at Big Data scale is impossible if we must rely solely on human tagging or basic associated metadata like file names to access and understand content.

Fortunately, EXALEAD CloudView integrates seamlessly with technologies like automatic speech-to-text transcription and object-recognition processing (Content-Based Image Retrieval, or CBIR) to enable clients to structure multimedia content from the inside out, bringing critical new accessibility to large-volume multimedia collections and enabling the development of innovative applications in fields like medicine, media, publishing, environmental science, forensics and digital asset management. (See for example the France 24 case study.)

Sentiment Analysis

CloudView's sentiment analysis framework uses semantic technologies to automatically discover, extract and summarize the emotions and attitudes expressed in unstructured content. This processing is sometimes applied to behind-the-firewall content like email messages, call recordings and customer/constituent surveys. More commonly, however, it is applied to the Web, the most comprehensive repository of public sentiment concerning everything from ideas and issues to people, products and companies.

Sentiment analysis on the Web typically entails collecting data from select Web sources (industry sites, the media, blogs, forums, social networks, etc.), cross-referencing this content with target entities represented in internal systems (services, products, people, programs, etc.), and extracting and summarizing the sentiments expressed in this cross-referenced content in the CloudView index.

Once this knowlegdebase of sentiment data has been created, it can be eploited via full text search and faceted navigation, quantitative dashboarding and freestyle exploratory analytics. See the Sentiment Analytics section on the Any-User Analytics page.

• Download our Practical Guide to Big Data
• Watch the Webinar "EXALEAD & Big Data: It's All About Usage"