Refining the process of gathering information

Bombarded by information from numerous sources, many people today turn to electronic news-aggregation services to find what they want. One European team of researchers claims to have developed a flexible and innovative tool that enables journalists and other users to fine-tune the process of news-gathering and delivery.

Early trials of this open-source, distributed system, developed under the IST project PENG, have only recently completed. But coordinator Gabriella Pasi says the participants were impressed with the results.

"Selected Swiss journalists and students assessed the performance of the system's various modules," she says. "For example they checked the effectiveness and accuracy of the information filtering, comparing the results with those from existing systems. They then looked at the integrated system and praised its user-friendliness."

Pasi adds that they liked the system's ability to find relevant information – measured in terms of recall (the proportion of retrieved and relevant documents compared to all documents in the collection) and precision (the ratio of retrieved and relevant documents to all the documents retrieved). A more detailed system trial is due for completion in November 2006.

More than just 'push'
The project originated in research carried out by several partners on information retrieval and filtering. Pasi notes that, "Our project proposal predated the launch of present news-aggregation services, which focus on 'pushing' out information based on user needs." The PENG system, by contrast, offers two distinct techniques: information filtering (push) and information retrieval (pull).

Current news-aggregation systems work very much like internet search engines, pushing out information based on certain user criteria. If users require further filtering, they must create a profile for themselves – which can result in the generation of somewhat limited lists. This process works well for journalists receiving information from online news agencies that produce a continuous news stream; but they still face the problem of selecting the most relevant news.

The PENG system enables users to go much further. By personalising filters, they can pick up targeted information from agencies and combine this with data retrieved from the web or specialised archives. They can also place constraints on the content they seek – such as the media category or trustworthiness of sources – to generate highly specific information. The system then calls on various modules to edit and summarise all this information automatically, before presenting it as the user wishes.

Innovative fuzzy algorithm
Pasi highlights the system's ability to learn user preferences over time. It can also deal with human vagueness or imprecision, such as in the filtering or interaction with the software.

The partners have also developed a new filtering algorithm. Based on categories, it can cluster news from agencies into thematic cluster groups such as sports or politics, for creating data subsets based on common characteristics (e.g. people with a certain hair colour). After these subsets are defined, the system can describe each group (e.g. this is the group with black hair).

"Of the two possible approaches to data clustering," says Pasi, "we chose 'unsupervised' because this approach does not force us to select a priori categories." She adds that the PENG system can display audiovisual content, but works mainly with textual information.

PENG was completed in August 2006. Though the complete system exists only as a prototype, project partner ATOS Origin is examining the possibility of using certain modules in standalone applications. The company is also interested in marketing the project's clustering algorithm, which could be used not only for filtering news but also for image gathering or e-commerce applications.

Contact:
Professor Gabriella Pasi
Consiglio Nazionale Delle Ricerche ITC-CNR
Via Bassini N. 15
I-20131 Milan
Italy
Tel: +39 02 2369 9489
Email: This email address is being protected from spambots. You need JavaScript enabled to view it.

Source: IST Results Portal

Most Popular Now

AI Tools Help Predict Severe Asthma Risk…

Mayo Clinic researchers have developed artificial intelligence (AI) tools that help identify which children with asthma face the highest risk of serious asthma exacerbation and acute respiratory infections. The study...

ChatGPT 4o Therapeutic Chatbot 'Ama…

One of the first randomized controlled trials assessing the effectiveness of a large language model (LLM) chatbot 'Amanda' for relationship support shows that a single session of chatbot therapy...

AI Distinguishes Glioblastoma from Look-…

A Harvard Medical School–led research team has developed an AI tool that can reliably tell apart two look-alike cancers found in the brain but with different origins, behaviors, and treatments. The...

Overcoming the AI Applicability Crisis a…

Opinion Article by Harry Lykostratis, Chief Executive, Open Medical. The government’s 10 Year Health Plan makes a lot of the potential of AI-software to support clinical decision making, improve productivity, and...

Smart Device Uses AI and Bioelectronics …

As a wound heals, it goes through several stages: clotting to stop bleeding, immune system response, scabbing, and scarring. A wearable device called "a-Heal," designed by engineers at the University...

Dartford and Gravesham Implements Clinis…

Dartford and Gravesham NHS Trust has taken a significant step towards a more digital future by rolling out electronic test ordering using Clinisys ICE. The trust deployed the order communications...

AI Body Composition Measurements can Pre…

Adiposity - or the accumulation of excess fat in the body - is a known driver of cardiometabolic diseases such as heart disease, stroke, type 2 diabetes, and kidney disease...