Refining the process of gathering information

Bombarded by information from numerous sources, many people today turn to electronic news-aggregation services to find what they want. One European team of researchers claims to have developed a flexible and innovative tool that enables journalists and other users to fine-tune the process of news-gathering and delivery.

Early trials of this open-source, distributed system, developed under the IST project PENG, have only recently completed. But coordinator Gabriella Pasi says the participants were impressed with the results.

"Selected Swiss journalists and students assessed the performance of the system's various modules," she says. "For example they checked the effectiveness and accuracy of the information filtering, comparing the results with those from existing systems. They then looked at the integrated system and praised its user-friendliness."

Pasi adds that they liked the system's ability to find relevant information – measured in terms of recall (the proportion of retrieved and relevant documents compared to all documents in the collection) and precision (the ratio of retrieved and relevant documents to all the documents retrieved). A more detailed system trial is due for completion in November 2006.

More than just 'push'
The project originated in research carried out by several partners on information retrieval and filtering. Pasi notes that, "Our project proposal predated the launch of present news-aggregation services, which focus on 'pushing' out information based on user needs." The PENG system, by contrast, offers two distinct techniques: information filtering (push) and information retrieval (pull).

Current news-aggregation systems work very much like internet search engines, pushing out information based on certain user criteria. If users require further filtering, they must create a profile for themselves – which can result in the generation of somewhat limited lists. This process works well for journalists receiving information from online news agencies that produce a continuous news stream; but they still face the problem of selecting the most relevant news.

The PENG system enables users to go much further. By personalising filters, they can pick up targeted information from agencies and combine this with data retrieved from the web or specialised archives. They can also place constraints on the content they seek – such as the media category or trustworthiness of sources – to generate highly specific information. The system then calls on various modules to edit and summarise all this information automatically, before presenting it as the user wishes.

Innovative fuzzy algorithm
Pasi highlights the system's ability to learn user preferences over time. It can also deal with human vagueness or imprecision, such as in the filtering or interaction with the software.

The partners have also developed a new filtering algorithm. Based on categories, it can cluster news from agencies into thematic cluster groups such as sports or politics, for creating data subsets based on common characteristics (e.g. people with a certain hair colour). After these subsets are defined, the system can describe each group (e.g. this is the group with black hair).

"Of the two possible approaches to data clustering," says Pasi, "we chose 'unsupervised' because this approach does not force us to select a priori categories." She adds that the PENG system can display audiovisual content, but works mainly with textual information.

PENG was completed in August 2006. Though the complete system exists only as a prototype, project partner ATOS Origin is examining the possibility of using certain modules in standalone applications. The company is also interested in marketing the project's clustering algorithm, which could be used not only for filtering news but also for image gathering or e-commerce applications.

Contact:
Professor Gabriella Pasi
Consiglio Nazionale Delle Ricerche ITC-CNR
Via Bassini N. 15
I-20131 Milan
Italy
Tel: +39 02 2369 9489
Email: This email address is being protected from spambots. You need JavaScript enabled to view it.

Source: IST Results Portal

Most Popular Now

Integrating Care Records is Good. Using …

Opinion Article by Dr Paul Deffley, Chief Medical Officer, Alcidion. A single patient record already exists in the NHS. Or at least, that’s a perception shared by many. A survey of...

Should AI Chatbots Replace Your Therapis…

The new study exposes the dangerous flaws in using artificial intelligence (AI) chatbots for mental health support. For the first time, the researchers evaluated these AI systems against clinical standards...

AI could Help Pathologists Match Cancer …

A new study by researchers at the Icahn School of Medicine at Mount Sinai, Memorial Sloan Kettering Cancer Center, and collaborators, suggests that artificial intelligence (AI) could significantly improve how...

AI Detects Early Signs of Osteoporosis f…

Investigators have developed an artificial intelligence-assisted diagnostic system that can estimate bone mineral density in both the lumbar spine and the femur of the upper leg, based on X-ray images...

AI Model Converts Hospital Records into …

UCLA researchers have developed an AI system that turns fragmented electronic health records (EHR) normally in tables into readable narratives, allowing artificial intelligence to make sense of complex patient histories...

AI Sharpens Pathologists' Interpret…

Pathologists' examinations of tissue samples from skin cancer tumours improved when they were assisted by an AI tool. The assessments became more consistent and patients' prognoses were described more accurately...

AI Tool Detects Surgical Site Infections…

A team of Mayo Clinic researchers has developed an artificial intelligence (AI) system that can detect surgical site infections (SSIs) with high accuracy from patient-submitted postoperative wound photos, potentially transforming...

Forging a Novel Therapeutic Path for Pat…

Rett syndrome is a devastating rare genetic childhood disorder primarily affecting girls. Merely 1 out of 10,000 girls are born with it and much fewer boys. It is caused by...

Mayo Clinic's AI Tool Identifies 9 …

Mayo Clinic researchers have developed a new artificial intelligence (AI) tool that helps clinicians identify brain activity patterns linked to nine types of dementia, including Alzheimer's disease, using a single...

AI Detects Fatty Liver Disease with Ches…

Fatty liver disease, caused by the accumulation of fat in the liver, is estimated to affect one in four people worldwide. If left untreated, it can lead to serious complications...

AI Matches Doctors in Mapping Lung Tumor…

In radiation therapy, precision can save lives. Oncologists must carefully map the size and location of a tumor before delivering high-dose radiation to destroy cancer cells while sparing healthy tissue...

Meet Your Digital Twin

Before an important meeting or when a big decision needs to be made, we often mentally run through various scenarios before settling on the best course of action. But when...