Human Information Interaction

---

Background and Aim: The current research aims at prototyping query-by-humming music information retrieval systems for smart phones.
Methods: This multi-method research follows simulation technique from mixed models of the operations research methodology, and the documentary research method, simultaneously. Two chromatic harmonica albums comprised the research population. To achieve the purpose of research, 24 homophonic tracks were splitted by using Helium Audio Splitter software. The splits were processed by Sonic Visualiser software; and 168 XML documents were produced. On the other hand, 4 research participants hummed and recorded splits. Hummed tracks were converted by using AMR to MP3 Converter software, processed by Sonic Visualiser, and resulted in 672 XML documents. MATLAB software was learned by the first group of XML documents (168), and then, processed the second group of XML documents (672) for providing desirable outputs. Outputs were compared by using Image Comparer software.
Results: Findings indicated a high degree of similarity (99 %) between outputs of two groups of XML documents. It has also been found that the gender and the music skill do not have any impact on the results.
Conclusion: It could be acknowledged that designing query-by-humming systems based on converting audio to XML documents, and document matching, is an appropriate strategy towards developing music retrieval applications for smart phones.

---

Purpose: There are several metrics for evaluating search engines. Though, many researchers have proposed new metrics in recent years. Familiarity with new metrics is essential. So, the purpose is to provide an analysis of important and new metrics to evaluate search engines.
Methodology: This review article critically studied the efficiency of metrics of evaluation. So, “evaluation metrics,” “evaluation measure,” “search engine evaluation,” “information retrieval system evaluation,” “relevance evaluation measure” and “relevance evaluation metrics” were investigated in “MagIran” “Sid” and Google Scholar search engines. Articles gathered to inspect and analyse existing approaches in evaluation of information retrieval systems. Descriptive-analytical approach used to review the search engine assessment metrics.
Findings: Theoretical and philosophical foundations determine research methods and techniques. There are two well-known “system-oriented” and “user-oriented” approaches to evaluating information retrieval systems. So, researchers such as Sirotkin (2013) and Bama, Ahmed, & Saravanan (2015) group the precision and recall metrics in a system-oriented approach. They also believe that Average Distance, normalized discounted cumulative gain, Rank Eff and B pref are rooted in the user-oriented approach. Nowkarizi and Zeynali Tazehkandi (2019) introduced comprehensiveness metric instead of Recall metric. They argue that their metric is rooted in a user-oriented approach, while the goal is not fully met. On the other hand, Hjørland(2010) emphasizes that we need a third approach to eliminate this dichotomy. In this regard, researchers such as Borlund, Ingwersen (1998), Borlund (2003), Thornley, Gibb (2007) have mentioned a third approach for evaluating information retrieval systems that refer to interact and compose two mentioned approaches. Incidentally, Borlund, Ingwersen(1998) proposed a Jaccard Association and Cosine Association measures to evaluate information retrieval systems. It seems that these two metrics have failed to compose the system-oriented and user-oriented approaches completely,  and need further investigation.
Conclusion: Search engines involve different components including: Crawler, Indexer, Query Processor, Retrieval Software, and Ranker. Scholars  wish to apply the most efficient search engines for retrieving required information resources. Each   metrics measures a specific component, to measure all, it is suggested to select metrics from all three mentioned groups in their search.