The DFG-funded STELLA project aims to create an evaluation infrastructure that allows to evaluate search and recommendation services within productive web-based search systems with real users.
STELLA provides an integrated e-Research environment that allows researchers in the field of information retrieval and recommendation services to conduct studies with real users in real environments. The experimental set-ups differ considerably from classical TREC studies, which can only be carried out offline, or also from user studies, which only allow laboratory experiments, and thus enable researchers to use an evaluation method that was previously reserved only for industrial research or the operators of large online platforms.
STELLA is funded by Deutsche Forschungsgemeinschaft (DFG) under the project number 407518790 in the “Research data and software” programme within the LIS (Scientific Library Services and Information Systems) funding scheme. The first project phase was originally funded in 2018 and is now in it’s second funding phase.
More information can be found at DFG’s GEPRIS research information system.