All Relations Lead to Rome (ARLtR), from Matthijs Jansen op de Haar (Twente), Tobias StĂ€hle (ETH ZĂŒrich) and Lorenzo Gatti (Twente), is a new release aiming to serve as a new benchmark for information retrieval.
The researchers claim that existing datasets exist largely in two exclusive types: (1) vector-based retrieval over unstructured text or (2) reasoning over a knowledge graph. They argue that there are few existing benchmarks that combine both in one place.
Their work, ARLtR, aims to be just such a unified dataset. It offers everything in one: knowledge graph, embeddings, and question and answer pairs explicitly grounded in the entities, relations, and supporting text sourced from a central corpus of documents. The name isnât just metaphorical, the benchmark (comprising 19,000 entities, 16,000 chunks, and 8,400 question/answer pairs) is literally a collection of data concerning the Roman Empire.
The idea is that coupling the symbolic graph with the dense vectors can give a single coherent resource for evaluating and developing hybrid retrieval systems and âsemantic steeringâ approaches. This is a dataset that might be useful to those building GraphRAG-style systems, and itâs on Hugging Face if you want to check it out.
https://huggingface.co/datasets/FaynePro/all-relations-lead-to-rome
https://www.linkedin.com/feed/update/urn:li:activity:7485991487487528960/
Large language models (LLMs) are increasingly used to automate data-processing workflows, yet coding agents typically produce scripts that are not automatically materialized as persistent, editable platform artifacts. We call this disconnect the NL2Pipeline gap. To bridge it, we introduce DataFlow-Harness, a platform that guides an LLM agent to construct platform-native directed acyclic graphs (DAGs) through typed, incremental mutations rather than free-form scripts