#ECIR2026 notifications were friendly to me 🤗
1. Full paper "Open Web Indexes for Remote Querying" with @gijs and @djoerd.
Can we let ppl query the Terabytes of Web Index we collect in #OpenWebSearchEU in new ways, making good use of Parquet, S3, DuckDB?
Turns out the answer is a big YES!
Pre-print of the paper w/ code coming soon!
1/4
#OpenWebSearchEU is a silver sponsor of #ECIR2025!
Open web index #OWI update:
4 billion URLs crawled
185 different languages
28 million Hosts
750 TB crawled
1 TB crawled per day
147 WARC Datasets
17.5 TB size of Open Web Index
28.8 TB size of WARC datasets
346 public datasets
Today, Open Web Search consortium meeting at LRZ. #OpenWebSearchEU
@heinragas Thanks for offering! #OpenWebSearchEU provides the data and index. I hope there will be a fully functional search engine at the end of the project. (build by anyone!) @openwebsearcheu @Negin
Don't be evil. #OpenWebSearchEU
This week: #OpenWebSearchEU consortium meeting in Nijmegen!
#OpenWebSearchEU has funding for organizations that build search engines using the open search infrastructure
https://openwebsearch.eu/third-party-calls-2024-media-release/
Frequently Asked Questions #FAQ about #OpenWebSearchEU
Another #ECIR2024 preprint online: "The Open Web Index: Crawling and Indexing the Web for Public Use". #OpenWebSearchEU
⭐️ OpenSearch #AdventCalendar | Day 19
ows.eu – Looking back & looking forward
As the year is slowly coming to an end and we are ready to wind down a bit, it's time for a little year in review of our OpenWebSearch.eu project.
A quick reminder: We started the Horizon EU project in September 2022 with 13 other consortium partners.
Read about the year´s highlights in today´s advent calendar post:
https://opensearchfoundation.org/en/adventcalendar-2023/
@openwebsearcheu
#OpenWebSearch #OpenWebSearchEU #OpenwebSearchCommunity
Ethical, open and non-commercial: the Open Web Search project is designed to provide Europe with the right alternative to existing search engines
Woke up at 6am to cycle through the pouring rain to the train station and miss my train by half a minute or so... Oh well.
On my way to the *Dutch-Belgian Information Retrieval workshop*, in Delft this year. Looking forward to spending the day with colleagues and getting updated on all the ongoing IR research "nearby".
https://dir2023.github.io/DIR2023/
In the afternoon, I stand in for @djoerd who unfortunately cannot make it (Covid 🙁), and will present the talk on #OpenWebSearchEU research project.
The first third-party funded project partners are on board!
They were selected from the first open call in spring and will enrich the #EU #horizonEurope project OpenWebSearch.eu with their expertise.
A warm welcome!
More info: https://openwebsearch.eu/third-parties-onboarding
#OpenWebSearch #OpenWebSearchCommunity #OpenWebSearchEU #HorizonEurope
@EC_NGI
Busy event week!
👉 #SC23 in Denver with #OpenWebSearchEU partners @LRZ_DE + IT4Innovations
👉 major panel on #OpenWebSearch + #LLMs at #NGIForum23 in Brussels , moderated by @osf's board member @frauplote and with OpenWebSearch.eu's principal investigator @grani of Universität Passau in the panel of experts. @alnuss explained the basic ows.eu ethics methodology at a workshop on #EthicsinSearch. Plus lots of good talks + interesting meetings with members of fellow @EC_NGI projects!
🚀 #NGIForum23 has kicked off! For the next two days technologists, innovators + researchers will meet in Brussels to discuss the Next Generation Internet – an Internet of Trust for European Citizens + Businesses. Lots to talk about + lots to think about + plan!
#OpenWebSearchEU is represented by Stefan Voigt, @grani @alnuss, @frauplote and Megi (Maggie) Sharikadze, among others.
Also some representatives of our NGI "sister" projects are here on site. Good to meet you here in person!
Chorizo alarm for the weekend!
What does a slice of chorizo have to do with open #websearch? Dr. Tim Smith from #OpenWebSearchEU's project partner CERN shows the added value of an #OpenWebIndex for #internetsearch in his TED Talk "Navigating the Entangled Web" using examples from physics.
Highly recommended!
⬇️ https://www.ted.com/talks/tim_smith_navigating_the_entangled_web
Hello, live from the ows.eu consortium meeting in Ostrava! We are the #OpenWebSearchEU initiative, having joined forces to promote Europe’s independence in Web Search.
The goal: to develop an open European infrastructure for web search. Our initiative will be contributing to Europe’s digital sovereignty as well as promoting an open human-centered search engine market.
Since today we are – finally – on Mastodon. Nice to be here!
Some incomplete list of publications that analyzed the #CommonCrawl data to identify malicious content are:
Srdjan Matic, et atl. Identifying sensitive URLs at web-scale, in Proceedings of the ACM Internet Measurement Conference, 2020, pp. 619–633.
https://gsmaragd.github.io/publications/IMC2020-GDPR/IMC2020-GDPR.pdf
#OWLer is the #OpenWebSearchEU collaborative web crawler. Do we crawl everything?
https://openwebsearcheu.pages.it4i.eu/wp1/owseu-crawler/owler/
