Projects
I share the source code of the software I develop for my papers as open source. Each project lists the related publications; see the Publications page for the full list.
Web data extraction and search
Open-source software from my research on extracting content, rules and images from web pages.
WebRuleBench Python · MIT
An open-source environment for benchmarking web extraction rules (CSS, XPath, regex) generated by large language models against human-annotated ground truth.
- New study; the paper is under revision.
- Software archive: Zenodo, doi:10.5281/zenodo.23142233
UzunExt C#
A web content extraction framework that uses additional information obtained from web pages to extract content quickly and accurately.
- A Novel Web Scraping Approach Using the Additional Information Obtained from Web Pages · IEEE Access, 2020
- Evaluation of Hap, AngleSharp and HtmlDocument in web content extraction · UNITECH’17, 2017
REGEXN Python
Converts CSS selector patterns into regular expressions for faster data extraction from HTML pages.
- A regular expression generator based on CSS selectors for efficient extraction from HTML pages · Turkish Journal of Electrical Engineering & Computer Sciences, 2020
Relevant-Image-Scraping Python
Finds the relevant images on web pages using only text data, without downloading the images.
- Automatically Discovering Relevant Images From Web Pages · IEEE Access, 2020
- Scraping Relevant Images from Web Pages without Download · ACM Transactions on the Web, 2024
iCrawler C#
An effective and efficient web content extractor for optimizing the crawling process.
- An effective and efficient web content extractor for optimizing the crawling process · Software: Practice and Experience, 2014
WebCE C#
A web content extractor with two algorithms that eliminate uninformative blocks and extract the content blocks of web pages.
- A hybrid approach for extracting informative content from web pages · Information Processing and Management, 2013
- Web content extraction by using decision tree learning · SIU, 2012
- A lightweight parser for extracting useful contents from web pages · ISCSE, 2011
- Analyzing of the Evolution of Web Pages by Using a Domain Based Web Crawler · Techsys, 2011
REA C#
An algorithm that discovers the layout of user reviews on web pages and extracts them efficiently.
- A novel algorithm for extracting the user reviews from web pages · Journal of Information Science, 2017
WebDataExtractionInPython Python
A comparison of Python libraries used for web data extraction.
- Comparison of Python Libraries used for Web Data Extraction · TechSys 2018, 2018
ImageCrawler Python
A crawler that downloads images from the web and extracts their features for use in machine learning.
SET Project
Search Engine for Turkish
A search engine developed for Turkish texts.
Libraries and tools
Reusable libraries I developed during my web and algorithm work.
obfc.js JavaScript · MIT
Draws SVG-based flowcharts by creating objects in your web pages.
- Object-based flowchart drawing library · UBMK, 2017
entrel.js JavaScript
A library built on obfc.js for drawing entity-relationship (ER) diagrams with simple JavaScript methods.
- Object-based Entity Relationship Diagram Drawing Library: EntRel.JS · TechSys 2018, 2018
SMA.NET C#
A library for evaluating string matching algorithms.
- Comparison of string matching algorithms in web documents · UNITECH’17, 2017
Animation.js JavaScript · GPL-3.0
A small library for animating an element or its child elements on a web page.