I share the source code of the software I develop for my papers as open source. Each project lists the related publications; see the Publications page for the full list.

Web data extraction and search

Open-source software from my research on extracting content, rules and images from web pages.

WebRuleBench Python · MIT

An open-source environment for benchmarking web extraction rules (CSS, XPath, regex) generated by large language models against human-annotated ground truth.

UzunExt C#

A web content extraction framework that uses additional information obtained from web pages to extract content quickly and accurately.

  • A Novel Web Scraping Approach Using the Additional Information Obtained from Web Pages · IEEE Access, 2020
  • Evaluation of Hap, AngleSharp and HtmlDocument in web content extraction · UNITECH’17, 2017

REGEXN Python

Converts CSS selector patterns into regular expressions for faster data extraction from HTML pages.

Relevant-Image-Scraping Python

Finds the relevant images on web pages using only text data, without downloading the images.

iCrawler C#

An effective and efficient web content extractor for optimizing the crawling process.

  • An effective and efficient web content extractor for optimizing the crawling process · Software: Practice and Experience, 2014

WebCE C#

A web content extractor with two algorithms that eliminate uninformative blocks and extract the content blocks of web pages.

  • A hybrid approach for extracting informative content from web pages · Information Processing and Management, 2013
  • Web content extraction by using decision tree learning · SIU, 2012
  • A lightweight parser for extracting useful contents from web pages · ISCSE, 2011
  • Analyzing of the Evolution of Web Pages by Using a Domain Based Web Crawler · Techsys, 2011

REA C#

An algorithm that discovers the layout of user reviews on web pages and extracts them efficiently.

  • A novel algorithm for extracting the user reviews from web pages · Journal of Information Science, 2017

WebDataExtractionInPython Python

A comparison of Python libraries used for web data extraction.

  • Comparison of Python Libraries used for Web Data Extraction · TechSys 2018, 2018

ImageCrawler Python

A crawler that downloads images from the web and extracts their features for use in machine learning.

SET Project

Search Engine for Turkish

A search engine developed for Turkish texts.

Libraries and tools

Reusable libraries I developed during my web and algorithm work.

obfc.js JavaScript · MIT

Draws SVG-based flowcharts by creating objects in your web pages.

  • Object-based flowchart drawing library · UBMK, 2017

entrel.js JavaScript

A library built on obfc.js for drawing entity-relationship (ER) diagrams with simple JavaScript methods.

  • Object-based Entity Relationship Diagram Drawing Library: EntRel.JS · TechSys 2018, 2018

SMA.NET C#

A library for evaluating string matching algorithms.

  • Comparison of string matching algorithms in web documents · UNITECH’17, 2017

Animation.js JavaScript · GPL-3.0

A small library for animating an element or its child elements on a web page.